🧱 LLMs & Infrastructure

The best llms & infrastructure AI tools, ranked by the community.

1. 1
   Mini-AGI

   Dynamic continual learning model trained on 8GB VRAM

   0 commentsY▲ 277 on HNLLMs & InfrastructureResearch & DataOpen Source

   0
2. 2
   Cactus Needle 3

   8-29MB automation models can match DeepSeek V4 Flash

   0 commentsY▲ 236 on HNLLMs & InfrastructureFreemium

   0
3. 3
   LLM Attention Visualization

   A visualization of the attention mechanism in LLMs.

   0 commentsY▲ 177 on HNResearch & DataLLMs & InfrastructureFree

   0
4. 4
   JevBench

   A reproducible benchmark for typed decision models

   0 commentsY▲ 153 on HNResearch & DataLLMs & InfrastructureFree

   0
5. 5
   CUA-S1

   A System One Model for Computer Use

   0 commentsY▲ 95 on HNAI AgentsLLMs & InfrastructureFreemium

   0
6. 6
   Lossless-memory

   A personal AI memory that never summarizes

   0 commentsY▲ 67 on HNLLMs & InfrastructureProductivityOpen Source

   0
7. 7
   Jevstiller

   Distill Jev into a local model – with a disagreement bound

   0 commentsY▲ 63 on HNLLMs & InfrastructureOpen Source

   0
8. 8
   jevals

   Replacing LLM judges with typed Jev decisions

   0 commentsY▲ 47 on HNLLMs & InfrastructureAI AgentsOpen Source

   0
9. 9
   Sunk Cost

   How long until a local LLM rig pays for itself?

   0 commentsY▲ 47 on HNLLMs & InfrastructureResearch & DataFree

   0
10. 10
    AI·rete·RAG

    A Rete rule engine decides – RAG explains why

    0 commentsY▲ 44 on HNLLMs & InfrastructurePaid

    0
11. 11
    OpenLake

    Storage engine for KV-cache offload and LLM training

    0 commentsY▲ 35 on HNLLMs & InfrastructureOpen Source

    0
12. 12
    Lanes Link

    A personal context MCP: one endpoint for every agent you use

    0 commentsY▲ 28 on HNLLMs & InfrastructureProductivityFreemium

    0
13. 13
    AURA

    A Rust agent that investigates and fixes production incidents

    0 commentsY▲ 28 on HNAI AgentsLLMs & InfrastructureOpen Source

    0
14. 14
    InstinctFlash

    High-Performance Serving Runtime for Robotics Models

    0 commentsY▲ 27 on HNLLMs & InfrastructureOpen Source

    0
15. 15
    OpenAPPA

    Open-source deterministic guardrails that don't break agents

    0 commentsY▲ 23 on HNAI AgentsLLMs & InfrastructureOpen Source

    0
16. 16
    Otis

    A minimal AI agent that runs local models out of the box

    0 commentsY▲ 19 on HNAI AgentsLLMs & InfrastructureFree

    0