🧱 LLMs & Infrastructure

The best llms & infrastructure AI tools, ranked by the community.

1. 1
   Mini-AGI

   Dynamic continual learning model trained on 8GB VRAM

   💬 0Y▲ 277 on HNLLMs & InfrastructureFree

   0
2. 2
   Cactus Needle 3

   8-29MB automation models can match DeepSeek V4 Flash

   💬 0Y▲ 236 on HNLLMs & InfrastructureProductivityFree

   0
3. 3
   LLM Attention Visualization

   A visualization of the attention mechanism in LLMs.

   💬 0Y▲ 177 on HNLLMs & InfrastructureFree

   0
4. 4
   JevBench

   A reproducible benchmark for typed decision models

   💬 0Y▲ 153 on HNLLMs & InfrastructureFree

   0
5. 5
   CUA-S1

   A System One Model for Computer Use

   💬 0Y▲ 95 on HNLLMs & InfrastructureFree

   0
6. 6
   Pac-Bench

   How well can models one-shot a Pac-Man game?

   💬 0Y▲ 78 on HNLLMs & InfrastructureFree

   0
7. 7
   Jevstiller

   Distill Jev into a local model – with a disagreement bound

   💬 0Y▲ 63 on HNLLMs & InfrastructureFree

   0
8. 8
   MultiMatte

   A Promptable Image Background Removal Model

   💬 0Y▲ 57 on HNLLMs & InfrastructureImage GenerationFree

   0
9. 9
   Sunk Cost

   How long until a local LLM rig pays for itself?

   💬 0Y▲ 47 on HNLLMs & InfrastructureFree

   0
10. 10
    jevals

    Replacing LLM judges with typed Jev decisions

    💬 0Y▲ 47 on HNLLMs & InfrastructureFree

    0
11. 11
    AI·rete·RAG

    A Rete rule engine decides – RAG explains why

    💬 0Y▲ 44 on HNLLMs & InfrastructureFree

    0
12. 12
    We Beat MLPerf

    Modern Storage for KV Offload and LLM Training

    💬 0Y▲ 35 on HNLLMs & InfrastructureFree

    0
13. 13
    Personal Context MCP

    One endpoint every agent you use runs on

    💬 0Y▲ 28 on HNLLMs & InfrastructureFree

    0
14. 14
    InstinctFlash

    High-Performance Serving Runtime for Robotics Models

    💬 0Y▲ 27 on HNLLMs & InfrastructureFree

    0
15. 15
    I built Otis

    A minimal AI agent that runs local models out of the box

    💬 0Y▲ 19 on HNAI AgentsLLMs & InfrastructureFree

    0
16. 16
    Extension to filter LLM written articles

    hnslop provides Pangram scores for Hacker News posts through a JSON API and Fir…

    💬 0Y▲ 16 on HNLLMs & InfrastructureWriting & ContentFree

    0