Free LLM & AI infrastructure tools

A visualization of the attention mechanism in LLMs.

An interactive visualization of the attention mechanism in a small large language model. Hover or tap any generated token to see which earlier tokens influenced it, with opacity scaled by attention weight across all heads and layers. Exampl

💬 0Y▲ 177 on HNResearch & DataLLMs & InfrastructureFreeby AI Launch Team

A reproducible benchmark for typed decision models

JevBench, from Benchmark Heaven, compares Jev-class decision models across intelligence, calibration, speed and cost. It sits alongside Benchmark Heaven's broader model rankings, which can be filtered by provider, lab, hosting region and da

💬 0Y▲ 153 on HNResearch & DataLLMs & InfrastructureFreeby AI Launch Team

How long until a local LLM rig pays for itself?

Sunk Cost estimates how long a machine for running local AI models takes to pay for itself compared with paying for an API. Pick a Mac mini, Mac Studio, DGX Spark or Strix Halo box, see which open models fit and how fast they run, and adjus

💬 0Y▲ 47 on HNLLMs & InfrastructureResearch & DataFreeby AI Launch Team

A minimal AI agent that runs local models out of the box

Otis is a minimal AI agent from Triangl Labs that runs local models out of the box. First shared by its maker on Show HN: https://news.ycombinator.com/item?id=49696084

💬 0Y▲ 19 on HNAI AgentsLLMs & InfrastructureFreeby AI Launch Team