LLM & AI infrastructure tools for researchers

Dynamic continual learning model trained on 8GB VRAM

mini-AGI is a byte-level language model that trains from scratch on a single 8 GB VRAM GPU and keeps learning from a continuous stream of text. Weights live on disk and are paged onto the GPU as needed, so model size is bounded by disk spac

💬 0Y▲ 277 on HNLLMs & InfrastructureResearch & DataOpen Sourceby AI Launch Team

A visualization of the attention mechanism in LLMs.

An interactive visualization of the attention mechanism in a small large language model. Hover or tap any generated token to see which earlier tokens influenced it, with opacity scaled by attention weight across all heads and layers. Exampl

💬 0Y▲ 177 on HNResearch & DataLLMs & InfrastructureFreeby AI Launch Team

A reproducible benchmark for typed decision models

JevBench, from Benchmark Heaven, compares Jev-class decision models across intelligence, calibration, speed and cost. It sits alongside Benchmark Heaven's broader model rankings, which can be filtered by provider, lab, hosting region and da

💬 0Y▲ 153 on HNResearch & DataLLMs & InfrastructureFreeby AI Launch Team

High-Performance Serving Runtime for Robotics Models

InstinctFlash is a high-performance serving framework for robotics models from General Instinct (YC P26). It serves eight robotics model families, including pi05, LingBot-VLA, LingBot-VA and GR00T N1.7, through one runtime with Python and W

💬 0Y▲ 27 on HNLLMs & InfrastructureOpen Sourceby AI Launch Team