AI tools for local models

Distill Jev into a local model – with a disagreement bound

Jevstiller distills a hosted Jev classifier into a local model, with a measured bound on how often the local model disagrees with Jev. It runs as a drop-in proxy, so batch jobs avoid a network call per answer while keeping answers close to

💬 0Y▲ 63 on HNLLMs & InfrastructureOpen Sourceby AI Launch Team

A minimal AI agent that runs local models out of the box

Otis is a minimal AI agent from Triangl Labs that runs local models out of the box. First shared by its maker on Show HN: https://news.ycombinator.com/item?id=49696084

💬 0Y▲ 19 on HNAI AgentsLLMs & InfrastructureFreeby AI Launch Team