AI tools for kv cache

Storage engine for KV-cache offload and LLM training

OpenLake is a high-performance storage engine for LLM inference and GPU training. Its Infinity Core I/O Engine delivered 6.72 GiB/s writes and 11.55 GiB/s reads in the MLPerf Storage v3.0 Llama 3.1 8B checkpointing benchmark through its S3

💬 0Y▲ 35 on HNLLMs & InfrastructureOpen Sourceby AI Launch Team