Large clusters for small models — Daniel Svonava, Superlinked

Daniel Svonava from Superlinked shows how to run many small AI models efficiently on ordinary hardware instead of expensive cloud services.

A single GPU from a few years ago can run a small model fast, and for specific tasks—like reading Vietnamese receipts or reviewing contracts—these small models perform as well as larger ones. The problem is serving many models at once: existing tools are unoptimized and routing systems built for one big model become slow when handling many small requests. Superlinked solves it with a system where a gateway sends requests to a shared queue, and workers fetch and process them themselves—doubling throughput. A Rust tool manages different model variants, and the system tunes models automatically; one example cost 80 cents and improved German legal text by 18 percent.

More to read

Lumaril, which develops AI software for optimizing industrial production by connecting to existing control systems, raised a $66M Series A at a $400M valuation

Techmeme · 3 h ago

DeepSeek open sources Super-Agent as a research prototype, a proactive coding agent it says can monitor group chats for coding issues and suggest solutions

Techmeme · 3 h ago

Insurance software maker Guidewire agrees to acquire Hyperexponential, which makes AI-powered insurance underwriting and pricing software, for $1.7B in cash

Techmeme · 3 h ago

One word for AI agents in 2027

Nate Herk · 7 h ago