Tag: llm
All the articles with the tag "llm".
Decoupling LLM Extraction: Building an Async Ingestion Queue in SQLite
Updated: at 07:00 AMLLM extraction is brutally slow. We solved it without a message broker: a single SQLite table acts as a durable async queue, a transient worker process drains it, and a lease in the meta table guarantees only one worker runs at a time, with built-in crash recovery.
