Engineering Blog

Production patterns, architectural deep-dives, and practical tutorials for self-hosted LLM gateways, token metering, and AI infrastructure.

📅 Published every 2 days with updates & practical guides

October 21, 2026

LiteLLM 1.107.0 shipped a credential stealer: what to check and what to rotate

A malicious litellm 1.107.0 was published to PyPI and Docker registries on 2026-10-21. A practical checklist: how to tell if you are affected, how to clean up, and which secrets to rotate.

#security #supply-chain #litellm

October 17, 2026

The 5 Big Problems with LLM APIs in Production (and How to Solve Them)

From secret sprawl and rate limits to opaque bills and vendor downtime—an architectural overview of common LLM API challenges and practical self-hosted solutions.

#architecture #ktms #tokenmeter #devops