02••13 min read
From Server 1 to N
Nine things that break the moment you add the second one. Your error tracker won’t show you any of them.
System designScalingRedis
01••14 min read
From Prompt to Bill: The Life of One LLM Call
One line of code, half a second of waiting, and a bill at the end of the month. What actually happens in between, from tokens to tail latency.
LLMsLatencyCost