LLM performance metrics: TTFT, ITL and throughput explained

Three essential metrics measure language model performance in production: time-to-first-token, inter-token latency, and throughput.