a fast.com style but for LLMs
A fast.com style benchmarking tool for LLM APIs. Pick a provider and model, and see live streaming output with real-time throughput metrics.