Llmspeed is a community-driven benchmarking tool that lets users estimate how fast a local LLM runs on various hardware configurations before purchasing. The platform provides estimates for a short prompt on a single device, drawing from community benchmarks on r/LocalLLaMA and localscore.ai, as well as projections based on hardware specifications. Users can browse by hardware, including NVIDIA RTX models like the RTX 3090, RTX 4090, and RTX 5090, as well as AMD and Mac options.
Models tested include Qwen, Gemma, Llama, and DeepSeek variants. The tool is open source on GitHub and aims to help enthusiasts make informed decisions about local AI deployment.
Source: Hacker News · Summarized by HeadlinesBriefing