AI & ML Research 3 Hours

Last updated: July 28, 2026, 2:30 PM ET

Local LLM Costs

Researchers measured power for local LLMs on Apple Silicon, finding that even small models consume significant energy, with larger models like Llama 2 70B requiring substantial resources, costing approximately $0.31 per kWh.