HeadlinesBriefing favicon HeadlinesBriefing.com

Run an AI chatbot right on your iPhone without cloud costs

Engadget •
×

Most AI chatter centers on cloud‑based giants, but a new wave lets users run open‑weight models directly on their phones. A local chatbot won’t match the sheer scale of ChatGPT or Gemini, yet it cuts costs and boosts privacy. One‑time purchases start at $5, a fraction of the $20‑plus monthly plans, for everyday use and no subscription fees.

Privacy enthusiasts gain a clear edge: local apps refuse login and never ship data to training servers. Unlike ChatGPT, Claude or Gemini, they run offline, eliminating rate limits. The trade‑off is a narrower knowledge base; open‑weight models cut off after their last training date, so they can’t answer events beyond that point without external search tools in real time today.

Two iOS apps make this feasible. Locally AI, free to download, auto‑suggests a starter model and handles the heavy lifting, while Private LLM costs $5 and offers a curated list of models. For best performance, the 3‑billion‑parameter Llama 3.2 needs 1.81 GB and an iPhone 15 Pro or newer, though lighter versions fit older devices with minimal lag and quick response times everywhere today.