HeadlinesBriefing favicon HeadlinesBriefing.com

US Army's AI Tokens Depleted Rapidly

Ars Technica •
×

The U.S. Army is rapidly depleting its supply of AI tokens intended for tools like Ask Sage. Initially provided with 100,000,000 tokens annually, the Defense Department consumed approximately 20 billion tokens per day during the 38-day Operation Epic Fury. Tokens are units of output from large language models, with one token roughly equating to 3.7 characters for Ask Sage.

This rapid consumption highlights a broader trend of organizations overestimating AI token availability. Meta, after encouraging "tokenmaxx" usage, has removed its token usage leaderboard and is considering caps. Uber similarly saw engineers exhaust a year's worth of tokens in just four months.

Despite these issues, the Pentagon continues to emphasize AI development, even cutting staff at a center focused on preventing civilian casualties to develop an AI tool for similar assessments. Some Army employees find the AI tools unreliable and not particularly useful for their work, warning against unthinking application of these technologies.