Key facts
- The U.S. Army has used up its annual allocation of AI tokens for the Ask Sage tool.
- The Army had access to 100 million tokens as part of an annual subscription.
- The Defense Department reportedly used 20 billion tokens per day during Operation Epic Fury.
- An Army employee found generative AI tools unreliable and not particularly useful for their work.
The U.S. Army has reportedly exhausted its annual supply of AI tokens for its Ask Sage tool, raising questions about usage limits and the practical application of generative AI within the military. The Army was allocated 100 million tokens as part of an enterprise pack subscription, but this supply was depleted, leading to potential limitations on its use.
During the 38-day Operation Epic Fury in Iran, the Defense Department is said to have consumed approximately 20 billion tokens per day. This rapid consumption highlights the significant demand for AI resources in military operations. While the Army and the Department of Defense did not comment on the matter, the Pentagon continues to prioritize AI development, even reallocating staff from the Civilian Protection Center of Excellence to focus on creating an AI tool for casualty assessments.
This situation mirrors challenges faced by other major tech companies. Meta, after encouraging employees to maximize AI token usage, has reportedly taken down its usage leaderboard and is considering capping token use per engineer. Similarly, Uber engineers reportedly used a year's worth of AI tokens in just four months. An Army employee cited in the report expressed skepticism about the reliability and usefulness of these generative AI tools for their work, noting instances of AI asserting task completion when it had not occurred. The employee emphasized the need for a thoughtful and trustworthy rollout of AI within government bureaucracy.