Walmart has implemented usage limits on its internal AI coding assistant, Code Puppy, to reduce redundant requests and manage costs. The company aims to encourage employees to leverage existing solutions and scale successful ideas across the organization.
The implementation of usage caps on internal AI tools highlights the growing challenge companies face in balancing the cost and efficiency of widespread AI adoption with the need to prevent duplicated efforts and manage expenses.
Walmart has introduced usage limits on its internal AI coding assistant, Code Puppy, to manage costs and prevent redundant requests. Suresh Kumar, Walmart's Global CTO, explained that the limits are in place because employees often ask the same questions repeatedly, which is more expensive than using existing solutions. The company aims to encourage employees to leverage solutions that have already been built and scaled. CEO John Furner expressed optimism about AI's potential to identify and scale the best ideas from Walmart's over 2 million employees, regardless of their location or role. He noted that if many associates are asking for similar functionalities, it indicates an opportunity to elevate that capability at an enterprise level. Kumar emphasized that this approach aligns with Walmart's 'everyday low cost' philosophy, ensuring maximum benefits from AI without unnecessary repetition. The tool is reportedly used by a wide range of employees, from engineers to hourly associates. While some employees have hit the token limit, which resets periodically, the company sees this as a way to streamline development and adoption.
Pick the topics you care about. Get only what matters, on your cadence.