All NewsEducationTV
Equities & FundsCrypto & Digital AssetsAI & TechnologyBusiness & CorporateUS Politics & PolicyGeopolitics & Global RiskMacro, Rates & FXCommodities & EnergyEuropean Politics & MarketsAsia-PacificReal Estate & Property
Story archiveAll categories
← All Stories

Companies evaluate employee AI use in performance reviews

Created at 13 Aug · 8:26 AM1 source↑ Market-relevant
IN SHORT

Businesses are developing new methods to assess how employees utilize AI tools, with some categorizing workers based on their AI adoption and others looking at productivity gains. This comes as companies grapple with standardizing AI implementation and training.

✉Newsletter

PiQ Daily

Pick your topics. Get only what matters, on your cadence.

Key Numbers

fiveAI archetypes at Gusto
500business leaders surveyed by General Assembly

Who's Involved

Gusto
HR platform developing AI archetypes for employee reviews
Scott Helmes
Chief People Officer at Gusto
Amazon
Company that pivoted away from AI use leaderboards
Uber
Company that pivoted away from AI use leaderboards
Duolingo
Company that walked back AI evaluation in reviews
Meta
Company facing lawsuit over AI productivity rankings
Richard Landers
Professor of industrial-organizational psychology at the University of Minnesota
General Assembly
Tech skills provider that surveyed business leaders on AI in reviews
Stefan Camilleri
VP of engineering at Typeform
Shensi Ding
Co-founder and CEO of AI software company Merge
Accenture
Consulting firm reportedly monitoring AI logins for promotions
Hugh Langley
Colleague who reported on Google's AI review policy
Google
Company allowing managers to evaluate AI proficiency
Lee Senderov
Chief Transformation Officer at Travelport
Travelport
Retail platform for travel agencies using AI code analysis
Companies evaluate employee AI use in performance reviews

↳ Why This Matters

As AI tools become more integrated into the workplace, companies are establishing new metrics and frameworks to evaluate employee performance, potentially impacting career progression, compensation, and job security.

Key facts

  • Companies are increasingly incorporating AI usage into employee performance reviews.
  • Gusto categorizes employees into five AI archetypes, from 'observers' to 'amplifiers'.
  • Some firms have abandoned leaderboards or specific metrics for AI use, focusing instead on broader impact.
  • Meta faces a lawsuit alleging AI productivity rankings were used for layoffs.
  • Experts caution against rewarding AI use without clear benchmarks or understanding its true impact.
  • Nearly half of US and UK business leaders surveyed by General Assembly include AI in reviews.

Companies are increasingly incorporating the use of artificial intelligence into employee performance reviews, seeking to standardize its adoption and understand its impact on productivity. Some organizations are developing specific frameworks to evaluate AI fluency, while others are grappling with the subjective nature of assessing AI's contribution.

Gusto, for instance, categorizes employees into five AI archetypes, ranging from 'observers' who are new to AI, to 'amplifiers' who innovate with the technology and share their knowledge. Scott Helmes, Gusto's chief people officer, stated the goal is to facilitate coaching conversations and establish a consistent way to discuss AI fluency across the organization.

However, not all attempts to quantify AI use have been successful. Companies like Amazon and Uber have moved away from AI usage leaderboards, and Duolingo has withdrawn plans to evaluate AI in performance reviews. Meta is facing a lawsuit from former employees who allege the company used AI to rank productivity, including AI tool usage, for layoffs, without fully accounting for leaves of absence.

Experts like Richard Landers, a professor of industrial-organizational psychology, highlight the challenges in fairly evaluating AI performance, noting that it's difficult to establish benchmarks when the technology's use and impact vary significantly across different jobs. He cautions against rewarding AI use without a clear understanding of its goals or outcomes.

A survey by tech skills provider General Assembly found that nearly half of business leaders in the US and UK have integrated AI into employee reviews, focusing on usage, performance improvements, and efficiency gains. However, unlike previous software implementations, many companies expect employees to lead the way in discovering AI's potential, often without formal training.

Some managers are looking at speed and output. Stefan Camilleri, VP of engineering at Typeform, asks engineers how much faster they complete tasks with AI, expecting more ambitious results. Shensi Ding, CEO of Merge, reviews employees based on the quality of their AI use and their willingness to teach colleagues, seeing knowledge sharing as a significant multiplier.

Larger companies are also formalizing AI's role in reviews. Meta has added 'AI driven impact' as a core component, and Accenture has reportedly monitored AI logins for promotions. Google also permits managers to evaluate AI proficiency, though it's not mandatory. Travelport is developing tools to analyze engineers' AI code usage to inform performance discussions.

Frequently asked questions

Companies are trying to standardize the implementation of AI, understand its impact on productivity, and coach employees on effective usage.

Some companies categorize employees into AI archetypes, while others look at speed, output quality, or knowledge sharing.

No, some companies have backed away from specific AI tracking methods, and many are still in an experimental phase.

It is difficult to establish objective benchmarks, and the impact of AI varies greatly depending on the job role.

What Happens Next

01Companies will continue to refine AI evaluation methods in performance reviews.
02Further legal challenges may arise concerning AI-driven performance assessments.
03The development of standardized AI fluency benchmarks is likely to continue.

Get the newsletter.

Pick the topics you actually care about. We'll email when there's news worth your time, on the cadence you choose. Cancel any time from your account.

Cadence

How It Developed

Companies are developing methods to evaluate employees' AI usage during performance reviews.
Gusto categorizes workers into five AI archetypes, from 'observers' to 'amplifiers'.
Some companies, like Amazon and Uber, have moved away from leaderboards for tracking AI use.
Duolingo rescinded plans to include AI use in performance reviews.
Meta faces allegations of using AI productivity rankings for layoffs.
Experts note the difficulty in fairly evaluating AI performance due to its subjective nature and varying job requirements.
General Assembly survey indicates nearly half of US and UK business leaders incorporate AI into reviews.
Typeform asks engineers how much faster they complete tasks with new AI tools.

Sources

T1
Your next performance review is about you know whatBusiness Insider

Related Stories

Booking CEO: AI will have a 'human cost,' employees must be 'AI literate'
12 Aug · 9:46 AM
SpaceXAI Releases Grok 4.6, Matches OpenAI on Key Benchmarks
12 Aug · 11:26 AM
Claude users protest AI watermarking, citing job and class concerns
12 Aug · 10:41 PM
AI watermark debate intensifies after 'Made with AI' label appears on Karoline Leavitt's X post
13 Aug · 2:11 AM
Silicon Valley Therapists See New Neuroses Tied to AI and Layoffs
13 Aug · 8:21 AM