Skip to content
ViqusViqus
Navigate
Company
Blog
About Us
Contact
System Status
Enter Viqus Hub

OpenAI's Chief Scientist Proposes Perplexity as a Shared Speed Limit for AI

Perplexity Metric AI Safety Frontier Model Governance Jakub Pachocki Pace the Frontier Capability Benchmarks
November 22, 2026
Source: TechCrunch AI

This summary and analysis were generated by AI from the original article at TechCrunch AI and may contain errors (how Viqus works). Read the source for full details.

Viqus Verdict Logo Viqus Verdict Logo 4
A Metric in Search of a Mandate
Media Hype 4/10
Real Impact 4/10

Article Summary

OpenAI chief scientist Jakub Pachocki has published a blog post arguing that perplexity, a measure of how well a language model predicts the next token, could serve as a shared benchmark for general intelligence. The proposal responds to a wider debate over slowing AI development, which intensified after a former OpenAI and Anthropic researcher warned that the companies were "gambling with our lives" and after Anthropic's IPO filing cited possible catastrophic risks. Anthropic CEO Dario Amodei had earlier proposed a plan to "pace the frontier," which Sam Altman and Elon Musk reportedly endorsed. Pachocki argues that downstream capability benchmarks become obsolete quickly, while perplexity has stayed informative. He charts OpenAI's perplexity falling since GPT-3.5, noting that losses below 0.8 coincided with emerging capabilities in cybersecurity and mathematics. Companies could then commit not to cross a set threshold until monitoring of AI behavior reaches a concrete milestone. The post is a proposal, not a binding agreement, and it does not specify who would enforce such limits.

Key Points

  • Pachocki proposes perplexity as a measurable, shared metric for AI progress that labs could use to set common limits.
  • He argues that downstream capability benchmarks age quickly while perplexity has remained a stable signal, with OpenAI's losses falling below 0.8 alongside new capabilities.
  • The proposal would have companies pause past a threshold until monitoring of AI behavior reaches a concrete milestone, but it remains a voluntary concept with no enforcement mechanism.

Why It Matters

The debate over limiting frontier AI needs an agreed measurement before any speed limit can be set, and this post is a concrete attempt to supply one. Even so, it is a single blog post from one lab with no binding commitments, and perplexity is a debated proxy for capability. The story is noteworthy mainly as a sign that leading labs are discussing coordinated limits, not as a policy change.


You might also be interested in