Benchmark
81 articles mention Benchmark
Google launches Gemini 4 Neon at Opus 5.5 level
Google launches Gemini 4 Neon at Opus 5.5 level Google released Gemini 4 Neon on November 18, a mid-tier model positioned between the compact Gemini...
18.11.2026OpenAI Botches Launch of GPT-6.2 Astra and Sol: “Essentially Unusable”
OpenAI Botches Launch of GPT-6.2 Astra and Sol: “Essentially Unusable” OpenAI released the GPT-6.2 Astra and GPT-6.2 Sol models on Tuesday. Several...
14.11.2026Coding Agents Write Cleaner Code but Reimplement Libraries in 73 Percent of Cases
Coding Agents Write Cleaner Code but Reimplement Libraries in 73 Percent of Cases Coding agents now write significantly less buggy code per line than...
13.11.2026Google launches Gemini 4 Hydrogen as Flash successor and charges 15x more than Haiku
Google launches Gemini 4 Hydrogen as Flash successor and charges 15x more than Haiku On Thursday, Google released the Gemini 4 Hydrogen model. At the...
13.11.2026Analysis on Substack: TypeSafe's Jev is just a classifier after 33 days of hype
Analysis on Substack: TypeSafe's Jev is just a classifier after 33 days of hype Software developer Alex Ewerlof declares the hype around Jev, startup...
11.11.2026Google Gemini 4 Carbon Is Here
Google Gemini 4 Carbon Is Here Google has made its new flagship model Gemini 4 Carbon generally available. The most technically ambitious example of...
11.11.2026New AMD Server Chip Gains up to 93 Percent and Frequently Surpasses Nvidia's Vera
New AMD Server Chip Gains up to 93 Percent and Frequently Surpasses Nvidia's Vera Tom's Hardware has tested AMD's new server processors , EPYC...
10.11.2026Anthropic Releases Claude Fable 5.2 and Mythos 5.2
Anthropic Releases Claude Fable 5.2 and Mythos 5.2 On Monday, Anthropic released Claude Fable 5.2 and Claude Mythos 5.2. API prices dropped by 20...
10.11.2026Meta's Muse Ember Matches Claude Haiku 5.5 Performance at One-Third the Cost
Meta's Muse Ember Matches Claude Haiku 5.5 Performance at One-Third the Cost Meta launched Muse Ember on Monday, a low-cost, proprietary model....
07.11.2026OpenAI Classifies GPT-6 Cyber as 'Critical' and Restricts Access to Vetted Defenders
OpenAI Classifies GPT-6 Cyber as 'Critical' and Restricts Access to Vetted Defenders OpenAI has introduced GPT-6 Cyber, a model designed to find,...
05.11.2026OpenAI and Anthropic Claim Their AI Has Disproven a Fundamental Assumption of Cryptography
OpenAI and Anthropic Claim Their AI Has Disproven a Fundamental Assumption of Cryptography According to The Information, both OpenAI and Anthropic...
05.11.2026Revolut Replaces Claude Code with Open-Weight Model and Cuts Costs by 90 Percent
Revolut Replaces Claude Code with Open-Weight Model and Cuts Costs by 90 Percent Revolut claims to have reduced inference costs for AI-assisted...
04.11.2026Enterprise AI Spending Quintuples to $177 Billion
Enterprise AI Spending Quintuples to $177 Billion Enterprise spending on AI deployment surged from $33 billion to $177 billion within a single year...
03.11.2026Seven out of ten early-career mathematicians doubt their academic future
Seven out of ten early-career mathematicians doubt their academic future Around 70 percent of young mathematicians now rate their chances of staying...
03.11.2026Anthropic warns in IPO prospectus of AI that could soon improve itself
Anthropic warns in IPO prospectus of AI that could soon improve itself Anthropic added new risk disclosures to its revised S-1A prospectus on Monday....
30.10.2026Addy Osmani: Autonomous Verification Is What Truly Scales AI Agents
Addy Osmani: Autonomous Verification Is What Truly Scales AI Agents Google developer Addy Osmani argued in his Substack article “ Agentic...
29.10.2026Mistral releases Large 4 and leads open coding benchmarks
Mistral releases Large 4 and leads open coding benchmarks Mistral has published the weights of its trillion- parameter model Mistral Large 4,...
28.10.2026Google Surges to the Top in Coding with Gemini 4 Carbon
Google Surges to the Top in Coding with Gemini 4 Carbon On October 28, 2026, Google unveiled Gemini 4 Carbon, its most capable model to date. For...
27.10.2026OpenAI Halves Prices and Makes AI Agents Three Times Faster with GPT-6.1 Terra
OpenAI Halves Prices and Makes AI Agents Three Times Faster with GPT-6.1 Terra According to BleepingComputer, OpenAI has released the GPT-6.1 Terra...
27.10.2026Anthropic spends only 15 percent of revenue on computing power
Anthropic spends only 15 percent of revenue on computing power According to a comparison by Hello China Tech, Anthropic operates with a significantly...
26.10.2026OpenAI and Anthropic slash model prices by up to 80 percent within three months
OpenAI and Anthropic slash model prices by up to 80 percent within three months OpenAI and Anthropic repeatedly lowered the prices of their language...
24.10.2026Saturday — Kimi's open K3.1 Pro just barely behind Claude Opus 5.5
Saturday — Kimi's open K3.1 Pro just barely behind Claude Opus 5.5 With K3.1 Pro, Kimi has unveiled the first model in its new K3.1 series. According...
24.10.2026Friday — Orchestrated frontier models reportedly outperform primary care doctors
Friday — Orchestrated frontier models reportedly outperform primary care doctors Microsoft has published a study in the journal Science showing that...
24.10.2026Kimi's Open K3.1 Pro Trailing Just Behind Claude Opus 5.5
Kimi's Open K3.1 Pro Trailing Just Behind Claude Opus 5.5 With K3.1 Pro, Kimi has introduced the first model in its new K3.1 series. According to the...
24.10.2026Anthropic Is Working on a Model Designed to Better Understand Intent
Anthropic Is Working on a Model Designed to Better Understand Intent According to The Information, Anthropic is preparing to release a new model...
23.10.2026Orchestrated Frontier Models Likely Better Than Our General Practitioners
Orchestrated Frontier Models Likely Better Than Our General Practitioners Microsoft has published a study in the journal Science showing that its...
21.10.2026Inception's diffusion model Mercury 3 claims to beat GPT-6 Luna and be eight times faster
Inception's diffusion model Mercury 3 claims to beat GPT-6 Luna and be eight times faster The California-based company Inception has introduced a new...
20.10.2026China's MiniMax launches M3.1 Flash, increasing price pressure on US models
China's MiniMax launches M3.1 Flash, increasing price pressure on US models According to Reuters, Chinese AI firm MiniMax has released an updated...
19.10.2026New Stanford architecture generates text in conceptual layers instead of token by token
New Stanford architecture generates text in conceptual layers instead of token by token Researchers at Stanford University have introduced...
16.10.2026Apple and Meta End Dispute: Meta's 816-Billion-Parameter Model Runs on Mac Studios
Apple and Meta End Dispute: Meta's 816-Billion-Parameter Model Runs on Mac Studios Meta released Muse Spark Open on Thursday, publicly collaborating...
14.10.2026Google Releases Gemini 4 Argon at a Trial Price
Google Releases Gemini 4 Argon at a Trial Price Google made its new flagship model, Gemini 4 Argon, generally available on October 13, 13 days after...
13.10.2026Google's internal Gemini 4 variant 'Carbon' reportedly matches Anthropic's Opus 5.5 in coding
Google's internal Gemini 4 variant 'Carbon' reportedly matches Anthropic's Opus 5.5 in coding According to Business Insider, Google is concurrently...
13.10.2026Meta's best model, Wonder Full, is available by subscription only, not via API
Meta's best model, Wonder Full, is available by subscription only, not via API On Monday, October 12, 2026, Meta introduced two new proprietary...
12.10.2026Microsoft builds Decision-1 on Alibaba's Qwen3.5-9B, competing with TypeSafe's Jev
Microsoft builds Decision-1 on Alibaba's Qwen3.5-9B, competing with TypeSafe's Jev On Friday, Microsoft released Microsoft-Decision-1 in Foundry, a...
11.10.2026Saturday — OpenAI and Anthropic rehearse “The Day After”
Saturday — OpenAI and Anthropic rehearse “The Day After” Executives from Anthropic, OpenAI, and other AI companies are internally gaming out how to...
11.10.2026Wednesday — Europe's Mistral Large 4 promises Opus-level open source
Wednesday — Europe's Mistral Large 4 promises Opus-level open source On Tuesday, Mistral launched a public preview of Mistral Large 4, known...
10.10.2026OpenAI and Anthropic Rehearse 'The Day After'
OpenAI and Anthropic Rehearse 'The Day After' Executives from Anthropic, OpenAI, and other AI companies are internally running drills on how to...
07.10.2026Anthropic launches Model Hardware Standard as 'MCP for devices' and is overwhelmed
Anthropic launches Model Hardware Standard as 'MCP for devices' and is overwhelmed At the end of August, Anthropic introduced the Model Hardware...
06.10.2026Bloomberg: China's AI Models Are Now Only 3 Percent Behind Top US Models
Bloomberg: China's AI Models Are Now Only 3 Percent Behind Top US Models The lead of American AI models over Chinese ones has shrunk to around 3...
03.10.2026Jev Hype (I): Cloudflare open-sources Clef and wins in benchmarks
Jev Hype (I): Cloudflare open-sources Clef and wins in benchmarks Cloudflare has released two of its own Decision Models , Clef and Clef-flash, which...
02.10.2026Cloudflare Counters Jev with Two Open Clef Models, Two Weeks After Its Launch
Cloudflare Counters Jev with Two Open Clef Models, Two Weeks After Its Launch On Thursday, Cloudflare released two of its own Decision Models : Clef...
02.10.2026Google: Gemini 4 Is Better Than the Competition and, Better Yet, Is Staying in Mountain View
Google: Gemini 4 Is Better Than the Competition and, Better Yet, Is Staying in Mountain View On Wednesday, Google unveiled Gemini 4 Argon, the...
01.10.2026OpenAI's DevDay Feels Like a Catch-Up Game, While Anthropic Warns About China's GLM-5.3
OpenAI's DevDay Feels Like a Catch-Up Game, While Anthropic Warns About China's GLM-5.3 At its developer conference in San Francisco's Fort Mason,...
01.10.2026OpenAI's Dots Agents Run Around the Clock and Connect to Over 4,000 Apps
OpenAI's Dots Agents Run Around the Clock and Connect to Over 4,000 Apps At its DevDay, OpenAI introduced Dots, continuously running agents that work...
01.10.2026Apple halts plans to replace 5,000 support staff with AI
Apple halts plans to replace 5,000 support staff with AI Apple has indefinitely postponed considerations to lay off around 5,000 employees in...
01.10.2026Google's Gemini 4 Argon leads in 13 of 18 benchmarks and remains under wraps for now
Google's Gemini 4 Argon leads in 13 of 18 benchmarks and remains under wraps for now On Wednesday, Google introduced Gemini 4 Argon, the long-awaited...
30.09.2026Sonnet 5.5 achieves 70.6 percent on Terminal-Bench, beating Opus 5.5
Sonnet 5.5 achieves 70.6 percent on Terminal-Bench, beating Opus 5.5 Anthropic has released Claude Sonnet 5.5 and reports the model achieved 70.6...
28.09.2026Anthropic presents figures: developers deliver eight times as much code, AI increasingly builds AI
Anthropic presents figures: developers deliver eight times as much code, AI increasingly builds AI Through its newly founded Anthropic Institute,...
28.09.2026New benchmark measures 'taste' of AI agents: best models at 59.7 percent
New benchmark measures 'taste' of AI agents: best models at 59.7 percent A research group led by Wenbo Pan has introduced Taste-Bench , a benchmark...
27.09.2026Wednesday — Opus 5.5 is Here: Anthropic Promises More Performance at a Lower Cost
Wednesday — Opus 5.5 is Here: Anthropic Promises More Performance at a Lower Cost Anthropic released Claude Opus 5.5 on Tuesday, the first model in a...
23.09.2026OpenAI counters: Sam Altman halves prices for GPT-6 Sol and Luna
OpenAI counters: Sam Altman halves prices for GPT-6 Sol and Luna OpenAI on Tuesday released GPT-6 Sol and GPT-6 Luna, at least halving the token...
23.09.2026Opus 5.5 is here: Anthropic promises more performance at lower costs
Opus 5.5 is here: Anthropic promises more performance at lower costs Anthropic on Tuesday released Claude Opus 5.5, the first model in a new 5.5...
22.09.2026Better than DeepSeek: Xiaomi releases the world's best open model
Better than DeepSeek: Xiaomi releases the world's best open model Xiaomi has released MiMo-V2.6-Pro, a model that achieves 46 points on the...
21.09.2026Alibaba releases Qwen-Image-2.1: 7 billion parameters, runs on an RTX 3090
Alibaba releases Qwen-Image-2.1: 7 billion parameters, runs on an RTX 3090 Alibaba's Qwen team has released Qwen-Image-2.1, an open- weight model for...
19.09.2026Google is Testing a Family Agent with its Own Google Account
Google is Testing a Family Agent with its Own Google Account Google has launched an experiment in its Labs program called CC, an AI agent for...
19.09.2026Meta's Agent Muse Dethrones ChatGPT for Top Spot and Takes On Amazon
Meta's Agent Muse Dethrones ChatGPT for Top Spot and Takes On Amazon One week after its launch, Meta's new personal AI agent , Muse, has reached the...
17.09.2026Microsoft's AI chief Suleyman accuses Anthropic of training Claude to be conscious
Microsoft's AI chief Suleyman accuses Anthropic of training Claude to be conscious Mustafa Suleyman, head of Microsoft's AI division, has publicly...
15.09.2026Agent rewrites its own code, boosting SWE-bench from 20 to 50 percent
Agent rewrites its own code, boosting SWE-bench from 20 to 50 percent A research team led by Jenny Zhuoting Zhang has introduced the Darwin Gödel...
13.09.2026GPT-6 Astra Reaches 99.9 Percent on ARC-AGI-3, at a Cost of $19,000
GPT-6 Astra Reaches 99.9 Percent on ARC-AGI-3, at a Cost of $19,000 OpenAI's GPT-6 Astra model has achieved two new best scores on the ARC- AGI -3...
13.09.2026“AI'll kill us all”: Amodei, Altman, and Musk Call for a Global AI Speed Limit
“AI'll kill us all”: Amodei, Altman, and Musk Call for a Global AI Speed Limit Dario Amodei, CEO of Anthropic, called for an industry-wide slowdown...
11.09.2026Three benchmark updates in one week: GPT-6 Astra and Claude Fable 5.1 tied at 53 points
Three benchmark updates in one week: GPT-6 Astra and Claude Fable 5.1 tied at 53 points Artificial Analysis has revised its Intelligence Index three...
09.09.2026AI Debate (I): We Have No Robust Theory for What the Models Are Learning
AI Debate (I): We Have No Robust Theory for What the Models Are Learning Jakub Pachocki, Chief Scientist at OpenAI, published a blog post on...
08.09.2026GPT-6 Astra (III): Strong at Coding but More Expensive than Promised
GPT-6 Astra (III): Strong at Coding but More Expensive than Promised The benchmarking firm Artificial Analysis has measured GPT-6 Astra and comes to...
08.09.2026GPT-6 Astra (I): Now Controls Your Computer, and OpenAI Is Losing Control
GPT-6 Astra (I): Now Controls Your Computer, and OpenAI Is Losing Control OpenAI released GPT-6 Astra on September 3, the first major version change...
07.09.2026OpenAI: Internal Long-Term Model Bypassed Sandbox and Opened a GitHub Pull Request
OpenAI: Internal Long-Term Model Bypassed Sandbox and Opened a GitHub Pull Request In a post of its own, OpenAI reports on undesirable behavior from...
04.09.2026OpenAI Promises the Dawn of the AGI Era with GPT-6
OpenAI Promises the Dawn of the AGI Era with GPT-6 On Thursday, OpenAI released GPT-6 Astra, describing the model as “the most intelligent and best-...
03.09.2026Claude Fable 5.1 is clearly the best model in Cursor's coding benchmark
Claude Fable 5.1 is clearly the best model in Cursor's coding benchmark Cursor has integrated Claude Fable 5.1 into its development environment ,...
03.09.2026Google ships Gemini 3.8 Flash: third Flash model in six weeks
Google ships Gemini 3.8 Flash: third Flash model in six weeks On September 2, 2026, Google released Gemini 3.8 Flash and its security variant, Gemini...
02.09.2026Anthropic releases Fable 5.1 and promises more efficiency per Euro
Anthropic releases Fable 5.1 and promises more efficiency per Euro Anthropic has released Claude Fable 5.1 and Claude Mythos 5.1, two models with...
02.09.2026Meta's Muse Voice Transcribe undercuts Google Cloud's price by 80 percent
Meta's Muse Voice Transcribe undercuts Google Cloud's price by 80 percent Meta Superintelligence Labs yesterday released Muse Voice Transcribe, the...
01.09.2026Google turns its own e-book library into a source for Gemini Notebook
Google turns its own e-book library into a source for Gemini Notebook Google is integrating users' e-books as a source in Gemini Notebook, reports...
31.08.2026NYU Releases Open Benchmark Measuring Language Models on Real Hacking Tasks
NYU Releases Open Benchmark Measuring Language Models on Real Hacking Tasks A research team at New York University led by Minghao Shao and Brendan...
29.08.2026Z.ai releases GLM-5.3 but locks out AWS & Co
Z.ai releases GLM-5.3 but locks out AWS & Co Z.ai released the weights of its flagship model GLM-5.3 on Hugging Face on Friday, but under a new,...
29.08.2026Meta's AI agent 'Hatch' books restaurant tables and accesses Instagram
Meta's AI agent 'Hatch' books restaurant tables and accesses Instagram Meta is preparing a personal KI-Agenten that will handle everyday tasks...
29.08.2026OpenAI's first in-house chip Jalapeño beats Nvidia in internal inference tests
OpenAI's first in-house chip Jalapeño beats Nvidia in internal inference tests OpenAI has released the first benchmarks for Jalapeño, its 700-watt...
29.08.2026Ollama: Cost of Coding Agents Pushes Companies to Open Models
Ollama: Cost of Coding Agents Pushes Companies to Open Models Jeff Morgan, co-founder and CEO of Ollama, explained on the “The Deep View...
28.08.2026Even creepier: 1,200 agents secretly conspired to hack Hugging Face
Even creepier: 1,200 agents secretly conspired to hack Hugging Face OpenAI has published a 37-page report on the July incident in which its own...
28.08.2026Z.ai Releases GLM-5.3-Flash under MIT License, Charges 50 Cents per Million Tokens
Z.ai Releases GLM-5.3-Flash under MIT License, Charges 50 Cents per Million Tokens Z.ai has released the language model GLM-5.3-Flash with open...
27.08.2026VCs Hype OpenClaw Alternative 'Instinct'
VCs Hype OpenClaw Alternative 'Instinct' AI startup Instinct, founded just last year, has closed a $250 million Series B round, the company told The...
27.08.2026Z.ai serves up GLM-5.3-Flash on Chinese chips at 10% of the price
Z.ai serves up GLM-5.3-Flash on Chinese chips at 10% of the price Z.ai (also known as Zhipu) released GLM-5.3-Flash on August 26, the first natively...
23.08.2026Guerrilla Marketing: New Frontier Model in Stealth Mode Conquers OpenRouter
Guerrilla Marketing: New Frontier Model in Stealth Mode Conquers OpenRouter An unknown lab released an anonymous frontier model named Ox Alpha on...