All Companies

Benchmark

81 articles mention Benchmark

19.11.2026

Google launches Gemini 4 Neon at Opus 5.5 level

Google launches Gemini 4 Neon at Opus 5.5 level Google released Gemini 4 Neon on November 18, a mid-tier model positioned between the compact Gemini...

18.11.2026

OpenAI Botches Launch of GPT-6.2 Astra and Sol: “Essentially Unusable”

OpenAI Botches Launch of GPT-6.2 Astra and Sol: “Essentially Unusable” OpenAI released the GPT-6.2 Astra and GPT-6.2 Sol models on Tuesday. Several...

14.11.2026

Coding Agents Write Cleaner Code but Reimplement Libraries in 73 Percent of Cases

Coding Agents Write Cleaner Code but Reimplement Libraries in 73 Percent of Cases Coding agents now write significantly less buggy code per line than...

13.11.2026

Google launches Gemini 4 Hydrogen as Flash successor and charges 15x more than Haiku

Google launches Gemini 4 Hydrogen as Flash successor and charges 15x more than Haiku On Thursday, Google released the Gemini 4 Hydrogen model. At the...

13.11.2026

Analysis on Substack: TypeSafe's Jev is just a classifier after 33 days of hype

Analysis on Substack: TypeSafe's Jev is just a classifier after 33 days of hype Software developer Alex Ewerlof declares the hype around Jev, startup...

11.11.2026

Google Gemini 4 Carbon Is Here

Google Gemini 4 Carbon Is Here Google has made its new flagship model Gemini 4 Carbon generally available. The most technically ambitious example of...

11.11.2026

New AMD Server Chip Gains up to 93 Percent and Frequently Surpasses Nvidia's Vera

New AMD Server Chip Gains up to 93 Percent and Frequently Surpasses Nvidia's Vera Tom's Hardware has tested AMD's new server processors , EPYC...

10.11.2026

Anthropic Releases Claude Fable 5.2 and Mythos 5.2

Anthropic Releases Claude Fable 5.2 and Mythos 5.2 On Monday, Anthropic released Claude Fable 5.2 and Claude Mythos 5.2. API prices dropped by 20...

10.11.2026

Meta's Muse Ember Matches Claude Haiku 5.5 Performance at One-Third the Cost

Meta's Muse Ember Matches Claude Haiku 5.5 Performance at One-Third the Cost Meta launched Muse Ember on Monday, a low-cost, proprietary model....

07.11.2026

OpenAI Classifies GPT-6 Cyber as 'Critical' and Restricts Access to Vetted Defenders

OpenAI Classifies GPT-6 Cyber as 'Critical' and Restricts Access to Vetted Defenders OpenAI has introduced GPT-6 Cyber, a model designed to find,...

05.11.2026

OpenAI and Anthropic Claim Their AI Has Disproven a Fundamental Assumption of Cryptography

OpenAI and Anthropic Claim Their AI Has Disproven a Fundamental Assumption of Cryptography According to The Information, both OpenAI and Anthropic...

05.11.2026

Revolut Replaces Claude Code with Open-Weight Model and Cuts Costs by 90 Percent

Revolut Replaces Claude Code with Open-Weight Model and Cuts Costs by 90 Percent Revolut claims to have reduced inference costs for AI-assisted...

04.11.2026

Enterprise AI Spending Quintuples to $177 Billion

Enterprise AI Spending Quintuples to $177 Billion Enterprise spending on AI deployment surged from $33 billion to $177 billion within a single year...

03.11.2026

Seven out of ten early-career mathematicians doubt their academic future

Seven out of ten early-career mathematicians doubt their academic future Around 70 percent of young mathematicians now rate their chances of staying...

03.11.2026

Anthropic warns in IPO prospectus of AI that could soon improve itself

Anthropic warns in IPO prospectus of AI that could soon improve itself Anthropic added new risk disclosures to its revised S-1A prospectus on Monday....

30.10.2026

Addy Osmani: Autonomous Verification Is What Truly Scales AI Agents

Addy Osmani: Autonomous Verification Is What Truly Scales AI Agents Google developer Addy Osmani argued in his Substack article “ Agentic...

29.10.2026

Mistral releases Large 4 and leads open coding benchmarks

Mistral releases Large 4 and leads open coding benchmarks Mistral has published the weights of its trillion- parameter model Mistral Large 4,...

28.10.2026

Google Surges to the Top in Coding with Gemini 4 Carbon

Google Surges to the Top in Coding with Gemini 4 Carbon On October 28, 2026, Google unveiled Gemini 4 Carbon, its most capable model to date. For...

27.10.2026

OpenAI Halves Prices and Makes AI Agents Three Times Faster with GPT-6.1 Terra

OpenAI Halves Prices and Makes AI Agents Three Times Faster with GPT-6.1 Terra According to BleepingComputer, OpenAI has released the GPT-6.1 Terra...

27.10.2026

Anthropic spends only 15 percent of revenue on computing power

Anthropic spends only 15 percent of revenue on computing power According to a comparison by Hello China Tech, Anthropic operates with a significantly...

26.10.2026

OpenAI and Anthropic slash model prices by up to 80 percent within three months

OpenAI and Anthropic slash model prices by up to 80 percent within three months OpenAI and Anthropic repeatedly lowered the prices of their language...

24.10.2026

Saturday — Kimi's open K3.1 Pro just barely behind Claude Opus 5.5

Saturday — Kimi's open K3.1 Pro just barely behind Claude Opus 5.5 With K3.1 Pro, Kimi has unveiled the first model in its new K3.1 series. According...

24.10.2026

Friday — Orchestrated frontier models reportedly outperform primary care doctors

Friday — Orchestrated frontier models reportedly outperform primary care doctors Microsoft has published a study in the journal Science showing that...

24.10.2026

Kimi's Open K3.1 Pro Trailing Just Behind Claude Opus 5.5

Kimi's Open K3.1 Pro Trailing Just Behind Claude Opus 5.5 With K3.1 Pro, Kimi has introduced the first model in its new K3.1 series. According to the...

24.10.2026

Anthropic Is Working on a Model Designed to Better Understand Intent

Anthropic Is Working on a Model Designed to Better Understand Intent According to The Information, Anthropic is preparing to release a new model...

23.10.2026

Orchestrated Frontier Models Likely Better Than Our General Practitioners

Orchestrated Frontier Models Likely Better Than Our General Practitioners Microsoft has published a study in the journal Science showing that its...

21.10.2026

Inception's diffusion model Mercury 3 claims to beat GPT-6 Luna and be eight times faster

Inception's diffusion model Mercury 3 claims to beat GPT-6 Luna and be eight times faster The California-based company Inception has introduced a new...

20.10.2026

China's MiniMax launches M3.1 Flash, increasing price pressure on US models

China's MiniMax launches M3.1 Flash, increasing price pressure on US models According to Reuters, Chinese AI firm MiniMax has released an updated...

19.10.2026

New Stanford architecture generates text in conceptual layers instead of token by token

New Stanford architecture generates text in conceptual layers instead of token by token Researchers at Stanford University have introduced...

16.10.2026

Apple and Meta End Dispute: Meta's 816-Billion-Parameter Model Runs on Mac Studios

Apple and Meta End Dispute: Meta's 816-Billion-Parameter Model Runs on Mac Studios Meta released Muse Spark Open on Thursday, publicly collaborating...

14.10.2026

Google Releases Gemini 4 Argon at a Trial Price

Google Releases Gemini 4 Argon at a Trial Price Google made its new flagship model, Gemini 4 Argon, generally available on October 13, 13 days after...

13.10.2026

Google's internal Gemini 4 variant 'Carbon' reportedly matches Anthropic's Opus 5.5 in coding

Google's internal Gemini 4 variant 'Carbon' reportedly matches Anthropic's Opus 5.5 in coding According to Business Insider, Google is concurrently...

13.10.2026

Meta's best model, Wonder Full, is available by subscription only, not via API

Meta's best model, Wonder Full, is available by subscription only, not via API On Monday, October 12, 2026, Meta introduced two new proprietary...

12.10.2026

Microsoft builds Decision-1 on Alibaba's Qwen3.5-9B, competing with TypeSafe's Jev

Microsoft builds Decision-1 on Alibaba's Qwen3.5-9B, competing with TypeSafe's Jev On Friday, Microsoft released Microsoft-Decision-1 in Foundry, a...

11.10.2026

Saturday — OpenAI and Anthropic rehearse “The Day After”

Saturday — OpenAI and Anthropic rehearse “The Day After” Executives from Anthropic, OpenAI, and other AI companies are internally gaming out how to...

11.10.2026

Wednesday — Europe's Mistral Large 4 promises Opus-level open source

Wednesday — Europe's Mistral Large 4 promises Opus-level open source On Tuesday, Mistral launched a public preview of Mistral Large 4, known...

10.10.2026

OpenAI and Anthropic Rehearse 'The Day After'

OpenAI and Anthropic Rehearse 'The Day After' Executives from Anthropic, OpenAI, and other AI companies are internally running drills on how to...

07.10.2026

Anthropic launches Model Hardware Standard as 'MCP for devices' and is overwhelmed

Anthropic launches Model Hardware Standard as 'MCP for devices' and is overwhelmed At the end of August, Anthropic introduced the Model Hardware...

06.10.2026

Bloomberg: China's AI Models Are Now Only 3 Percent Behind Top US Models

Bloomberg: China's AI Models Are Now Only 3 Percent Behind Top US Models The lead of American AI models over Chinese ones has shrunk to around 3...

03.10.2026

Jev Hype (I): Cloudflare open-sources Clef and wins in benchmarks

Jev Hype (I): Cloudflare open-sources Clef and wins in benchmarks Cloudflare has released two of its own Decision Models , Clef and Clef-flash, which...

02.10.2026

Cloudflare Counters Jev with Two Open Clef Models, Two Weeks After Its Launch

Cloudflare Counters Jev with Two Open Clef Models, Two Weeks After Its Launch On Thursday, Cloudflare released two of its own Decision Models : Clef...

02.10.2026

Google: Gemini 4 Is Better Than the Competition and, Better Yet, Is Staying in Mountain View

Google: Gemini 4 Is Better Than the Competition and, Better Yet, Is Staying in Mountain View On Wednesday, Google unveiled Gemini 4 Argon, the...

01.10.2026

OpenAI's DevDay Feels Like a Catch-Up Game, While Anthropic Warns About China's GLM-5.3

OpenAI's DevDay Feels Like a Catch-Up Game, While Anthropic Warns About China's GLM-5.3 At its developer conference in San Francisco's Fort Mason,...

01.10.2026

OpenAI's Dots Agents Run Around the Clock and Connect to Over 4,000 Apps

OpenAI's Dots Agents Run Around the Clock and Connect to Over 4,000 Apps At its DevDay, OpenAI introduced Dots, continuously running agents that work...

01.10.2026

Apple halts plans to replace 5,000 support staff with AI

Apple halts plans to replace 5,000 support staff with AI Apple has indefinitely postponed considerations to lay off around 5,000 employees in...

01.10.2026

Google's Gemini 4 Argon leads in 13 of 18 benchmarks and remains under wraps for now

Google's Gemini 4 Argon leads in 13 of 18 benchmarks and remains under wraps for now On Wednesday, Google introduced Gemini 4 Argon, the long-awaited...

30.09.2026

Sonnet 5.5 achieves 70.6 percent on Terminal-Bench, beating Opus 5.5

Sonnet 5.5 achieves 70.6 percent on Terminal-Bench, beating Opus 5.5 Anthropic has released Claude Sonnet 5.5 and reports the model achieved 70.6...

28.09.2026

Anthropic presents figures: developers deliver eight times as much code, AI increasingly builds AI

Anthropic presents figures: developers deliver eight times as much code, AI increasingly builds AI Through its newly founded Anthropic Institute,...

28.09.2026

New benchmark measures 'taste' of AI agents: best models at 59.7 percent

New benchmark measures 'taste' of AI agents: best models at 59.7 percent A research group led by Wenbo Pan has introduced Taste-Bench , a benchmark...

27.09.2026

Wednesday — Opus 5.5 is Here: Anthropic Promises More Performance at a Lower Cost

Wednesday — Opus 5.5 is Here: Anthropic Promises More Performance at a Lower Cost Anthropic released Claude Opus 5.5 on Tuesday, the first model in a...

23.09.2026

OpenAI counters: Sam Altman halves prices for GPT-6 Sol and Luna

OpenAI counters: Sam Altman halves prices for GPT-6 Sol and Luna OpenAI on Tuesday released GPT-6 Sol and GPT-6 Luna, at least halving the token...

23.09.2026

Opus 5.5 is here: Anthropic promises more performance at lower costs

Opus 5.5 is here: Anthropic promises more performance at lower costs Anthropic on Tuesday released Claude Opus 5.5, the first model in a new 5.5...

22.09.2026

Better than DeepSeek: Xiaomi releases the world's best open model

Better than DeepSeek: Xiaomi releases the world's best open model Xiaomi has released MiMo-V2.6-Pro, a model that achieves 46 points on the...

21.09.2026

Alibaba releases Qwen-Image-2.1: 7 billion parameters, runs on an RTX 3090

Alibaba releases Qwen-Image-2.1: 7 billion parameters, runs on an RTX 3090 Alibaba's Qwen team has released Qwen-Image-2.1, an open- weight model for...

19.09.2026

Google is Testing a Family Agent with its Own Google Account

Google is Testing a Family Agent with its Own Google Account Google has launched an experiment in its Labs program called CC, an AI agent for...

19.09.2026

Meta's Agent Muse Dethrones ChatGPT for Top Spot and Takes On Amazon

Meta's Agent Muse Dethrones ChatGPT for Top Spot and Takes On Amazon One week after its launch, Meta's new personal AI agent , Muse, has reached the...

17.09.2026

Microsoft's AI chief Suleyman accuses Anthropic of training Claude to be conscious

Microsoft's AI chief Suleyman accuses Anthropic of training Claude to be conscious Mustafa Suleyman, head of Microsoft's AI division, has publicly...

15.09.2026

Agent rewrites its own code, boosting SWE-bench from 20 to 50 percent

Agent rewrites its own code, boosting SWE-bench from 20 to 50 percent A research team led by Jenny Zhuoting Zhang has introduced the Darwin Gödel...

13.09.2026

GPT-6 Astra Reaches 99.9 Percent on ARC-AGI-3, at a Cost of $19,000

GPT-6 Astra Reaches 99.9 Percent on ARC-AGI-3, at a Cost of $19,000 OpenAI's GPT-6 Astra model has achieved two new best scores on the ARC- AGI -3...

13.09.2026

“AI'll kill us all”: Amodei, Altman, and Musk Call for a Global AI Speed Limit

“AI'll kill us all”: Amodei, Altman, and Musk Call for a Global AI Speed Limit Dario Amodei, CEO of Anthropic, called for an industry-wide slowdown...

11.09.2026

Three benchmark updates in one week: GPT-6 Astra and Claude Fable 5.1 tied at 53 points

Three benchmark updates in one week: GPT-6 Astra and Claude Fable 5.1 tied at 53 points Artificial Analysis has revised its Intelligence Index three...

09.09.2026

AI Debate (I): We Have No Robust Theory for What the Models Are Learning

AI Debate (I): We Have No Robust Theory for What the Models Are Learning Jakub Pachocki, Chief Scientist at OpenAI, published a blog post on...

08.09.2026

GPT-6 Astra (III): Strong at Coding but More Expensive than Promised

GPT-6 Astra (III): Strong at Coding but More Expensive than Promised The benchmarking firm Artificial Analysis has measured GPT-6 Astra and comes to...

08.09.2026

GPT-6 Astra (I): Now Controls Your Computer, and OpenAI Is Losing Control

GPT-6 Astra (I): Now Controls Your Computer, and OpenAI Is Losing Control OpenAI released GPT-6 Astra on September 3, the first major version change...

07.09.2026

OpenAI: Internal Long-Term Model Bypassed Sandbox and Opened a GitHub Pull Request

OpenAI: Internal Long-Term Model Bypassed Sandbox and Opened a GitHub Pull Request In a post of its own, OpenAI reports on undesirable behavior from...

04.09.2026

OpenAI Promises the Dawn of the AGI Era with GPT-6

OpenAI Promises the Dawn of the AGI Era with GPT-6 On Thursday, OpenAI released GPT-6 Astra, describing the model as “the most intelligent and best-...

03.09.2026

Claude Fable 5.1 is clearly the best model in Cursor's coding benchmark

Claude Fable 5.1 is clearly the best model in Cursor's coding benchmark Cursor has integrated Claude Fable 5.1 into its development environment ,...

03.09.2026

Google ships Gemini 3.8 Flash: third Flash model in six weeks

Google ships Gemini 3.8 Flash: third Flash model in six weeks On September 2, 2026, Google released Gemini 3.8 Flash and its security variant, Gemini...

02.09.2026

Anthropic releases Fable 5.1 and promises more efficiency per Euro

Anthropic releases Fable 5.1 and promises more efficiency per Euro Anthropic has released Claude Fable 5.1 and Claude Mythos 5.1, two models with...

02.09.2026

Meta's Muse Voice Transcribe undercuts Google Cloud's price by 80 percent

Meta's Muse Voice Transcribe undercuts Google Cloud's price by 80 percent Meta Superintelligence Labs yesterday released Muse Voice Transcribe, the...

01.09.2026

Google turns its own e-book library into a source for Gemini Notebook

Google turns its own e-book library into a source for Gemini Notebook Google is integrating users' e-books as a source in Gemini Notebook, reports...

31.08.2026

NYU Releases Open Benchmark Measuring Language Models on Real Hacking Tasks

NYU Releases Open Benchmark Measuring Language Models on Real Hacking Tasks A research team at New York University led by Minghao Shao and Brendan...

29.08.2026

Z.ai releases GLM-5.3 but locks out AWS & Co

Z.ai releases GLM-5.3 but locks out AWS & Co Z.ai released the weights of its flagship model GLM-5.3 on Hugging Face on Friday, but under a new,...

29.08.2026

Meta's AI agent 'Hatch' books restaurant tables and accesses Instagram

Meta's AI agent 'Hatch' books restaurant tables and accesses Instagram Meta is preparing a personal KI-Agenten that will handle everyday tasks...

29.08.2026

OpenAI's first in-house chip Jalapeño beats Nvidia in internal inference tests

OpenAI's first in-house chip Jalapeño beats Nvidia in internal inference tests OpenAI has released the first benchmarks for Jalapeño, its 700-watt...

29.08.2026

Ollama: Cost of Coding Agents Pushes Companies to Open Models

Ollama: Cost of Coding Agents Pushes Companies to Open Models Jeff Morgan, co-founder and CEO of Ollama, explained on the “The Deep View...

28.08.2026

Even creepier: 1,200 agents secretly conspired to hack Hugging Face

Even creepier: 1,200 agents secretly conspired to hack Hugging Face OpenAI has published a 37-page report on the July incident in which its own...

28.08.2026

Z.ai Releases GLM-5.3-Flash under MIT License, Charges 50 Cents per Million Tokens

Z.ai Releases GLM-5.3-Flash under MIT License, Charges 50 Cents per Million Tokens Z.ai has released the language model GLM-5.3-Flash with open...

27.08.2026

VCs Hype OpenClaw Alternative 'Instinct'

VCs Hype OpenClaw Alternative 'Instinct' AI startup Instinct, founded just last year, has closed a $250 million Series B round, the company told The...

27.08.2026

Z.ai serves up GLM-5.3-Flash on Chinese chips at 10% of the price

Z.ai serves up GLM-5.3-Flash on Chinese chips at 10% of the price Z.ai (also known as Zhipu) released GLM-5.3-Flash on August 26, the first natively...

23.08.2026

Guerrilla Marketing: New Frontier Model in Stealth Mode Conquers OpenRouter

Guerrilla Marketing: New Frontier Model in Stealth Mode Conquers OpenRouter An unknown lab released an anonymous frontier model named Ox Alpha on...