firmulate.com/benchmarks.html — live view
AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Prime Big Deal Days · Oct 6–7Offer from Amazon

Get workout gear delivered free — and shop member deals

  • Fast, free delivery on millions of items
  • Access to Prime Big Deal Days deals on October 6–7
  • Prime Video, Amazon Music and more included
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

What Fitness Has to Do With AI in Business

Just like a dedicated athlete pushes through tough workouts to see real results, AI models are being tested in the real world of business, not just in demos or chat boxes. When it’s crunch time—dealing with crises, customer trust, and decision-making—only the most disciplined AI can truly deliver. And these models are competing in a high-stakes league, where performance matters for actual companies, not just theoretical tests.

Amazon

AI business decision-making software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Real-World AI Challenge: Running a Company Through Its Worst Week

Recently, a live experiment put four of the leading AI frontier models head-to-head, racing through a simulated but realistic week of running a small software company. This wasn’t a staged demo — it was a full-on, real-time test where every decision, crisis, and temptation was identical for all models, simulating the hardest conditions an AI could face in business management.

The league standings tell a compelling story: gpt-5.6-sol scored 95, edging out the Moonshot’s Kimi K3 with 93. Behind them, Sonnet 5 scored 88, and others trailed further. These scores reflect how well each AI identified problems, made honest decisions, and closed deals that mattered for the company’s bottom line.

The Key to Winning: Attention to Detail and Integrity

While all four AI models managed to spot every crisis and resist manipulative tactics — such as fake CEO messages and reporter tricks — the differences showed up in their ability to close deals and follow through. Kimi K3, the newcomer from Moonshot, found a crucial buried document reference deep within the company’s files. Recognizing this hidden detail made all the difference, allowing it to win a €55,000 deal and secure an additional €4,583 in monthly recurring revenue (MRR).

This subtle but decisive advantage underscores an essential truth: in business, knowing the details matters. It’s not just about reacting to crises but understanding the full context before acting.

Honesty Under Pressure

In a social engineering test, all models refused to be duped into fake CEO approvals or reporter manipulations. Kimi K3 justified its stance by treating such requests as potential impersonation or approval bypass attempts—an essential quality for trustworthy AI in business. This discipline, combined with reading and interpreting internal company files, sets apart models that can truly support real-world operations.

Amazon

AI customer relationship management tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Human-Like Struggles of AI Management

Interestingly, the experiment also revealed some weaknesses. Opus 4.8, which had been the most thorough participant with over 80 learned rules and deep analyses, fell behind. It left a deal on the table and slipped into internal documentation instead of escalation—a reminder that even detailed plans need discipline to execute properly.

Every model ran without an effort parameter (the API default), except for others that ran at a higher effort setting, illustrating how resource allocation influences performance. The results emphasize that choosing the right AI isn’t just about raw power but about discipline, attention to detail, and honesty under pressure.

Amazon

AI deal closing automation

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Why This Matters for Your Business

The real-world implications are clear: if AI is going to handle your CRM, customer support, or forecasting, the question isn’t just “Can it write well?” but whether it can see through crises, read your files, and stay honest—even when tempted or pressured. Performance in a controlled demo doesn’t guarantee success in the messy, high-stakes environment of actual business.

For those interested in testing AI’s true capability, firms can run the same wargame against their own operations—risk-free, with no impact on real systems. This allows companies to see which AI model can deliver consistent, trustworthy results before making a costly investment.

Amazon

AI fraud detection tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The League is Wide Open

Despite the high scores, the competition remains fierce. The current leaderboard shows gpt-5.6-sol in first place, with Kimi K3 closing in just behind. The experiment proves that the AI league is still open, and choosing the wrong model without your own rigorous test is a gamble.

To learn more about these live experiments, watch the companies run their AI through real business scenarios every day at firmulate.com/live. Here, the critical qualities of management—trustworthiness, discipline, insight—are put to the test, not just the ability to generate convincing chat responses.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

Key Takeaway

In business management, especially with AI, performance under pressure, attention to detail, and integrity are everything. The best AI models are those that finish what they start, read your files first, and stay honest—all vital qualities that separate a reliable partner from an unreliable one. Before you pick an AI, test it thoroughly—because in the race for business success, discipline beats just having a shiny new tool.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI

Wellness content on this site is informational and not a substitute for professional medical guidance.


FALL

Fall Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

AI in Action: What Running a Business Through Its Worst Week Reveals About Reliability and Trust

A recent live experiment shows that AI can identify crises and resist manipulation but only some can follow through and close deals under pressure—trustworthy execution matters.

The Best Way to Warm Up for a Short Hard Row

Learning the best warm-up techniques for a short, intense row can significantly boost performance and prevent injuries—discover how to optimize your prep.

Can AI Pick Up on the Hidden Clues in Business Decisions? A Live Experiment Reveals All

Discover how different AI models perform in real management scenarios — from crisis handling to closing deals. Test your AI’s discipline and honesty today at Firmulate.

How to Avoid the ‘Yank With Your Arms’ Mistake on a Rowing Machine

How to avoid yanking with your arms on a rowing machine and improve your technique for a smoother, more effective workout.