Grok 3 Unveiled: xAI’s leap in AI innovation
Grok 3 Shatters AI Benchmarks: xAI's Latest Model Sets New Industry Standards with Unprecedented 1400+ Arena Score
xAI, led by Elon Musk, has launched Grok 3, claiming it to be the world’s most advanced AI model. Following its live demo, the model has set new AI performance benchmarks—most notably becoming the first to exceed a score of 1400 on Chatbot Arena. Grok 3 outperforms established competitors like OpenAI’s GPT-4o and Google’s Gemini 2 Pro in reasoning, coding, and problem-solving capabilities. The tech community has praised this achievement, particularly noting xAI’s swift progress as a newcomer in the AI field. Within xAI, the model’s development has generated significant excitement, with both team members and industry observers anticipating its future applications and potential to advance AI technology further.
Key Insights from the Grok 3 Video
According to Elon, Grok 3 is an order of magnitude more capable than Grok 2.
The capacity was doubled in 92 days!
Total GPUs: 200K
All of this compute was used to improve Grok — which has lead to Grok 3.
Grok 3’s training was ten times more extensive than Grok 2’s. While its initial pretraining phase concluded in early January, the model continues to undergo training.
Here are the benchmark numbers:
Grok 3 significantly outperforms other models in its category such as Gemini 2 Pro and GPT-4o. Even Grok-3 mini shows to be competitive.
Results of early Grok 3 in the Chatbot Arena (LMSYS)
It reached an Elo score of 1400 which no other model has achieved.
The model score keeps improving.
Grok 3 also has reasoning capabilities too!
The Grok team has been testing these capabilities which they have unlocked using RL.
The model is good, especially in coding.
Grok 3 Reasoning performance:
The results correspond to the beta version of Grok-3 Reasoning.
It outperforms o1 and DeepSeek-R1 when given more test-time compute (allowing it to think longer).
The Grok 3 mini reasoning model is also very capable.
More on DeepSearch:
- the model can think deeply about user intent
- what facts to consider
- how many websites to browse
- it can cross-validate different sources
DeepSearch also exposes the steps that it takes to conduct the search itself.
What others are saying on X:
An early version of Grok-3 (codename “chocolate”) has claimed the #1 spot in Arena!
Grok-3 has achieved two major milestones:
- First model ever to break the 1400 score barrier
- #1 ranking across all categories—an increasingly challenging feat
I was given early access to Grok 3 earlier today, making me I think one of the first few who could run a quick vibe check.
— Andrej Karpathy (@karpathy) February 18, 2025
Thinking
✅ First, Grok 3 clearly has an around state of the art thinking model ("Think" button) and did great out of the box on my Settler's of Catan… pic.twitter.com/qIrUAN1IfD
BREAKING: @xAI early version of Grok-3 (codename “chocolate”) is now #1 in Arena! 🏆
— lmarena.ai (formerly lmsys.org) (@lmarena_ai) February 18, 2025
Grok-3 is:
– First-ever model to break 1400 score!
– #1 across all categories, a milestone that keeps getting harder to achieve
Huge congratulations to @xAI on this milestone! View thread 🧵… https://t.co/p8z8lccNd5 pic.twitter.com/hShGy8ZN1o
Recent Blog Posts
ChatGPT 5 – When Your AI Friend Gets a Corporate Makeover
I've been using OpenAI's models since the playground days, back when you had to know what you were doing just to get them running. This was before ChatGPT became a household name, when most people had never heard of a "large language model." Those early experiments felt like glimpsing the future. So when OpenAI suddenly removed eight models from user accounts last week, including GPT-4o, it hit different than it would for someone who just started using ChatGPT last month. This wasn't just a product change. It felt like losing an old friend. The thing about AI right now is...
May 22, 2025Anthropic Claude 4 release
As a fan and daily user of Anthropic's Claude, we're excited about their latest release proclaiming Claude 4 "the world's best coding model" with "sustained performance on long-running tasks that require focused effort and thousands of steps." Yet we're also fatigued by the AI industry's relentless pace. The Hacker News comment section reveals something fascinating: we're experiencing collective AI development fatigue. The release that would have blown minds a year ago is now met with a mix of excitement and exhaustion—a perfect snapshot of where we are in the AI hype cycle. Code w/ Claude VideoCode with Claude Conference Highlights...
May 22, 2025How Sam Altman just executed the tech industry’s most audacious talent heist
When Jony Ive walked away from Apple in 2019, Silicon Valley held its breath. The man who designed the iPhone—the device that redefined human interaction with technology—was free to work with anyone. Google's billions beckoned. Meta's metaverse promised new frontiers. Microsoft's enterprise muscle offered guaranteed scale. Instead, Ive chose a startup CEO barely into his thirties, betting his next chapter on artificial intelligence hardware that didn't yet exist. That CEO was Sam Altman. And with Tuesday's announcement that Ive's design firm LoveFrom is merging with OpenAI, Altman has pulled off what may be the most strategically devastating talent acquisition in...