The $200 AI Pro Mode: Is It Worth It?

OpenAI has launched this o1 Pro Mode, right? And it’s not cheap at $200/month. The promise here is that it can tackle the complex challenges in science, math, and coding like nothing before. But let’s pump the brakes for a moment and think about whether this kind of investment is sensible.

What Is o1 Pro Mode Exactly?

This o1 Pro Mode is basically a souped-up version of their reasoning model. According to them, it’ll give us the most reliable and detailed responses to those head-scratching queries we have in fields like science, math, and coding. But being a part of the ChatGPT Pro plan, which costs $20/month, brings up the question: is it really worth that extra $200?

Now, they claim this Pro version is more reliable thanks to more computing power, which is nice. Bob McGrew, an ex-OpenAI officer, even used the term “intelligence overhang.” It suggests we’re kind of stuck in a rut, unable to get the most out of this extra intelligence due to the limitations of a text-based interface.

The Price Tag: Justifying the Cost

This $200/month translates to a whopping $2400/year, making it the priciest chatbot subscription on the planet. I mean, the price alone raises eyebrows. What are we getting for this money? They say you won’t hit rate limits and have unlimited access to their models. But come on, is that why we’re coughing up this much cash?

Simon Willison, a British computer scientist, actually asked if OpenAI has given any concrete examples of prompts that fail in the regular o1 but thrive in the o1 Pro Mode. And there are some documented failures. Like Sudoku puzzles and optical illusions? The model could not handle them at all, leaving humans scratching their heads.

Then you look at OpenAI’s own benchmarks, and it’s just a slight upgrade over the standard o1 for coding and math problems. They had to run stringent tests to show its consistency, requiring it to solve questions correctly four out of four times. But even that didn’t seem groundbreaking.

Pros and Cons: Can It Change Medicine?

Even with the mixed reviews, this Pro mode shines when it comes to reliability and performance, especially in coding, math, data science, and case law analysis. They claim it cut errors by 75% in routine coding tasks and achieved perfect reliability in competition-level problems. That’s impressive, and it almost makes the $200/month feel justified for pros who need dependable AI.

Bob McGrew pointed out that this reliability might be the biggest unlock for o1 Pro, especially in medicine. The advanced capabilities could be valuable for complex technical tasks, making it a boon for medical research. Its ability to process images could actually make a difference in research and education.

The Conclusion: Is It Worth the Money?

So there’s a lot to mull over. For those in medicine or fields that require high levels of accuracy and reliability, $200/month might just be pocket change compared to the time saved and quality of work produced. But for your average Joe? That price tag might feel like a punch in the gut, especially when other more affordable AI trading bots are well within reach.