Moments after OpenAI, Google, or Anthropic drop a major upgrade to their AI models, you’ll see people already speculating on the next update’s date and features. And there have been fairly regular updates to feed those rumors. However, those days may be over, according to a Bloomberg report. All three major AI developers are reportedly struggling to make their next-gen models match their ambitions for improvement over the current crop.
The report claims that OpenAI’s work on the Orion model isn’t going as well as the company expected. The model doesn’t perform at the level the company is aiming for, especially when it comes to coding. Orion may not offer a seismic change from GPT-4 compared to how GPT-4 blew GPT-3.5 out of the water. That may be one reason OpenAI CEO Sam Altman publicly pushed back on rumors about the release date for the Orion model and an upgrade to ChatGPT.
Delays and lower expectations are also plaguing Google and Anthropic. Google’s Gemini development is slower than hoped, according to Bloomberg. Anthropic has already pushed back releasing its Claude 3.5 Opus model for similar reasons despite teasing it earlier this year.
All of the AI developers are running into the same ceilings in growing their model’s abilities. The biggest is likely training data. The companies have leveraged enormous datasets to train their AI models, but even the internet is not infinite, and that goes even more when discussing high-quality data useful for training AI. Finding previously unused, accessible information is becoming tricky. That’s partly because of growing awareness and consideration for ethical and legal rights to use some data, but that’s only part of the…
Read full post on Tech Radar
