For a while now, companies like OpenAI and Google have been touting advanced "reasoning" capabilities as the next big step in their latest artificial intelligence models. Now, though, a new study from six Apple engineers shows that the mathematical "reasoning" displayed by advanced large language models can be extremely brittle and unreliable in the face of seemingly trivial changes to common benchmark problems. The fragility highlighted in these new results helps support previous research suggesting that LLMs use of probabilistic pattern matching is missing the formal understanding of underlying concepts needed for truly reliable mathematical reasoning capabilities. "Current LLMs are not capable of genuine logical reasoning," the researchers hypothesize based on these results. "Instead, they attempt to replicate the reasoning steps observed in their training data." Mix it up In "GSM-Symbolic: Understanding the Limitations of Mathematic
Search This Blog
Lagos Writer
News feed, music updates, tech news, and so much more.
Posts
Featured
Latest posts
Posted by
Too Simpu
Google signed a deal to power data centers with nuclear micro-reactors from Kairos — but the 2030 timeline is very optimistic
- Get link
- Other Apps
Posted by
Too Simpu
Bill Clinton: If Laken Riley's Killer Had Been Vetted She Would Be Alive
- Get link
- Other Apps
Posted by
Too Simpu
Billy Joel reunites with Axl Rose, John Mayer at LA concert
- Get link
- Other Apps
Posted by
Too Simpu
Ariana Grande’s Return as ‘SNL’ Host: All 7 Sketches Ranked
- Get link
- Other Apps
Posted by
Too Simpu
Hayley Williams responds to accusations of toxic workplace at her Nashville hair salon
- Get link
- Other Apps
Posted by
Too Simpu
SpaceX catches returning rocket in mid-air, turning a fanciful idea into reality
- Get link
- Other Apps
Posted by
Too Simpu
The best Amazon Prime Big Deal Days deals in Australia
- Get link
- Other Apps
Posted by
Too Simpu
Brantley Gilbert & Wife’s Baby Born on Tour Bus Mid-Show
- Get link
- Other Apps
Posted by
Too Simpu
Ye Sued by Former Assistant Alleging She Was Drugged, Sexually Assaulted at Diddy Studio Session
- Get link
- Other Apps
Posted by
Too Simpu
Neil Young endorses Kamala Harris for President: “She is an honest, forthright truth teller”
- Get link
- Other Apps