Open Internet by MindsNet

Regressed Performance in Language Models

The performance of language models, specifically GPT-5.4-mini, has regressed significantly compared to its predecessor, GPT-5-mini, under vanilla prompting. This regression affects various tasks, with accuracy dropping substantially. The issue seems to stem from the models' tendency to produce shorter outputs and a lack of thoroughness in their responses.

Computing & Technology, Computer Science, Machine Learning