Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
FrontierScience Benchmark by OpenAI (openai.com)
17 points by mustaphah 64 days ago | hide | past | favorite | 1 comment


If a model eventually scores perfectly on every benchmark yet ends up practically useless, what’s the next step?

Benchmarks measure competence inside a predefined problem space, but real scientific and engineering work isn’t bounded — it keeps changing underneath you.

At some point we don’t just need a system that knows how to solve problems in theory; we need one that can actually do something with that ability.

The equivalent of making the coffee when we want coffee, not just getting a perfect score on a coffee-theory exam.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: