I'm Vivek, co-founder/CEO of HackerRank (YC S11); You may know us as a hiring tool for developers/companies.
Over the years, we have built up deep expertise in generating programming challenges, and we are now using that to make coding models better.
Our first launch is Model Kombat -- an arena where you can directly compare anonymized coding models, side by side, on real problems.
* Pick an arena (Java, Python, etc.)
* Each battle has 3 rounds: see the problem + two model outputs -> vote on which you’d actually prefer
* Leaderboards + problem statements are updated weekly.
We already have 400+ challenges live, and our goal is to evolve toward real-world, multi-file challenges and robust tooling for coding model evaluation.
Try it now at: modelkombat.com
We’d love your feedback.
Then again, I’ve seen interviews play out like that too.