What is "quality"? What is the objective test of it?
I have made my definition clear: if people are choosing a product consistently, it must be of some value to them. What is your definition?
mcploitable is a set of MCP servers that do not know they are part of a training range. Each is designed with intentionally vulnerable tools and/or overly permissive prompts. They are designed to replicate real-life agentic attacks and demonstrate the OWASP Agentic Top 10. There are also 3 guided simulations for those ASI categories that don't lend themselves well to being a vulnerable box.
I honestly don't think it's possible to have a QA team large enough to handle the gajillions of websites that come up and disappear every day. They just have to come up with better and better metrics until they find one that approximates the human experience the best.
reply