Social Web Application Idea: Open Heuristics
There are basically two steps (after registering):
- Site owners submit a website (or site section or even page) for heuristic evaluation.
- Evaluators submit a list of errors - each tagged with zero or more heuristics.
After submitting these errors the evaluators can see a list of all errors (including those suggested by others) for that site. This is to prevent a bias towards the first person's findings. Evaluators may return to add more findings but these will be marked as potentially biased.
Evaluators are ranked by usefulness, number of errors submitted etc and sites could be ranked by number of bugs found but I'm not sure if that would serve a purpose or be attractive to site owners. Sites could also be ranked according to how much they've improved which might have a use.