Crowdsourcing Human Evaluation
Under review
November 04, 2025
People can crowdsource human evaluation trials.
How it helps community:
People and researchers use W&B for tracking and logging of experiments. How about also allow them to run human evaluation of their models via crowdsourcing the users of W&B.
How it helps W&B the company:
For W&B you attract and also curate before anyone else the best models that have a valid and reliable human evaluation to back them.