Crowd Evaluation

The rise of the internet has produced many opportunities for focal actors to leverage creativity inside and outside their organizations’ boundaries. Yet an important step in any innovation process is the selection of the ‘right’ ideas. Traditionally, focal actors use expert panels that perform the selection task. An alternative to this traditional approach may be to have the crowd conduct the evaluation. However, shifting the evaluation from an offline expert panel to an online crowd implies significant changes.


The following research questions are currently under investigation:

  • Which factors can explain the results of crowd evaluation processes on platforms in which users develop their own designs and a peer community can vote for such designs?

  • Under which conditions does the crowd produce similar evaluation outcomes compared to an expert panel?

  • How may certain stimuli (e.g. different incentives) affect the outcome of crowd evaluation outcomes?


External Partners