Carnegie Mellon University
fng_phd_hci_2021.pdf (2.3 MB)

From Contests to Communities of Practice: Designing for Effective Feedback Exchange in Online Innovation Contests

Download (2.3 MB)
posted on 2021-04-30, 20:24 authored by Felicia NgFelicia Ng
Online innovation contests are an increasingly popular tool that organizations are using to find breakthrough solutions to problems in a variety of social, scientific, and business domains. By posting a specific challenge and a monetary prize on the internet, they attract large and diverse
crowds of people to propose new ideas, in hopes of surfacing one or a few outstanding winners. However, prize-centered contest designs are inefficient at leveraging participant contributions and producing high-quality ideas. Competitive winner-takes-all systems inherently do not reward the majority of ideas, which discourages participants from contributing their earnest efforts, both during and after contests, especially if they lose or believe they may lose. The result is that most online innovation contests produce a disproportionately large number of l ow-quality ideas. As
such, these inefficiencies demonstrate a need for new contest designs to better leverage participant contributions towards more effective innovation processes. In this dissertation, I address these inefficiencies by exploring an alternative approach to designing online innovation contests as communities of practice, in which many participants are
encouraged to contribute their efforts to help and l earn from one another, while collectively raising the quality of ideas. To explore this, I introduce new design interventions for inducing different types of participants i n online innovation communities to exchange feedback on one another’s innovation ideas i n contests. Through five field studies in real-world online innovation contests, I test and identify the conditions under which each intervention i s effective at engaging and benefiting participants and improving project quality. Specifically, I show that the introduction of new peer advisor programs, in which participants are explicitly invited and assigned to serve as feedback providers to specific project teams, elicits greater engagement between community members than standard collaboration mechanisms that are currently available on online innovation contest platforms. These successfully leverage more participant contributions by inducing a mutual exchange of benefits related to human capital development (e.g. l earning, networking). However, meta-analyses across the five studies reveal that feedback only results in improvements to project quality when teams are matched
with advisors who have relevant expertise in their project domains, and when feedback is exchanged during early stages in the contest process. In addition, helping feedback receivers process and incorporate feedback into project revisions also benefits project quality for participants who are not experts in their project domain. In summary, this work contributes: (1) a new approach for designing online innovation contests as communities of practice: specifically, by inducing participants to exchange feedback with one
another, and (2) a conceptual framework of conditions under which feedback interventions are effective at engaging and benefiting participants as well as improving project quality. These contributions provide practical guidance to organizations and researchers who are looking to
advance innovation strategies and understandings of collaboration i n online communities.




Degree Type

  • Dissertation


  • Human-Computer Interaction Institute

Degree Name

  • Doctor of Philosophy (PhD)


Aniket Kittur Robert Kraut

Usage metrics


    Ref. manager