Eli candelo yenzelwe ukuba isetyenziswe njengesingqiniso, kunokuba kufundwe njengokuba ebalisayo.
Intsebenziswano Mass axutyiweyo izimvo ezivela kwinzululwazi ngummi, crowdsourcing, kunye nobukrelekrele nabaqeshi. Inzululwazi Citizen ngokuqhelekileyo ithetha ebandakanya "ngabemi" (oko kukuthi, non-izazinzulu) kwinkqubo yenzululwazi (Crain, Cooper, and Dickinson 2014) . Crowdsourcing ngokuqhelekileyo kuthetha ukuthatha ingxaki ngokuqhelekileyo isonjululwe ngaphakathi umbutho kwaye endaweni kwabangaphandle ukuba isihlwele (Howe 2009) . Ubukrelekrele Collective kudla ngokuthetha amaqela abantu ngokusebenzisana kunye ngeendlela kubonakala ukuba okrelekrele (Malone and Bernstein 2015) . Nielsen (2012) kukho elimangalisayo incwadi-ubude kokukhutshelwa ngamandla intsebenziswano sesininzi zophando lwezenzululwazi.
Kukho iintlobo ezininzi ngentsebenziswano ubunzima ezingangeniyo cocekileyo ngamahlelo amathathu ukuba olucetywayo, kwaye ndicinga ezintathu ezifuna ingqwalasela eyodwa ngenxa yokuba kunokuba luncedo kuphando loluntu kwinqanaba elithile. Omnye umzekelo iimarike wokuxela, apho abathathi kuthenga kwezivumelwano zorhwebo olunokuhlawulelwa esekelwe kwiziphumo ezenzeka ehlabathini (Wolfers and Zitzewitz 2004; Arrow et al. 2008) . Iimarike Ukuqikelela zidla ezisetyenziswa mveliso kunye noorhulumente ngenxa nokuqikelelwa, kunye neemarike ukuqikelela nazo asetyenziswa abaphandi zentlalo ukuqikelela replicability lezifundo epapashwe bengqondo (Dreber et al. 2015) .
Umzekelo wesibini engahambiselaniyo kakuhle kungena scheme yam ngokweendidi yiprojekthi PolyMath, apho abaphandi yasebenzisana usebenzisa blogs kunye wikis ukungqina theorems math esitsha (Gowers and Nielsen 2009; Cranshaw and Kittur 2011; Nielsen 2012; Kloumann et al. 2016) . Iprojekthi PolyMath na kwezinye iindlela ezifanayo ukuze Netflix Prize, kodwa nxaxheba kwiprojekthi PolyMath wakha ngenkuthalo phezu izisombululo buso abanye.
Umzekelo wesithathu okungalungelaniyo kakuhle kungena scheme yam ngokweendidi na mobilizations ixesha-ixhomekeke ezifana Ukuthethelela Advanced Research Projects Agency (DARPA) Network Challenge (oko kukuthi, i Red Balloon Challenge). Kuba ngakumbi kule ixesha mobilizations ezibuthathaka ukubona Pickard et al. (2011) , Tang et al. (2011) , kunye Rutherford et al. (2013) .
Igama elithi "intelekelelo ngabantu" ephuma umsebenzi wenziwe zizazinzulu computer, nokuqonda umongo emva kolu phando kuya kuphucula amandla akho alathe iingxaki kunokuba efanele oko. Ngokuba imisebenzi ethile, iikhompyutha inamandla kakhulu nge zenzeko kude kunene abantu bade ingcali. Umzekelo, kwi itshesi, iikhompyutha bangababetha na iinkosi ezona ezukileyo. Kodwa-yaye oku noku ngaphantsi kakuhle zentlalo izazinzulu-neminye imisebenzi, iikhompyutha okunene kubi kakhulu kunokuba abantu. Ngamanye amazwi, ngoku wena ngaphezu nakwezona ezintsonkothileyo computer imisebenzi ezithile ebandakanya nokusebenza imifanekiso, ividiyo, i-odiyo, nokubhaliweyo. Ngaloo ndlela-njengoko kunokufaniswa xkcd elimangalisayo ikhathuni-kukho imisebenzi ekulula neekhompyutha nzima ebantwini, kodwa kukwakho imisebenzi kunzima neekhompyutha lula ngabantu (Figure 5.13). izazinzulu computer ukusebenza kwezi nzima-for-iikhompyutha-lula-for-human imisebenzi, ngoko, babeqonda ukuba kuquka abantu kwinkqubo yabo bezibalo. Nantsi indlela Luis von Ahn (2005) uchaza intelekelelo ngabantu xa kuqala elitsha gama idizeteyishini bakhe: ". Ipharadaym ngenxa ngokusebenzisa amandla processing ngabantu ukusombulula iingxaki iikhompyutha akakwazi noko ukusombulula"
Xa le nkcazelo FoldIt-endiya kuchaziwe kwicandelo evulekileyo iminxeba-bangathathelwa ingqalelo iprojekthi intelekelelo ngabantu. Noko ke, ndikhetha bahlele FoldIt njengoko umnxeba evulekileyo kuba sifuna izakhono ezizodwa kwaye ithatha simse negalelo kunokuba usebenzisa gqiphu-isicelo-ukudibanisa sicwangciso.
Kuba unyango obalaseleyo ubude incwadi yokubala kwabantu, ngengqiqo kwiikomfa kwekota, funda Law and Ahn (2011) . Isahluko 3 of Law and Ahn (2011) i ingxoxo umdla ukudibanisa amanyathelo ezintsonkothileyo ngaphezu kwabo kwesi sahluko.
Igama elithi "kwahlukana-isicelo-ukudibanisa" wasetyenziswa Wickham (2011) ukuchaza qhinga computing zamanani, kodwa abonisa ngokugqibeleleyo inkqubo iiprojekthi ezininzi kokubalwa kwabantu. Lwahlulwa-isicelo-ukudibanisa qhinga uyafana sikhokelo MapReduce esiveliswe Google (Dean and Ghemawat 2004; Dean and Ghemawat 2008) .
Iiprojekthi ezimbini abakrelekrele intelekelelo zabantu ukuba andizange indawo ukuxoxa le Game ESP (Ahn and Dabbish 2004) kunye reCAPTCHA (Ahn et al. 2008) . Zombini ezi projekthi bafumana iindlela zokusungula ukukhuthaza nxaxheba ukubonelela iilebhile imifanekiso. Noko ke, zombini ezi projekthi navuswa imibuzo yeenqobo kuba, ngokungafaniyo Galaxy Zoo, abathathi nxaxheba ESP Umdlalo reCAPTCHA wayengazi ukuba idatha yabo ezisetyenziswayo (Lung 2012; Zittrain 2008) .
Sikhuthazwa ESP Game, abaphandi abaninzi baye bazama ukuphuhlisa abanye "imidlalo kunye nenjongo" (Ahn and Dabbish 2008) (oko kukuthi, "imidlalo intelekelelo yoluntu-based" (Pe-Than, Goh, and Lee 2015) ) ukuba kunokuba kusetyenziswa ukusombulula iintlobo nezinye iingxaki. Yintoni le "imidlalo kunye nenjongo" kufuneka efanayo kukuba ukuzama ukwenza imisebenzi inxaxheba kubalwa kwabantu ezonwabisayo. Ngoko ke, lo gama ESP Game ayixoxe ukwahlulwa-isicelo-ukudibanisa efanayo isakhiwo kunye Galaxy Zoo, oko eyahlukileyo indlela nxaxheba kwenza-fun vs. umnqweno ukunceda zenzululwazi.
Inkcazelo wam Galaxy Zoo lutsala Nielsen (2012) , Adams (2012) , Clery (2011) , kwaye Hand (2010) , kunye nentetho yam lweenjongo zophando Galaxy Zoo kwenziwe lula. Kuba ngakumbi ngembali zokuhlela Way ngezeastronomi kunye nendlela Galaxy Zoo uyaqhubeka le isithethe, bona Masters (2012) kunye Marshall, Lintott, and Fletcher (2015) . Building on Galaxy Zoo, abaphandi ezigqityiweyo Galaxy Zoo 2 baqokelela ngaphezu ngaphezulu kwezigidi 60 ukuhlela ezintsonkothileyo morphological ukusuka amavolontiya (Masters et al. 2011) . Ngaphezu koko, kwimodeli kungena iingxaki ngaphandle kweendunduma kumnyele kuquka ngokuphonononga phezu kwenyanga, sikhangela langa, kwaye ukhuphele amaxwebhu endala phandle. Okwangoku, zonke iiprojekthi zabo eqokelelwe www.zooniverse.org (Cox et al. 2015) . Enye yeeprojekthi-Snapshot Serengeti-sinika ubungqina bokuba iiprojekthi zokuhlela umfanekiso Galaxy Zoo-uhlobo kwakhona kwenziwa uphando yokusingqongileyo (Swanson et al. 2016) .
Kubaphandi uceba ukusebenzisa kwimarike yabasebenzi micro-task (umzekelo, Amazon Mechanical Bonk) ngeprojekthi intelekelelo ngabantu, Chandler, Paolacci, and Mueller (2013) kunye Wang, Ipeirotis, and Provost (2015) zinika amacebiso kuyilo msebenzi neminye imiba enxulumene.
Abaphandi abanomdla ekudaleni izinto Ndikhe ngokuba iinkqubo intelekelelo babantu kwisizukulwana yesibini (umzekelo, iinkqubo ezisebenzisa iilebhile babantu ukuqeqesha indlela yokufunda kumatshini) ukuze abe nomdla Shamir et al. (2014) (kuba ngumzekelo usebenzisa audio) kwaye Cheng and Bernstein (2015) . Kwakhona, ezi projekthi kunokwenziwa iminxeba evulekileyo, apho abaphandi bakhuphisane ukwenza imifuziselo machine nokufunda kunye nokusebenza mkhulu axelwe kwangaphambili. Ngokomzekelo, iqela Galaxy Zoo wabaleka ifowuni evulekileyo kwaye wafumana indlela entsha ukuba basebenze lowo yaphuhliswa Banerji et al. (2010) ; bona Dieleman, Willett, and Dambre (2015) ngeenkcukacha.
iminxeba Open akunto intsha. Enyanisweni, omnye iminxeba vu ezaziwayo-kakuhle busuka 1714 xa iPalamente eBritani wadalwa Yokwazi Prize for nabani na unokuba kegama indlela ekunokuqondwa yeside yenqanawa elwandle. Ingxaki angakunceda ezininzi izazinzulu inkulu imihla, kuquka Isaac Newton, kwaye isisombululo eliphumelelayo ekugqibeleni angeniswe Weewotshi evela emaphandleni owaya ingxaki ngokwahlukileyo izazinzulu abo ingqalelo isisombululo ukuba ngandlel 'kubandakanya ngeenkwenkwezi (Sobel 1996) . Njengoko lo mzekelo ubonisa, esinye isizathu sokuba iifowuni open ekucingelwa ukuba kusebenza kakuhle ukwenzela ukuba babonelela ukufikelela abantu iimbono ezahlukeneyo kunye nezakhono (Boudreau and Lakhani 2013) . Bona Hong and Page (2004) kunye Page (2008) ngaphezulu ixabiso lokungafani ekusombululeni iingxaki.
Ngalinye amatyala umnxeba evulekileyo kwisahluko ifuna isuntswana ingcaciso ngakumbi kuba kutheni elimfaneleyo kolu didi. Okokuqala, enye indlela endiya ukwahlula phakathi intelekelelo lwabantu kunye neeprojekthi umnxeba evulekileyo kukuba ingaba imveliso ngumlinganiselo zonke izisombululo (intelekelelo babantu) okanye simse (umnxeba open). The Netflix Prize liphantse lunenkohliso kulo mba ngenxa simse kwafumaniseka ukuba umyinge nobunzima izisombululo ngamnye, ibe sasingena ekuthiwa isisombululo zomculo (Bell, Koren, and Volinsky 2010; Feuerverger, He, and Khatri 2012) . nangona kunjalo, ngokwembono Netflix, bonke kwakufuneka enze azithiye simse.
Okwesibini, abanye iinkcazelo intelekelelo oluntu (umzekelo, Von Ahn (2005) ), FoldIt kufuneka ingqalelo iprojekthi intelekelelo ngabantu. Noko ke, ndikhetha bahlele FoldIt njengoko umnxeba evulekileyo kuba sifuna izakhono ezizodwa kwaye ithatha simse negalelo, kunokuba usebenzisa gqiphu-isicelo-ukudibanisa sicwangciso.
Okokugqibela, umntu unokuxoxa athi Peer-to-Patent ngumzekelo yokuqokelelwa kwedatha isasazwe. Ndikhetha sizidibanise njengoko umnxeba evulekileyo kuba ine isakhiwo ukhuphiswano-ezifana kwaye kuphela amagalelo angawona zisetyenziswa (kanti kunye nokuqokelelwa kwedatha zisasazwe, ingcamango iminikelo okulungileyo nokubi ingaphantsi ocacileyo).
Kuba engakumbi Netflix Prize, bona Bennett and Lanning (2007) , Thompson (2008) , Bell, Koren, and Volinsky (2010) , kunye Feuerverger, He, and Khatri (2012) . Vetshe FoldIt ubone, Cooper et al. (2010) , Andersen et al. (2012) , kunye Khatib et al. (2011) ; Inkcazelo wam FoldIt lutsala kwiinkcazo in Nielsen (2012) , Bohannon (2009) , kwaye Hand (2010) . Vetshe Peer-to-Patent, bona Noveck (2006) , Bestor and Hamp (2010) , Ledford (2007) , kunye Noveck (2009) .
Ngokufanayo iziphumo Glaeser et al. (2016) , Mayer-Schönberger and Cukier (2013) , iingxelo Isahluko 10 iinzuzo ezinkulu imveliso ye abahloli kwezindlu kwiSixeko saseNew York, xa zohlolo sikhokelwa imifuziselo ongaphambili. E New York City, le mifuziselo okulungiselelwe zakhiwa ngabasebenzi umzi, kodwa kwezinye iimeko, umntu unokucinga ukuba okufumaniweyo okanye ziphuculwe iminxeba evulekileyo (umzekelo, Glaeser et al. (2016) ). Noko ke, elinye inkxalabo enkulu kunye zisetyenziselwa imifuziselo okulungiselelwe kulwabiwo lwezibonelelo kukuba imifuziselo ezinokuliqhekeza ekubetheleleni umkhethe okhoyo. Abaphandi abaninzi sele uyazi "yenkunkuma, inkunkuma ngaphandle", kunye imifuziselo exelwe kunokuba "kwamacala, icala phandle." Yabona Barocas and Selbst (2016) kunye O'Neil (2016) ngaphezulu ngeengozi imifuziselo okulungiselelwe wakha nedatha uqeqesho edlelelelayo.
Enye ingxaki ukuze ukuthintela oorhulumente ekusebenziseni ngokhuphiswano evulekileyo kukuba ifuna ukukhululwa data, nto leyo enokukhokelela ukunyhashwa zabucala. Ngaphezulu malunga nekhusi nokukhululwa data imbiza evulekileyo ukubona Narayanan, Huey, and Felten (2016) kunye nengxoxo kwiSahluko 6.
Inkcazelo wam eBird lutsala kwiinkcazo in Bhattacharjee (2005) kunye Robbins (2013) . Ngokungaphaya ngokuba abaphandi basebenzise imifuziselo zamanani ukuhlalutya data eBird bona Hurlbert and Liang (2012) kunye Fink et al. (2010) . Kuba ngakumbi ngembali inzululwazi ummi ornothology, bona Greenwood (2007) .
Kuba engakumbi Malawi Iijenali Project, bona Watkins and Swidler (2009) kunye Kaler, Watkins, and Angotti (2015) . Kunye ngaphezulu iprojekthi enxulumene eMzantsi Afrika, bona Angotti and Sennott (2015) . Kuba imizekelo yophando usebenzisa data evela Project Malawi IiJenali ukubona Kaler (2004) kunye Angotti et al. (2014) .
indlela yam umcebise wawenzelwe zokuqala, olusekelwe phezu imizekelo yimpumelelo kwaye aliphumelelanga iiprojekthi intsebenziswano ubunzima ukuba Ndakhe ndeva. Kukho kwakhona njengomlambo yophando esizama ukusebenzisa iingcamango jikelele entlalweni nasengqondweni ukuba umyili uluntu oluselayinini ezinxulumene kuyilo lweeprojekthi intsebenziswano ubunzima, yabona, umzekelo, Kraut et al. (2012) .
Ngokuphathelele ukukhuthaza nxaxheba, nguwe kanye wawakhoakulula uku bana phandle kanye esibangela ukuba abantu bathathe inxaxheba kwiiprojekthi ubunzima ngentsebenziswano (Nov, Arazy, and Anderson 2011; Cooper et al. 2010, Raddick et al. (2013) ; Tuite et al. 2011; Preist, Massung, and Coyle 2014) . Ukuba uceba ukwenza nxaxheba kunye intlawulo kwimarike yabasebenzi micro-task (umzekelo, Amazon Mechanical Bonk) Kittur et al. (2013) unika ingcebiso ethile.
Ngokuphathelele eyenza ndothuka, kuba imizekelo izinto ezingalindelekanga kuphuma kweeprojekthi Zoouniverse, bona Marshall, Lintott, and Fletcher (2015) .
Ngokuphathelele ekubeni ezisesikweni, iintshayelelo ezilungileyo jikelele nemiba ezibandakanyekayo Gilbert (2015) , Salehi et al. (2015) , Schmidt (2013) , Williamson (2016) , Resnik, Elliott, and Miller (2015) , kunye Zittrain (2008) . Kuba imiba enxulumene ngqo kwimiba yomthetho kunye nabasebenzi isihlwele, bona Felstiner (2011) . O'Connor (2013) sijongene imibuzo malunga lokongamela yemikhwa uphando xa iindima abaphandi kunye nxaxheba imfobe. Kuba imiba enxulumene data yokwabelana ngoxa ebakhusela participats kwiiprojekthi inzululwazi ngummi, bona Bowser et al. (2014) . Zombini Purdam (2014) kunye Windt and Humphreys (2016) kufuneka ingxoxo malunga nemiba yokuziphatha ukuqokelelwa kwedatha isasazwe. Okokugqibela, iiprojekthi inkoliso yabo iyaqonda iminikelo kodwa musani ubuqambi ngetyala ukuba nxaxheba. Kwi Foldit, abadlali Foldit zidla zidweliswe njengombhali (Cooper et al. 2010; Khatib et al. 2011) . Kwezinye iiprojekthi umnxeba evulekileyo, negalelo eliphumelelayo ngokufuthi ukubhala iphepha echaza izisombululo yabo (umzkl, Bell, Koren, and Volinsky (2010) kunye Dieleman, Willett, and Dambre (2015) ). Kwi Galaxy Zoo usapho iiprojekthi, abanegalelo esebenzayo kakhulu kwaye ezibalulekileyo amaxesha bayamenywa ukuba intsebenziswano ababhali emaphepheni. Ngokomzekelo, uIvan Terentev kunye Tim Matorny, nxaxheba ababini Radio Galaxy Zoo ukusuka eRashiya, baba intsebenziswano-ababhali kwenye amaphepha eyavela kuloo projekthi (Banfield et al. 2016; Galaxy Zoo 2016) .