Qaybtan waxa loo qorsheeyay in lagu isticmaalo sida tixraac, halkii in la akhriyo sida sheeko.
Iskaashi Mass daryaa fikrado ka sayniska muwaadin, crowdsourcing, iyo sirdoonka wadareed. Sayniska Citizen sida caadiga ah waxay ka dhigan tahay ku lug leh "muwaadiniinta" (ie, non-saynisyahano) in habka cilmiyeed (Crain, Cooper, and Dickinson 2014) . Crowdsourcing sida caadiga ah waxay ka dhigan tahay qaadashada dhibaato badanaa xalin gudahood urur markaasaa beddelkiisii-keenidda in dad (Howe 2009) . Sirdoonka Collective sida caadiga ah waxay ka dhigan tahay kooxaha shaqsiyaadka simaha wadajir siyaabo in u muuqdaan kuwo caqli (Malone and Bernstein 2015) . Nielsen (2012) waa hordhac ah oo buug-dhererka cajiib galay xoogga iskaashiga mass cilmi sayniska.
Waxaa jira noocyo badan oo ka mid ah iskaashiga mass aan u hir geli saddexda qaybood aan soo jeediyay, waxaana qabaa saddex mudan yihiin fiiro gaar ah sababtoo ah waxa ay muhim u noqon kara cilmi bulsho barta qaar ka mid ah. Mid ka mid ah tusaale ahaan waa suuqyada saadaasha, halkaas oo ay ka qaybgalayaashu ka iibsan iyo heshiisyada ganacsiga ee la redeemable ku saleysan natiijooyinka kuwaas oo ka dhaca dunida (Wolfers and Zitzewitz 2004; Arrow et al. 2008) . Suuqyada Saadaalinta ayaa badanaa loo isticmaalaa by shirkadaha iyo dowladaha, waayo, oddoroska, iyo suuqyada saadaalinta ayaa sidoo kale loo isticmaalaa by cilmi bulsho in la saadaaliyo replicability ee cilmiga lagu daabacay cilmi nafsiga (Dreber et al. 2015) .
Tusaale A labaad oo aan si fiican u geli nidaamka Qoondayntani waa mashruuc PolyMath ah, halkaas oo cilmi gacan saar la isticmaalayo blogs iyo wikis inay caddeeyaan aragti cusub xisaabta (Gowers and Nielsen 2009; Cranshaw and Kittur 2011; Nielsen 2012; Kloumann et al. 2016) . Mashruuca PolyMath waa siyaabo qaar ka mid ah Prize Netflix, laakiin in ka qaybgalayaasha mashruuca PolyMath dheeraad ah si firfircoon uga dhisay on xalka qayb ka mid ah kuwa kale.
Tusaale A saddexaad oo aan si fiican u geli nidaamka Qoondayntani waa abaabul wakhti ku tiirsan sida Difaaca Advanced Research Mashaariicda Agency (DARPA) Network Challenge (ie, u Challenge Red buufin). Wixii dheeraad ah oo ku saabsan wakhtiga kuwan abaabul xasaasi arki Pickard et al. (2011) , Tang et al. (2011) , iyo Rutherford et al. (2013) .
Ereyga "xisaabinta aadanaha" soo baxa shaqada sameeyey by saynisyahano computer, iyo fahamka macnaha guud ee ka dambeeya cilmi hagaajin doonaa awoodda aad u soo qaado dhibaatooyinka laga yaabo kasteba waa in. Waayo, hawlaha qaarkood, kombiyuutarada waa cajiib awood leh awoodaha fog iyo aad u aadanuhu xitaa khabiir. Tusaale ahaan, in chess, kombiyuutarada garaaci karaan xataa sayid fiican grand. Laakiin-kanna waa ka yar iyo sidoo mahadiyo bulshada saynisyahano-for hawlo kale, kombiyuutarada dhab yihiin wax badan ka xun dadka. In si kale loo dhigo, hadda aad ka khayr badan xitaa computer ugu casri ah ee hawlaha qaarkood ku lug processing ee images, video, audio, iyo qoraalka. Sayidka-sidii lagu muujiyey by a XKCD cajiib cartoon-jira hawlaha waa in u fududahay kombiyuutarada iyo adag oo loogu talagalay dadka, laakiin sidoo kale waxaa jira hawlo in ay adag tahay, waayo, kombiyuutarada iyo fududahay dadka (Jaantuska 5.13). saynisyahano Computer ka shaqeeya, kuwaas oo ay adag tahay-for-kombiyuutarada-fudud-for-insaanka hawlaha, haddaba sidaas daraaddeed, ogaaday in ay ka mid noqon kara dadka in ay habka xisaabeed. Halkan sida Luis von Ahn (2005) ku tilmaamay xisaabinta aadanaha marka ugu horreysa ee uu asal ahan dheer ee uu PhD-: ". Qaabka a for isticmaalka awoodda processing aadanaha si ay u xaliyaan dhibaatooyinka kombiyuutarada oo aan weli xal u heli karo"
Marka la qeexo this FoldIt-oo aan ku tilmaamay in qeybta on furan oo ku baaqay in-laga yaabaa in loo tixgeliyo mashruuc xisaabinta aadanaha. Si kastaba ha ahaatee, waxaan doorto inay guraan FoldIt sida call furan maxaa yeelay waxa ay u baahan tahay xirfado gaar ah iyo waxa ay qaadataa xalka ugu wanaagsan halkii ay qeyb ka tahay isticmaalka kala-dalban-geeyo istaraatijiyad.
Wixii daaweyn ah oo dhererkiisu buug fiican oo ah xisaabinta aadanaha, in dareenka ugu guud ee muddada, arki Law and Ahn (2011) . Cutubka 3 of Law and Ahn (2011) ayaa dood xiiso leh oo ka adag isku tallaabooyin badan kuwa ku jira cutubkan.
Ereyga "kala-dalban-geeyo" waxaa loo isticmaalaa by Wickham (2011) si ay u sharxaan istiraatiijiyad ah Kombuyuutarada tirakoobka, laakiin waxa ay si fiican u qabsada hanaanka mashaariic badan xisaabinta aadanaha. Kala-dalban-geeyo istaraatijiyad ayaa waxay la mid tahay qaabka MapReduce horumartay ee Google (Dean and Ghemawat 2004; Dean and Ghemawat 2008) .
Laba mashaariicda xisaabinta aadanaha xariif ah in aanan haysan meel ay uga wada hadlaan waa Game gaar ah (Ahn and Dabbish 2004) iyo reCAPTCHA (Ahn et al. 2008) . Labada mashaariic kuwan helay siyaabo hal abuur leh si ay u dhiiri ka qaybgalayaasha in ay bixiyaan sumadaha on images. Si kastaba ha ahaatee, labada mashaariic kuwan ayaa sidoo kale su'aalo anshax sababtoo ah, ka duwan Galaxy Zoo, ka qaybgalayaasha in Game gaar ahaan iyo reCAPTCHA ma aqoon sida ay xogta la isticmaalo (Lung 2012; Zittrain 2008) .
Waxaa dhiirigelintiisa lahaa Game gaar ah, cilmi badan ayaa isku dayay in la horumariyo dadka kale "kulan la ujeeddo" (Ahn and Dabbish 2008) (ie, "kulan xisaabinta aadanaha ku salaysan" (Pe-Than, Goh, and Lee 2015) ) in ay noqon kartaa loo isticmaalaa in lagu xalliyo kala duwan ee dhibaatooyinka kale. Waa maxay "kulan la ujeeddo" leeyihiin in caadiga ah waa in ay isku dayaan in ay sameeyaan hawlaha ku lug leh xisaabinta aadanaha xiiso leh. Sidaas darteed, halka Game gaar ahaan ku qaybsada isla kala-dalban-isku-dhismeedka la Galaxy Zoo, waxa ay ka duwan tahay sida qaybgalayaasha waxa laga niyad-xiiso vs. doonayaan in la caawiyo sayniska.
My description ee Galaxy Zoo barbaro on Nielsen (2012) , Adams (2012) , Clery (2011) , iyo Hand (2010) , iyo bandhigo gool cilmi of Galaxy Zoo la fududeeyey. Wixii dheeraad ah oo ku saabsan taariikhda soocidda Galaxy ee xiddigaha iyo sida Galaxy Zoo sii dhaqanka this, ka eeg Masters (2012) iyo Marshall, Lintott, and Fletcher (2015) . Building on Galaxy Zoo, cilmi dhameystirtay Galaxy Zoo 2 oo laga soo ururiyey in ka badan 60 milyan oo dheeraad ah kala saaro morphological adag ka mutadawiciin (Masters et al. 2011) . Dheeraad ah, waxay jahaysteen baxay dhibaatooyin ka baxsan fataahadda Galaxy oo ay ku jiraan sahaminta dusha sare ee dayaxa, Boogaadin meerayaasha, leexiyo waraaqaha jir. Currently, mashaariicda oo dhan la ururiyey ee www.zooniverse.org (Cox et al. 2015) . Mid ka mid ah mashaariicda-Sawirka Serengeti-bixisaa caddayn in mashaariicda image soocidda nooca Zoo-Galaxy ayaa sidoo kale waxaa la samayn karaa cilmi deegaanka (Swanson et al. 2016) .
Wixii cilmi qorshaynayso inay u isticmaasho suuqa shaqada micro-hawl (tusaale, Amazon Farsamada Turk) mashruuc xisaabinta aadanaha, Chandler, Paolacci, and Mueller (2013) iyo Wang, Ipeirotis, and Provost (2015) waxay bixiyaan talo wanaagsan on design hawsha iyo arimaha kale ee la xiriira.
Cilmi xiiso abuuro waxa aan loo yaqaan nidaamka xisaabinta aadanaha qarniga labaad (tusaale ahaan, nidaamka in ay isticmaalaan sumadaha aadanaha si ay u tababaraan model waxbarashada mashiinka a) waxaa laga yaabaa xiiso Shamir et al. (2014) (tusaale ahaan ah iyadoo la isticmaalayo audio) iyo Cheng and Bernstein (2015) . Sidoo kale, mashaariic kuwan la samayn karaa iyada oo ku baaqay furan, ku dheehan cilmi tartamaan si ay u abuuraan daydo waxbarashada mashiinka la waxqabadka ugu weyn saadaal ah. Tusaale ahaan, kooxda Galaxy Zoo orday call furan oo laga helay hab cusub oo mustawaha mid horumartay ee Banerji et al. (2010) ; arki Dieleman, Willett, and Dambre (2015) wixii faahfaahin ah.
wicitaanada Open aan ku cusub. Dhab ahaantii, mid ka mid ah wicitaanada furan ugu fiican u yaqaan taariikhda dib u 1714 markii Baarlamaanka Britain ee abuuray Longtitude Prize ee qof in dhici karta hab lagu ogaado dhigaha ee markab badda. Dhibaatada xaqal badan oo saynisyahano ugu weyn ka mid ah maalmaha, oo ay ku jiraan Isaac Newton, iyo xal guusha waxaa ugu danbeyn soo gudbiyeen clockmaker ka baadiyaha, kuwaas oo soo dhawaaday dhibaato ka saynisyahano kuwaas oo diiradda on xal in bartey ku lug lahaa xiddigaha kala duwan (Sobel 1996) . Tusaale ahaan this muujinayaa, hal sabab in wicitaanada furan ayaa loo maleynayaa in si fiican u shaqeeyo waa in ay bixiyaan helitaanka dadka qaba fikradaha iyo xirfadaha kala duwan (Boudreau and Lakhani 2013) . Eeg Hong and Page (2004) iyo Page (2008) waayo badan oo ku saabsan qiimaha kala duwan ee xalinta dhibaatada.
Mid kasta oo ka mid ah xaaladaha call furan cutubkii u baahan tahay xoogaa sharaxaad dheeraad ah sababta ay iska leh in this category. First, hal hab si aan u kala saaro xisaabinta aadanaha iyo mashaariicda call u furan waa in wax soo saarka waa celcelis ahaan xal dhan (xisaabinta aadanaha) ama xalka ugu wanaagsan (call furan). Netflix Prize waa xoogaa adag in arrintan la xiriira, sababtoo ah xalka ugu wanaagsan soo baxday in celcelis ahaan a casri ah oo xal shaqsiyadeed, an soo dhawaaday yeedhay xal galidoonaan (Bell, Koren, and Volinsky 2010; Feuerverger, He, and Khatri 2012) . Marka laga eego dhinaca Netflix, si kastaba ha ahaatee, waxay lahaayeen in la sameeyo oo dhan qaado xalka ugu wanaagsan.
Second, by qeexidda qaar ka mid ah xisaabinta aadanaha (tusaale ahaan, Von Ahn (2005) ), waa in la tixgeliyaa FoldIt mashruuc xisaabinta aadanaha. Si kastaba ha ahaatee, waxaan doorto inay guraan FoldIt sida call furan maxaa yeelay waxa ay u baahan tahay xirfado gaar ah iyo waxa ay qaadataa xalka ugu wanaagsan ka qayb qaatay, halkii la isticmaalayo kala-dalban-geeyo istaraatijiyad.
Ugu dambeyntii, mid ka doodi karaa in Peer-to-macay waa tusaale ka mid ah ururinta xogta loo qaybiyey. Waxaan doortaan in ay u waxaa ka mid ah sida call furan, sababtoo ah waxa uu leeyahay qaab-dhismeedka tartanka-sida a oo kaliya qaaraan ugu fiican waxaa loo isticmaalaa (halka la ururinta xogta qaybiyey, fikradda ah ku darsaday wanaagsan iyo kuwa xun waa ka yar cad).
Wixii dheeraad ah oo ku Prize Netflix ah, arki Bennett and Lanning (2007) , Thompson (2008) , Bell, Koren, and Volinsky (2010) , iyo Feuerverger, He, and Khatri (2012) . Wixii dheeraad ah oo ku FoldIt arko, Cooper et al. (2010) , Andersen et al. (2012) , iyo Khatib et al. (2011) ; aan sharaxaad of FoldIt barbaro on sharaxaada in Nielsen (2012) , Bohannon (2009) , iyo Hand (2010) . Wixii dheeraad ah oo ku Peer-to-macay, arki Noveck (2006) , Bestor and Hamp (2010) , Ledford (2007) , iyo Noveck (2009) .
Similar in natiijada Glaeser et al. (2016) , Mayer-Schönberger and Cukier (2013) , Cutubka 10 wararka guulaha waaweyn ee wax soo saarka ee kormeerayaasha guryaha ee New York City marka kormeer ku hanuunsanahay by daydo saadaal ah. In City New York, kuwaas oo lagu daydo saadaal la dhisay by shaqaalaha magaalada, laakiin xaaladaha kale, mid ka mid ah qiyaasi kartaa in ay la abuuri karo ama hagaagtay la wicitaanada furan (tusaale, Glaeser et al. (2016) ). Si kastaba ha ahaatee, mid ka mid ah walaac ugu weyn ee la daydo saadaal la isticmaalay si loo qaybiyo khayraadka waa in lagu daydo u leeyihiin awood u leh in la xoojiyo eexasho jira. Cilmi badan oo hore u "soo baxay qashinka ee, qashinka" ogaan, iyo nadaam saadaal ah waxay noqon kartaa "eexda in, eexda soo baxay." Eeg Barocas and Selbst (2016) iyo O'Neil (2016) waayo badan oo ku saabsan khataraha daydo saadaal dhisay macluumaadka tababar u janjeeraa dhinac.
Mid ka mid ah dhibaato laga yaabo in looga hortago in dawladaha ka isticmaalaya tartanka furan waa in ay u baahan tahay in la sii daayo macluumaadka, taas oo keeni karta in ay xadgudubyada gaarka ah. Wixii dheeraad ah oo ku saabsan arimaha gaarka ah iyo in la sii daayo macluumaadka in wicitaanada furan arki Narayanan, Huey, and Felten (2016) iyo dood ee ku xusan cutubka 6.
My sharaxaad of eBird barbaro on sharaxaada in Bhattacharjee (2005) iyo Robbins (2013) . Wixii dheeraad ah oo ku saabsan sida cilmi isticmaali daydo tirakoobka si ay u falanqeeyaan xogta eBird arki Hurlbert and Liang (2012) iyo Fink et al. (2010) . Wixii dheeraad ah oo ku saabsan taariikhda sayniska muwaadin ee ornothology, arki Greenwood (2007) .
Wixii dheeraad ah oo ku joornaalada Project Malawi ah, arki Watkins and Swidler (2009) iyo Kaler, Watkins, and Angotti (2015) . Oo badan oo ku saabsan mashruuc la xiriira ee South Africa, arki Angotti and Sennott (2015) . Wixii tusaalooyin dheeraad ah oo macluumaadka cilmi baadhista la isticmaalayo ka Project Malawi joornaalada ka arki Kaler (2004) iyo Angotti et al. (2014) .
My hab si bixiya talo design ahaa yeelista, oo ku salaysan tusaalayaal guul iyo guuldareystay mashaariic iskaashi ballaaran oo aan maqlay oo ku saabsan. Waxa kale oo jira durdur ah cilmi-isku dayaysa in ay codsan aragtiyaha nafsi guud bulshada si la dhigaayo bulshada online in ay haboon tahay in design ah ee mashaariicda iskaashiga mass, arki, tusaale ahaan, Kraut et al. (2012) .
Marka laga qayb-galayaasha dhiiri, waa run ahaantii arrin adag in ogaado si sax ah sababta ay dadku ka qeyb qaataan mashaariicda iskaashiga mass (Nov, Arazy, and Anderson 2011; Cooper et al. 2010, Raddick et al. (2013) ; Tuite et al. 2011; Preist, Massung, and Coyle 2014) . Haddii aad qorsheyneysid inaad ku dhiiri ka qaybgalayaasha lacagta suuqa shaqada micro-hawl (tusaale, Amazon Farsamada Turk) Kittur et al. (2013) waxay bixisaa talo qaar ka mid ah.
Marka laga awood la yaab leh, waayo, tusaalooyin badan oo daahfurtay in aan la filayn ka soo baxay mashaariicda Zoouniverse, arki Marshall, Lintott, and Fletcher (2015) .
Marka laga isagoo anshaxa, qaar ka mid isbarasho guud fiican in arrimaha ku lugta leh waa Gilbert (2015) , Salehi et al. (2015) , Schmidt (2013) , Williamson (2016) , Resnik, Elliott, and Miller (2015) , iyo Zittrain (2008) . Wixii arimo gaar ah oo la xiriira arrimaha sharciga la shaqaalaha badnaa, arki Felstiner (2011) . O'Connor (2013) ka qabanayaa su'aalo ku saabsan kormeer anshaxa cilmi markii doorarka cilmibaadhayaal iyo ka qaybgalayaasha qasayo. Waayo, arrimaha la xiriira xogta la wadaago iyadoo la ilaalinayo participats mashaariicda sayniska muwaadin, arki Bowser et al. (2014) . Labada Purdam (2014) iyo Windt and Humphreys (2016) ay leeyihiin qaar ka mid ah wada hadal ku saabsan arrimaha anshaxa in ururinta xogta loo qaybiyey. Ugu dambeyntii, mashaariicda ugu qiro darsaday laakiin ma siin credit qoray in ka qayb-galayaasha. In Foldit, ciyaartoyda Foldit waxaa inta badan ku qoran sida qoraaga ah (Cooper et al. 2010; Khatib et al. 2011) . In mashaariicda kale ee u furan call, geysato guusha inta badan soo qori kartaa warqad ku tilmaamay xal ay (tusaale ahaan, Bell, Koren, and Volinsky (2010) iyo Dieleman, Willett, and Dambre (2015) ). In qoyska Galaxy Zoo mashaariic, qayb aad u firfircoon oo muhiim ah ayaa mararka qaar lagu casuumay in ay wada-qorayaasha on waraaqaha. Tusaale ahaan, Ivan Terentev iyo Tim Matorny, laba ka qaybgalayaasha Radio Galaxy Zoo ka Russia, waxay ahaayeen co-qorayaasha on mid ka mid ah Wargeysyada ka soo kacday ka mashruuca ah in (Banfield et al. 2016; Galaxy Zoo 2016) .