Karolong ena e reretsoe ho sebelisoa e le ya referense eo e neng e e-na le ho bala e le phetoang.
Boima tshebedisano e nyalana mehopolo tsoang moahi saense, crowdsourcing, le bohlale kopanetsweng. Moahi saense ea bitsoang ka tlwaelo ho bolela amang "baahi" (khr, bao e seng bo-rasaense) ya thulaganyo e libuka tsa saense (Crain, Cooper, and Dickinson 2014) . Crowdsourcing ka tlwaelo bolela ho bothata ka tlwaelo rarolla ka hare ho mokhatlo o hlophisitsoeng 'me ho e-na outsourcing ae sebelisetsa ho etsa bongata bo (Howe 2009) . Kopanetsweng dihlwedi ka tlwaelo ho bolela lihlopha tsa batho ka bomong emelang mmoho ka litsela tse bonahalang tse bohlale (Malone and Bernstein 2015) . Nielsen (2012) ke buka e babatsehang-bolelele qala ho sebelisoa matla a tshebedisano bongata bakeng sa ho etsa lipatlisiso tsa saense.
Ho na le mefuta e mengata ya tirisanommogo boima hore u se ke ua lumellane ka makhethe tsa limakasine ka lihlopha tse tharo tse I sisintsweng, 'me ke nahana tharo tšoaneloa lebisa tlhokomelo e khethehileng hobane ba ka' na ba molemo ka ho etsa lipatlisiso tsa phedisano ka ntlha e itseng. Mohlala o mong ke limmaraka bolela lintho esale pele, moo barupeluoa reka le dikontraka il'o hoeba tse rekolloa thehiloeng diphetho tse etsahalang lefatšeng (Wolfers and Zitzewitz 2004; Arrow et al. 2008) . Boleloa esale pele ka limmaraka ba atisa ho sebelisoa ke lifeme le mebuso bakeng bonelang, 'me boleloa esale pele ka limmaraka le tsona li sebelisoa ke bafuputsi tsoang sechabeng ho noha replicability ea lithuto tsa hatisitsoeng ka kelello (Dreber et al. 2015) .
A mohlala bobeli ke hore ha e lumellane hantle ho kena categorization leqheka lena ka ke projeke PolyMath, moo bafuputsi sebelisana sebelisa Blogs le wikis ho paka theorems e ncha ea lipalo (Gowers and Nielsen 2009; Cranshaw and Kittur 2011; Nielsen 2012; Kloumann et al. 2016) . Ngoe kahong eo PolyMath ke ka tsela e itseng e tšoanang le ea Netflix Moputso, empa ha barupeluoa PolyMath projeke eketsehileng ka mafolofolo hahiloeng tharollo leeme la ba bang.
A mohlala la boraro seo ha se lumellane ho fihlela categorization leqheka lena ka ke mobilizations nako e itšetlehileng ka tse kang Defense Advanced Research Projects Agency (DARPA) Network Bothata (khr, le Lefubelu Balloon Bothata). Bakeng sa ka nako tsena mobilizations mamelang le e ikemiselitseng ho bona Pickard et al. (2011) , Tang et al. (2011) , le Rutherford et al. (2013) .
Poleloana e reng "botho balelela" tsoa mosebetsing o etsoang ke bo-rasaense ba k'homphieutha, le ho utloisisa moelelo oa taba ka morao ho etsa lipatlisiso sena se tla ntlafatsa bokhoni ba hao ba ho nka mathata a ka 'nang ba amenable ho eona. Bakeng sa ditshebetso tse itseng, lik'homphieutha li Hoa makatsa hore ebe matla ka bokgoni tla fihlela joale feteng batho esita setsebi. Ka mohlala, ka gago ka ba, lik'homphieutha ka otla esita le molemo ka ho fetisisa benghali hlollang. Empa-'me sena se ka tlaase ho moo hantle ananelang litsebi tsa kahisano-bakeng sa ditshebetso tse ding, lik'homphieutha le hantle mpe ho feta batho. Ka mantsoe a mang, le hona joale o molemo le ho feta ya hau khomputareng u rarahaneng ka ho fetisisa mesebetsing e itseng e amanang le ho e lokisa ya litšoantšo, video, mamelwang, 'me taba e ngotsoeng. Kahoo-joalokaha ho ile ha bontšoa ke e babatsehang XKCD qabolang-na le mesebetsi eo ke bonolo hore lik'homphieutha le thata bakeng sa batho ba, empa ho na le boetse ho na le mesebetsi eo ke e thata bakeng sa lik'homphieutha le bonolo hore batho ba (Figure 5.13). Computer bo-rasaense ba sebetsa tsena thata-ka-lik'homphieutha-eo ho leng bonolo bakeng-botho mesebetsi e meng ntle, ka hona, o ile a hlokomela hore ba ka kenyeletsa batho ka tiriso ya thulaganyo bona dikhomphuitha. Mona 's kamoo Luis av Ahn (2005) hlalosoa balelela botho ha a qala ho qaptjoa lentsoe lena ka puong ea hae: ". Sa paradigm bakeng ts'ebelisong e lokisa botho matla a ho rarolla mathata a hore lik'homphieutha ka e e-s'o rarolla"
Ke tlhaloso ena FoldIt-e leng seo ke hlalosoa karolong konopo e bulelang bulehetse di-call-a ka nkoa e le tsa botho balelela projeke. Leha ho le joalo, ke khetha ho mekgahlelo ho FoldIt joalokaha letsetsa bulehileng hobane e hloka fumants'a litsebo tsa e khethehileng le ho nka tharollo e molemohali tlatselitse ho e-na a sebelisa petsoha-amang-kopana leano lena.
Etsoe o babatsehang bukeng bolelele kalafo ea balelela batho, ka kutloisiso fetisisa kakaretso ea lentsoe, bona Law and Ahn (2011) . Khaolo ea 3 ea Law and Ahn (2011) e na le puisano e susumetsang e thahasellisang ka mehato e rarahaneng ho feta kopana feta ba khaolong ena.
Poleloana e reng "e petsoha-amang-kopana 'e ne e sebelisetsoa ke Wickham (2011) ho hlalosa ka leano la dikhomphiutha dipalopalo, empa e ho phethahetseng hapa tshebetso ya ho diporojeke tse ngata balelela batho. The petsoha-amang-kopana leqheka leo e tšoana le ea MapReduce moralo wa pele nakong Google (Dean and Ghemawat 2004; Dean and Ghemawat 2008) .
'Meli bohlale botho balelela diprojeke tse ke ne ke sa ja sebaka se sengata ho buisana ke ESP Game (Ahn and Dabbish 2004) le reCAPTCHA (Ahn et al. 2008) . Ka bobeli ea merero tsena fumana litsela tsa ho bōpa ho re susumelletsa barupeluoa ho fana ka se ngotsweng litšoantšo. Leha ho le joalo, ka bobeli ea merero tsena boetse tsosoa lipotso tse boitshwaro hobane, ho fapana le Galaxy Zoo, barupeluoa ba ka ESP Game le reCAPTCHA ne ke sa tsebe hore na ya data bona e ile ea e sebelisoa (Lung 2012; Zittrain 2008) .
Bululetsoeng ke ESP Game, bafuputsi ba bangata ba leka ho hlahisa ba bang "lipapali tsa le morero oa e le" (Ahn and Dabbish 2008) (khr, "botho thehiloeng balelela lipapali tsa" (Pe-Than, Goh, and Lee 2015) ) e ka ba sebelisoa ho rarolla mefuta e fapaneng ya mathata a mang. Seo batho bana ba "bapala lipapali tse itseng e nang le morero" li tšoana ke hore ba lekang ho etsa hore mesebetsi eo ameha balelela botho bo thabisang. Kahoo, le hoja qalong ESP Game arolelanang e le 'ngoe e arohaneng-amang-kopana sebopeho le Galaxy Zoo, ho fapana le tseleng eo barupeluoa ba susumetsoa-monate vs takatso ea ho thusa saense.
Tlhaloso ea ka ea Galaxy Zoo hulela ka la Nielsen (2012) , Adams (2012) , Clery (2011) , le Hand (2010) , le nehelano ea ka ea lipakane tsa patlisiso ea la Galaxy Zoo ile tsela e bonolo. Etsoe eketsehileng mabapi le histori ea galaxy tlhophiso thutong ea linaleli le kamoo Galaxy Zoo tsoela pele neano ena, sheba Masters (2012) le ho Marshall, Lintott, and Fletcher (2015) . Moaho Galaxy Zoo, bafuputsi phethoa Galaxy Zoo 2 e leng bokella ba fetang limilione tse 60 tse rarahaneng classifications morphological tsoang baithaopi (Masters et al. 2011) . Ho ekelletsa moo, ba ile ba se makala a ka ntle mathata ka ntle ho galaxy phetoho ho akarelletsa hlahloba holim 'a khoeli, ho batla lipolanete le fetolela ho fumana litokomane tsa boholo-holo. Hona joale, diporojeke tsohle tsa bona bokelloa nakong www.zooniverse.org (Cox et al. 2015) . E mong oa mesebetsi eo e-setshwantshotsepamo Serengeti-e fana ka bopaki ba hore Galaxy Zoo-mofuta wa sebaka setšoantšo tlhophiso diporojeke ka boela entseng bakeng sa phuputso tsa tikoloho (Swanson et al. 2016) .
Etsoe babatlisisi rera ho sebelisa dikokwanyana mosebetsi o mmaraka wa mosebetsi (mohlala, Amazon Mechanical Turk) bakeng sa palelelo projeke batho, Chandler, Paolacci, and Mueller (2013) le ho Wang, Ipeirotis, and Provost (2015) fana ka keletso e ntle ho mosebetsi o rala le ho tse ling litaba tse amanang.
Bafuputsi thahasella ho bōpa seo ke 'nile ka bitsoa tloha molokong o mong oa bobeli balelela botho litsamaiso (mohlala, litsamaiso tse neng li sebelisa dileibole botho ho koetlisa mochine ithuta ea mohlala) U lokela ho thahasella Shamir et al. (2014) (mohlala e sebelisa mamelwang) le Cheng and Bernstein (2015) . Hape, diporojeke tsena ka etsoang le di-call bulehileng, oo ka oona bafuputsi phehisana ho bopa dikai mochine ithuta le tshebetso khōlō ka ho fetisisa ho lepa. Ka mohlala, palo ea sehlopha e Galaxy Zoo matha e pitso bulehetse 'me ba fumana tsela e ncha eo outperformed e mong' ntshetswa pele a Banerji et al. (2010) ; sheba Dieleman, Willett, and Dambre (2015) bakeng sa dintlha.
-call Open hase ntho e ncha. Ha e le hantle, e mong oa pitso ea ho fetisisa tse tsebahalang li butsoe khale 1714 ha Paramente Brithani o bōpile The Longitude Moputso le mang kapa mang e ka hlahisa tsela ea ho fumana hore na Longitude oa sekepe leoatleng. Bothata stumped tse ngata tsa bo-rasaense khōlō ka ho fetisisa ea matsatsi, ho akarelletsa le Isaac Newton, 'me tharollo hapa e ile romelwa ke clockmaker ho tloha mahaeng ba neng ba atamela bothata tsela e fapaneng le bo-rasaense ba neng ba amehile ka tharollo e neng e tla ka tsela e itseng ho akarelletsa tsebo ea linaleli (Sobel 1996) . Ka mohlala sena se bontša, lebaka le leng hore di-call bulehetse ba nahana hore ba sebetse hantle ke hore ba fane ka phihlello ho batho ba nang le tshwaneng fapaneng le bokgoni (Boudreau and Lakhani 2013) . Sheba Hong and Page (2004) le Page (2008) bakeng sa tse eketsehileng mabapi le bohlokoa ba ho mefuta-futa a lokisa mathata.
E mong le e ea linyeoe pitso lumeletsoe ka molao khaolo e hloka a batla a ea tlhaloso ka ho eketsehileng bakeng sa hobane'ng ha ho ke a sehlopha sena. Taba ea pele, tsela e 'ngoe eo ke e khetholla pakeng tsa balelela batho le mererong eo ea kaho bulehetse pitso ke hore na khumo ke karolelano ea litharollo tsohle (balelela botho) kapa tharollo e molemohali (bulehetse pitso). The Netflix Moputso ke a batla a le qhekellang ntlheng ena hobane tharollo e molemohali reteleha ho ba karolelano e tsoetseng pele ea litharollo motho ka mong, e leng ba atamela bitsoa tharollo libini (Bell, Koren, and Volinsky 2010; Feuerverger, He, and Khatri 2012) . Ho tswa lehlakoreng la Netflix Leha ho le joalo, kaofela ba ne ba ho etsa e ne e nka tharollo e molemohali.
Ea bobeli, ba bang ba litlhaloso tsa balelela botho (mohlala, Von Ahn (2005) ), FoldIt lokela ho nkoa e le tsa botho balelela projeke. Leha ho le joalo, ke khetha ho mekgahlelo ho FoldIt joalokaha letsetsa bulehileng hobane e hloka fumants'a litsebo tsa e khethehileng le ho nka tharollo e molemohali tlatselitse, ho e-na a sebelisa petsoha-amang-kopana leano lena.
Qetellong, e mong o ne a pheha khang ea hore lithaka-to-Patent ke mohlala oa pokello aba ya data. Ke khetha ho kenyeletsa eona e le letsetsa bulehileng hobane e na le sebopeho sa Tlholisanong-joaloka 'me feela menehelo molemo ka ho fetisisa sebelisoa (athe le pokello aba ya data, khopolo ea menehelo botle le bobe ka tlaase hlakileng).
Bakeng sa ka Netflix Moputso, sheba Bennett and Lanning (2007) , Thompson (2008) , Bell, Koren, and Volinsky (2010) , le Feuerverger, He, and Khatri (2012) . Etsoe eketsehileng mabapi le FoldIt bona, Cooper et al. (2010) , Andersen et al. (2012) , le Khatib et al. (2011) ; tlhaloso ea ka ea FoldIt hulela ka la litlhaloso a Nielsen (2012) , Bohannon (2009) , le Hand (2010) . Etsoe eketsehileng mabapi le Lithaka-to-Patent, sheba Noveck (2006) , Bestor and Hamp (2010) , Ledford (2007) , le Noveck (2009) .
E tšoanang le liphello tsa Glaeser et al. (2016) , Mayer-Schönberger and Cukier (2013) , Khaolong ea 10 litlaleho tse finyeletsoeng kholo ka tlhahiso ya bahlahlobi matlo a New York City ha inspections ba tataisoa ke dikai lepa. New York City, dikai tsena lepa ile ha hahoa ke bahiruoa motse, empa maemong a mang, ho motho ea ka nahana hore ba ne ba ka bōptjoa kapa ntlafala le di-call bulehetse (mohlala, Glaeser et al. (2016) ). Leha ho le joalo, ho ameha e le 'ngoe e khōlō dikai lepa e sebelisoa ho di abelang dipaka mehlodi ya ke hore dikai ba na le bokhoni ba ho matlafatsa biases teng. Bafuputsi ba bangata ba se a ntse a tseba "lithōle a, lithōle tsoa", 'me ka dikai lepa ho ka ba "leeme ka, leeme tsoa." See Barocas and Selbst (2016) le ho O'Neil (2016) bakeng sa tse eketsehileng mabapi le likotsi tsa ho dikai lepa hahiloeng le ya data leeme thupelo.
bothata e le 'ngoe e ka' nang a thibela mebuso ho sebelisa litlhōlisano bulehile e le hore e hloka hore data ya ho lokolloa, e leng ne a ka lebisa ditlolo a ba sephiring. Etsoe ho eketsehileng ka sephiri mme ya data lokolloe ka di-call bulehetse bona Narayanan, Huey, and Felten (2016) le puisano Khaolong ea 6.
Tlhaloso ea ka ea eBird hulela ka la litlhaloso a Bhattacharjee (2005) le ho Robbins (2013) . Etsoe eketsehileng mabapi le kamoo bafuputsi ba sebelisa dikai dipalopalo ho sekaseka ya data eBird bona Hurlbert and Liang (2012) le ho Fink et al. (2010) . Etsoe eketsehileng mabapi le histori ea moahi saense ornothology, sheba Greenwood (2007) .
Bakeng sa ka Malawi limakasine Project, sheba Watkins and Swidler (2009) le ho Kaler, Watkins, and Angotti (2015) . Le bakeng sa eketsehileng mabapi le morero tse amanang Afrika Boroa, sheba Angotti and Sennott (2015) . Bakeng sa mehlala eketsehileng ea ho etsa lipatlisiso a sebelisa ya data ho tloha Malawi limakasine Project bona Kaler (2004) le ho Angotti et al. (2014) .
katamelo ea ka ea ho fana ka boqapi ba bona ho kopa keletso ne inductive, e thehiloeng ka mehlala ea atlehileng le hlōlehileng ho phethahala diporojeke boima tshebedisano hore ke 'nile ka utloa ka. Ho boetse ho na le molapo oa ho etsa lipatlisiso ho leka ho etsa ho eketsehileng kakaretso tsoang sechabeng likhopolo kelello ho qapa baahi ba metse Inthaneteng ke hore tshwanetseng ho tla etsa meralo ea diporojeke boima tshebedisano, ho bona, ho etsa mohlala, Kraut et al. (2012) .
Mabapi le susumetsang barupeluoa, ho ke ke ha e le hantle haholo le qhekellang ho utloisisa hore na hantle-ntle ke hobane'ng ha batho ba le seabo mererong boima tshebedisano (Nov, Arazy, and Anderson 2011; Cooper et al. 2010, Raddick et al. (2013) ; Tuite et al. 2011; Preist, Massung, and Coyle 2014) . Haeba u rera ho susumelletsa barupeluoa ba nang le tefo mabapi le 'marakeng e le mosebetsi o boima dikokwanyana mosebetsi o (mohlala, Amazon Mechanical Turk) Kittur et al. (2013) e fana ka keletso e itseng.
Mabapi nolofalletsa makala ha mehlala eketsehileng sibolloeng sa lebelloang ho tsoa mererong eo ea kaho Zoouniverse, sheba Marshall, Lintott, and Fletcher (2015) .
Mabapi le ho ba boitshwaro, ba bang molemo tumeliso kakaretso litabeng tse amehang li Gilbert (2015) , Salehi et al. (2015) , Schmidt (2013) , Williamson (2016) , Resnik, Elliott, and Miller (2015) , le Zittrain (2008) . Etsoe litokollo ho toba e amanang le litokollo tsa semolao le basebetsi bongata, bona Felstiner (2011) . O'Connor (2013) o bua le lipotso mabapi le bolebeli boitshwaro ba etsa lipatlisiso tse ha karolo e phethoang ke bafuputsi le barupeluoa ea fifatsa. Etsoe litaba tse amanang le ho abelana lintho ya data ha a ntse a sireletsa participats a moahi diporojeke saense, bona Bowser et al. (2014) . Ka bobeli Purdam (2014) le ho Windt and Humphreys (2016) ba bang ba bua ka litaba tse boitshwaro a pokello aba ya data. Qetellong, merero ho fetisisa ananela menehelo empa u se ke ua fana ka eena mongoli ho reka ka mokitlane ho barupeluoa. A Foldit, libapali li sa Foldit ba atisa ho tse thathamisitsoeng joalokaha mongoli e (Cooper et al. 2010; Khatib et al. 2011) . Mererong e meng bulehetse mohala, e nang le seabo ho hapa ka hangata ho ngola pampiri e hlalosang litharollo tsa bona (mohlala, Bell, Koren, and Volinsky (2010) le ho Dieleman, Willett, and Dambre (2015) ). Ka Galaxy Zoo lelapa la merero, phehisa a sebetsang a fetisisa le oa bohlokoa ka linako tse ling memeloa ho ba sebedisana bangodi mabapi le lipampiri. Ka mohlala, Ivan Terentev le Tim Matorny, ba babeli Radio Galaxy Zoo barupeluoa ho tloha Russia, e ne e sebedisana bangodi ho se seng sa lipampiri tse ileng ba hlaha tsoang projeke eo (Banfield et al. 2016; Galaxy Zoo 2016) .