Seo u lokelang ho se bala ka mor'a moo
- Selelekela (karolo ea 5.1)
Bohokahanyi ba masisa bo kopanya maikutlo a tsoang ho baahi ba saense , ho bokella batho ba bangata le ho ba le bohlale . Hangata saense ea baahi e bolela ho "baahi" (ke hore, litsebi tsa saense) ka mokhoa oa saense; bakeng sa ho eketsehileng, bona Crain, Cooper, and Dickinson (2014) le Bonney et al. (2014) . Hangata ho bokella chelete ho bolela ho sebetsana le bothata bo tloaelehileng ka har'a mokhatlo o hlophisitsoeng mme ho e-na le ho o fetisetsa ho letšoele; bakeng sa ho feta, bona Howe (2009) . Hangata bohlale bo kopaneng bo bolela lihlopha tsa batho ba sebetsang hammoho ka litsela tse bonahalang li le bohlale; bakeng sa ho eketsehileng, bona Malone and Bernstein (2015) . Nielsen (2012) ke kenyelletso ea bolelele ba libuka ho matla a ho sebelisana ka bongata bakeng sa lipatlisiso tsa saense.
Ho na le mefuta e mengata ea tšebelisano-'moho e sa lumellaneng ka nepo likarolong tse tharo tseo ke li hlalositseng, 'me ke nahana hore tse tharo tsa tsona li tšoaneloa ke tlhokomelo e khethehileng hobane li ka' na tsa e-ba molemo ho patlisiso ea sechaba. Mohlala o mong ke maraka a bolelang esale pele, moo barupeluoa ba rekang le ho rekisa likonteraka tse lopolotsoeng ho latela liphello tse etsahalang lefatšeng. Ho rekisoa ha limmaraka hangata ho sebelisoa ke mekhatlo le mebuso bakeng sa ho bolela, 'me li boetse li sebelisitsoe ke bafuputsi ba sechaba ho bolela esale pele phetoho ea lipatlisiso tse hatisitsoeng ka kelello (Dreber et al. 2015) . Bakeng sa kakaretso ea limmaraka tsa ho bolela esale pele, bona Wolfers and Zitzewitz (2004) le Arrow et al. (2008) .
Mohlala oa bobeli o sa lumellaneng hantle le morero oa ka oa lihlopha ke PolyMath project, moo bafuputsi ba ileng ba sebelisana le li-blogs le wikis ho pakahatsa litoropele tse ncha tsa lipalo. Morero oa PolyMath ka litsela tse ling o lekana le Moputso oa Netflix, empa morero ona o kopanela ka mafolofolo likarolong tse ling tsa ba bang. Bakeng sa lintlha tse eketsehileng mosebetsing oa PolyMath, bona Gowers and Nielsen (2009) , Cranshaw and Kittur (2011) , Nielsen (2012) , le Kloumann et al. (2016) .
Mohlala oa boraro o sa lumellaneng hantle le mekhatlo ea ka ea lihlopha ke ea ho itšetleha ka nako e kang ea Defense Advanced Research Projects Agency (DARPA) Network Challenge (ke hore, Red Balloon Challenge). Bakeng sa lintlha tse eketsehileng mabapi le liphallelo tsena tse sa utloiseng nako, sheba Pickard et al. (2011) , Tang et al. (2011) , le Rutherford et al. (2013) .
- Palo ea batho (karolo ea 5.2)
Poleloana "phetoho ea batho" e tsoa mosebetsing o entsoeng ke bo-rasaense ba k'homphieutha, le ho utloisisa moelelo oa lipatlisiso tsena ho tla ntlafatsa bokhoni ba hau ba ho khetha mathata a ka 'nang a loketse. Bakeng sa mesebetsi e itseng, lik'homphieutha li na le matla a makatsang, a nang le bokhoni bo fetang hōle le batho ba litsebi. Ka mohlala, ka chess, lik'homphieutha li ka otla esita le baeletsi ba molemo ka ho fetisisa. Empa-mme sena ha se ratoe haholo ke bo-rasaense ba sechaba-mesebetsing e meng, lik'homphieutha li hlile li mpe ho feta batho. Ka mantsoe a mang, hona joale o molemo ho feta khomphuta e rarahaneng ka ho fetisisa mesebetsing e itseng e amanang le ho sebetsana le litšoantšo, video, molumo, le mongolo. Ka hona, bo-rasaense ba k'homphieutha ba sebetsang mesebetsing ena e thata-ea-lik'homphieutha-ba elelloa hore ba ka kenyelletsa batho ts'ebetsong ea bona ea boitsebiso. Ke kamoo Luis von Ahn (2005) hlalositseng phetoho ea batho ha a qeta ho qapa lentsoe lena ha a qeta ho ngola: "paradigm bakeng sa ho sebelisa matla a ho sebetsana le batho ho rarolla mathata ao lik'homphieutha li ke keng tsa li rarolla." Bakeng sa phekolo ea bolelele ba nako ea ho bala batho, e leng lentsoe le tloaelehileng haholoanyane, sheba Law and Ahn (2011) .
Ho ea ka tlhaloso e hlalositsoeng ka Ahn (2005) Foldit-eo ke e hlalositseng karolong ea lits'ebetso tse bulehileng-e ka nkoa e le morero oa ho bala batho. Leha ho le joalo, ke khetha ho arola Foldit e le pitso e bulehileng hobane e hloka tsebo e khethehileng (le hoja e se e koetlisitsoeng hantle) 'me e nka tharollo e molemo ka ho fetisisa, ho e-na le ho sebelisa leano la ho arohana-kopo.
Mantsoe a reng "ho arohana-ho sebetsa-ho kopanya" a sebelisitsoe ke Wickham (2011) ho hlalosa leano la lipalo tsa lipalo-palo, empa o nka ts'ebetso ea merero ea batho ba bangata. Ts'ebetso ea ho kopanya-e sebelisanang-e kopane e tšoana le moralo oa MapReduce o hlahisitsoeng Google; bakeng sa ho eketsehileng ho MapReduce, bona Dean and Ghemawat (2004) le Dean and Ghemawat (2008) . Bakeng sa lintlha tse ling mabapi le mekhoa ea litsebi tsa k'homphieutha tse abetsoeng, sheba Vo and Silvia (2016) . Khaolo ea 3 ea Law and Ahn (2011) na le puisano ea merero e nang le likarolo tse rarahaneng ho feta tse khaolong ena.
Mererong ea ho bala batho eo ke e tšohlileng khaolong ena, barupeluoa ba ne ba tseba se etsahalang. Leha ho le joalo, merero e meng e batla ho nka "mosebetsi" o seng o ntse o etsahala (o tšoanang le eBird) le ntle le tlhokomeliso ea barupeluoa. Sheba, ka mohlala, Game Game (Ahn and Dabbish 2004) le reCAPTCHA (Ahn et al. 2008) . Leha ho le joalo, merero ena ka bobeli e boetse e phahamisa lipotso tsa boitšoaro hobane barupeluoa ba ne ba sa tsebe hore na basebetsi ba bona ba sebelisoa joang (Zittrain 2008; Lung 2012) .
Ba susumelitsoe ke Game ESP, bafuputsi ba bangata ba 'nile ba leka ho hlahisa "lipapali tse nang le morero" (Ahn and Dabbish 2008) (e leng, "lipapali tsa batho ba bapalang" (Pe-Than, Goh, and Lee 2015) ) e ka ba e sebelisetsoang ho rarolla mathata a mang a mangata. Seo 'lipapali tsena tse nang le sepheo' li tšoanang ka tsona ke hore li leka ho etsa mesebetsi e amanang le palo ea batho e thabisang. Ka hona, le hoja Game ESP e arolelana sebopeho se tšoanang le se bitsoang Galaxy Zoo, se fapana le kamoo barupeluoa ba susumelitsoeng kateng-ho ithabisa le takatso ea ho thusa saense. Bakeng sa ho eketsehileng ka lipapali tse nang le morero, bonang Ahn and Dabbish (2008) .
Tlhaloso ea ka ea Galaxy Zoo e ea ho Nielsen (2012) , Adams (2012) , Clery (2011) , le Hand (2010) , mme lipuo tsa ka tsa lipatlisiso tsa Galaxy Zoo li nolofalitsoe. Bakeng sa lintlha tse ngata mabapi le histori ea lihlopha tsa linaleli ho ea linaheng tsa linaleli le kamoo Galaxy Zoo e tsoelang pele kateng moetlo ona, sheba Masters (2012) le Marshall, Lintott, and Fletcher (2015) . Ho hahoa ho Galaxy Zoo, bafuputsi ba ile ba qeta Galaxy Zoo 2 tse ileng tsa bokella tse fetang limilione tse 60 tse rarahaneng morphological classification ho tloha ho baithaopi (Masters et al. 2011) . Ho phaella moo, ba ile ba kenella ka mathata a ka thōko ho melala ea linaleli, ho kenyelletsa ho hlahloba holim'a Khoeli, ho batla lipolanete, le ho ngola litokomane tsa khale. Hona joale, merero ea bona eohle e bokelloa ho website ea Zooniverse (Cox et al. 2015) . E 'ngoe ea merero-Snapshot Serengeti-e fana ka bopaki ba hore merero ea lihlopha tsa mefuta ea Galaxy Zoo e ka etsoa hape bakeng sa lipatlisiso tsa tikoloho (Swanson et al. 2016) .
Bakeng sa bafuputsi ba rerang ho sebelisa maraka a maholo a basebetsi (mohlala, Amazon Mechanical Turk) bakeng sa morero oa ho bala batho, Chandler, Paolacci, and Mueller (2013) le J. Wang, Ipeirotis, and Provost (2015) fana ka keletso e ntle mabapi le ho etsoa ha mosebetsi le lintlha tse ling tse amanang le tsona. Porter, Verdery, and Gaddis (2016) fana ka mehlala le keletso e tsepamisitsoeng haholo-holo litšebelisong tsa maraka a mesebetsi ea microtask bakeng sa seo ba se bitsang "ho eketseha ha data." Moeli o pakeng tsa ho eketseha ha data le ho bokelloa ha data o batla o fosahetse. Bakeng sa lintlha tse ling mabapi le ho bokella le ho sebelisa lilabo bakeng sa thuto e hlophisitsoeng bakeng sa melaetsa, bona Grimmer and Stewart (2013) .
Bafuputsi ba thahasella ho bopa seo ke se bitsitseng mekhoa ea ho bala likarolo tsa batho (mohlala, mekhoa e sebelisang mangolo a batho ho koetlisa mechine ea ho ithuta mechine) e ka 'na ea thahasella Shamir et al. (2014) (bakeng sa mohlala o sebelisang molumo) le Cheng and Bernstein (2015) . Hape, mechine ea ho ithuta mechine ka merero ena e ka etsoa ka litefouno tse bulehileng, moo bafuputsi ba phelisanang ho etsa mehlala ea ho ithuta mechine ka ts'ebetso e kholo ka ho fetisisa. Ka mohlala, sehlopha sa Galaxy Zoo se ile sa letsetsa mohoo o bulehileng 'me sa fumana mokhoa o mocha o neng o fapane le o hlahisitsoeng Banerji et al. (2010) ; sheba Dieleman, Willett, and Dambre (2015) bakeng sa lintlha.
- Bula li-call (karolo 5.3)
Bula li-call ha li ncha. Ha e le hantle, e 'ngoe ea lits'ebetso tse bulehileng ka ho fetisisa e tsejoang ka morao ho tloha ka 1714 ha Paramente ea Brithani e bōpa The Longitude Prize bakeng sa mang kapa mang ea ka hlahisang tsela ea ho tseba bochabela ba likepe lebōpong. Bothata bo ile ba hlasela bo-rasaense ba bangata ka ho fetisisa ba mehleng eo, ho akarelletsa le Isaac Newton, 'me qetellong tharollo e atlehang e ile ea romeloa ke John Harrison, moetsi oa lioache oa mahaeng ea ileng a atamela bothata bo fapaneng le bo-rasaense ba neng ba tsepamisitse tharollo e neng e tla akarelletsa tlhahiso ea linaleli ;; bakeng sa tlhahisoleseling e eketsehileng, bona Sobel (1996) . Joalokaha mohlala ona o bontša, lebaka le le leng leo ho thoeng litho tse bulehileng li sebetsa hantle ke hore li fane ka batho ba nang le litebello le bokhoni bo fapaneng (Boudreau and Lakhani 2013) . Bona Hong and Page (2004) le Page (2008) bakeng sa tse ling ka boleng ba mefuta-futa ho rarolla bothata.
Nako le e 'ngoe ea linyeoe tse bulehileng khaolong ena e hloka tlhaloso e eketsehileng ea hore na ke hobane'ng ha e le sehlopheng sena. Ntlha ea pele, tsela e 'ngoe eo ke e khethollang lipakeng tsa batho le ho bula merero ea ho letsetsa ke hore na palo e ke ke ea etsoa ka tharollo (palo ea batho) kapa tharollo e ntle ka ho fetisisa (pitso e bulehileng). Moputso oa Netflix o batla o le thata tabeng ena hobane tharollo e molemohali e bile tekanyo e rarahaneng ea tharollo ea motho ka mong, mokhoa o bitsoang tharollo ea sehlopha (Bell, Koren, and Volinsky 2010; Feuerverger, He, and Khatri 2012) . Ho latela Netflix, leha ho le joalo, sohle seo ba neng ba tlameha ho se etsa ke ho khetha tharollo e molemo ka ho fetisisa. Bakeng sa tse ling ka Moputso oa Netflix, bona Bennett and Lanning (2007) , Thompson (2008) , Bell, Koren, and Volinsky (2010) , le Feuerverger, He, and Khatri (2012) .
Ea bobeli, ka litlhaloso tse ling tsa palo ea batho (mohlala, Ahn (2005) ), Foldit e lokela ho nkoa e le morero oa ho bala batho. Leha ho le joalo, ke khetha ho e hlalosa e le pitso e bulehileng kaha e hloka tsebo e khethehileng (le hoja e se koetliso e khethehileng) mme e nka tharollo e molemo ka ho fetisisa, ho e-na le ho sebelisa leano la ho arohana-kopo. Bakeng sa ho eketsehileng ka Foldit bona, Cooper et al. (2010) , Khatib et al. (2011) , le Andersen et al. (2012) ; Tlhaloso ea ka ea Foldit e hlahisa tlhaloso Bohannon (2009) , Hand (2010) , le Nielsen (2012) .
Qetellong, motho a ka pheha khang ea hore Peer-to-Patent ke mohlala oa ho bokelloa ha data. Ke khetha ho e kenyelletsa e le pitso e bulehileng kaha e na le mohaho o ts'oanang le tlhōlisano 'me ke monehelo o motle feela o sebelisoang, athe ka ho bokelloa ha lintlha, mohopolo oa menehelo e metle le e mpe ha e hlake. Bakeng sa lintlha tse ling ka Peer-to-Patent, sheba Noveck (2006) , Ledford (2007) , Noveck (2009) , le Bestor and Hamp (2010) .
Mabapi le ho sebelisa litefello tse bulehileng ho patlisiso ea sechaba, liphello li tšoana le tsa Glaeser et al. (2016) , li tlalehiloe khaolong ea 10 ea Mayer-Schönberger and Cukier (2013) moo New York City e ileng ea khona ho sebelisa mehlala ea ho etsa mohlala ho hlahisa phaello e kholo ea tlhahiso ea bahlahlobi ba matlo. New York City, mekhoa ena e boletsoeng esale pele e hahiloe ke basebetsi ba toropo, empa maemong a mang, motho a ka nahana hore a ka bōptjoa kapa a ntlafatsoa ka lithefolo tse bulehileng (mohlala, Glaeser et al. (2016) ). Leha ho le joalo, ntho e ka sehloohong e amehang ka mehlala ea ho bolela esale pele bakeng sa ho fana ka mehloli ke hore mefuta ena e na le monyetla oa ho tiisa liketso tse teng. Bafuputsi ba bangata ba se ba ntse ba tseba "lithōle, lithōle," 'me ka mehlala ea mehlala ea pele e ka' na ea "ba leeme, ho Barocas and Selbst (2016) ." Bona Barocas and Selbst (2016) le O'Neil (2016) bakeng sa ho eketsehileng ka likotsi tsa mehlala e tsitsitseng e hahiloeng ka boitsebiso ba koetliso bo ikemetseng.
Bothata bo bong bo ka thibelang mebuso ho sebelisa litlhōlisano tse bulehileng ke hore sena se hloka ho lokolloa ha data, e leng se ka lebisang ho tlōlo ea sephiri. Bakeng sa lintlha tse eketsehileng mabapi le ho lokolloa ha boinotši le boitsebiso lipaleng tse bulehileng, bona Narayanan, Huey, and Felten (2016) le puisano ho khaolo ea 6.
Bakeng sa lintlha tse ling mabapi le phapang le ho tšoana pakeng tsa ho bolela esale pele le tlhaloso, sheba Breiman (2001) , Shmueli (2010) , Watts (2014) , le Kleinberg et al. (2015) . Bakeng sa lintlha tse ngata mabapi le karolo ea ho bolela esale pele lipatlisisong tsa sechaba, bona Athey (2017) , Cederman and Weidmann (2017) , Hofman, Sharma, and Watts (2017) , ( ??? ) , le Yarkoni and Westfall (2017) .
Bakeng sa tlhahlobo ea merero e bulehileng ea baeloji, ho kenyelletsanoa le keletso ea moralo, sheba Saez-Rodriguez et al. (2016) .
- Ho bokelloa ha data (karolo 5.4)
Tlhaloso ea ka ea eBird e hlahisa tlhaloso e Bhattacharjee (2005) , Robbins (2013) , le Sullivan et al. (2014) . Bakeng sa lintlha tse eketsehileng mabapi le kamoo bafuputsi ba sebelisang mehlala ea lipalo ho hlahlobisisa data eBir bona bona Fink et al. (2010) le Hurlbert and Liang (2012) . Bakeng sa lintlha tse eketsehileng ha u lekanya bokhoni ba barupeluoa ba eBird, bona Kelling, Johnston, et al. (2015) . Bakeng sa lintlha tse eketsehileng historing ea saense ea baahi linthong tsa ornithology, bona Greenwood (2007) .
Bakeng sa lintlha tse eketsehileng Morero oa Li-Journals tsa Malawi, bona Watkins and Swidler (2009) le Kaler, Watkins, and Angotti (2015) . Bakeng sa lintlha tse ling mabapi le morero o amanang le oona Afrika Boroa, bona Angotti and Sennott (2015) . Bakeng sa mehlala e eketsehileng ea lipatlisiso tse sebelisang boitsebiso bo tsoang ho Project Journals ea Malawi bona Kaler (2004) le Angotti et al. (2014) .
- Ho iketsetsa hau (karolo 5.5)
Mokhoa oa ka oa ho fana ka keletso ea moralo o ne o se na thuso, o thehiloe mehlala ea mekhoa e atlehileng le e hlōlehileng ea tšebelisano-'moho eo ke e utloileng. Ho boetse ho bile le lipatlisiso tsa boiteko ba ho sebelisa likhopolo-taba tse tloaelehileng tsa kelello tsa sechaba ho theha metse ea Inthaneteng e amanang le moralo oa merero e sebelisoang ho sebelisana, bonang, Kraut et al. (2012) .
Mabapi le barupeluoa ba susumetsang, ho hlile ho le thata ho utloisisa hantle hore na ke hobane'ng ha batho ba kenya letsoho merero e sebelisanang le litšebelisano-'moho (Cooper et al. 2010; Nov, Arazy, and Anderson 2011; Tuite et al. 2011; Raddick et al. 2013; Preist, Massung, and Coyle 2014) . Haeba u rerile ho susumetsa barupeluoa ka tefo ka marakeng a mesebetsi ea basebetsi (mohlala, Amazon Mechanical Turk), Kittur et al. (2013) fana ka keletso.
Mabapi le ho etsa hore ho makatse, bakeng sa mehlala e mengata ea lintho tse sa lebelloang tse hlahang mererong ea Zooiverse, bona Marshall, Lintott, and Fletcher (2015) .
Mabapi le ho ba le litekanyetso tsa boitšoaro, tse ling tse kenyelletsoeng ka kakaretso litabeng tse amehang ke Gilbert (2015) , Salehi et al. (2015) , Schmidt (2013) , Williamson (2016) , Resnik, Elliott, and Miller (2015) , le Zittrain (2008) . Bakeng sa litaba tse amanang le litaba tsa molao le basebeletsi ba bangata, bona Felstiner (2011) . O'Connor (2013) o botsa lipotso mabapi le ho laola mekhoa ea ho etsa lipatlisiso ha lipatlisiso ha mesebetsi ea bafuputsi le barupeluoa ba fuputsa. Bakeng sa litaba tse amanang le ho arolelana boitsebiso ha u ntse u sireletsa barupeluoa mererong ea baahi ba saense, bona Bowser et al. (2014) . Purdam (2014) le Windt and Humphreys (2016) ba na le puisano ka litaba tsa boitšoaro ka ho bokelloa ha lintlha. Qetellong, merero e mengata e lumela menehelo empa ha e fane ka mokitlane mokitlane ho barupeluoa. Foldit, ba bapalang hangata ba thathamisitsoe e le mongoli (Cooper et al. 2010; Khatib et al. 2011) . Mererong e meng ea pitso e bulehileng, mofani ea atlehang a atisa ho ngola pampiri e hlalosang tharollo ea bona (mohlala, Bell, Koren, and Volinsky (2010) le Dieleman, Willett, and Dambre (2015) ).
