Seem no yog tsim los siv raws li ib tug siv, es tsis yuav tsum tau nyeem raws li ib tug narrative.
Pawg koom tes blends tswv yim los ntawm pej xeem science, crowdsourcing, thiab collective txawj ntse. Citizen science feem ntau txhais tau tias uas "pej xeem" (ie, uas tsis yog-zaum) nyob rau hauv kev tshawb fawb (Crain, Cooper, and Dickinson 2014) . Crowdsourcing feem ntau txhais tau tias ib qho teeb meem feem ntau solved tsis pub dhau ib lub koom haum thiab es tsis txhob outsourcing nws mus rau ib tug tib neeg coob (Howe 2009) . Collective txawj ntse feem ntau txhais tau tias pab pawg neeg ntawm cov neeg ua yeeb yam collectively nyob rau hauv txoj kev uas zoo li ntse (Malone and Bernstein 2015) . Nielsen (2012) yog ib tug zoo kawg nkaus hauv phau ntawv ntev kev taw qhia mus rau hauv lub hwj chim ntawm loj kev sib koom tes rau kev tshawb fawb.
Muaj ntau ntau hom loj kev sib koom tes uas tsis haum ntxiab mus rau hauv lub peb pawg tias kuv npaj siab, thiab kuv xav hais tias peb yuav tsum tau txais tshwj xeeb xim vim hais tias lawv tej zaum yuav pab tau nyob rau hauv kev sib raug zoo kev tshawb fawb ntawm tej taw tes. Ib tug piv txwv yog twv ua ntej kev lag luam, qhov twg neeg koom yuav thiab luam ntawv cog lus uas yog redeemable raws li tau uas tshwm sim nyob rau hauv lub ntiaj teb no (Wolfers and Zitzewitz 2004; Arrow et al. 2008) . Cua kev lag luam yog feem ntau siv los ntawm tuam txab thiab tsoom fwv rau forecasting, thiab cua ciaj uas muag tau kuj tau siv los ntawm kev sib raug zoo soj ntsuam mus twv seb tus replicability ntawm luam tawm cov kev tshawb fawb nyob rau hauv psychology (Dreber et al. 2015) .
Ib tug thib ob piv txwv tias tsis haum zoo rau hauv kuv lub categorization tswvyim yog lub PolyMath project, qhov chaw uas soj ntsuam collaborated siv blogs thiab wikis los ua pov thawj tshiab lej theorems (Gowers and Nielsen 2009; Cranshaw and Kittur 2011; Nielsen 2012; Kloumann et al. 2016) . Lub PolyMath project yog nyob rau hauv ib co txoj kev zoo xws li cov Netflix nqi zog, tab sis nyob rau hauv lub PolyMath project koom ntau nquag ua nyob rau hauv ib nrab daws ntawm lwm tus neeg.
Ib tug thib peb piv txwv uas tsis haum zoo rau hauv kuv lub categorization tswvyim yog lub sij hawm-dependent mobilizations xws li cov kws muaj txuj ci Advanced Research tej yaam num Agency (DARPA) Network sib tw (ie, Liab Zais pa sib tw). Yog xav paub ntxiv nyob rau hauv cov lub sij hawm rhiab mobilizations saib Pickard et al. (2011) , Tang et al. (2011) , thiab Rutherford et al. (2013) .
Lub sij hawm "tib neeg le caag" los ntawm kev ua hauj lwm ua los ntawm lub computer zaum, thiab to taub lub ntsiab lus teb qab qhov kev tshawb fawb yuav ua kom koj muaj peev xwm mus tos tawm cov teeb meem uas tej zaum yuav amenable mus rau nws. Rau tej kev pab raws qib, computers yog incredibly haib nrog tuition deb tshaj txawm cov kws muaj txuj tib neeg. Piv txwv li, nyob rau hauv chess, computers tau tuav txawm qhov zoo tshaj plaws neeg pej xeem nrog masters. Tab sis-thiab qhov no yog tsis tshua tau menyuam los ntawm kev zaum-rau lwm yam, computers yog cov ua tau heev npaum li cas dua li cov neeg. Nyob rau hauv lwm yam lus, tam sim no koj zoo tshaj txawm lub feem ntau sophisticated computer tom tej kev pab raws qib uas ua cov dluab, yees duab, suab, thiab cov ntawv nyeem. Yog li-raws li twb tau taw qhia los ntawm ib tug zoo kawg nkaus XKCD tas luav-muaj tej yam uas yooj yim rau computers thiab nyuaj rau cov neeg, tab sis tseem muaj tej yam uas nyuaj rau computers thiab yooj yim rau cov neeg (Daim duab 5.13). Khoos phib tawj zaum ua hauj lwm rau cov nyuaj-rau-computers-ib qho yooj yim-rau-tib neeg paub tab, yog li ntawd, pom tau hais tias lawv yuav muaj xws li cov tib neeg nyob rau hauv lawv computational txheej txheem. Ntawm no yog yuav ua li cas Luis von Ahn (2005) piav tib neeg le caag thaum nws ua ntej coined lub sij hawm nyob rau hauv nws dissertation: "ib tug paradigm rau siv tib neeg ua hwj huam los daws cov teeb meem uas computers yuav tsis tau daws kom tau."
Los ntawm no txhais FoldIt-uas kuv tau piav nyob rau hauv seem rau qhib hu-yuav muab suav hais tias ib tug tib neeg le caag peb tes num. Txawm li cas los, kuv tau xaiv categorize FoldIt raws li ib qhib hu vim hais tias nws yuav tsum tau tshwj xeeb cov kev txawj thiab nws yuav siv sij hawm qhov zoo tshaj plaws tshuaj pab es siv ib tug split-thov-muab lub tswv yim.
Rau ib tug zoo heev phau ntawv ntev kev kho mob ntawm tib neeg le caag, nyob rau hauv lub feem ntau kev nkag siab ntawm lub sij hawm, mus saib Law and Ahn (2011) . Tshooj 3 ntawm Law and Ahn (2011) muaj ib qho kev nthuav kev sib tham ntawm ntau muab cov kauj ruam tshaj qhov sawv daws yuav nyob rau hauv tshooj no.
Lub sij hawm "split-thov-muab" siv los ntawm Wickham (2011) mus piav qhia txog ib lub tswv yim es thiaj tsis xam, tab sis nws txig captures tus txheej txheem ntawm ntau tib neeg le caag txug tej yaam. Lub split-thov-muab lub tswv yim yog zoo li tus MapReduce moj khaum tsim ntawm Google (Dean and Ghemawat 2004; Dean and Ghemawat 2008) .
Ob tug ntse tib neeg le caag tej yaam num uas kuv tsis muaj qhov chaw sib tham txog yog cov ESP cov kev ua si (Ahn and Dabbish 2004) thiab reCAPTCHA (Ahn et al. 2008) . Ob yam no tej yaam num pom muaj tswv yim txoj kev los txhawb cov miv sab koom los muab cov ntawv lo rau cov dluab. Txawm li cas los, ob leeg ntawm no tej yaam num kuj tsa raug cai cov lus nug vim hais tias, tsis zoo li Galaxy Zoo, tuaj koom nyob rau hauv lub ESP cov kev ua si thiab reCAPTCHA tsis paub yuav ua li cas lawv cov ntaub ntawv raug siv (Lung 2012; Zittrain 2008) .
Inspired los ntawm cov ESP cov kev ua si, muaj ntau yam kev soj ntsuam tau npaj los tsim lwm tus neeg "kev ua si nrog ib lub hom phiaj" (Ahn and Dabbish 2008) (ie, "tib neeg raws li le caag ua si" (Pe-Than, Goh, and Lee 2015) ) uas yuav ua tau siv los daws tau ib tug ntau yam ntawm lwm yam teeb meem. Yuav ua li cas cov "kev ua si nrog ib lub hom phiaj" muaj nyob rau hauv ntau yog hais tias lawv sim ua kom cov paub tab muab kev koom tes nyob rau hauv tib neeg le caag tsi zoo. Yog li, thaum lub sij hawm ESP kev ua si txoj tib split-thov-muab qauv nrog Galaxy Zoo, nws txawv nyob rau hauv yuav ua li cas koom yog kev mob siab-kev lom zem thiab muaj siab los pab science.
Kuv cov hauj lwm ntawm Galaxy Zoo thim rau Nielsen (2012) , Adams (2012) , Clery (2011) , thiab Hand (2010) , thiab kuv nthuav qhia ntawm cov kev tshawb fawb hom phiaj ntawm Galaxy Zoo twb yooj yim zog. Yog xav paub ntxiv nyob rau hauv lub keeb kwm ntawm galaxy kev faib nyob rau hauv astronomy thiab yuav ua li cas Galaxy Zoo tseem no kev lig kev cai, saib Masters (2012) thiab Marshall, Lintott, and Fletcher (2015) . Lub tsev nyob rau Galaxy Zoo, tus neeg tshawb fawb tiav Galaxy Zoo 2 uas sau ntau tshaj 60 lab ntau morphological classifications los ntawm tuaj pab dawb (Masters et al. 2011) . Ntxiv mus, lawv branched tawm mus rau hauv cov teeb meem nyob sab nraum ntawm galaxy morphology xws li kawm ua tus nto ntawm lub hli, searching rau ntiaj teb, thiab transcribing qub ntaub ntawv. Tam sim no, tag nrho lawv tej yaam num yog sau ntawm www.zooniverse.org (Cox et al. 2015) . Ib tug ntawm cov tej yaam num-Snapshot Serengeti-muab pov thawj tias Galaxy Zoo-hom duab kev faib tej yaam num kuj yuav ua tau rau tej cov kev tshawb fawb (Swanson et al. 2016) .
Rau kev soj ntsuam kev npaj rau siv ib tug micro-neeg ua hauj lwm ua hauj lwm ua lag luam (xws li, Amazon Neeg kho tshuab Turk) rau ib tug tib neeg le caag peb tes num, Chandler, Paolacci, and Mueller (2013) thiab Wang, Ipeirotis, and Provost (2015) muaj zoo tswv yim rau neeg ua hauj lwm tsim thiab lwm yam teeb meem.
Soj ntsuam xav nyob rau hauv kev tsim dab tsi kuv twb hu ua ob tiam tib neeg le caag tshuab (xws li, tshuab uas siv tib neeg ntawv los qhia ib lub tshuab kev kawm qauv) tej zaum yuav xav nyob rau hauv Shamir et al. (2014) (rau ib tug piv txwv uas siv cov suab) thiab Cheng and Bernstein (2015) . Tsis tas li ntawd, cov tej yaam num yuav ua tau nrog qhib hu, uas soj ntsuam sib tw los tsim tshuab kev kawm ua qauv nrog tus loj tshaj predictive kev kawm. Piv txwv li, lub Galaxy Zoo pab neeg khiav ib qho qhib hu thiab pom ib tug tshiab mus kom ze uas outperformed ib tug tsim nyob rau hauv Banerji et al. (2010) ; saib Dieleman, Willett, and Dambre (2015) kom paub meej.
Qhib hu yog tsis tshiab. Nyob rau hauv qhov tseeb, ib tug ntawm cov feem ntau zoo-paub qhib hu hnub rov qab mus rau 1714 thaum teb chaws Aas Kiv tus Parliament tsim lub longitude nqi zog rau leej twg uas yuav tsim ib txoj kev los mus txiav txim lub longitude ntawm ib lub nkoj tom hiav txwv. Qhov teeb meem stumped ntau ntawm cov loj tshaj zaum ntawm lub hnub, xws li Isaac Newton, thiab cov winning tshuaj nws thiaj li xa los ntawm ib tug clockmaker los ntawm cov countryside uas mus kev rau lub teeb meem txawv los ntawm zaum uas raug teem rau ib cov tshuaj uas yuav sov ua licas koom nrog astronomy (Sobel 1996) . Raws li qhov piv txwv no qhia txog, ib tug yog vim li cas uas qhib hu yog xav mus ua hauj lwm zoo li ntawd, yog hais tias lawv muab kev nkag tau rau cov neeg uas sib txawv kev xaav thiab kev txawj ntse (Boudreau and Lakhani 2013) . Saib Hong and Page (2004) thiab Page (2008) yog xav paub ntau rau ntawm tus nqi ntawm ntau haiv neeg nyob rau hauv kev daws teebmeem.
Txhua lub qhib hu tus neeg mob nyob rau hauv tshooj yuav tsum tau ib tug me ntsis ntawm ntxiv piav yog vim li cas nws yog nyob rau hauv no. Ua ntej, ib txoj kev uas kuv paub qhov txawv ntawm tib neeg le caag thiab qhib hu tej yaam num yog seb cov qhov tso zis yog ib qho nruab nrab ntawm tag nrho cov kev daws teeb meem (tib neeg le caag) los yog cov tshuaj zoo tshaj (qhib hu). Lub Netflix nqi zog yog dog dig lo qhia nyob rau hauv no hais txog vim hais tias qhov zoo tshaj plaws tshuaj muab tawm los ua ib tug sophisticated nruab nrab ntawm ib tug neeg daws teeb meem, ib tug mus hu ua ib tug khaub ncaws ntau cov tshuaj (Bell, Koren, and Volinsky 2010; Feuerverger, He, and Khatri 2012) . Los ntawm cov foundations ntawm Netflix, txawm li cas los, tag nrho lawv yuav tsum tau ua yog tuaj tos cov tshuaj zoo tshaj.
Ob, los ntawm ib co txhais cov ntsiab lus ntawm tib neeg le caag (xws li, Von Ahn (2005) ), FoldIt yuav tsum raug xam tias yog ib tug tib neeg le caag peb tes num. Txawm li cas los, kuv tau xaiv categorize FoldIt raws li ib qhib hu vim hais tias nws yuav tsum tau tshwj xeeb cov kev txawj thiab nws yuav siv sij hawm qhov zoo tshaj plaws tshuaj pab, es tsis siv ib tug split-thov-muab lub tswv yim.
Thaum kawg, ib tug yuav cam hais tias Peer-to-Patent yog ib qho piv txwv ntawm faib cov ntaub ntawv sau. Kuv xaiv muaj xws li nws raws li ib tug qhib hu vim hais tias nws muaj ib tug contest zoo li qauv thiab tsuas yog qhov zoo tshaj plaws pab yog siv (whereas nrog faib cov ntaub ntawv sau, lub tswv yim ntawm kev zoo thiab kev phem kev pab yog tsawg ntshiab).
Yog xav paub ntxiv nyob rau hauv lub Netflix nqi zog, saib Bennett and Lanning (2007) , Thompson (2008) , Bell, Koren, and Volinsky (2010) , thiab Feuerverger, He, and Khatri (2012) . Yog xav paub ntxiv nyob rau hauv FoldIt pom, Cooper et al. (2010) , Andersen et al. (2012) , thiab Khatib et al. (2011) ; kuv cov hauj lwm ntawm FoldIt thim rau kev qhia txog nyob rau hauv Nielsen (2012) , Bohannon (2009) , thiab Hand (2010) . Yog xav paub ntxiv nyob rau hauv Peer-to-Patent, saib Noveck (2006) , Bestor and Hamp (2010) , Ledford (2007) , thiab Noveck (2009) .
Zoo ib yam li qhov kev tshwm sim ntawm Glaeser et al. (2016) , Mayer-Schönberger and Cukier (2013) , Tshooj 10 qhia loj nreg nyob rau hauv lub tsim ntawm cov vaj tse inspectors nyob rau hauv New York City thaum kuaj yog ua los ntawm predictive qauv. Nyob rau hauv New York City, cov predictive qauv tau ua los ntawm lub nroog ua hauj lwm, tab sis nyob rau hauv lwm tus neeg mob, ib tug yuav xav txog tej yam uas lawv yuav tsum tau tsim los yog zoo tuaj nrog qhib hu (eg, Glaeser et al. (2016) ). Txawm li cas los, ib tug loj kev txhawj xeeb nrog predictive qauv siv los faib cov kev pab yog hais tias lub qauv muaj lub peev xwm mus pab txhawb ntxiv uas twb muaj lawm biases. Muaj ntau soj ntsuam ntawm twb paub "thoob khib nyiab nyob rau hauv, khib nyiab tawm", thiab nrog predictive qauv nws yuav ua tau "kev tsis ncaj ncees nyob rau hauv, kev tsis ncaj ncees tawm." Saib Barocas and Selbst (2016) thiab O'Neil (2016) rau ntxiv rau cov kev piam sij ntawm predictive qauv ua nrog biased kev kawm ntaub ntawv.
Ib qhov teeb meem uas tej zaum yuav tiv thaiv kom txhob tsoom fwv los ntawm siv qhib kev sib tw yog hais tias nws yuav tsum tau cov ntaub ntawv tso tawm, uas yuav ua rau tus kheej ua txhaum. Yog xav paub ntxiv txog kev ceev ntiag tug thiab cov ntaub ntawv tso tawm nyob rau hauv qhib hu saib Narayanan, Huey, and Felten (2016) thiab cov kev sib tham nyob rau hauv Tshooj 6.
Kuv cov hauj lwm ntawm eBird thim rau kev qhia txog nyob rau hauv Bhattacharjee (2005) thiab Robbins (2013) . Yog xav paub ntxiv nyob rau hauv yuav ua li cas soj ntsuam siv statistical qauv rau kev tsom xam eBird cov ntaub ntawv saib Hurlbert and Liang (2012) thiab Fink et al. (2010) . Yog xav paub ntxiv nyob rau hauv lub keeb kwm ntawm pej xeem science nyob rau hauv ornothology, saib Greenwood (2007) .
Yog xav paub ntxiv nyob rau hauv lub Malawi Txhua Project, saib Watkins and Swidler (2009) thiab Kaler, Watkins, and Angotti (2015) . Thiab yog xav paub ntxiv nyob rau hauv ib yam project nyob rau hauv South Africa, saib Angotti and Sennott (2015) . Yog xav paub ntxiv piv txwv ntawm kev tshawb fawb uas siv cov ntaub ntawv los ntawm lub Malawi Txhua Project saib Kaler (2004) thiab Angotti et al. (2014) .
Kuv mus kom ze rau muab tsim tswv yim yog inductive, raws li nyob rau cov piv txwv ntawm kev vam meej thiab ua tsis tau tejyam loj sib koom tes tej yaam num uas kuv twb tau hnov txog. Muaj kuj yog ib tug kwj ntawm cov kev tshawb fawb npaj siab mus thov ntau general social puas siab puas ntsws theories rau tsim online zej zog uas yog cov mus rau lub tsim ntawm loj sib koom tes tej yaam num, saib, piv txwv li, Kraut et al. (2012) .
Hais txog motivating koom, nws yog ua tau kuj lo qhia kom paub tseeb raws nraim yog vim li cas cov neeg koom nyob rau hauv loj kev sib koom tes tej yaam num (Nov, Arazy, and Anderson 2011; Cooper et al. 2010, Raddick et al. (2013) ; Tuite et al. 2011; Preist, Massung, and Coyle 2014) . Yog hais tias koj npaj yuav txhawb cov miv sab koom nrog kev them nyiaj rau ib tug micro-neeg ua hauj lwm ua hauj lwm ua lag luam (xws li, Amazon Neeg kho tshuab Turk) Kittur et al. (2013) muaj ib co tswv yim.
Hais txog enabling surprise, rau ntau cov piv txwv ntawm kev npaj txhij txog discoveries los ntawm Zoouniverse tej yaam num, saib Marshall, Lintott, and Fletcher (2015) .
Hais txog ua zoo, ib txhia zoo general qhia rau cov teeb meem muab kev koom tes yog Gilbert (2015) , Salehi et al. (2015) , Schmidt (2013) , Williamson (2016) , Resnik, Elliott, and Miller (2015) , thiab Zittrain (2008) . Rau tej teeb meem hais txog kev cai lij choj teeb meem nrog cov neeg coob coob ua hauj lwm, saib Felstiner (2011) . O'Connor (2013) chaw nyob cov lus nug txog kev raug cai ntsuam xyuas ntawm kev tshawb fawb thaum lub luag hauj lwm ntawm kev soj ntsuam thiab koom plooj. Rau cov teeb meem muaj feem xyuam rau sib koom cov ntaub ntawv thaum tiv thaiv participats nyob rau hauv pej xeem science tej yaam num, saib Bowser et al. (2014) . Ob Purdam (2014) thiab Windt and Humphreys (2016) muaj ib co kev sib tham txog qhov kev zoo thiab cov teeb meem nyob rau hauv faib cov ntaub ntawv sau. Thaum kawg, feem ntau tej yaam num lees paub pab tab sis tsis muab authorship credit rau koom. Nyob rau hauv Foldit, lub Foldit players yog feem ntau uas muaj npe raws li ib tug sau (Cooper et al. 2010; Khatib et al. 2011) . Nyob rau hauv lwm yam kev qhib hu tej yaam num, cov winning contributor yuav feem ntau sau ib daim ntawv piav txog lawv cov kev daws (xws li, Bell, Koren, and Volinsky (2010) thiab Dieleman, Willett, and Dambre (2015) ). Nyob rau hauv lub Galaxy Zoo tsev neeg ntawm tej yaam num, tsis tshua muaj active thiab tseem ceeb contributors yog tej zaum caw mus yuav co-sau phau ntawv rau cov ntaub ntawv. Piv txwv li, Ivan Terentev thiab Tim Matorny, ob xov tooj cua Galaxy Zoo koom los ntawm Russia, yog co-sau phau ntawv rau ib tug ntawm cov ntaub ntawv uas sawv los ntawm peb tes num (Banfield et al. 2016; Galaxy Zoo 2016) .