Yuav nyeem dab tsi ntxiv
- Kev Taw Qhia (Tshooj 5.1)
Kev koom tes sib koom ua ke nrog cov tswv yim los ntawm kev tshawb fawb txog pej xeem , kev pov hwm , thiab kev txawj ntse . Citizen science feem ntau yog txhais tau tias yog "pej xeem" (piv txwv li, cov neeg tsis paub qab hau) hauv kev tshawb fawb; rau ntxiv, saib Crain, Cooper, and Dickinson (2014) thiab Bonney et al. (2014) . Kev sib txuam feem ntau yog txhais tau hais tias siv qhov teebmeem daws qhov teebmeem hauv ib lub koomhaum thiab nws yuav tsum yog tus outsourcing rau ib pawg neeg; rau ntxiv, saib Howe (2009) . Cov kev txawj ntse feem ntau yog txhais tau hais tias ib pawg ntawm cov neeg ua haujlwm sawv cev rau txoj hauv kev uas ntse; rau ntxiv, saib Malone and Bernstein (2015) . Nielsen (2012) yog ib phau ntawv qhia ntev txog lub zog ntawm kev sib koom tes rau kev tshawb fawb.
Muaj ntau ntau hom kev sib koom tes uas tsis haum kom haum rau peb pawg uas kuv tau npaj, thiab kuv xav tias peb cov neeg tsim nyog tau txais tshwj xeeb vim tias lawv yuav pab tau rau kev tshawb nrhiav. Ib qho piv txwv yog twv ua ntej kev lag luam, thaum koom nrog kev sib cog lus thiab kev cog lus ua lag luam uas muaj kev txhiv dim los ntawm cov txiaj ntsim tau tshwm sim hauv lub ntiaj teb. Kev sib tw ua lag luam feem ntau siv los ntawm cov tuam txhab thiab cov tsoom fwv rau kev xav txog, thiab lawv kuj tau siv los ntawm cov neeg tshawb xyuas txog kev sib tw kom pom tseeb txog cov ntaub ntawv tshawb fawb hauv kev tshawb fawb (Dreber et al. 2015) . Yog xav paub txog cov kev twv muag ntawm kev lag luam, saib Wolfers and Zitzewitz (2004) thiab Arrow et al. (2008) .
Ib qho piv txwv thib ob uas tsis haum rau hauv kuv lub tswv yim categorization yog qhov project PolyMath, uas cov neeg tshawb nrhiav ua haujlwm siv cov blogs thiab cov lus qhia los ua pov thawj tshiab lej theorems. Txoj haujlwm PolyMath yog nyob rau hauv qee txoj kev zoo ib yam li Netflix Prize, tab sis nyob rau hauv qhov kev tshawb fawb no muaj kev koom tes ntau ntawm cov kev daws teeb meem ntawm lwm tus. Yog xav paub ntxiv txog txoj haujlwm PolyMath, mus saib Gowers and Nielsen (2009) , Cranshaw and Kittur (2011) , Nielsen (2012) , thiab Kloumann et al. (2016) .
Tus piv txwv thib peb uas tsis haum rau hauv kuv lub tswvyim categorization yog lub sijhawm ntawm cov neeg ua haujlwm xws li Cov Kws Paub Txog Kev Tshawb Fawb Qhov Kev Tshawb Fawb Txog Kev Tshawb Fawb (DARPA) Network Challenge (ie, Balloon Challenge Red). Yog xav paub ntxiv txog cov sij hawm no-mob siab txhawb nqa pom Pickard et al. (2011) , Tang et al. (2011) , thiab Rutherford et al. (2013) .
- Human computation (ntu 5.2)
Lub sij hawm "tib neeg kev paub" los ntawm kev ua hauj lwm ua los ntawm cov kws tshawb fawb hauv computer, thiab nkag siab txog cov ntsiab lus hauv txoj kev tshawb fawb no yuav ua kom koj muaj peev xwm xaiv qhov teeb meem uas tsim nyog rau nws. Rau tej yam dej num, cov koos pis tawj muaj hwj chim loj heev, nrog kev muaj peev xwm nyob deb tshaj cov neeg ntawm cov neeg muaj txuj ci tshwj xeeb. Piv txwv, hauv chess, cov koos pis tawj ua rau txawm tias qhov zoo tshaj plaws grandmasters. Tab sis-thiab qhov no tsis tshua zoo dua los ntawm cov kws tshawb fawb-rau lwm yam dej num, cov khoos phis tawj tau ua rau cov neeg mob loj dua. Hauv ua ke, tam sim no koj zoo dua li lub tshuab computer tshaj plaws hauv tej lub luag haujlwm ntawm kev ua duab, duab, suab, thiab ntawv nyeem. Computer cov kws tshawb fawb ua hauj lwm rau cov kev nyuaj-rau-computers-yooj yim-rau-tib neeg paub tab li no pom tau hais tias lawv muaj peev xwm suav nrog tib neeg hauv lawv cov txheej txheem computational. Ntawm no yog li cas Luis von Ahn (2005) tau piav txog tib neeg kev paub thaum nws thawj lub sijhawm hauv nws zaj lus sau tseg: "ib qho kev siv rau kev siv tib neeg kev ua haujlwm los daws cov teeb meem uas computers tsis tuaj yeem daws tau." Rau ib phau ntawv ntev kho ntawm tib neeg kev xam pom, feem ntau kev nkag siab ntawm lub sij hawm, saib Law and Ahn (2011) .
Raws li cov lus txhais hauv Ahn (2005) Foldit-uas kuv tau piav qhia nyob rau hauv seem ntawm kev hu-qhib yuav suav tau tias yog ib qhov kev ntsuas tib neeg. Txawm li cas los xij, kuv xaiv Categorize Foldit ua tus qhib hu vim tias nws yuav tsum muaj kev txawj ntse tshwj xeeb (txawm tias tsis yog kev cob qhia kev kawm) thiab nws yuav siv qhov kev daws teeb meem zoo tshaj plaws, tsis yog siv qhov muab faib ua ke-nruab nrab.
Lo lus "split-apply-combine" yog siv los ntawm Wickham (2011) los mus piav qhia txog lub tswv yim rau kev sib tw, tab sis nws txig cov txheej txheem ntawm ntau cov tib neeg kev ua lag luam. Sib cais-nruab nrab-sib txuas ua ke uas zoo sib xws rau MapReduce moj khaum hauv Google; rau ntxiv rau MapReduce, saib Dean and Ghemawat (2004) thiab Dean and Ghemawat (2008) . Yog xav paub ntau ntxiv ntawm lwm cov qauv kev lag luam, saib Vo and Silvia (2016) . Tshooj 3 kev Law and Ahn (2011) muaj kev sib tham txog cov haujlwm uas muaj ntau txoj hauv kev ua ke ntau dua cov hauv tshooj lus no.
Nyob rau hauv cov kev qhia txog tib neeg kev lag luam uas kuv tau sib tham hauv tshooj, cov neeg koom tau paub txog dab tsi tshwm sim. Qee lub luag haujlwm, tab sis, nrhiav kev ntes "haujlwm" uas twb tshwm sim lawm (zoo li eBird) thiab tsis muaj cov neeg paub txog. Saib, piv txwv, tus ESP Game (Ahn and Dabbish 2004) thiab reCAPTCHA (Ahn et al. 2008) . Txawm li cas los xij, ob qho tib si ntawm cov haujlwm no tseem muaj cov lus nug txog kev ncaj ncees vim tias cov neeg koom tsis paub tias lawv cov ntaub ntawv raug siv li cas (Zittrain 2008; Lung 2012) .
Tshaj tawm ntawm ESP Game, ntau cov kws tshawb fawb tau sim los tsim lwm cov "kev ua si nrog lub hom phiaj" (Ahn and Dabbish 2008) (piv txwv li, "ua tib neeg raws le kev ua lej" (Pe-Than, Goh, and Lee 2015) ) uas yog siv los daws teeb meem ntau yam. Cov "kev ua si nrog lub hom phiaj" muaj ntau yam yog tias lawv sim ua kom cov hauj lwm uas muaj feem cuam tshuam rau neeg suav hais txog kev lom zem. Yog li, thaum cov kev ua si hauv ESP sib koom ua ke-siv-ua ke qauv nrog Galaxy Zoo, nws txawv hauv kev koom tes li cas yog kev txhawb siab-kev lom zem tshaj qhov muaj siab los pab kev tshawb nrhiav. Yog xav paub ntxiv txog kev ua si nrog lub hom phiaj, saib Ahn and Dabbish (2008) .
Kuv qhov kev piav qhia ntawm Galaxy Zoo draws ntawm Nielsen (2012) , Adams (2012) , Clery (2011) , thiab Hand (2010) , thiab kuv kev nthuav qhia ntawm cov hom phiaj tshawb fawb ntawm Galaxy Zoo yog yooj yim. Yog xav paub ntxiv txog keeb kwm ntawm galaxy kev cais hauv astronomy thiab Galaxy Zoo li cas qhov kev lig kev cai, saib Masters (2012) thiab Marshall, Lintott, and Fletcher (2015) . Lub tsev ntawm Galaxy Zoo, cov kws tshawb fawb tau ua tiav Galaxy Zoo 2 uas tau sau ntau tshaj 60 plhom tawm ntau hom kev qhia tawm ntawm cov neeg tuaj yeem pab dawb (Masters et al. 2011) . Tsis tas li ntawd xwb, lawv tau tawm mus ua teeb meem sab nraud ntawm galaxy morphology, nrog rau kev tshawb txog lub hli ntawm lub hli, nrhiav lub ntiaj teb, thiab sau cov ntaub ntawv qub. Tam sim no, tag nrho lawv cov haujlwm yog sau nyob rau ntawm Zooniverse lub website (Cox et al. 2015) . Ib qho ntawm cov hauj lwm-Snapshot Serengeti-muab pov thawj tias Galaxy zoo hom duab classification tej yaam num kuj tseem yuav ua rau kev tshawb fawb txog ib puag ncig (Swanson et al. 2016) .
Rau cov kws soj ntsuam xyuas npaj siv lub chaw muag khoom noj khoom haus (xws li, Amazon Mechanical Turk) rau ib qhov project Chandler, Paolacci, and Mueller (2013) thiab J. Wang, Ipeirotis, and Provost (2015) muab tswv yim zoo rau kev tsim qauv thiab lwm yam teeb meem muaj feem xyuam. Porter, Verdery, and Gaddis (2016) muab kev piv txwv thiab cov tswv yim tshwj xeeb rau kev siv cov microtask cov kev lag luam rau cov lus lawv hu ua "cov ntaub ntawv cog lus." Cov kab txuas ntawm cov ntaub ntawv txhawb nqa thiab cov ntaub ntawv khaws qee yam tsis zoo. Yog xav paub ntxiv txog kev sau thiab siv cov ntawv rau kev saib xyuas kev kawm rau cov ntawv nyeem, saib Grimmer and Stewart (2013) .
Cov neeg tshawb nrhiav xav tsim tej yam kuv tau hu ua computer uas pab tau tib neeg cov kev laij lej (xws li, cov tshuab siv tib neeg cov ntawv los cob qhia lub tshuab kev kawm) tej zaum yuav nyiam Shamir et al. (2014) (rau ib qho piv txwv uas siv audio) thiab Cheng and Bernstein (2015) . Tsis tas li ntawd, lub tshuab kev kawm txog cov qauv ntawm cov projects no yuav raug hu nrog kev qhib lus, uas cov neeg tshawb xyuas sib tw los ua cov tshuab kev kawm nrog cov txheej txheem loj tshaj. Piv txwv, Galaxy Zoo pab pawg tau khiav qhib kev sib tham thiab nrhiav kom tau ib qho kev qhia tshiab uas ua tau zoo tshaj plaws rau hauv Tsim los ntawm Banerji et al. (2010) ; saib Dieleman, Willett, and Dambre (2015) kom paub meej.
- Qhib hu (Tshooj 5.3)
Kev qhib hu tsis yog tshiab. Qhov tseeb tiag, yog ib lub caij nyoog zoo tshaj plaws hu ua hnub qhib rov los txog 1714 thaum Britain lub Koom Txoos tsim qhov Longitude Prize rau txhua tus neeg uas yuav tsim ib txoj kev los txiav txim siab txog lub nkoj hauv hiav txwv. Qhov teeb meem stumped ntau ntawm cov kws tshawb fawb loj tshaj plaws ntawm lub caij, xws li Isaac Newton, thiab cov kev sib tw yeej tau muab xa los ntawm John Harrison, tus neeg ua hauj lwm ntawm lub nroog uas tau ntsib qhov teeb meem txawv ntawm cov kws tshawb fawb uas tau teem rau kev daws teeb meem ; yog xav paub ntxiv, saib Sobel (1996) . Raws li qhov ua piv txwv no, ib qhov laj thawj uas qhib kev hu ua xav ua haujlwm zoo yog tias lawv muab tau rau cov neeg uas muaj kev sib txawv thiab kev txawj (Boudreau and Lakhani 2013) . Saib Hong and Page (2004) thiab Page (2008) ntxiv rau qhov muaj nqis ntawm ntau haiv neeg hauv kev daws teeb meem.
Txhua tus neeg qhib hu rau hauv tshooj yuav tsum tau piav me ntsis txog vim li cas nws yog nyob rau hauv pawg no. Ua ntej, ib txoj kev uas kuv paub qhov txawv ntawm tib neeg kev lag luam thiab kev hu xov tooj qhib yog seb cov zis yog qhov nruab nrab ntawm txhua qhov kev daws teeb meem (kev ua tib zoo ntawm tib neeg) los yog cov tshuaj zoo tshaj plaws (qhib hu). Netflix Prize yog ib qho nyuaj rau txoj kev xav no vim hais tias qhov kev daws teeb meem zoo tshaj los ua ib qho nyuaj nruab nrab ntawm cov kev daws teeb meem, ib qho kev hu ua ntau yam kev pabcuam (Bell, Koren, and Volinsky 2010; Feuerverger, He, and Khatri 2012) . Los ntawm cov kev xav ntawm Netflix, li cas los xij, txhua yam lawv tau ua yog xaiv qhov kev daws teeb meem zoo tshaj plaws. Ntxiv rau Netflix Prize, saib Bennett and Lanning (2007) , Thompson (2008) , Bell, Koren, and Volinsky (2010) , thiab Feuerverger, He, and Khatri (2012) .
Thib ob, los ntawm qee cov lus txhais ntawm tib neeg kev xam pom (xws li, Ahn (2005) ), Foldit yuav tsum tau suav hais tias yog ib qhov kev ntsuas tib neeg. Txawm li cas los xij, kuv xaiv los ua qhov kev sib tham qhib vim tias nws yuav tsum muaj kev txawj ntse tshwj xeeb (txawm tias tsis yog qhov kev kawm tshwj xeeb) thiab nws yuav siv qhov kev daws teeb meem zoo tshaj plaws, tsis yog siv qhov muab faib ua ke-nruab nrab. Yog xav paub ntxiv txog Foldit, Cooper et al. (2010) , Khatib et al. (2011) , thiab Andersen et al. (2012) ; Kuv piav qhia txog Foldit thim piav qhia txog Bohannon (2009) , Hand (2010) , thiab Nielsen (2012) .
Thaum kawg, ib tug yuav cam tias Peer-to-Patent yog ib qho piv txwv ntawm kev faib cov ntaub ntawv khaws cia. Kuv xaiv kom muab nws hu ua vim tias nws muaj kev sib tw zoo li kev sib tw thiab tsuas yog qhov zoo tshaj plaws txoj kev koom tes siv, yog muaj nrog faib cov ntaub ntawv khaws tseg, lub tswv yim ntawm qhov zoo thiab tsis zoo yog tsis tshua meej. Yog xav paub ntxiv rau Peer-to-Patent, mus saib Noveck (2006) , Ledford (2007) , Noveck (2009) , thiab Bestor and Hamp (2010) .
Hauv kev siv cov kev qhib hu rau kev tshawb fawb, tau zoo ib yam li cov neeg ntawm Glaeser et al. (2016) , tau tshaj tawm nyob rau hauv tshooj 10 ntawm Mayer-Schönberger and Cukier (2013) uas New York City tau siv cov qauv kev twv ua ntej los tsim cov khoom loj hauv cov khoom tsim tau ntawm cov neeg soj ntsuam vaj tse. Hauv New York City, cov qauv kev twv no yog los ntawm cov neeg ua haujlwm hauv nroog, tiamsis lwm tus neeg, xav txog tias lawv yuav tsim los kho nrog cov neeg hu xov tooj (xws li, Glaeser et al. (2016) ). Txawm li cas los xij, ib qho kev txhawj xeeb loj tshaj nrog cov qauv ntawm kev siv los muab faib cov kev pab yog tias cov qauv no muaj peev xwm los txhawb cov kev xav tau. Muaj ntau cov kws tshawb fawb tau paub "khib nyiab, khib nyiab tawm," thiab nrog cov qauv ua ntej nws yuav ua tau "zoo dua, kev txiav txim siab tawm." Saib Barocas and Selbst (2016) thiab O'Neil (2016) ntxiv rau txoj kev txhawj xeeb ntawm cov qauv kev ntseeg nrog rau kev cob qhia cov ntaub ntawv.
Ib qho teeb meem uas yuav thaiv tsoom fwv los ntawm kev siv qhib kev sib tw yog tias qhov no yuav tsum tau muab cov ntaub ntawv tso tawm, uas yuav ua rau kev ua txhaum cai tsis pub leej twg paub. Yog xav paub ntxiv txog kev ceev ntiag tug thiab cov ntaub ntawv tso tawm hauv kev qhib hu, saib Narayanan, Huey, and Felten (2016) thiab kev sib tham hauv tshooj 6.
Xav paub ntau ntxiv ntawm qhov txawv thiab qhov zoo sib xws ntawm twv ua ntej thiab piav qhia, saib Breiman (2001) , Shmueli (2010) , Watts (2014) , thiab Kleinberg et al. (2015) . Yog xav paub ntxiv txog kev twv hauv kev tshawb fawb, mus saib Athey (2017) , Cederman and Weidmann (2017) , Hofman, Sharma, and Watts (2017) , ( ??? ) , thiab Yarkoni and Westfall (2017) .
Rau kev ntsuam xyuas cov haujlwm qhib hu ua biology, suav nrog cov tswv yim tsim, saib Saez-Rodriguez et al. (2016) .
- Muab cov ntaub ntawv khaws cia (ntu 5.4)
Kuv qhov kev piav qhia ntawm eBird thim rau kev piav qhia hauv Bhattacharjee (2005) , Robbins (2013) , thiab Sullivan et al. (2014) . Yog xav paub ntxiv txog kev soj ntsuam ntawm kev tshawb fawb siv los ntsuam xyuas eBird cov ntaub ntawv saib Fink et al. (2010) thiab Hurlbert and Liang (2012) . Yog xav paub ntxiv txog qhov kev txawj ntse ntawm eBird cov neeg tuaj koom, saib Kelling, Johnston, et al. (2015) . Yog xav paub ntxiv txog keeb kwm ntawm pej xeem cov kev tshawb fawb hauv ornithology, saib Greenwood (2007) .
Yog xav paub ntxiv txog Malawi Cov Hom Haujlwm, saib Watkins and Swidler (2009) thiab Kaler, Watkins, and Angotti (2015) . Yog xav paub ntxiv txog ib txoj haujlwm hauv South Africa, saib Angotti and Sennott (2015) . Rau ntau cov qauv ntawm kev tshawb fawb siv cov ntaub ntawv los ntawm Malawi Duab Kev Tuaj Saib xyuas Kaler (2004) thiab Angotti et al. (2014) .
- Tsim koj tus kheej (ntu 5.5)
Kuv txoj kev qhia txog kev tsim cov tswv yim tsim yog inductive, raws li cov piv txwv ntawm txoj kev vam meej thiab ua tsis tau zoo sib koom tes uas kuv tau hnov txog. Kuj muaj kev tshawb nrhiav kev sim siv ntau tshaj kev puas siab puas ntsws theories los tsim cov vev xaib hauv zej zos uas muaj feem xyuam rau kev tsim cov qauv kev sib koom tes, saib, piv txwv li, Kraut et al. (2012) .
Hais txog cov neeg tuaj koom siab, nws tseem ceeb heev kom paub tseeb tias vim li cas cov neeg koom rau hauv cov koom tes nrog kev sib koom tes (Cooper et al. 2010; Nov, Arazy, and Anderson 2011; Tuite et al. 2011; Raddick et al. 2013; Preist, Massung, and Coyle 2014) . Yog tias koj npaj siab txhawb cov neeg tuaj koom nrog kev them nyiaj rau ntawm lub khw muag khoom ua lag luam (xws li, Amazon Mechanical Turk), Kittur et al. (2013) muaj qee cov tswv yim.
Hais txog kev ua haujlwm tsis txaus ntseeg, rau ntau cov qauv ntawm kev npaj txhij txog discoveries los ntawm cov haujlwm Zooiverse, saib Marshall, Lintott, and Fletcher (2015) .
Hais txog kev coj zoo, qee cov ntsiab lus zoo rau cov teeb meem yog Gilbert (2015) , Salehi et al. (2015) , Schmidt (2013) , Williamson (2016) , Resnik, Elliott, and Miller (2015) , thiab Zittrain (2008) . Rau cov teeb meem tshwj xeeb uas muaj feem xyuam nrog cov teeb meem kev cai lij choj nrog cov neeg ua hauj lwm coob, saib Felstiner (2011) . O'Connor (2013) teb cov lus nug txog kev saib xyuas kev ncaj ncees ntawm kev tshawb fawb thaum lub luag haujlwm ntawm cov neeg tshawb nrhiav thiab cov neeg koom nrog. Rau cov teeb meem ntsig txog kev sib qhia cov ntaub ntawv thaum tiv thaiv cov neeg koom hauv kev tshawb fawb txog pej xeem, saib Bowser et al. (2014) . Ob Purdam (2014) thiab Windt and Humphreys (2016) muaj qee cov kev sibtham txog teebmeem teeb meem hauv cov ntaub ntawv khaws tseg. Thaum kawg, feem ntau cov haujlwm lees paub cov nyiaj pab tab sis tsis muab ntawv tso cai rau cov neeg tuaj koom. Hauv Foldit, cov players feem ntau sau ua tus sau (Cooper et al. 2010; Khatib et al. 2011) . Hauv lwm txoj haujlwm qhib hu haujlwm, tus neeg tsim khoom uas tau txais txiaj ntsig yeej tuaj yeem sau ib daim ntawv qhia txog lawv cov kev daws teeb meem (xws li, Bell, Koren, and Volinsky (2010) thiab Dieleman, Willett, and Dambre (2015) ).
