4.3 Biyu girma da gwaje-gwajen: Lab-filin da kuma analog-digital

Lab gwaje-gwajen bayar iko, filin gwajen bayar da labarun almara, kuma digital filin gwajen hada iko da labarun almara a sikelin.

Gwaje-gwaje sun zo da yawa da siffofi daban-daban. A baya, masu binciken sun gano cewa yana taimakawa don tsara gwaje-gwaje tare da ci gaba tsakanin jarrabawar gwaje-gwaje da gwaje-gwajen gwaje-gwaje . Yanzu, duk da haka, masu bincike ya kamata su tsara gwaje-gwajen tare da cigaba na biyu tsakanin nazarin analog da gwaje-gwaje na dijital . Wannan wuri na zane-zane na biyu zai taimake ka ka fahimci karfi da kasawan hanyoyin daban-daban da kuma fadada wuraren da ya fi dacewa (siffar 4.1).

Hoto na 4.1: Tsarin sararin samaniya don gwaje-gwaje. A baya, gwaje-gwaje sun bambanta tare da girman zangon. Yanzu, su ma sun bambanta a kan analog-dijital girma. Wannan samfurin zane-zane na biyu an kwatanta shi ta gwaje-gwaje hudu da na bayyana a cikin wannan babi. A ganina, yanki mafi girma shine damar gwaje-gwaje na zamani.

Ɗaya girma tare da gwaje-gwajen da za a iya tsara shi shine shimfidar rubutu. Yawancin gwaje-gwaje a cikin ilimin zamantakewa su ne gwaje-gwajen gwaje-gwaje inda ɗaliban dalibai ke yin ayyuka na ban mamaki a cikin laccocin don bashi bashi. Irin wannan gwaji ya mamaye bincike akan ilimin halayyar kwakwalwa domin ya sa masu bincike su kirkiro saitunan da aka tsara don warewa daidai da kuma gwada gwaje-gwajen musamman game da halin zamantakewa. Ga wasu matsalolin, duk da haka, wani abu yana jin dadi game da zartar da karfi game da halin mutum daga irin waɗannan mutane masu ban mamaki da ke yin irin waɗannan ayyuka masu ban mamaki a cikin irin wannan sabon wuri. Wadannan damuwa sun haifar da motsi ga gwaje-gwaje a filin . Gwajin gwaje-gwajen sun hada da kyakkyawar tsarin gwajin gwagwarmaya da wasu kungiyoyin wakilai masu wakilci wadanda ke aiki mafi yawan ayyuka a cikin saitunan halitta.

Kodayake wasu mutane suna tunani game da lab da gwaje-gwaje na kwarewa a matsayin hanyoyin da suka dace, yana da kyau a yi la'akari da su kamar yadda ya dace, tare da karfi da raunana. Alal misali, Correll, Benard, and Paik (2007) sunyi amfani da gwaje-gwajen gwaje-gwaje da gwaje-gwajen gwaje-gwajen a kokarin ƙoƙari na gano tushen "azãba mata." A Amurka, iyaye mata suna samun kuɗi fiye da mata marasa 'ya'ya, koda lokacin kwatanta mata da kamfanoni irin wannan aiki a cikin ayyukan da aka yi. Akwai bayanai masu yawa game da wannan tsari, ɗaya daga cikinsu shi ne cewa masu daukan ma'aikata suna nuna bambanci ga iyaye mata. (Abin sha'awa, kishiyar alama ta zama gaskiya ga iyayensu: suna nuna karuwanci fiye da marayu marayu.) Don tantance yiwuwar nuna bambanci ga iyaye mata, Correll da abokan aiki sunyi gwaje-gwaje biyu: daya a cikin lab da daya a filin.

Na farko, a cikin gwajin gwaji sun gaya wa mahalarta, wadanda suka kasance daliban koleji, cewa wani kamfani yana gudanar da bincike na neman aikin mutum don jagorantar sabon sashen kasuwanci na Gabas ta Gabas. An gaya wa] aliban cewa kamfanin yana son taimakon su a cikin aikin haya, kuma ana buƙatar su su sake dawowa da 'yan takarar da dama da dama kuma su yi la'akari da' yan takara a kan wasu nau'o'i, irin su fahimta, jin dadi, da kuma sadaukar da kansu don yin aiki. Bugu da ƙari, an tambayi dalibai idan za su bayar da shawarar yin aiki da mai bukata da kuma abin da za su bayar da shawarar a matsayin fara albashi. Amma ba a sani ba ga ɗalibai, an sake gina su don su kasance kamar misalin abu daya: wasu daga cikinsu sun nuna alamun mahaifiyar (ta hanyar lissafin shiga a cikin mahaifiyar malaman) kuma wasu ba su. Correll da abokan aiki sun gano cewa ɗalibai ba su iya bayar da shawara ga iyaye mata ba kuma suna ba su albashin farawa. Bugu da ƙari, ta hanyar nazarin lissafi na duka ƙididdigar da yanke shawara game da haɗin kai, Correll da abokan aiki sun gano cewa rashin fahimtar iyayen mata sun bayyana a fili cewa an kiyasta su a matsayin kwarewa da ƙaddamarwa. Sabili da haka, wannan gwagwarmayar gwagwarmaya ta baiwa Correll da abokan aiki damar yin la'akari da sakamako masu tasiri da kuma samar da bayanin yiwuwar wannan sakamako.

Ko shakka babu, wanda zai iya yin shakka game da zartar da game da dukan kasuwancin Amurka na aiki bisa la'akari da ƙwararrun ƙananan dalibai waɗanda ba su taɓa samun aiki na cikakken lokaci ba, to ba shi kadai ya haɗta wani. Sabili da haka, Correll da abokan aiki sun gudanar da gwaje-gwaje na musamman. Sun mayar da martani ga daruruwan wuraren yin tallace-tallace tare da rubutun haruffan murya kuma suka sake komawa. Hakazalika da kayan da aka nuna wa dalibai, wasu sun sake komawa bayan haihuwar mata kuma wasu ba su. Correll da abokan aiki sun gano cewa iyaye mata ba za su iya mayar da su ba don tambayoyi fiye da matan da ba su da yara. A wasu kalmomi, masu aiki na ainihi suna yin yanke shawara masu dacewa a cikin yanayi na dabi'a sunyi kama da ƙananan dalibai. Shin, sun yi irin wannan yanke shawara don wannan dalili? Abin takaici, ba mu sani ba. Masu binciken ba su iya tambayar masu daukan ma'aikata su yi la'akari da 'yan takarar ko kuma bayyana yanke shawara ba.

Wannan nau'i na gwaje-gwaje ya nuna da yawa game da Lab da kuma gwaje-gwaje a filin. Labaran Lab na bayar da masu bincike a kusa da-duka kula da yanayin da mahalarta ke yin yanke shawara. Don haka, alal misali, a cikin gwaji na jarrabawar, Correll da abokan aiki sun iya tabbatar da cewa duk an sake karantawa a cikin wani wuri mai dadi; a cikin gwajin gwajin, wasu daga cikin sake dawowa bazai iya karantawa ba. Bugu da ari, saboda mahalarta a cikin labarun sun san cewa ana nazarin su, masu bincike sukan iya tattara ƙarin bayanai da zasu iya taimakawa wajen bayyana dalilin da ya sa mahalarta ke yin yanke shawara. Alal misali, Correll da abokan aiki sun tambayi mahalarta a cikin gwaji na jarrabawar jarrabawa don su fahimci 'yan takara a daban-daban. Irin wannan tsari na bayanai zai iya taimakawa masu bincike su fahimci hanyoyin da ke tattare da bambance-bambance a yadda mahalarta ke kula da komawa.

A gefe guda kuma, wadannan nau'ikan halaye guda ɗaya da na bayyana kawai a matsayin amfani ne a wasu lokuta ana la'akari da rashin amfani. Masu bincike da suka fi son nazarin yanayi sun nuna cewa masu shiga cikin gwajin gwaje-gwaje na iya yin bambanci sosai domin sun san cewa ana nazarin su. Alal misali, a cikin gwaji na gwajin, mahalarta zasu iya tunanin makasudin binciken kuma canza halin su don kada su nuna rashin jin dadi. Bugu da ƙari, masu bincike waɗanda suka fi dacewa da gwaje-gwajen yanayi zasu iya jayayya cewa ƙananan bambance-bambance na sake komawa cikin yanayin tsabta mai kyau, kuma ta haka gwajin gwaji zai kara yawan sakamako na iyaye a hakikanin yanke hukunci. A ƙarshe, masu gabatarwa da yawa na gwaje-gwaje na gwaje-gwaje sunyi la'akari da gwaje-gwaje na gwaje-gwajen "dogara ga masu halartar WEIRD: yawanci ɗalibai daga kasashen yamma, Ilmantarwa, Masana'antu, Rich, da Democratic (Henrich, Heine, and Norenzayan 2010a) . Gwaje-gwajen da Correll da abokan aiki (2007) nuna sun nuna matakan biyu a kan ci gaba da rubutu. A tsakanin waɗannan matakan biyu akwai magungunan samfurori iri-iri, ciki har da haɗaka irin su kawo waɗanda ba 'yan makaranta a cikin layi ko shiga cikin filin amma har yanzu masu halartar suna yin wani aiki na ban mamaki.

Bugu da ƙari da yanayin da aka yi a baya, zamanin na zamani yana nufin cewa masu bincike yanzu suna da girma ta biyu tare da gwaje-gwajen na iya bambanta: analog-digital. Kamar dai yadda akwai gwaje-gwaje mai tsabta, gwaje-gwaje mai kyau, da samfurori iri-iri a tsakanin, akwai nazarin analog mai tsabta, tsabtace nau'i na dijital, da kuma nau'in hybrids daban-daban. Yana da kyau don bayar da cikakkiyar ma'anar wannan tsarin, amma ma'anar aiki mai amfani shine cewa cikakkun gwaje-gwaje na dijital suna gwaje-gwajen da suke yin amfani da kayan aikin dijital don karɓar masu halartar, haɓaka, ba da magani, da ma'auni. Alal misali, Restivo da binciken van de Rijt (2012) na barnstars da Wikipedia ya kasance gwajin dijital ne na musamman saboda ya yi amfani da tsarin na'ura na dukkanin wadannan matakai guda hudu. Hakazalika, cikakken nazarin analog bazai yi amfani da kayan aikin dijital ba saboda kowane daga cikin wadannan matakai guda hudu. Yawancin gwaje-gwaje masu gwaji a cikin ilimin kwakwalwa suna da cikakkiyar nazarin analog. A tsakanin waɗannan matakan biyu, akwai gwaje-gwaje na zamani wanda ke amfani da haɗin tsarin analog da dijital.

Yayin da wasu mutane ke yin la'akari da gwaje-gwaje na dijital, suna nan da nan suna tunani akan gwaje-gwajen kan layi. Wannan abin takaici ne saboda damar da za a gudanar da gwaje-gwaje na dijital ba kawai a kan layi ba. Masu bincike zasu iya gudanar da gwaje-gwaje na zamani ta hanyar yin amfani da na'urori na dijital a cikin jiki ta duniya don yada alamun magani ko sakamakon sakamakon. Alal misali, masu bincike za su iya amfani da wayoyin hannu don yalwata jiyya ko na'urori masu auna hankali a cikin gine-ginen wuri don auna sakamakon. A gaskiya ma, kamar yadda za mu gani a baya a cikin wannan babin, masu bincike sun riga sun yi amfani da matakan wutar lantarki don su auna sakamakon sakamakon gwaje-gwajen game da makamashi da ake amfani da gidaje 8.5 miliyan (Allcott 2015) . Yayin da na'urori na dijital suka ci gaba da haɓaka cikin rayuwar mutane kuma masu sauti sun zama cikin haɗin gine-ginen, wadannan damar da za su iya gudanar da gwaje-gwaje na zamani a cikin jiki ta duniya zasu kara karuwa sosai. A takaice dai, gwaje-gwaje na dijital ba kawai nazarin kan layi ba ne.

Tsarin lantarki yana samar da sababbin hanyoyin yin gwaje-gwaje a ko'ina tare da ci gaba da layi. A cikin gwaji mai tsafta, misali, masu bincike zasu iya amfani da tsarin dijital don gwada yawan halayen mahalarta; misali daya daga wannan nau'i na ingantattun kayan aiki shine kayan aiki na idanu wanda yake bada cikakkun matakan da za su iya kallo. Hakanan na zamani yana haifar da yiwuwar gudanar da gwaje gwaje-gwaje a cikin layi. Alal misali, masu bincike sun hanzarta amfani da kamfanin na Mechanical Turk (MTurk) don tara masu halartar gwaje-gwajen kan layi (siffa 4.2). Matakan MTurk sun haɗu da "ma'aikata" waɗanda ke da ayyuka waɗanda ake buƙatar kammalawa tare da "ma'aikata" wadanda ke so su cika wadannan ayyuka na kudi. Sabanin kasuwanni na gargajiyar gargajiya, duk da haka, ayyukan da ake amfani da ita yana buƙatar kawai 'yan mintoci kaɗan don kammalawa, kuma dukan hulɗar tsakanin ma'aikata da ma'aikacin shine a layi. Saboda MTurk yana amfani da nau'o'i na nazarin al'ada na al'ada-biya mutane don kammala ayyukan da ba za su yi ba kyauta-yana da kyau don dacewa da wasu gwaje-gwaje. Mahimmanci, MTurk ya kirkiro hanyoyin da za a gudanar da gudanarwa na mahalarta - karɓar mutane da biyan kuɗi - kuma masu bincike sun yi amfani da wannan kayan don su shiga cikin mahalarta masu zaman kansu a koyaushe.

Figure 4.2: Takardun da aka buga ta amfani da bayanai daga Amazon Mechanical Turk (MTurk). MTurk da sauran kasuwancin kasuwancin kan layi suna ba masu bincike hanya mai kyau don karɓar masu halartar taron don gwaje-gwaje. An sauya daga Bohannon (2016) .

Tsarin na'urori na yau da kullum suna samar da karin hanyoyin da za a iya gwada su. Musamman ma, sun taimaka wa masu bincike su hada karfi da sarrafa bayanai da suke hade da gwajin gwaje-gwajen tare da masu yawancin mahalarta da kuma sauran saitunan halitta wanda ke hade da gwajin gwaji. Bugu da ƙari, gwaje-gwaje na filin wasanni na zamani yana ba da damar sau uku waɗanda ke da wahala a cikin nazarin analog.

Na farko, yayin da mafi yawan nazarin analog da gwaje-gwajen gwaje-gwaje na da daruruwan mahalarta, gwaje-gwaje na filin wasa na zamani na iya samun miliyoyin mahalarta. Wannan canji a sikelin shine saboda wasu gwaje-gwaje na dijital na iya samar da bayanai a farashi mai tsada. Wato, da zarar masu bincike sun kirkiro kayan aikin gwaje-gwajen, kara yawan yawan mahalarta bazai ƙara yawan kudin ba. Kara yawan mahalarta da wani factor na 100 ko fiye da shi ne ba kawai a gwada yawa canji. yana da canji na kwararru , domin yana sa masu bincike suyi koyi da abubuwa daban-daban daga gwaje-gwaje (misali, bambancin yanayin maganin) da kuma yin gwaje-gwajen gwaje-gwajen daban-daban (misali, gwaje-gwajen manyan kungiyoyi). Wannan batu yana da mahimmanci, zan dawo zuwa ƙarshen babin lokacin da na bada shawara game da ƙirƙirar gwaje-gwaje na dijital.

Na biyu, yayin da mafi yawan nazarin analog da gwaje-gwajen gwaje-gwaje sunyi wa mahalarta nau'in widget din, wanda aka yi amfani da gwaje-gwaje a filin wasa sau da yawa yana amfani da bayanan bayanan game da mahalarta a cikin tsari da kuma nazari na bincike. Wannan bayanan bayanan, wanda ake kira bayanan kulawa , yana samuwa a cikin gwaje-gwaje na dijital saboda ana gudanar da su a saman tsarin da aka saba kan su (duba babi na 2). Alal misali, wani mai bincike a Facebook yana da karin bayani game da mutane a cikin gwaji na gwaje-gwaje na zamani kamar yadda jami'in jami'a ya yi game da mutanen da ke cikin gwajin analog na analog. Wannan maganin da aka riga ya sa ya samar da samfurin gwaji mafi dacewa-irin su rufe (Higgins, Sävje, and Sekhon 2016) da kuma ɗaukar nauyin mahalarta (Eckles, Kizilcec, and Bakshy 2016) - (Eckles, Kizilcec, and Bakshy 2016) bincike-irin su ƙididdigar ilimin kwayoyin cutar (Athey and Imbens 2016a) da daidaita daidaituwa don daidaitaccen daidaituwa (Bloniarz et al. 2016) .

Na uku, yayin da yawancin nazarin analog da gwaje-gwaje na gwaje-gwaje sun shayar da jiyya da kuma auna ma'auni a cikin wani lokaci mai mahimmanci, wasu gwaje-gwaje na filin wasanni sun faru a kan lokuta da yawa. Alal misali, Restivo da gwagwarmayar van de Rijt sun sami sakamakon da aka auna a kowace rana har kwana 90, kuma daya daga cikin gwaje-gwajen da zan fada maka daga baya a cikin babi na (Ferraro, Miranda, and Price 2011) gano sakamakon a cikin shekaru uku ba da mahimmanci ba. kudin. Wadannan hanyoyi uku, bayanan magancewa, da magungunan lokaci da bayanai-sun fi yawanci lokacin da gwaje-gwajen ke gudana a kan tsarin da aka saba kan su (duba babi na 2 don ƙarin bayani game da tsarin bincike).

Duk da yake gwaje-gwaje na na'urori na zamani sun ba da dama, suna kuma raba wasu raunana tare da duka analog da kuma nazarin binciken analog. Alal misali, ba za a iya amfani da gwaje-gwaje don nazarin da suka gabata ba, kuma zasu iya kwatanta tasirin jiyya wanda za'a iya amfani dasu. Har ila yau, kodayake gwaje-gwaje sun kasance masu amfani don jagorantar manufofin, jagorancin jagorancin da suke iya ba da ɗan iyakance saboda matsalolin irin su kare muhalli, matsalolin kulawa, da la'akari da ma'auni (Banerjee and Duflo 2009; Deaton 2010) . Nemo gwaje-gwajen nau'i na nau'i na nau'i mai yawa suna kara girman damuwar da aka samo daga gwaje-gwajen filin-batun da zan tattauna a baya a cikin wannan babin kuma a babi na 6.