Ayyukan

key:

• mataki na wahala: sauki , matsakaici , m , Da wuya
• bukatar ilimin lissafi ( )
• bukatar coding ( )
• data tarin ( )
• ta favorites ( )

1. [ , ] Berinsky da kuma abokan aiki (2012) bincika injuna Turk a sashi daga rubanya uku classic gwaje-gwajen. Rubanya da classic Asian cuta siffatawa gwaji da Tversky and Kahneman (1981) . Ku sakamakon wasan Tversky da Kahneman ta? Ku sakamakon wasan Berinsky da kuma abokan aiki? Menene-idan wani abu-baya wannan ya koya mana game da amfani da injuna Turk for binciken gwajen?

2. [ , ] A cikin wani da ɗan harshe-in-kunci takarda mai taken "Mun karya Up," zamantakewa psychologist Robert Cialdini, daya daga cikin marubutan Schultz et al. (2007) , ya rubuta cewa ya yi ritaya da wuri daga aiki a matsayin wani farfesa, a sashi saboda kalubalen da yake fuskanta yin filin gwaje-gwajen a cikin wani horo (tunani) cewa yafi gudanar da gwaje-gwajen Lab (Cialdini 2009) . Read Cialdini takarda, ka rubuta masa email na kira da'a hadakai da shi zuwa sake ya fasa-up a cikin hasken da yiwuwa na digital gwaje-gwajen. Yi amfani da takamaiman misalai na bincike cewa magance damuwarsa.

3. [ ] Domin sanin ko kananan farko nasarorin kulle-in ko Fade bãya, van de Rijt da kuma abokan aiki (2014) ta shãmakace a cikin hudu daban-daban tsarin bestowing nasara a kan da ka zaba mahalarta, sa'an nan kuma auna tsawon lokaci tasirin wannan sabani nasara. Za ku iya tunanin sauran tsarin da ba ka iya gudu kama gwajen? Kimanta wadannan tsarin cikin sharuddan al'amurran da suka shafi kimiyya darajar, algorithmic confounding (duba Babi na 2), da kuma xa'a.

4. [ , ] Sakamakon wani gwajin iya dogara a kan mahalarta. Create an gwaji, sa'an nan kuma gudu da shi a kan Amazon Mechanical Turk (MTurk) ta yin amfani biyu daban-daban daukar ma'aikata dabarun. Ka yi kokarin tara da gwaji da kuma daukar ma'aikata dabarun sabõda haka, sakamakon zai zama kamar daban-daban kamar yadda zai yiwu. Alal misali, your daukar ma'aikata dabarun iya zama kurtu mahalarta, a sãfe da maraice, ko rama mahalarta da high kuma low albashi. Wadannan irin bambance-bambance a daukar ma'aikata dabarun zai iya haifar da daban-daban tafkunansu mahalarta da kuma daban-daban na gwaji sakamakon. Ta yaya daban-daban bai your results hallara? Menene wannan ya nuna game da guje gwaje-gwajen a MTurk?

5. [ , , , ] Tunanin cewa ka aka shirin wani tunanin Contagion binciken (Kramer, Guillory, and Hancock 2014) . Yi amfani da sakamakon daga baya observational binciken da Kramer (2012) zuwa yanke yawan mahalarta a kowace yanayin. Wadannan biyu karatu ba su daidaita ba daidai saboda haka tabbatar da baro-baro lissafa duk zaton cewa ka yi:

   1. Run a kwaikwaiyo da za su shirya da yawa mahalarta dã an da ake bukata a gane wani sakamako a matsayin babban matsayin sakamako a Kramer (2012) tare da \ (\ alpha = 0.05 \) da kuma \ (1 - \ beta = 0.8 \).
   2. Shin, daidai lissafi analytically.
   3. Ganin sakamakon daga Kramer (2012) da aka Wani tunanin Contagion (Kramer, Guillory, and Hancock 2014) a kan-powered (ie, bai da karin mahalarta fiye da da ake bukata)?
   4. Daga cikin zaton cewa ka yi, wanda da babbar sakamako a kan lissafi?

6. [ , , , ] Amsa tambaya a sama, amma maimakon yin amfani da baya observational binciken da Kramer (2012) a yi amfani da sakamakon daga baya halitta gwaji da Coviello et al. (2014) .

7. [ ] Dukansu Rijt et al. (2014) da kuma Margetts et al. (2011) biyu yi gwaje-gwajen da nazarin aiwatar da mutane ya sanya hannu a takarda. Kwatanta da bambanci da zane da kuma binciken wadannan karatu.

8. [ ] Dwyer, Maki, and Rothman (2015) gudanar biyu filin gwaje-gwajen a kan dangantaka a tsakanin zamantakewa norms da proenvironmental hali. A nan ne m da takarda:

   "Ta yaya za m kimiyya a iya amfani karfafa proenvironmental hali? A biyu karatu, shisshigi da nufin inganta makamashi kiyayewa hali a fili wanka yayi nazari da tsoma na siffatawa norms da kuma na sirri alhakin. A Nazarin 1, hasken status (ie, a kan ko a kashe) da aka nemi yin amfani da wani shiga wani unoccupied jama'a bathroom, sigina da siffatawa kullum sabõda abin da wuri. Mahalarta sun muhimmanci mafi kusantar su kunna fitilu kashe, idan sun kasance kashe a lokacin da suka shiga. A Nazarin 2, wani ƙarin yanayin da aka hada da na kullum juya kashe hasken da aka nuna da wani confederate, amma mahalarta kasance ba da kansu da alhakin juya shi a kan. Personal alhakin tace rinjayar zamantakewa norms a hali. a lokacin da mahalarta suke da alhakin juya a kan haske, rinjayar da kullum da aka rage. Wadannan sakamakon nuna yadda siffatawa norms da kuma na sirri alhakin iya tsara da tasiri na proenvironmental shisshigi. "

   Read da takarda da tsara wani kwafi na binciken 1.

9. [ , ] Orawa a baya tambaya, yanzu gudanar da your zane.

   1. Ta yaya sakamakon kwatanta?
   2. Abin da zai bayyana wadannan bambance-bambance?

10. [ ] An gwaji muhawara game da gwaje-gwajen da yin amfani da mahalarta dauka daga Amazon Mechanical Turk. A a layi daya, akwai kuma ya kasance gwaji muhawara game da gwaje-gwajen da yin amfani da mahalarta dauka daga dalibi dalibi alƙarya. Rubuta biyu page memo gwada kuma contrasting da Turkers da undergraduates kamar yadda masu bincike mahalarta. Your kwatanta kamata sun hada da wani tattaunawa na biyu kimiyya da tafarkin al'amurran da suka shafi.

11. [ ] Jim Manzi littafin uncontrolled (2012) shi ne mai ban mamaki gabatarwa a cikin ikon experimentation a business. A cikin littafin ya relayed wannan labarin:

    "Na yi sau daya a wata ganawa da mai gaskiya business baiwa, a kai sanya billionaire da suka yi mai zurfi, da ilhama understating ikon gwaje-gwajen. Da kamfanin ya ciyar gagarumin albarkatun kokarin haifar girma store taga nuni da zai jawo hankalin masu amfani da kuma tallace-tallace ƙaruwa, kamar yadda al'ada hikima ce su ya kamata. Masana a hankali gwada zane bayan zane, da kuma a cikin mutum gwajin review zaman tsawon shekaru kiyaye nuna wani gagarumin causal sakamako na kowace sabuwar nuni zane a kan tallace-tallace. Senior marketing da merchandising executives gana da Shugaba da za a duba wadannan tarihi gwajin sakamakon a ZuwaZuwa. Bayan gabatar da duk na gwaji data, sun kammala da cewa al'ada hikima ba daidai ba ne-cewa taga nuni ba fitar da tallace-tallace. Su shawarar mataki ya rage halin kaka da kuma} o} arin a cikin wannan yanki. Wannan cika fuska nuna ikon da experimentation to kife al'ada hikima. The Shugaba ta mayar da martani ne mai sauki: 'My ƙarshe shi ne cewa your zanen kaya ba da kyau.' Da bayani da aka ƙara kokarin a store nuni zane, da kuma samun sabon mutane su yi shi. " (Manzi 2012, 158–9)

    Wanne irin tushe ne damuwa da Shugaba?

12. [ ] Orawa a baya tambaya, tunanin cewa ka kasance a taron inda sakamakon gwaje-gwajen da aka tattauna. Mene ne hudu tambayoyi da ka iya tambaya, daya ga kowane irin tushe (ilimin kididdiga, yi, na-ciki, da na waje)?

13. [ ] Bernedo, Ferraro, and Price (2014) ke karanta shekaru bakwai sakamako na ruwa saving baki aka bayyana a cikin Ferraro, Miranda, and Price (2011) (duba siffa 4.10). A cikin wannan takarda, Bernedo da kuma abokan aiki kuma nemi su fahimci inji baya da sakamako daga gwama hali na gidaje da cewa suna da, kuma ba su koma bayan da magani da aka tsĩrar. Wato, wajen, suka yi kokarin su ga ko da magani tasiri ga gida ko homeowner.

    1. Karanta takarda, bayyana da zane, da kuma takaita da binciken. b) Kada su binciken tasiri yadda ya kamata ka tantance kudin-tasiri na kama shisshigi? Idan haka ne, me ya sa? Idan ba haka ba, me ya sa ba haka ba?

14. [ ] A cikin wani follow-up to Schultz et al. (2007) , Schultz da kuma abokan aiki yi jerin uku gwaje-gwajen a kan sakamako daga siffatawa da injunctive norms a kan wani m muhalli hali (tawul sake amfani) biyu riƙa (a hotel da timeshare gida) (Schultz, Khazian, and Zaleski 2008) .

    1. Takaita zane da kuma binciken daga cikin wadannan uku gwaje-gwajen.
    2. Yaya, idan a duk, ba su canza fassarar Schultz et al. (2007) ?

15. [ ] A mayar da martani ga Schultz et al. (2007) , Canfield, Bruin, and Wong-Parodi (2016) ya gudu jerin Lab-kamar gwajen yi nazarin zane na lantarki takardar kudi. Ga yadda suka bayyana shi a cikin m:

    "A wani binciken da na tushen gwaji, kowane ɗan takara ga wani misali da wutar lantarki lissafin ga wani iyali da gwada high lantarki amfani, rufe bayani game da (a) tarihi amfani, (b) kwatancen to makwabta, da (c) tarihi amfani da nema fashewa. Mahalarta ga dukan bayanai iri a daya daga uku Formats ciki har da (a) Tables, (b) bar jadawalai, kuma (c) icon jadawalai. Mun bayar da rahoton a kan uku main binciken. Na farko, masu amfani da gane kowane irin wutar lantarki-yin amfani da bayanai da mafi lokacin da aka gabatar a tebur, watakila saboda alluna sauƙaƙe sauki aya karatu. Na biyu, zaɓuɓɓukanka da kuma nufi domin ya ceci wutar lantarki su ne karfi ga tarihi amfani bayanai, m da format. Na uku, mutane da ƙananan makamashi rubuce-rubuce fahimci duk bayanai m. "

    Ba kamar sauran bi-up karatu, babban sakamako na sha'awa cikin Canfield, Bruin, and Wong-Parodi (2016) da aka ruwaito hali ba ainihin hali. Wadanne ne karfi da raunin da irin wannan binciken a cikin wani mafi fadi bincike shirin inganta makamashi tanadi?

16. [ , ] Smith and Pell (2003) ne a satirical meta-bincike na karatu nuna da tasiri na parachutes. Suka gama:

    "Kamar yadda da yawa shisshigi nufin hana rashin lafiya, da tasiri na parachutes bai an hõre rigorous kimantawa da yin amfani da yi da ka sarrafawa gwaji. Masu bayar da shawarwarin da shaida bisa magani sun soki tallafi na shisshigi kimanta da amfani kawai observational data. Muna tunanin cewa kowa da kowa zai amfana idan mafi m protagonists shaida tushen magani shirya da kuma shiga cikin wani biyu makafi, yi da ka, placebo sarrafawa, crossover fitina da laima. "

    Rubuta wani op-ed dace a general readership jarida, kamar The New York Times, jayayya a kan fetishization na gwaji shaida. Samar da takamaiman, kankare misalai. Ambato: Ka kuma duba, Bothwell et al. (2016) da kuma Deaton (2010)

17. [ , , ] Difference-in-bambance-bambance estimators wani magani sakamako za a iya more daidai fiye da bambanci-in-rõwa estimators. Rubuta memo zuwa wani m lura da A / B gwaji a fara-up kafofin watsa labarun kamfanin bayyana darajar da bambanci-in-bambance-bambance m for guje wani online gwaji. The memo ya kamata sun hada da wata sanarwa da matsalar, wasu diraya game da yanayin karkashin abin da bambanci-in-bambanci estimator za outperform bambanci-in-rõwa estimator, kuma mai sauki kwaikwaiyo binciken.

18. [ , ] Gary Loveman wani farfesa a Harvard Business School da zama Shugaba na Harrah ta, daya daga cikin mafi girma a gidan caca kamfanoni a duniya. A lokacin da ya koma Harrah ta, Loveman sāke kamfanin da m flier-kamar biyayya shirin da tattara gagarumin yawa na bayanai game da abokin ciniki hali. A saman wannan ko da yaushe-on ji tsarin, kamfanin ya fara gudu gwaje-gwajen. Alal misali, su gudu wani gwaji to kimanta da sakamako mai coupon a free hotel dare ga abokan ciniki tare da wani caca juna. Ga yadda Loveman bayyana muhimmancin experimentation to Harrah ta yau da kullum business ayyuka:

    "Yana da kamar ba ka dama mata, ba ka sata, da kuma ka samu a yi iko kungiyar. Wannan shi ne daya daga cikin abubuwan da za ka iya rasa aikinku for a Harrah's-ba gudu a kula da kungiyar. " (Manzi 2012, 146)

    Rubuta wani email zuwa wani sabon ma'aikaci bayyana dalilin da ya sa Loveman tunani shi ne don haka da muhimmanci a yi iko kungiyar. Ya kamata ka yi kokarin hada wani misali-dai real ko sanya up-to nuna your batu.

19. [ , ] Wani sabon gwaji da nufin kimanta sakamakon karbar saƙon rubutu da masu tuni a alurar riga kafi fahimta. 150 kananan dakunan shan magani, kowane da 600 m marasa lafiya, suna son su shiga. Akwai tsayayyen farashi na 100 daloli ga kowane asibitin kana so ka yi aiki tare da, da kuma halin kaka 1 dollar ga kowane saƙon rubutu cewa kana so ka aika. Bugu da ari, wani kananan dakunan shan magani da kake aiki tare da su auna sakamako (ko wani karbi lamba) for free. Zaton cewa kana da kasafin kudin na 1000 daloli.

    1. A karkashin abin da yanayi zai kasance mafi alhẽri a mayar da hankali your albarkatun a kan wani karamin yawan kananan dakunan shan magani da kuma karkashin abin da yanayi zai kasance mafi alhẽri gare su yada more yadu?
    2. Abin da dalilai zai ƙayyade karami sakamako size cewa za ka iya dogara gane da kasafin kudin?
    3. Rubuta memo bayyana wadannan cinikayya-offs zuwa m funder.

20. [ , ] Wata babbar matsala da online Darussan ne attrition. mutane da yawa dalibai da fara Darussan ƙarasa faduwa-fito. Ka yi tunanin cewa kana aiki a wani online koyo dandamali, da kuma zanen a dandamali Ya halitta a gani ci gaba bar ta tunani zai taimaka hana dalibai daga faduwa daga cikin shakka. Za ka so ka gwada sakamako na ci gaba bar kan dalibai a babban mai aiki da na'urar kwamfuta zamantakewa kimiyya hanya. Bayan shawo kan wata da'a al'amurran da suka shafi da zai bayyana a cikin gwaji, ku da abokan aiki samun damu cewa hanya zai ba su da isasshen dalibai su dogara gane alãmõmin ci gaba bar. A cikin lissafin kasa za ka iya ɗauka cewa rabin dalibai za su samu ci gaban bar da rabin ba. Bugu da ari, za ka iya ɗauka cewa babu tsangwama. A takaice, za ka iya ɗauka cewa mahalarta ne kawai ta shafa ko su karbi magani ko iko. suna ba Madĩna da ko sauran mutane karbi magani ko iko (domin karin m definition, gani Gerber and Green (2012) , Ch. 8). Don Allah ci gaba da lura da kowane ƙarin zaton cewa ka yi.

    1. Aike da ci gaba bar ana sa ran kara da rabo daga daliban da suka gama rarraba by 1 yawan maki, abin da yake da samfurin size da ake bukata a dogara gane da sakamako?
    2. Aike da ci gaba bar ana sa ran kara da rabo daga daliban da suka gama rarraba da 10 kashi maki, abin da yake da samfurin size da ake bukata a dogara gane da sakamako?
    3. Yanzu tunanin cewa ka gudanar da gwaji da kuma daliban da suka kammala dukan shakka kayan riƙi wani karshe jarrabawa. A lokacin da ka kwatanta karshe jarrabawa scores na daliban da suka samu da ci gaba bar wa waɗanda suke yi ba, ka sami, da yawa zuwa ga mamaki, cewa] aliban da suka ba sama da ci gaba bar zahiri zira kwallaye mafi girma. Shin wannan yana nufin cewa ci gaba bar sa dalibai su koyi m? Me za ka koya daga wannan sakamako data? (Ambato: Duba Gerber and Green (2012) , Ch. 7)

21. [ , ] A cikin wani kyakkyawa takarda, Lewis and Rao (2015) vividly nuna a muhimman hakkokin ilimin kididdiga rage mata har m gwaje-gwajen. The takarda-wanda asali yana da m title "A Near-yiwuwar aunawa da Koma Talla" -shows yadda da wuya shi ne don auna sama a kan zuba jari na online talla, har ma da digital gwajen shafe miliyoyin abokan ciniki. More kullum, da takarda a fili ya nuna cewa yana da wuya a kimanta kananan magani sakamako amidst m sakamako data. Ko ya bayyana diffently, takarda nuna cewa kimani magani effects zai yi manyan amincewa jinkiri a lõkacin da tasiri-to-misali-sabawa (\ (\ frac {\ Delta \ bar {y}} {\ sigma} \)) rabo ne kananan. The muhimmanci general darasi daga wannan takarda shi ne cewa sakamakon daga gwaje-gwajen da kananan tasiri-to-misali-sabawa rabo (misali, Roi na ad yakin) zai zama unsatisfying. Your kalubale za a rubuta a memo to wani a cikin marketing sashen na kamfanin evaluting a shirya gwaji don auna Roi wani ad yaƙin neman zaɓe. Your memo ya kamata a goyon bayan da jadawalai da sakamakon kwamfuta gwajegwaje.

    Ga wasu bango bayani da ka iya bukatar. Dukan waɗannan lamba dabi'u ne na hali na real gwaje-gwajen ya ruwaito a cikin Lewis and Rao (2015) :

    • Roi, a key awo for online ad yakin, aka bayyana a cikin net riba daga yaƙin neman zaɓe (babban riba daga yaƙin neman zaɓe debe kudin yakin neman zabe) raba da kudin da yaƙin neman zaɓe. Alal misali a yaƙin neman zaɓe da cewa yana da wani sakamako a kan tallace-tallace zai yi wani Roi na -100% da kuma yakin inda riba generated kasance daidai yake da halin kaka zai yi wani Roi of 0.

    • da nufin tallace-tallace da abokin ciniki ne $ 7 da misali karkata daga $ 75.

    • yaƙin neman zaɓe ana sa ran kara tallace-tallace da $ 0,35 da abokin ciniki wanda yayi dace da karuwa a riba na $ 0,175 per abokin ciniki. A wasu kalmomin, da babban gefe ne 50%.

    • shirya girman da gwaji ne 200,000 mutane, rabin a lura kungiyar da kuma rabin a cikin iko kungiyar.

    • kudin yakin neman zabe ne $ 0,14 da yar.

    Rubuta memo evaluting wannan gwaji. Za ka bayar da shawarar kaddamar da wannan gwaji kamar yadda shirya? Idan haka ne, me ya sa? Idan ba haka ba, abin da canje-canje za ka bayar da shawarar?

    A m memo zai magance wannan batu. mafi memo zai generalize daga wannan yanayin a cikin hanya daya (misali, nuna yadda hukuncin da canje-canje a matsayin aiki na da tasiri-to-misali-sabawa rabo). da kuma mai girma memo zai gabatar da wani cikakken jimlace sakamakon.

22. [ , ] Shin, daidai kamar yadda m tambaya, amma maimakon kwaikwaiyo kamata ka yi amfani nazari results.

23. [ , , ] Shin, daidai kamar yadda m tambaya, amma amfani da biyu kwaikwaiyo da nazari results.

24. [ , , ] Tunanin cewa ka rubuta da memo aka bayyana a sama-ta yin amfani da ko dai kwaikwaiyo, nazari results, ko biyu-da wani daga cikin marketing sashen bayar da shawarar yin amfani da wani bambanci-in-bambance-bambance estimator maimakon wani bambanci a wajen estimator (duba Sashe 4.6.2) . Rubuta wani sabon guntu memo bayyana yadda wani 0.4 hulda tsakanin tallace-tallace da gwajin kuma tallace-tallace bayan gwajin zai canza your ƙarshe.

25. [ , ] A domin kimanta tasiri na wani sabon shafin yanar-tushen aiki sabis, a jami'a aiki ayyuka ofishin gudanar da wani yi da ka kula da fitina tsakanin 10,000 dalibai shiga karshe shekarar makaranta. A free biyan kuɗi tare da musamman log-in bayanai da aka aiko, ta hanyar wani m email gayyatar 5,000 na da ka zaba dalibai, yayin da wasu 5,000 dalibai suke a cikin iko kungiyar da kuma ba su da wani biyan kuɗi. Watanni goma sha biyu daga baya, a follow-up binciken (ba tare da wani ba amsa) ya nuna cewa, a biyu da magani da kuma kula da kungiyoyin, 70% daga cikin daliban sun kulla cikakken lokaci aiki a zaba filin (Table 4.5). Saboda haka, ga alama cewa yanar gizo na tushen sabis ba sakamako.

    Duk da haka, a hankali data masanin kimiyya a jami'ar dube da bayanai a bit more a hankali da kuma gano cewa kawai 20% na daliban da magani kungiyar kullum shigad cikin account bayan karbar email. Bugu da ari, kuma da ɗan mamaki, daga waɗanda suka yi shigad cikin website kawai 60% ya kulla cikakken lokaci aiki a zaba filin, wanda shi ne m fiye da kudi ga mutanen da ba su shiga a cikin da ƙananan fiye da kudi ga mutanen da a kula da yanayin (Table 4.6).

    1. Samar da wani bayani ga abin da zai faru.
    2. Mene ne biyu daban-daban hanyoyin da za a lissafta da sakamako na jiyya a wannan gwaji?
    3. Aka ba da wannan sakamakon haka, ya kamata jami'ar aiki sabis samar da wannan yanar gizo na tushen aiki sabis duk dalibai? Just zama bayyananne, wannan ba a question da wani sauki amsar.
    4. Me ya kamata su yi gaba?

    Ambato: Wannan tambaya ke bayan da kayan rufe a wannan babi, amma bayani al'amurran da suka shafi kowa a gwaje-gwajen. Wannan irin gwaji zane ne, wani lokacin ake kira da ƙarfafawa zane domin mahalarta suna karfafa tafiyar da magani. Wannan matsala ne misalin abin da ake kira daya mai gefe ba yarda (duba Gerber and Green (2012) , Ch. 5)

26. [ ] Bayan m jarrabawa, shi dai itace cewa gwaji aka bayyana a cikin previous tambaya ya fi rikitarwa. Sai dai itace cewa 10% na mutanen da a cikin iko kungiyar biya damar yin amfani da sabis, kuma suka ƙare har da wani aikin kudi na 65% (Table 4.7).

    1. Rubuta wani email rungumar abin da kuke tunani da ke faruwa da kuma bayar da shawarar a hanya na aiki.

    Ambato: Wannan tambaya ke bayan da kayan rufe a wannan babi, amma bayani al'amurran da suka shafi kowa a gwaje-gwajen. Wannan matsala ne misalin abin da ake kira biyu mai gefe ba yarda (duba Gerber and Green (2012) , Ch. 6)