Примечания книги Темные данные. Практическое руководство по принятию правильных решений в мире недостающих данных. Автор книги Дэвид Хэнд

Онлайн книга

Книга Темные данные. Практическое руководство по принятию правильных решений в мире недостающих данных
Человечество научилось собирать, обрабатывать и использовать в науке, бизнесе и повседневной жизни огромные массивы данных. Но что делать с данными, которых у нас нет? Допустимо ли игнорировать то, чего мы не замечаем? Британский статистик Дэвид Хэнд считает, что это по меньшей мере недальновидно, а порой – крайне опасно. В своей книге он выделяет 15 влияющих на наши решения и действия видов данных, которые остаются в тени. Например, речь идет об учете сигналов бедствия, которые могли бы подать жители бедных районов, если бы у них были смартфоны, результатах медицинского исследования, которые намеренно утаили или случайно исказили, или данных, ставших «темными» из-за плохого набора критериев для включения в выборку. Хэнд также рассказывает о том, какие меры могут сгладить эффект «темных данных» и как их можно обратить себе на пользу. Книга будет интересна широкому кругу читателей, интересующихся дата-сайенс, программированием и статистикой.

Примечания книги

1

https://blog.uvahealth.com/2019/01/30/measles-outbreaks/, accessed 16 April 2019.

2

http://outbreaknewstoday.com/measles-outbreak-ukraine-21000-cases-2019/, accessed 16 April 2019.

3

https://www.theglobeandmail.com/canada/article-canada-could-see-large-amount-of-measles-outbreaks-health-experts/, accessed 16 April 2019.

4

E. M. Mirkes, T. J. Coats, J. Levesley, and A. N. Gorban, “Handling missing data in large healthcare dataset: A case study of unknown trauma outcomes.” Computers in Biology and Medicine 75 (2016): 203-16.

5

https://www.livescience.com/24380-hurricane-sandy-status-data.html.

6

D. Rumsfeld, Department of Defense News Briefing, 12 February 2002.

7

http://archive.defense.gov/Transcripts/Transcript.aspx?TranscriptID=2636, accessed 31 July 2018.

8

https://er.jsc.nasa.gov/seh/explode.html.

9

https://xkcd.com/552/; отчет комиссии Роджерса см. https://forum.nasaspaceflight.com/index.php?topic=8535.0.

10

R. Pattinson, Arctic Ale: History by the Glass, issue 66 (July 2102), https://www.beeradvocate.com/articles/6920/arctic-ale/, accessed 31 July 2018.

11

В действительности оказалось, что победившая заявка была шуткой и участник торгов не собирался платить. Но даже при этом Вудул мог рассчитывать на приличную прибыль: частный коллекционер из Шотландии недавно продал с аукциона бутылку из экспедиции 1875 г. за £3300, что равняется примерно $4300.

12

D. J. Hand, F. Daly, A. D. Lunn, K. J. McConway, and E. Ostrowski, A Handbook of Small Data Sets (London: Chapman and Hall, 1994).

13

D. J. Hand, “Statistical challenges of administrative and transaction data (with discussion),” Journal of the Royal Statistical Society, Series A181 (2018): 555-605.

14

https://www.quora.com/How-many-credit-and-debit-card-transactions-are-there-every-year, accessed 24 August 2018.

15

M. E. Kho, M. Duffett, D. J. Willison, D. J. Cook, and M. C. Brouwers, “Written informed consent and selection bias in observational studies using medical records: Systematic review,” BMJ (Clinical Research Ed.) 338 (2009): b866.

16

S. Dilley and G. Greenwood, “Abandoned 999 calls to police more than double,” 19 September 2017, http://www.bbc.co.uk/news/uk-41173745, accessed 10 December 2017.

17

M. Johnston, The Online Photographer, 17 February 2017, http://theonlinephotographer.typepad.com/the_online_photographer/2017/02/i-find-this-a-particularly-poignant-picture-its-preserved-in-the-george-grantham-bain-collection-at-the-library-of-congres.html, accessed 28 December 2017.

18

A. L. Barrett and B. R. Brodeski, “Survivorship bias and improper measurement: How the mutual fund industry inflates actively managed fund performance” (Rock-ford, IL: Savant Capital Management, Inc., March 2006), https://www.etf.com/docs/sbiasstudy.pdf, accessed 28 December 2017.

19

T. Schlanger and C. B. Philips. “The mutual fund graveyard: An analysis of dead funds,” The Vanguard Group, January 2013.

20

https://xkcd.com/1827/.

21

Knowledge Extraction Based on Evolutionary Learning, http://sci2s.ugr.es/keel/dataset.php?cod=163, accessed 22 September 2019.

22

M. C. Bryson, “The Literary Digest poll: Making of a statistical myth,” The American Statistician 30 (1976): 184-5.

23

http://www.applied-survey-methods.com/nonresp.html, accessed 4 November 2018.

24

Office for National Statistics: https://bit.ly/3aasSzL.

25

R. Tourangeau and T. J. Plewes, eds., Nonresponse in Social Surveys: A Research Agenda (Washington, DC: National Academies Press, 2013).

26

J. Leenheer and A. C. Scherpenzeel, “Does it pay off to include non-internet households in an internet panel?” International Journal of Internet Science 8 (2013), 17-29.

27

Tourangeau and Plewes, Nonresponse in Social Surveys.

28

H. Wainer, “Curbstoning IQ and the 2000 presidential election,” Chance 17 (2004): 43-46.

29

I. Chalmers, E. Dukan, S. Podolsky, and G. D. Smith, “The advent of fair treatment allocation schedules in clinical trials during the 19th and early 20th centuries,” Journal of the Royal Society of Medicine 105 (2012): 221-7.

30

J. B. Van Helmont, Ortus Medicinae, The Dawn of Medicine (Amsterdam: Apud Ludovicum Elzevirium, 1648), http://www.jameslindlibrary.org/van-helmont-jb-1648/, accessed 15 June 2018.

31

W. W. Busse, P. Chervinsky, J. Condemi, W. R. Lumry, T. L. Petty, S. Rennard, and R. G. Townley, “Budesonide delivered by Turbuhaler is effective in a dose-dependent fashion when used in the treatment of adult patients with chronic asthma,” Journal of Allergy and Clinical Immunology 101 (1998): 457-63; J. R. Carpenter and M. Kenward, “Missing data in randomised controlled trials: A practical guide,” November 21, 2007, http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.468.9391&rep=rep1&type=pdf, accessed 7 May 2018.

32

P. K. Robins, “A comparison of the labor supply findings from the four negative income tax experiments,” Journal of Human Resources 20 (1985): 567-82.

33

A. Leigh, Randomistas: How Radical Researchers Are Changing Our World (New Haven, CT: Yale University Press, 2018).

34

P. Quinton, “The impact of information about crime and policing on public perceptions,” National Policing Improvement Agency, January 2011, http://whatworks.college.police.uk/Research/Documents/Full_Report_-_Crime_and_Policing_Information.pdf, accessed 17 June 2018.

35

J. E. Berecochea and D. R. Jaman, (1983) Time Served in Prison and Parole Outcome: An Experimental Study: Report Number 2, Research Division, California Department of Corrections.

36

G.C.S. Smith and J. Pell, “Parachute use to prevent death and major trauma related to gravitational challenge: Systematic review of randomised controlled trials,” British Medical Journal 327 (2003): 1459-61.

37

The Washington Post, “Test of ‘dynamic pricing’ angers Amazon customers,” October 7, 2000, http://www.citi.columbia.edu/B8210/read10/Amazon%20Dynamic%20Pricing%20Angers%20Customers.pdf, accessed 19 June 2018.

38

BBC, “Facebook admits failings over emotion manipulation study,” BBC News, 3 October 2014, https://www.bbc.co.uk/news/technology-29475019, accessed 19 June 2018.

39

http://www.bbc.co.uk/news/uk-politics-eu-referendum-35959949.

40

Цифры по иммиграции: https://bit.ly/2M3Rjab, accessed 2 January 2018.

41

Office for National Statistics: “Crime in England and Wales: Year ending June 2017,” https://www.ons.gov.uk/peoplepopulationandcommunity/crimeandjustice/bulletins/crimeinenglandandwales/june2017#quality-and-methodology, accessed 4 January 2018.

42

J. Wright, “The real reasons autism rates are up in the U.S.” Scientific American, March 3, 2017, https://www.scientificamerican.com/article/the-real-reasons-autism-rates-are-up-in-the-u-s/, accessed 3 July 2018.

43

N. Mukadam, G. Livingston, K. Rantell, and S. Rickman, “Diagnostic rates and treatment of dementia before and after launch of a national dementia policy: An observational study using English national databases. BMJ Open 4, no. 1 (January 2014), http://bmjopen.bmj.com/content/bmjopen/4/1/e004119.full.pdf, accessed 3 July 2018.

44

https://www.ons.gov.uk/businessindustryandtrade/retailindustry/timeseries/j4mc/drsi.

45

https://www.census.gov/retail/mrts/www/data/pdf/ec_current.pdf.

46

Titanic Disaster: Official Casualty Figures, 1997, http://www.anesi.com/titanic.htm, accessed 2 October 2018.

47

A. Agresti, Categorical Data Analysis, 2d ed. (New York: Wiley, 2002), 48-51.

48

W. S. Robinson, “Ecological correlations and the behavior of individuals,” American Sociological Review 15 (1950): 351-7.

49

G. Gigerenzer, Risk Savvy: How to Make Good Decisions (London: Penguin Books, 2014), 202.

50

W. J. Krzanowski, Principles of Multivariate Analysis, rev. ed. (Oxford: Oxford University Press, 2000), 144.

51

S. de Lusignan, J. Belsey, N. Hague, and B. Dzregah, “End-digit preference in blood pressure recordings of patients with ischaemic heart disease in primary care,” Journal of Human Hypertension 18 (2004): 261-5.

52

L. E. Ramsay et al., “Guidelines for management of hypertension: Report of the third working party of the British Hypertension Society,” Journal of Human Hypertension 13 (1999): 569-92.

53

J. M. Roberts Jr. and D. D. Brewer, “Measures and tests of heaping in discrete quantitative distributions,” Journal of Applied Statistics 28 (2001): 887-96.

54

https://www.healthline.com/health/mens-health/average-weight-for-men.

55

B. Kenber, P. Morgan-Bentley, and L. Goddard, “Drug prices: NHS wastes £30m a year paying too much for unlicensed drugs, Times (London), 26 May 2018, https://www.thetimes.co.uk/article/drug-prices-nhs-wastes-30m-a-year-paying-too-much-for-unlicensed-drugs-kv9kr5m8p?shareToken=0e41d3bbd6525068746b7db8f9852a24, accessed 26 May 2018.

56

H. Wainer, “Curbstoning IQ and the 2000 presidential election,” Chance 17 (2004): 43-46.

57

W. Kruskal, “Statistics in society: Problems unsolved and unformulated,” Journal of the American Statistical Association, 76, (1981): 505-15.

58

Я не смог найти ясного происхождения этого закона. В своем президентском обращении 1979 г. к Королевскому статистическому обществу Клаус Мозер (“Statistics and public policy,” Journal of the Royal Statistical Society, Series A143 (1980): 1-32) говорит, что он был разработан Центральным статистическим управлением Великобритании. Эндрю Эренберг цитирует его как Закон Тваймана без указания источника (“The teaching of statistics: Corrections and comments,” Journal of the Royal Statistical Society, Series A138 (1975): 543-45).

59

T. C. Redman, “Bad data costs the U.S. $3 trillion per year,” Harvard Business Review, 22 September 2016, https://hbr.org/2016/09/bad-data-costs-the-u-s-3-trillion-per-year, accessed 17 August 2018.

60

ADRN, https://adrn.ac.uk/.

61

https://adrn.ac.uk/media/174470/homlessness.pdf, accessed 24 August 2018.

62

В отличие от «регламентирования», которое имеет юридическую силу и становится нормативными актами одновременно во всех странах – членах ЕС, «директива» требует достижения результатов без указания на то, как именно это сделать. – Здесь и далее прим. авт.

63

https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32004L0113, accessed 18 February 2019.

64

M. Hurwitz and J. Lee, Grade Inflation and the Role of Standardized Testing (Baltimore, MD: Johns Hopkins University Press, forthcoming).

65

R. Blundell, D. A. Green, and W. Jin, “Big historical increase in numbers did not reduce graduates’ relative wages,” Institute for Fiscal Studies, 18 August 2016, https://www.ifs.org.uk/publications/8426, accessed 23 November 2018.

66

В британских университетах существует система присуждаемых классов (1, 2:1, 2:2 и 3 в порядке убывания престижности), которые показывают способности студента, его личный вклад и успеваемость за годы учебы.

67

D. Willetts, A University Education (Oxford: Oxford University Press, 2017).

68

R. Sylvester, “Schools are cheating with their GCSE results,” The Times (London) – 21 August 2018, https://www.thetimes.co.uk/article/schools-are-cheating-with-their-gcse-results-q83s909k6?shareToken=0ce9828e6183e9b37a1454f8f588eaa7, accessed 23 August 2018.

69

“Ambulance service ‘lied over response rates,’” The Telegraph (London), 28 February 2003, http://www.telegraph.co.uk/news/1423338/Ambulance-service-lied-over-response-rates.html, downloaded on 6 October 2018.

70

https://sites.psu.edu/gershcivicissue/2017/03/15/unemployment-and-how-to-manipulate-with-statistics/, accessed 6 October 2018.

71

https://www.heraldscotland.com/news/13147231.Former_police_officers_crime_figures_are_being_massaged_to_look_better_/.

72

J. M. Keynes, General Theory of Employment Interest and Money (New York: Harcourt, Brace, 1936).

73

BBC, 1 February 2011, https://www.bbc.co.uk/news/uk-12330078, accessed 18 August 2018.

74

Direct Line Group, 2014, https://www.directlinegroup.com/media/news/brand/2014/11-07-2014b.aspx, accessed 11 April 2014.

75

A. Reurink, “Financial fraud: A literature review,” MPlfG Discussion Paper 16/5 (Cologne: Max Planck Institute for the Study of Societies, 2016).

76

R. Caruana, Y. Lou, J. Gehrke, P. Koch, M. Sturm, and N. Elhahad, “Intelligible models for healthcare: predicting pneumonia risk and hospital 30-day readmission,” Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’15, Sydney, Australia, 10-13 August 2015, pp. 1721-30.

77

Board of Governors of the Federal Reserve System, Report to the Congress on Credit Scoring and Its Effects on the Availability and Affordability of Credit, August 2007, https://www.federalreserve.gov/boarddocs/RptCongress/creditscore/creditscore.pdf, accessed 18 August 2018.

78

E. Wall, “How car insurance costs have changed,” The Telegraph (London), 21 January 2013, http://www.telegraph.co.uk/finance/personalfinance/insurance/motorinsurance/9815330/How-car-insurance-costs-have-changed-EU-gender-impact.html, accessed 19 August 2018.

79

Канеман Д. Думай медленно… Решай быстро. – М.: АСТ, 2013.

80

V. Van Vlasselaer, T. Eliassi-Rad, L. Akoglu, M. Snoeck, and B. Baesens, “Gotcha! Network-based fraud detection for social security fraud,” Management Science 63(14 July 2016): 3090-3110.

81

B. Baesens, V. van Vlasselaer, and W. Verbet, Fraud Analytics: Using Descriptive, Predictive, and Social Network Techniques: A Guide to Data Science for Fraud Detection (Hoboken, NJ: Wiley, 2105), 19.

82

“Crime in England and Wales: Year Ending June 2017,” https://www.ons.gov.uk/peoplepopulationandcommunity/crimeandjustice/bulletins/crimeinenglandandwales/june2017, accessed 31 December 2017.

83

D. J. Hand and G. Blunt, “Estimating the iceberg: How much fraud is there in the UK?” Journal of Financial Transformation 25, part 1(2009): 19-29, http://www.capco.com/?q=content/journal-detail&sid=1094.

84

Rates of fraud, identity theft and scams across the 50 states: FTC data,” Journalist’s Resource, 4 March 2015, https://journalistsresource.org/studies/government/criminal-justice/united-states-rates-fraud-identity-theft-federal-trade-commission, accessed 19 August 2018.

85

Форсайт Ф. День шакала. – М.: Прогресс, 1990.

86

B. Whitaker, “Never too young to have your identity stolen,” The New York Times, 27 July 2007, http://www.nytimes.com/2007/07/21/business/21idtheft.html, accessed 3 February 2018.

87

Javelin, 1 February 2017, https://www.javelinstrategy.com/coverage-area/2017-identity-fraud, accessed 3 February 2018.

88

III, “Facts + Statistics: Identity theft and cybercrime,” 2016, https://www.iii.org/fact-statistic/facts-statistics-identity-theft-and-cybercrime#, accessed 3 February 2018.

89

DataShield, 14 March 2013, http://datashieldcorp.com/2013/03/14/5-worst-cases-of-identity-theft-ever/, accessed 3 February 2018.

90

A. Reurink; Chapter 5, Note 12.

91

https://www.sec.gov/news/pressrelease/2015-213.html, accessed 30 September 2018.

92

“Accounting scandals: The dozy watchdogs,” Economist, 11 December 2014, https://www.economist.com/news/briefing/21635978-some-13-years-after-enron-auditors-still-cant-stop-managers-cooking-books-time-some, accessed 7 April 2018.

93

E. Greenwood, Playing Dead: A Journey through the World of Death Fraud (New York: Simon and Schuster, 2017).

94

CBS This Morning, “Playing a risky game: People who fake death for big money,” https://www.cbsnews.com/news/playing-a-risky-game-people-who-fake-death-for-big-money/, accessed 6 April 2018.

95

M. Evans, “British woman who ‘faked death in Zanzibar in £140k insurance fraud bid’ arrested along with teenage son,” The Telegraph (London), 15 February 2017, https://www.telegraph.co.uk/news/2017/02/15/british-woman-faked-death-zanzibar-140k-insurance-fraud-bid/, accessed 6 April 2018.

96

S. Hickey, “Insurance cheats discover social media is the real pain in the neck,” The Guardian (London), 18 July 2016, https://www.theguardian.com/money/2016/jul/18/insurance-cheats-social-media-whiplash-false-claimants, accessed 4 April 2018.

97

P. Kerr, “‘Ghost Riders’ are target of an insurance sting,” The New York Times, 18 August 1993, https://www.nytimes.com/1993/08/18/us/ghost-riders-are-target-of-an-insurance-sting.html, accessed 6 April 2018.

98

FBI (N.A.), “Insurance Fraud,” https://www.fbi.gov/stats-services/publications/insurance-fraud, accessed 6 April 2018.

99

E. Crooks, “More than 100 jailed for fake BP oil spill claims,” Financial Times (London), 15 January 2017, https://www.ft.com/content/6428c082-db1c-11e6-9d7c-be108f1c1dce, accessed 6 April 2018.

100

ABI, “The con’s not on – Insurers thwart 2,400 fraudulent insurance claims valued at £25 million every week,” Association of British Insurers, 7 July 2017, https://www.abi.org.uk/news/news-articles/2017/07/the-cons-not-on-insurers-thwart-2400-fraudulent-insurance-claims-valued-at-25-million-every-week/, accessed 4 April 2018.

101

“PwC Global Economic Crime Survey: 2016; Adjusting the lens on economic crime,” 18 February 2016, https://www.pwc.com/gx/en/economic-crime-survey/pdf/GlobalEconomicCrimeSurvey2016.pdf, accessed 8 April 2018.

102

J. M. Masson, ed., The Complete Letters of Sigmund Freud to Wilhelm Fliess (Cambridge, MA: Belknap Press, 1985), 398.

103

Ливио М. От Дарвина до Эйнштейна: Величайшие ошибки гениальных ученых, которые изменили наше понимание жизни и вселенной. – М.: АСТ, 2015.

104

“Frontal lobotomy,” Journal of the American Medical Association 117 (16 August 1941): 534-35.

105

N. Weiner, Cybernetics (Cambridge, MA: MIT Press, 1948).

106

J. B. Moseley et al., “A controlled trial of arthroscopic surgery for osteoarthritis of the knee,” New England Journal of Medicine 347, no. 2 (2002): 81-88.

107

J. Kim et al., Association of multivitamin and mineral supplementation and risk of cardiovascular disease: A systematic review and meta-analysis. Circulation: Cardio-vascular Quality and Outcomes11 (July 2018), http://circoutcomes.ahajournals.org/content/11/7/e004224, accessed 14 July 2018.

108

J. Byrne, MD, “Medical practices not supported by science,” Skeptical Medicine, https://sites.google.com/site/skepticalmedicine/medical-practices-unsupported-by-science, accessed 14 July 2018.

109

Кун Т. Структура научных революций. – М.: АСТ, 2015.

110

T. Kuhn, The Structure of Scientific Revolutions, 2d ed. (Chicago: University of Chicago Press, 1970), 52.

111

J.P.A. Ioannidis, “Why most published research findings are false,” PLOS Medicine 2, no. 8 (2005): 696-701.

112

L. Osherovich, “Hedging against academic risk,” Science-Business eXchange, 14 April 2011, https://www.gwern.net/docs/statistics/bias/2011, accessed 12 July 2018.

113

M. Baker, “1,500 scientists lift the lid on reproducibility,” Nature 533 (July 2016): 452-54, https://www.nature.com/news/1-500-scientists-lift-the-lid-on-reproducibility-1.19970, accessed 12 July 2018.

114

C. G. Begley and L. M. Ellis, “Raise standards for preclinical cancer research,” Nature-Comment 483 (March 2012): 531-33.

115

L. P. Freedman, I. M. Cockburn, and T. S. Simcoe, “The economics of reproducibility in preclinical research,” PLOS Biology, 9 June 2015, http://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.1002165, accessed 12 July 2018.

116

B. Nosek et al., “Estimating the reproducibility of psychological science,” Science 349, no. 6251 (August 2015): 943-52.

117

Технический статистический термин, который мы определим далее в этой книге.

118

Вулф Т. Битва за космос. – М.: Амфора, 2006.

119

https://cirt.gcu.edu/research/publication_presentation/gcujournals/nonsignificant.

120

http://jir.com/index.html.

121

F. C. Fang, R. G. Steen, and A. Casadevall, “Misconduct accounts for the majority of retracted scientific publications,” PNAS 109 (October 2012): 17028-33.

122

D. G. Smith, J. Clemens, W. Crede, M. Harvey, and E. J. Gracely, “Impact of multiple comparisons in randomized clinical trials,” American Journal of Medicine 83 (September 1987): 545-50.

123

C. M. Bennett, A. A. Baird, M. B. Miller, and G. L. Wolford, “Neural correlates of interspecies perspective taking in the post-mortem Atlantic Salmon: An argument for proper multiple comparisons correction,” Journal of Serendipitous and Unexpected Results 1, no. 1 (2009): 1-5, http://docplayer.net/5469627-Journal-of-serendipitous-and-unexpected-results.html, accessed 16 August 2018.

124

S. Della Sala and R. Cubelli, “Alleged ‘sonic attack’ supported by poor neuro-psychology,” Cortex 103 (2018): 387-88.

125

R. L. Swanson et al., “Neurological manifestations among U. S. Government personnel reporting directional audible and sensory phenomena in Havana, Cuba,” JAMA 319 (20 March 2018): 1125-33.

126

F. Miele, Intelligence, Race, and Genetics: Conversations with Arthur R. Jensen (Oxford: Westview Press, 2002), 99-103.

127

C. Babbage, Reflections on the Decline of Science in England, and on Some of Its Causes (London: B. Fellowes, 1830).

128

A. D. Sokal, “Transgressing the boundaries: Toward a transformative hermeneutics of quantum gravity,” Social Text 46/47 (Spring/Summer 1996): 217-52.

129

https://read.dukeupress.edu/social-text, accessed 23 January 2019.

130

A. Sokal and J. Bricmont, Intellectual Imposters: Postmodern Philosophers’ Abuse of Science (London: Profile Books, 1998).

131

http://science.sciencemag.org/content/342/6154/60/tab-pdf.

132

http://www.scs.stanford.edu/~dm/home/papers/remove.pdf.

133

https://j4mb.org.uk/2019/01/09/peter-boghossian-professor-faces-sack-over-hoax-that-fooled-academic-journals/.

134

C. Dawson and A. Smith Woodward, “On a bone implement from Piltdown (Sussex),” Geological Magazine Decade 6, no. 2 (1915): 1-5, http://www.boneandstone.com/articles_classics/dawson_04.pdf, accessed 7 July 2018.

135

M. Russell (2003) Piltdown Man: The Secret Life of Charles Dawson (Stroud, UK: Tempus, 2003); M. Russell, The Piltdown Man Hoax: Case Closed (Stroud, UK: The History Press, 2012).

136

J. Scott, “At UC San Diego: Unraveling a research fraud case,” Los Angeles Times, 30 April 1987, http://articles.latimes.com/1987-04-30/news/mn-2837_1_uc-san-diego, accessed 4 July 2018.

137

B. Grant, “Peer-review fraud scheme uncovered in China,” Scientist, 31 July 2017, https://www.the-scientist.com/the-nutshell/peer-review-fraud-scheme-uncovered-in-china-31152, accessed 4 July 2018.

138

https://ori.hhs.gov/about-ori, accessed 14 October 2018.

139

R. A. Millikan, “On the elementary electric charge and the Avogrado constant,” Physical Review 2, no. 2 (August 1913): 109-43.

140

W. Broad and N. Wade, Betrayers of the Truth: Fraud and Deceit in the Halls of Science (New York: Touchstone, 1982).

141

D. Goodstein, “In defense of Robert Andrews Millikan,” American Scientist 89, no. 1 (January-February 2001): 54-60.

142

R. G. Steen, A. Casadevall, and F. C. Fang, “Why has the number of scientific retractions increased?” PLOS ONE 8, no. 7 (8 July 2013), http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0068397, accessed 9 July 2018.

143

D. J. Hand, “Deception and dishonesty with data: Fraud in science,” Significance 4, no.1 (2007): 22-25; D. J. Hand, Information Generation: How Data Rule Our World (London: Oneworld Publications, 2007); H. F. Judson, The Great Betrayal: Fraud in Science (Orlando, FL: Harcourt, 2004).

144

D. J. Hand, “Who told you that?: Data provenance, false facts, and separating the liars from the truth-tellers,” Significance (August 2018): 8-9.

145

LGTC (2015), https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/408386/150227_PUBLICATION_Final_LGTC_2015.pdf, accessed 17 April 2018.

146

Tameside, https://www.tameside.gov.uk/Legal/Transparency-in-Local-Government, accessed 17 April 2018.

147

См., например: D. Rubin, “Inference and missing data,” Biometrika, 63, no. 3 (December 1976): 581-92.

148

C. Marsh, Exploring Data (Cambridge: Cambridge University Press, 1988).

149

В этом рассказе главный герой берет на себя роль свата и подбирает достойного жениха собственной матери. – Прим. пер.

150

X.-L. Meng, “Statistical paradises and paradoxes in big data (I): Law of large populations, big data paradox, and the 2016 U.S. presidential election,” Annals of Applied Statistics 12 (June 2018): 685-726.

151

R.J.A. Little, “A test of missing completely at random for multivariate data with missing values,” Journal of the American Statistical Association 83, no. 404 (December 1988): 1198-1202.

152

E. L. Kaplan and P. Meier, “Nonparametric estimation from incomplete observations,” Journal of the American Statistical Association 53, no. 282 (June 1958): 457-81.

153

G. Dvorsky, “What are the most cited research papers of all time?” 30 October 2014, https://io9.gizmodo.com/what-are-the-most-cited-research-papers-of-all-time-1652707091, accessed 22 April 2018.

154

F. J. Molnar, B. Hutton, and D. Fergusson, “Does analysis using ‘last observation carried forward’ introduce bias in dementia research?” Canadian Medical Association Journal 179 no. 8 (October 2008):751-53.

155

J. M. Lachin, “Fallacies of last observation carried forward,” Clinical Trials 13, no. 2 (April 2016): 161-68.

156

A. Karahalios, L. Baglietto, J. B. Carlin, D. R. English, and J. A. Simpson, “A review of the reporting and handling of missing data in cohort studies with repeated assessment of exposure measures,” BMC Medical Research Methodology 12 (11 July 2012): 96, https://bmcmedresmethodol.biomedcentral.com/track/pdf/10.1186/1471-2288-12-96.

157

S.J.W. Shoop, “Should we ban the use of ‘last observation carried forward’ analysis in epidemiological studies?” SM Journal of Public Health and Epidemiology 1, no. 1 (June 2015): 1004.

158

S. J. Miller, ed., Benford’s Law: Theory and Applications (Princeton, NJ: Princeton University Press, 2015).

159

S. Newcomb “Measures of the velocity of light made under the direction of the Secretary of the Navy during the years 1880-1882,” Astronomical Papers 2 (1891): 107-230 (Washington, DC: U. S. Nautical Almanac Office).

160

ADRN, https://adrn.ac.uk/.

161

D. Barth-Jones D. “The ‘reidentification’ of Governor William Weld’s medical information: A critical re-examination of health data identification risks and privacy protections, then and now,” 3 September 2015, https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2076397, accessed 24 June 2018.

162

A. Narayanan and V. Shmatikov, “How to break the anonymity of the Netflix Prize dataset,” 22 November 2007, https://arxiv.org/abs/cs/0610105, accessed 25 March 2018; A. Narayanan and V. Shmatikov V. (2008) Robust deanonymization of large sparse datasets (how to break the anonymity of the Netflix Prize dataset), 5 February 2008, https://arxiv.org/pdf/cs/0610105.pdf, accessed 24 June 2018.

163

D. Hugh-Jones, “Honesty and beliefs about honesty in 15 countries,” 29 October 2015, https://www.uea.ac.uk/documents/3154295/7054672/Honesty+paper/41fecf09-235e-45c1-afc2-b872ea0ac882, accessed 26 June 2018.

164

C. Gentry, “Computing arbitrary functions of encrypted data,” Communications of the ACM, 53, no. 3 (March 2010): 97-105.

165

https://www.behaviouralinsights.co.uk/wp-content/uploads/2016/08/16-07-12-Counting-Calories-Final.pdf, accessed 27 October 2018.

166

A. Cavallo, “Online and official price indexes: Measuring Argentina’s inflation,” Journal of Monetary Economics 60, no. 2 (2013): 152-65.

167

A. Cavallo and R. Rigobon, “The billion prices project: Using online prices for measurement and research,” Journal of Economic Perspectives 30, no. 2 (Spring 2016): 151-78.

168

C. Szegedy et al., “Intriguing properties of neural networks,” https://arxiv.org/pdf/1312.6199.pdf, 19 February 2014, accessed 23 August 2008.

169

M. Sharif, S. Bhagavatula, L. Bauer, and M. K. Reiter, “Accessorize to a crime: Real and stealthy attacks on state-of-the-art face recognition,” October 2016, https://www.cs.cmu.edu/~sbhagava/papers/face-rec-ccs16.pdf, accessed 23 August 2018.

Вход
Поиск по сайту
Ищем:
Календарь
Навигация