English-language podcasts

Normal Curves: Sexy Science, Serious Statistics

Researching Honesty Part 2: Can innocent mistakes explain the data?

73 min

Listen through the publisher, then discuss the episode here or arrange an in-person Roundtable. Your city determines where to meet.

Roundtables are designed for groups of four, with a shared subject and room for everyone to speak. Come for discussion, with no dating expectation.

Does cheating make you more creative? A provocative study from Harvard Business School suggested that it does. But data detectives uncovered suspicious patterns in the results, and a Harvard investigation found even more troubling changes in the data. In Part 2 of our investigation into the Francesca Gino research misconduct case, we dig into the now-retracted “Evil Genius” study and the suspicious changes that made its results look better, then turn to Harvard law professor Lawrence Lessig's defense of Gino: Could innocent mistakes by “an army of research assistants” explain what happened? Along the way, we explore the trap of circular reasoning in statistics, why good data management matters, and how much responsibility researchers bear for their data even when it's out of their hands. Statistical topics Statistical sleuthing Data forensics Data integrity Data cleaning Data management Reproducibility Statistical significance Spreadsheets Predictor variables Outcome variables Circular reasoning Research misconduct Methodologic Morals “You cannot define your predictor variable using your outcome variable.” “If it takes an army of research assistants to clean your data, you're probably doing something wrong and maybe you need a statistician.” “Being too smart to commit stupid fraud is not a defense. Smart people do stupid things all the time.” “The more hoops your explanation has to jump through, the less convincing it becomes.” References Gino F, Wiltermuth SS. Evil genius? How dishonesty can lead to greater creativity (https://pubmed.ncbi.nlm.nih.gov/24549296/). Psychol Sci. 2014;25(4):973-981. Retracted. doi:10.1177/0956797614520714 (https://doi.org/10.1177/0956797614520714) Retraction notice: Evil genius? How dishonesty can lead to greater creativity. Psychol Sci. 2023;34(8):947. doi:10.1177/09567976231187595 (https://doi.org/10.1177/09567976231187595) Simonsohn U, Simmons JP, Nelson LD. Data falsificada (part 3): “The cheaters are out of order.” Data Colada. June 23, 2023.https://datacolada.org/111 Simonsohn U, Simmons JP, Nelson LD. Exhibits 3, 4, and 5. Data Colada. September 16, 2023.https://datacolada.org/114https://datacolada.org/114 Simmons JP. Harvard's Gino report reveals how a dataset was altered. Data Colada. July 9, 2024.https://datacolada.org/118 Lessig L. The Gino Case. Website and podcast series presenting arguments challenging Harvard's research misconduct findings.https://theginocase.info/ Simonsohn U, Simmons JP, Nelson LD. Data Falsificada. ResearchBox. Research data, analysis code, and supporting materials accompanying the Data Colada investigations.https://researchbox.org/1630.34 Harvard Business School. Investigative report concerning allegations of research misconduct involving Francesca Gino. Harvard Business School Research Integrity Investigation Report. 2023. Accessed October 18, 2026.https://datacolada.org/wp-content/uploads/Harvard-Report-on-Gino.pdf Kristin and Regina’s online courses: Demystifying Data: A Modern Approach to Statistical Understanding (https://online.stanford.edu/courses/som-xche0033-demystifying-data-modern-approach-statistical-understanding) Clinical Trials: Design, Strategy, and Analysis (https://online.stanford.edu/courses/som-xche0030-clinical-trials-design-strategy-and-analysis) Medical Statistics Certificate Program (https://online.stanford.edu/programs/medical-statistics-program) Writing in the Sciences (https://www.coursera.org/learn/sciwrite) Epidemiology and Clinical Research Graduate Certificate Program (https://online.stanford.edu/programs/epidemiology-and-clinical-research-graduate-certificate) Program that Kristin teaches in:: Epidemiology and Clinical Research Graduate Certificate Program (https://online.stanford.edu/programs/epidemiology-and-clinical-research-graduate-certificate) Kristin’s manuscript writing course: Find us on: Kristin - LinkedIn (https://www.linkedin.com/in/kristin-sainani-642b5914/) &Twitter/X (https://x.com/KristinSainani) Regina -LinkedIn (https://www.linkedin.com/in/reginanuzzo/) &https://www.reginanuzzo.com/ReginaNuzzo.com (http://reginanuzzo.com/) (00:00) - Intro (06:50) - The Claim: Superstars and Fraud (08:09) - Lessig’s Army of Research Assistants (22:15) - Sorted Data and 13 Suspicious Values (28:29) - Harvard’s Recovered Files from Gino’s Laptop (31:27) - Twelve People Reclassified as Cheaters (34:58) - Four RAT Totals That Don’t Add Up (46:22) - Lessig’s Research Assistant Theory (50:00) - Circular Logic and the Googling Defense (01:05:36) - Where the Evidence Leaves Us (01:08:15) - Rating the Claim (01:10:35) - Methodological Morals

Episode information is provided by the publisher. Listening takes place on the publisher’s service.

Listen at the source ↗

Featured places to meet in Palo Alto, CA

Explore these places and arrange a conversation through ThinkMatch.

City guide for Palo Alto, CA

More from Normal Curves: Sexy Science, Serious Statistics

Normal Curves: Sexy Science, Serious Statistics

Huntington’s Disease: Can Gene Therapy Slow It Down?

69 min

Could a new gene therapy slow the progression of Huntington’s disease? Early results suggested an astonishing 80% reduction in disease progression. But there’s a catch: the evidence comes from just a handful of treated patients, compared with patients from an entirely different study. How can we know whether we're comparing like with like? We dig into the science behind the treatment, the statistical challenges of finding a fair comparison group, and the heated controversy between the drug company and the FDA. Along the way, we take a statistical detour into propensity score matching—and wrestle with a difficult question: How much evidence should we demand when patients are running out of time? Statistical topics External control groups Randomized controlled trials Sham surgery controls Propensity scores Restricted full propensity score matching Inverse probability of treatment weighting (IPTW) Confounding Selection bias Methodologic Morals “Seventeen patients is still 17 patients, no

Discuss this episode

Community Poll

Public cultural institutions should present contested works with context instead of simply removing them.

Share your view, then see how readers voted. No sign-in required. This poll is shared across stories.

Do you agree or disagree?

Choose one answer

Common Quandary

A Common Quandary to discuss

Another conversation to explore, separate from this news story.

You scratched a borrowed heirloom and repaired it perfectly. Do you confess?

You borrow a family heirloom for an event and accidentally leave a small scratch. A careful repair makes it almost invisible, and its owner happily accepts it back without noticing anything.

What is confession for when the harm has already been repaired?

Explore this quandary