This meeting involved a presentation from and discussion with PolitiFact Editor-in-Chief Angie Drobnic Holan. This page includes materials that she shared during the meeting, as well as ideas and resources that FLC members shared throughout the semester.
Many of the most well-known and well-established methods of fact-checking and evaluating information online (e.g. the CRAAP test) were developed in earlier eras of the internet and do not account for the specific dynamics of the current information (and mis/disinformation) landscape
Research has demonstrated that these methods are ineffective in the contemporary online landscape. In empirical studies, students routinely fail to distinguish misinformation and disinformation from legitimate reputable sources, and they are commonly misled by the source evaluation strategies that they have been taught in school: paying attention to top-level domains (.org vs. .com), assessing the professional appearance of the site, examining the content to determine if it cites sources or refers to experts, CRAAP test steps, etc. (see Wineburg & McGrew, 2017, and Breakstone et. al., 2021)
These earlier strategies and tools build upon habits of mind and practices that we associate with effective analysis and critical thinking (e.g. close reading); however, these values are counter-intuitive to effective online information evaluation. Rather than spend a lot of time carefully examining information sources online, rendering oneself more susceptible to being misled, it is more effective to prioritize more targeted methods of verifying a source’s reputability before engaging with the content at all.
A more effective strategy to evaluate online information and instruct students to evaluate online information is “Lateral reading”: a method of evaluating online sources derived from Wineburg & McGrew’s research, which builds on the source assessment strategies used by professional fact checkers
Lateral reading: opening up new tabs to verify the reputability of the author and/or the organization/company sponsoring the information elsewhere
The admonishment from conspiracy theorists to “do your own research” builds upon this susceptibility: we are trained in most educational contexts that doing “deep dives” and “going down the rabbit hole” = good research. This impulse is manipulated by those who want to spread misinformation. A better habit of mind to foster in students is to verify the credibility of the producers and publishers of any information before engaging with it deeply (see Caulfield, 2018, Warzel, 2021).
Baer, Andrea and Daniel Kipnis. “Evaluating Online Sources: A Toolkit.” 2019
Baer, Andrea and Daniel Kipnis. “Tutorial: Evaluating Online Sources through Lateral Reading.” 2019
Mike Caulfield: Online Verification Skills Videos (produced by CIVIX Canada)
"Video 1: Introductory Video" (3:13)
"Video 2: Investigate the Source" (2:44)
Video: "How to Find Better Information Online: Click Restraint" (2:19) (Stanford History Education Group)
Video: Media Wise: "Lateral Reading: How to Go Down the Rabbit Hole" (0:53)
Video: Media Wise: "Three Tips for Spotting Misinformation" (1:00)
Video: Media Wise: "Are These Dancing Robots Legit?"" (3:27)
PolitiFact fact checking examples:
"No, A CDC Study Did Not Find that Mask Mandates Make No Statistical Difference on Coronavirus Rates"
"Biden’s Criticism of Trump Administration Vaccine Contracts Too Broad to Be Accurate""
"No Evidence that a Dumpster Dive Found 2020 Cast Ballots Shredded in Arizona"
"Mike Pence Is Wrong that HR 1 Forces States to Shift to Universal Mail Balloting"
Clemson University’s “Spot the Troll” Quiz
“The Librarian War Against QAnon,” The Atlantic, Feb. 18, 2021, Barbara Fister
“Shifting Attention to Accuracy Can Reduce Information Online,” Nature, Mar 17, 2021, Pennycook et al.
“Major Universities Are Using Race as a 'High Impact Predictor' of Student Success,” The Markup, March 2, 2021. Todd Feather.
(Another example of the insidiousness of algorithms. The same racism associated with risk assessment tools used for criminal sentencing is also being perpetuated by universities who use these tools.)
“Pants on Fire! On the Rhetoric of Fact-Checking in U.S. Political Culture,” Dana Cloud
This is the third chapter in Dana Cloud’s book Reality Bites Rhetoric and the Circulation of Truth Claims in U.S. Political Culture (2018), where she critiques fact-checking as a method for persuasion (i.e. as a way to change people’s politics). One Writing Arts instructor assigns this reading as a way to pivot from citizen-based media literacy to looking at systemic problems in the politics of post-truth.
Evidence that lateral reading instruction is effective:
"Lateral Reading: College Students Learn to Critically Evaluate internet Sources in an Online Course," Misinformation Review, (2021), Breakstone et al.
"Improving College Students’ Fact-Checking Strategies through Lateral Reading Instruction in a General Education Civics Course, Cognitive Research: Principles and Implications, 6(23), 2021, Brodsky et. al.