Discussion about this post

User's avatar
Andy Wheeler's avatar

This is a common error with using survey sampling of rare events. Here is a Chance article from almost 30 years ago going through a similar critique of Gary Kleck's work on using a gun for self-defense, https://sites.stat.columbia.edu/gelman/surveys.course/Hemenway1997.pdf

I think I originally saw the idea from Noah Smith, but you can basically ask any crazy question on a survey and get ~1/12 people to answer in the affirmative (which is around 8%). So ask "have you been abducted by aliens", and you will get people who say yes. So anything rarer than 1/10 people in surveys is quite hard to estimate in practice.

Part of it is people answering junk (some surveys, like Monitoring the Youth, have fake drug questions to catch kids just saying yes to everything). Some of it is bad recall and poor reading comprehension (not as a dig, just as a fact of life, should not assume college level reading capabilities for any survey).

FUNshoot News's avatar

Just to add to this, FBI UCR data shows fewer than 11,000 homicides with a firearm annually; call it a quarter million in 20 years. Even if EVERY homicide was a "mass shooting", that puts 80 eye witnesses per victim at every shooting. If a "mass shooting" is four or more, that's 320 or more witnesses at each one.

The same groups that have rejected DGU survey data from Gary Kleck and William English as an unreliable indicator are now championing this survey.

No posts

Ready for more?