Can research make you dumber? It can if you believe it.
I just read Can Facebook Make You Fat and Poor? on Mashable. It’s a post by David Mielach, of BusinessNewsDaily.
In particular, the researchers found that social media users were more likely to binge eat and have a higher body-mass index. Frequent Facebook users also were more likely to have certain financial problems, including a lower credit score and higher levels of debt.
But wait. It says the research was based on the responses of 541 Facebook users in the United States. So what does that really mean? What does this research really mean? And to be fair, I haven’t gone into the actual research. I’m just commenting on the coverage. Maybe they did everything right and avoided the problems I see. And maybe not.
First, who’s in the sample? Is it Facebook users, really, or Facebook users who answer surveys? Those are different sets of people. Is it balanced for age, demographic, technology, geography?
Maybe people who answer surveys have less self control, which is part of the reason they answer surveys. And maybe people who answer surveys have less money, caused perhaps by the behavior that finds time to answer surveys. Maybe they are just younger, on average, and that causes the money difference.
Research depends on the sample. So that’s a good reason to be skeptical.
So maybe what it really shows isn’t about Facebook users but rather about people who answer surveys. Maybe they — survey answerers have less self control so they couldn’t resist taking the survey really know is that people who answer surveys on Facebook have less self control — that’s why they took their time to answer the survey. And maybe people who answer surveys have less money — because they waste their time answering surveys.
And there is that whole issue of causation and correlation: Could we just as easily say living in a large house makes you rich, or attending college makes you young? That’s as logical as saying Facebook users have less self control and less money. Right?
Here’s a direct quote from the research:
These results are concerning given the increased time people spend using social networks, as well as the worldwide proliferation of access to social networks anywhere, anytime via smartphones and other gadgets. Given that self-control is important for maintaining social order and personal well-being, this subtle effect could have widespread impact.
So now it’s widespread impact. The emphasis above is mine. Wow: Is this looking for a news lead, or rather reaching out, stretching to the ultimate, to look for a news lead? Or what?
I’m not saying that information is bad. Misinformation is.
I’m not saying that research is bad. Believing it is. Question the research, question the assumptions, look through it, and then take what’s valuable in it. Never just believe it.