Category Archives: Style v. Substance

How to talk about science & the environment, based on survey results

It’s easy to think of science communication as imparting facts the audience doesn’t have yet. Think of what we do in the classroom. We know that we know things students don’t know yet. Students are responsible for absorbing this material if they want an A in the class. On the other hand, we don’t test voters about their factual knowledge before we let them vote. That’s probably a good thing – several southern states used to deploy impossible voter “literacy” tests as a way to disenfranchise black voters. These tests were banned as part of the landmark 1965 Voting Rights Act, but the conservative Roberts Supreme Court overturned this section of the law. Today, the biggest thing stopping a fact-based pop quiz before people vote may be a political party that likes to make up it’s own facts!

Whenever I read about scientific debates being put in to policy, it feels like I always see people taking the tone that “if only the other side knew the facts, they would join us.” For example, if only people knew how harmful it was to the entire school when a parent avoids vaccinating their kids. If only people knew the risks of climate change. Over at Slate, Dr. Tim Requarth has an excellent article summarizing how this “deficit” model is a poor way to communicate science to the broader public. Providing more knowledge actually tends to backfire in lab experiments. So why does the “fill a deficit in people’s knowledge” style of communication persist?

“The deficit model perfectly explains how a scientist learns science. But the obstacles faced by science communicators are not epistemological but cultural. The skills required are not those of a university lecturer but a rhetorician.”

Maybe it’s because I was trained in the social sciences and not neuroscience, but I don’t fully buy this. I have sent scientific manuscripts off to journals where my peer reviewers and/or the editors have had very different assumptions of what good research should be. Any social scientist who tries to publish for long enough will run in to hostile reviewers. I’ve always tried to avoid being this kind of reviewer and focused on the internal consistency of analysis. However, I have seen reviewers ignore serious methods issues that I caught. I think they hated the framing of an article so much that they didn’t bother to keep reading!

Even when we think of ourselves as scientists, we need to learn something about being a “rhetorician” to overcome hostile peer reviewers. Early on in my career, I assumed reviewers would take statistical results at roughly face value. My first quant manuscript showed that, among other things, prime time presidential press conferences received unusual coverage. One of my initial peer reviewers didn’t buy the result. After all, cable news can broadcast breaking news at 2:30 AM if they need to, so why should the time of day matter at all? I was a bit surprised by this comment. First of all, I wasn’t studying cable news!

Looking back on it, this peer reviewer and I had different assumptions. I had written “late runs” for evening stories and rushed against a tight deadline. I spent one evening with the overnight crew at a local TV station and that’s when I started looking at grad school as a less painful option. I knew that just because reporters have the technical capacity to cover stories at 2:30 AM doesn’t mean they want to sacrifice their entire routine to work the graveyard shift. However, I wrote this earlier draft of my article focusing on how these traditions persist even as technological barriers fade. I never really did a good job explaining why these barriers might persist.

When I first got this review I was outraged. Reviewer #2 had invented incorrect facts to justify a rejection. The next time I sent the paper off, a reviewer was furious I didn’t describe a big post 9/11 spike in how George W. Bush’s press conferences were covered. I tested for it and it wasn’t there, after controlling for specific things Bush did differently than his predecessors.

Eventually I learned that even my quantitative articles have to have more storytelling. I can’t just point to the evening press conference variable and rely on common sense. I had to explain that it took Congressional Democrats six years (and a major scandal) to realize they might get a better chance to respond to Ronald Reagan’s prime time press conferences if they stayed in their office to answer a reporter’s phone call! I had to explain what Bush did differently in his press conferences, and that presidents doing things could influence journalists. If my narrative has gaps, people will fill in the gaps with their own assumptions, even though those assumptions are normally wrong.

Assumptions About How the Public Views Science

With this in mind, I wanted to delve in to some assumptions we may have about how the public views science. Donald Trump wants to slash the EPA’s budget. Lamar Smith, the Texas Republican chairman of the House Science committee, insists that scientists are manipulating data to over-emphasize the effects of climate change. His has a long history of using subpoenas to go after federal scientists publishing results he doesn’t like. He also just happens to get more campaign contributions from the oil and gas industry than any other industry. Smith wants all federal grant recipients to pledge they are acting in “the national interest” and accused climate scientists of abandoning the scientific method during a recent hearing. If Lamar Smith is the Republican Party’s main legislator on science and the environment, how much is he speaking for the interests of Republican voters?

To try and answer this question, I looked at data from the American National Election Survey. The full survey asked the same panelists a series of questions before and after the election. One of the things they asked respondents to do was answer, on a 0-100 scale, how do you feel about the following people or groups. 0 is feeling very cold, 50 is average or indifferent, and 100 is warmth. One of the groups they asked about was scientists. Let’s see how they compare to other groups:

Overall Trump vote Other vote
Scientists 76.7 71.71 81.93
Clinton 43.81 12.99 68.88
Trump 42.09 76.29 15.65
Christian Fundamentalists 50.27 62 39.73
Tea Party 44.53 59.46 30.9
Gays & Lesbians 60.73 49.66 71.57
Police 75.48 85.33 70.38

On average, respondents felt more warmth towards scientists than any other person or group in the post-election survey! There is a bit of a partisan split, but warmth towards scientists is fairly bipartisan. At the time of this survey, scientists were not seen as a distinctly liberal interest group. One of the long-standing concerns about today’s March For Science is that marchers would play in to the hands of someone like Lamar Smith, making scientists a more partisan football.

The best analogy may be how people feel about police. Some progressives have strong negative feelings towards police officers, particularly in the wake of Black Lives Matter. However, most Democrats feel at least some warmth to police. Some Trump voters have strong negative feelings towards scientists. However, most Trump voters felt at least some warmth to scientists. The regression results were dull enough (statistical significance but small effects) that I put them as a footnote only.

Next, let’s take a look at government funding for “science and technology.” In the abstract, this polls very well in the ANES. 58.35 percent of respondents said the government should spend more money on science and technology. Only 7.52 percent of respondents say the government should spend less money. When people critique spending, they tend to say they dislike particular projects, not the abstract idea. Even Lamar Smith wrote an op-ed in USA Today suggesting more funding in science and technology would be good, even though he spent most of the op-ed attacking scientists he dislikes.

To test where people stand on this issue I ran an ordered logit model. The ologit is used when we have three or more categories that we can put in a rank order, like spend less on science and technology, spend the same amount, or spend more. It assumes each independent variable will have a certain effect pushing people to one end of the spectrum or the other. In other words, having a college degree would either push people to spending more or spending less. It wouldn’t split respondents like a wishbone.

I put this together fairly quickly, so I used the following independent variables:

  • College graduate
  • Age (range 18-90)
  • Male
  • Race (white = omitted; multi-racial respondents are coded as “other” in the quick ANES aggregation)
  • Trump voter
  • Ideology on 7 point liberal/conservative scale, where 1 is very liberal. I use results from the post-election survey.
  • A question on how respondents interpret the Bible. All respondents got this question regardless of their faith.
    • The Bible is the actual word of God and is to be taken literally, word for word
    • The Bible is the word of God but not everything in it should be taken literally
    • The Bible is a book written by men and is not the word of God.
    • Sometimes I just separated the more secular response from the other two.
  • Income is currently restricted in the ANES because it could be used to identify respondents. The survey used two different questions in a split-panel designed for self-identified class, which I don’t want to tangle with today. So there’s no good control there.

Here are the results:

scibud_o-use

* Note: Categories are ranked less spending, equal spending, more spending. Positive coefficients indicate a group of respondents who wants the government to spend more.

As we might expect, increased government spending is a partisan issue. The more conservative someone is, the less they support additional government spending on science and technology. Even after controlling for ideology, Trump voters are somewhat less supportive, but p = 0.056. Interpret that however you see fit; I’m going to just move on. College graduates were not significantly more likely to support additional government funding for science. However, people who said the Bible is not the word of God were significantly more in favor of increased government funding.

I’m a bit uneasy about how to interpret the large difference between Hispanic respondents and non-Hispanic Whites. The ANES asked respondents about Hispanic ethnicity and race as separate questions. If I read the codebook correctly, at least 20 percent of Hispanic respondents checked other: Hispanic for race instead of checking a box for white, black, native American, Asian or pacific islander.

Anyway, it’s a bit difficult to interpret ologit results since we need to rely on the cut points to get more tangible estimates of how many respondents are in each category. I used Stata’s margins command to make two different predictions. First, here is the prediction for White males who voted for Trump, lack a college degree, and did not say the Bible is written by men:

Ideology Less Funding Equal Funding More Funding
1 (very liberal) 5.26% 27.06% 67.68%
2 6.20% 30.05% 63.75%
3 7.30% 33.08% 59.62%
4 8.58% 36.07% 55.35%
5 10.05% 38.95% 51.00%
6 11.74% 41.62% 46.64%
7 (very conservative) 13.68% 44.00% 42.32%

Now here are White females who did not vote for Trump, have a college degree, and said the Bible is written by men:

Ideology Less Funding Equal Funding More Funding
1 (very liberal) 2.69% 16.52% 80.79%
2 3.19% 18.88% 77.94%
3 3.77% 21.45% 74.78%
4 4.46% 24.19% 71.35%
5 5.27% 27.09% 67.64%
6 6.21% 30.08% 63.70%
7 (very conservative) 7.31% 33.11% 59.57%

There are definitely some differences based on political ideology and other variables. However, more funding for science and technology has pretty strong support in the abstract.

If people marching today talk about scientific method or process in abstract terms, they should remember that this has fairly broad support. Even conservative Trump voters have relatively warm feelings towards scientists and funding science. Marchers can build off these positive associations. It’s worth noting that even Lamar Smith is trying to draft off the positive associations people have with science. He’s trying to portray himself as a defender of “good science” even as he conducts political witch hunts. (I’ve seen progressives use similar framing to attack conservative scholarship, but they lack subpoena power.)

If marchers accuse Republican voters of being broadly anti-science, they risk alienating voters and making scientists look like a liberal interest group. Right now, most Republican voters do not associate science with liberal interest groups. They may associate a few disciplines with liberal interest groups. I think most sociologists want to strengthen that association. But portraying all Republicans as being anti-science could easily backfire, since this is not how many Republicans see themselves.

Science In the Abstract vs. Environmental Policy

The elephant in the room is that partisans tend to see specific science-related policy choices differently than they see science in the abstract. For example, Lamar Smith can write an op-ed declaring his support for more science funding, then spend most of his time in Congress attacking climate researchers. Voters could feel warmly towards scientists, but still resist vaccination. Prior studies have shown that conservatives with a high amount of scientific knowledge know what the scientific consensus is on climate change, but they refuse to accept it. We may be better off thinking of hostile audiences outside academic like we think of hostile peer reviewers, instead of treating them like people who just need to be informed about science.

With that in mind, I decided to test how much having a college degree and warm feelings towards scientists affect respondents’ views on climate change, after controlling for ideology. For now let’s start with the question “is global warming happening?” 80.8 percent of respondents said global warming has probably been happening, while 19.2 percent said it probably hasn’t been happening. Those were the only options in the ANES. Respondents couldn’t choose a definitive yes or no. Given how pessimistic some of my friends are, I expected to see more “it’s probably not happening” responses. I ran a logit regression to see what predicts a yes. (I know, it’s weird when most people say yes, but I think this makes the direction of coefficients easier to keep straight.)

logit-warminghappening

Reminder: positive regression coefficients here mean support for the more environmentalist position that global warming is probably happening.

For starters, it’s worth pointing out that college graduates were not significantly more likely to say global warming is probably happening. One of the biggest surprises here is that there isn’t a straight line between how literally someone takes the Bible and whether they think global warming is happening. People who took a moderate stance on this question of faith were the most likely to say global warming is probably happening, controlling for other variables. It’s easy to think of rational, atheistic science on one side of environmental debates and evangelical faith as the other side. It may be worth thinking more about how to talk to people who are in the middle, trying to balance the warnings of modern science with the teachings of their religious faith.

As we might expect, political ideology is the biggest predictor of whether someone says global warming is probably happening. Even after controlling for some variables that predict political ideology and whether someone voted for Trump, political identity and behavior appear to have a strong correlation with someone’s belief in whether global warming is a real phenomenon. (Full disclosure: this is a bit of a statistical dodge in the causal argument since “do you think global warming is happening?” came from the pre-election wave of the ANES.) Here are predicted probabilities for saying global warming is real, based on who someone voted for and their political ideologies:

Ideology Trump Voter Other Voter
1 (very liberal) 91.34% 97.46%
2 87.96% 96.35%
3 83.52% 94.78%
4 77.91% 92.62%
5 71.09% 89.66%
6 63.20% 85.74%
7 (very conservative) 54.56% 80.68%

What Causes Global Warming?

Finally, let’s take a look at the follow-up question: “do you think a rise in the world’s temperatures would be caused mostly by human activity, natural causes, or about equally human activity and natural causes?” People who had said they don’t believe the earth is warming were asked to assume it is for this follow-up question. (They were overwhelmingly willing to give an answer instead of refusing to answer.) 38.8 percent said mostly human activity, 18.2 percent said mostly natural causes, and 43 percent said the two were roughly equal.

I re-ordered the responses for an ordered logit model. In this model, positive regression coefficients mean a respondent moves closer to saying climate change is mostly caused by human activity.

warming-humancause

There is a whole lot to talk about here. Let’s start with the biggest coefficient. People who said global warming is probably happening were much more likely to say human activity is causing global warming. It may seem so obvious that these go together that treating one variable as a cause and the other as an effect is a bit weird. Normally I would agree. However, these questions come one after the other. This gives us a good transition to talk about how to persuade people. Scholars tend to agree that it’s hard to change someone’s mind once they are dead set on an issue. It’s easier to get someone to form new associations about an issue than directly countering their position. It’s even easier to prompt people by reminding them of something they know. Most people know the Earth is getting warmer. Reminding them of this may make it easier to associate certain human activity with rising temperatures.

Most of the other variables operate like we’d expect. Older respondents, males and African Americans were all closer to the “mostly natural causes” side. People who gave the secular answer “the Bible was written by men” were a bit more likely to say humans are also responsible for climate change. However, college graduates were not significantly more likely to say this, after controlling for other variables. Respondents’ feelings of warmth towards scientists barely made a dent in what they thought about climate change.

In many ways, positions on climate change appear to be a way that respondents express their political identity. I think this actually makes a lot of sense. Let’s assume we all want to secure freedom, prosperity and happiness for ourselves and our children. That’s a really big goal. It’s also a really hard goal. How do we get there? If the world provided one clear answer that stood head and shoulders above the rest, we’d all flock to it. However, human behavior is far too complex and unpredictable. When people have broad goals and don’t really know how to achieve them, they tend to adopt various rituals.

Moving away from fossil fuels could have a major impact on people’s day-to-day lives. Large sections of America take commuting by car for granted. Cutting back on cars could mean massive changes in when people work and how much time we can spend with loved ones. Some people would lose jobs. Others would find better jobs. Cutting back on things like air conditioning could have a serious impact on Americans’ quality of life. Of course, so could rising oceans and unpredictable freakish weather.

When I look at these results, I can’t help but wonder if people say the climate is not changing or human activity doesn’t cause climate change because they are terrified of having to change their daily routines. I can sympathize with that. Change is hard. All of us who have had to make some change in our personal or professional lives know how hard change can be. It’s not surprising that people who don’t want to change their behavior on the environment would flock towards conservatism, particularly the nostalgic sloganeering of “Make America Great Again.”

I understand why people get so angry at climate change deniers, but I can’t quite tap in to that anger myself. The stakes are too high. If talking to people about their fears gets them to understand how anxiety leads to poor decisions, that’s better for the environment than any yelling or screaming we are capable of.


So Trump Had a Press Conference…

I’ve mainly been working on non-politics projects lately, so I haven’t seen any of the Donald Trump press conference yet. I’m not going to try and assess his performance or the news coverage of that event specifically until I watch the film. On the other hand, I have published on presidential press conferences, so I wanted to cover a few broad rules of the setting that should translate to this week’s press conference or any future press conference:

1) Subsequent news coverage will focus on what Trump said, as opposed to getting a wide balance of opinion, unless a news organization dedicates a lot of space to the press conference

One of the main things I wanted to study in my dissertation was whether politicians could do things that affects the balance of opinion found in news coverage. I looked at press conferences from 1891-2009 since we can compare what was said to the subsequent news coverage, which is rare in news interviews. I measured balance of opinion as a proportion of quoted words from the president to all quoted words in news coverage of an event. The New York Times‘ average proportion was 0.757. In other words, nearly 76 percent of the quoted words came from the president versus 24 percent for everyone else. ABC Nightly News’ proportion was 0.695.

I found surprisingly few variables affect this ratio. As we might imagine, if a president has a joint press conference with another foreign leader they tend to get some quotes in the news as well. However, there was no significant partisan difference after controlling for different ways that presidents set up their press conferences. Approval ratings have tiny, insignificant effects. One peer reviewer was convinced that presidents who had been in the news a lot wouldn’t have as much control. After weeks of gathering additional data I found this had literally 0 impact.

The main thing that leads to more balance of opinion is whether news organizations leave enough space to quote people other than the president. When the Times or ABC only published one short story, that story would only try to summarize the main things the president said. The single most common outcome is a completely one-sided story. More important conferences will get multiple stories, each focused on a different issue or incident. This is when we get more sources.

2) The questions and the subsequent writeup are two different things

Press conferences are a performance. Since presidential press conferences are on TV, there’s more room for journalists to perform, not just presidents. Many journalists want to brand themselves as tough interrogators, holding presidents accountable. With the rise of partisan news, the image of holding people accountable has become less about “I’d grill everyone, even my own mother!” and more about partisan allegiances.

Working journalists know that they need to produce some story at the end. If they keep pressing the president on one topic, he may cancel the press conference or simply not say anything interesting. Since one press conference could lead to five stories on five different topics, there is pressure to move on instead of harping on a particular topic. The more a president opens up about a topic, the more there is for a journalist to write about. Aggressive flashes during the press conference can turn to deference afterwards. On the other hand, exchanges that seem innocuous as they happen may attract much more attention after the conference, when people can review the tapes.

3) The performance is news

Journalists have written about how people conducted themselves in on-the-record presidential press conferences for as long as presidents have held them on the record. I looked at these stories dating back to the Times’ very first story about Eisenhower doing one press conference for print media then inviting news cameras in for a second, shorter conference that repeated most of the same questions. Day-to-day news reporting in the Times and other objective news organizations follows a strict rule of avoiding judgments about a source’s moral character. Press conferences are an exception. Someone’s performance and character is fair game. One of the more common strategies is to have some reporters focus on the literal facts while one reporter focuses on the conference as a performance.

I assume a lot of people are writing about Trump’s performance as we speak. You may think journalists focusing on theatre is another one of those unusual Trump things. It isn’t. Journalists only gave a few years before hammering away at Eisenhower for poor performances in front of the camera:

“One purpose of today’s Presidential news conference was to promote acceptance of the Administration’s new Middle East security policy, but two incidents occurred there that are likely to have the opposite effect.”

Throughout the article the reporter focused on Eisenhower’s communication style: “casual remarks…that implied that the United States might well have to use small atomic weapons” and his “extemporaneous” answer to another question. Five months later, Eisenhower’s “casual dismissal” of Soviet Premier Nikita Khrushchev’s appearance on CBS was used to imply “the tendency of the Administration to continue regarding propaganda as a nuisance rather than as an opportunity.”

4) Public opinion doesn’t affect journalists

My adviser Steve Clayman – along with several colleagues – studied whether unpopular presidents face more aggressive questioning. He found no relationship between approval ratings and any form of journalistic aggressiveness. I found no relationship between approval ratings and how much attention a press conference gets or the balance of opinion in those stories. It’s probably a good thing that the press will not be more deferential to a popular president. On the other hand, this means Trump will not get additional scrutiny just because he is deeply unpopular.


Stepping Away From the Rage

You might be surprised that I went dark for a few weeks after the election, but now I am writing a flurry of posts. I’ve actually had some of these posts written in draft form for weeks. I wanted to wait out the circular firing squad that I’m seeing on left-leaning social media. Unfortunately, it’s December and the circular firing squad isn’t going away. The absurdity is getting a bit much, so I’ve got to say my peace and move on.

As someone who spent years studying how different news organizations gravitated towards different topics in the 2008 election, I expected the same in 2016. Candidates have different things they care about, different priorities for the country. They also gravitate towards issues that poll well for them. We saw this kind of asymmetry in the primaries. Bernie Sanders was all about income inequality and then added political reform to reflect his struggles under DNC rules and new followers’ anger towards the DNC. Hillary Clinton emphasized race and gender to try and capture Obama’s base along with her foreign policy experience. For Republicans, Ted Cruz emphasized local government and Christian values. John Kasich emphasized pragmatic experience. Donald Trump emphasized immigration, trade and being an outsider who could make better deals to clean up DC.

In the general election, both sides converged on the campaign agenda. Trump made his campaign about his own personality, and Clinton agreed to make the campaign about Trump. People talked about race and gender largely via reference to Trump’s behavior and critiques of Trump. That’s why it feels like he has a mandate and why many on the left feel so devastated. I think a lot of progressive put all their eggs in the “make this election a referendum on Trump” basket and it didn’t quite work out. The symmetry of Campaign 2016 is part of why it got so nasty.

I’ll get back to this idea of symmetry and how it is haunting Democrats’ attempts to process the election in a bit. First it is important to recognize just how narrow Trump’s victory was. As a sports fan, I know narrow championship defeats feel much worse than getting blown out. A whole bunch of things had to break in Donald Trump’s favor or against Hillary Clinton. This list is adapted from a longer list David Roberts offered at Vox of possible reasons for Clinton’s loss. I’m not always a fan of Roberts’ work, but he did a good job in the beginning of his essay laying out all the explanations that other progressives have offered:

  • An unpopular candidate in Clinton
  • Poor Clinton strategy on which states to focus on
  • Lack of Clinton outreach to white working class / rural voters
  • Too much emphasis on Trump’s character vs. Clinton’s economic plan
  • The FBI, Russian hackers, Wikileaks all worked against Clinton
  • The media emphasized Clinton’s e-mails over any other story
  • Voter restrictions in states like North Carolina
  • The electoral college made Trump votes more valuable
  • Voters may have disproportionately chose third party candidates over Clinton
  • Racial and gender politics driving at least some voters to Trump as opposed to disqualifying him in voters’ minds.

After giving his long list, Roberts offers one of the more insightful things I have seen any Democrat say after the election:

Like everyone, I buy some of these more than others. But there are bits and pieces of evidence for all of them. Some of them don’t hold up on their own — voter suppression probably didn’t swing the election, nor did third-party candidates — but all of them plausibly played a role or have some grain of truth.

Even before giving the list of what went wrong, Roberts explains what went right. Hillary Clinton won the popular vote. By the time all the votes are counted, Clinton should have the second highest vote total of anyone who has run for President of the United States. Trump earned 2.4 million fewer votes and squeaked through the Electoral College. Since Trump had such a narrow victory, it’s easy to say that Clinton would have won if just one thing broke differently.

I think this is why there has been so much unproductive finger pointing on the left. Clinton came so close to winning that everyone can convince themselves “I held up my end! It’s that other part of the Democratic coalition that let us down!” For starters, here’s Bernie Sanders:

You may recall that Sanders’ biggest problem in the beginning of his campaign was emphasizing economics almost exclusively. He said racial inequality was secondary to class. Black Lives Matter activists targeted his rallies for protests, charging the stage a few times. Sanders moved towards the left on race for the primary. But now that the Democrats lost the general election, Sanders is saying he was right all along. He hasn’t exactly been received warmly by other progressives.

Roberts posted these tweets in his Vox piece and then piled on:

There isn’t a ton of evidence that an economically populist message — divorced of appeals to xenophobia or white resentment — moves the WWC. In fact, as Andrew Prokop notes, “In two of those crucial Midwestern states that flipped to Trump, Democratic Senate candidates [Russ Feingold and Ted Strickland] campaigned on economically populist platforms — but they did notably worse than Hillary Clinton.”

Why is that?

Perhaps because politicians know, though won’t say, that appeals to xenophobia and white resentment work. If I may coin a phrase: It’s the white resentment, stupid.

I’m not sure I would want to build any kind of broad, sweeping theory over two data points. Feingold and Strickland were both politicians who tried to restart their careers after being voted out of statewide office. They both lost to incumbent Republicans. Defeating an incumbent is difficult! It’s hard to ignore incumbency and these Democrats’ previous losses unless you are so convinced race is the only answer that you ignore every other possibility. I have to admit, this is where I found Roberts very hard to follow. It feels like he’s ready to concede Ohio, Wisconsin, and every other state with a significant rural white population. Can that be right? Sorry, but I’m not one to throw in the towel.

Maybe there’s a weakness in the progressive coalition. Once someone is convinced that there is one best explanation, there’s a tendency to point fingers at every progressive who offers a different top priority.

Most of us have a wide range of priorities. If a pollster asked “what is the single biggest problem facing America today?” I could give a clear answer. Give me a minute and I can give issue #2 and #3. We prioritize how much we care about politics too. We can prioritize what kinds of things are dealbreakers on a first date and what we want most out of a career. Setting priorities is one of the basic things we do as people. It’s a basic thing for successful organizations as well. But when progressives say they care about one issue more than another, other members of the progressive coalition attack them for “selling out” part of the group.

The Republicans have their nasty fights too. How often has Ted Cruz accused someone of “selling out” conservative principles? However, the large Christian conservative faction embraced Donald Trump, a man who repeatedly worked with Playboy (should have checked his IMDB page). At the end of the day, most Republicans prioritized winning the White House over anything else, so they voted for Trump. After the election, Democrats are currently fighting a nasty battle about whether to prioritize broadening the party to win elections or ideological purity over race and racism. Anyone who wants to do any kind of political advocacy is going to face questions of how much to focus on ideological purity versus attracting a broad audience. These aren’t easy questions, and the answer probably depends on what you want to accomplish.

Progressives are currently fighting over one of the toughest issues they have ever confronted: how to argue against racism. There is no research that suggests calling someone a racist will cause them to say “aww, shucks, you were right!” Professors who study political persuasion tend to agree that immediately dismissing someone as racist, sexist or homophobic may be one of the least persuasive arguments out there. As I was writing this, this very premise of making political arguments that could persuade other people came under attack in certain academic circles:

Taking these tweetstorms at face value doesn’t add up. My hunch is that there is just enough of an unspoken difference in priorities for people to get angry with each other. Goff wants to focus on more active racists and define a set of behaviors or attitudes as unacceptable. Singal’s priority is thinking of how to best communicate with people who don’t explicitly endorse racism but voted for Trump anyway. Reading these back and forth tweets as an outsider, I think everyone is working with a different definition of what “persuasion” means.

When I taught students about political persuasion, I tried to move them away from the idea of flipping someone’s opinion on an issue. I knew the students who would care most about my lecture were people who felt very strongly on one side of an issue or issues, and they hated people on the other side. So I started the lesson by explaining that if someone is strongly committed, they are going to be incredibly difficult to budge. However, most people aren’t that strongly committed on most issues. The less committed can be nudged and prodded to care about the issues we care about. Instead of trying to convert the worst of the worst, I would try to prod the less committed to say “oh, ok, I’ll do it your way if I get a little something in return.”

There’s an interesting parallel to protests here. You might think protesters are all ideologues jumping up and down. It turns out that successful protests are focused on particular issues and tolerant of ideological differences. Setting priorities is critical. Positive priorities – explaining to people what you want to do – are far more successful than protesting just to critique someone. Effective protesters get friends and family in the door via social networks and worry about ideology later. Ziad Munson, who studied the pro-life movement, argued the right is far more successful at this. Think about all the sniping coming from different corners of the left. It’s a minefield! How many people do you think would look at the circular firing squad and say sign me up?

Other successful organizations tend to focus on their strengths and mitigate weaknesses. Let’s think of the Trump campaign. Trump excels at putting on a show, conveying emotion, and provoking people. He is weak at policy. He made his campaign about conveying emotions and provoking opponents to near constant distraction. To borrow from sports, Donald Trump set the tempo for this campaign. Hillary Clinton and other progressives were happy to play at this tempo, waging their own emotional campaign. I feel like I have to re-state this for emphasis. Donald Trump waged a highly asymmetrical campaign, but Clinton and other progressives decided to engage on Trump’s terms. It sort of worked too. Clinton was relatively weak at conveying emotion. She would have fared better if people focused on policy. And she still got more votes!

But Hillary Clinton is moving on. It’s time to think of Democrats’ strengths. This is more than a bit nerve wracking. Democrats’ main strength in this election was getting more aggregate votes for the presidency and the Senate, but Trump won the Electoral College and Republicans control the Senate. Republicans control the House and dominate at the local level. Yes, the electoral map favors the Republicans. But the only way to change the system is to get large majorities within the current system.

With all the anger surrounding the election and post-election squabbling, I started dreaming of a very different kind of government. Imagine a city where there were concerts outside city hall every week during the summer. It’s not a partisan rally. It’s not even a political thing. City Hall just happens to have a nice courtyard that makes for a great, low cost outdoor venue. Some people wander by for a few minutes before going to one of the local bars or movie theaters. Other people bring their lawn furniture. This is a regular summertime event next to one of my favorite coffee shops. When I dropped by to check out one of the larger concerts, I kind of got the feeling some people go every week. The band is great. Everyone feels welcome, like they belong in the community.

In 2016, the Democrats are the only major political party with the potential to imagine a society where everyone has the potential to make a valuable contribution, and everyone feels like they have the right to belong. Who wouldn’t want to live in a positive place where we all work hard to support each other and lift each other up?

Trump held a lot of rallies, but there was always suspicion and demonization of interlopers. He campaigned on the idea that no matter how much our neighbors have sacrificed to make America great, only a certain group of loyalists count as “true Americans.”

Our country was founded on an idea that people were created equal, with certain unalienable rights. We founded a democracy under the idea that giving people the right to choose their leaders was the best way to promote life, liberty and the pursuit of happiness. That doesn’t mean everyone was granted full citizenship right away. Every generation had its doubts about whether certain “undesirables” deserved the right to vote. Over time, we let more and more people vote and become full members of the community. There was fear. There was anger. But each time America emerged full of vibrant life, with liberty and happiness for more of our community.

I understand why people feel angry and outraged. I understand why people think resisting Donald Trump’s massive disregard for the Constitution requires picking fights at every turn. Remember, picking fights at every turn is Trump’s strategy. Are there progressives out there who think the best plan is to try and beat Donald Trump at his own game? If you oppose Trump’s attempts to deny Americans equality and unalienable rights, you can’t campaign on a message that many Americans are too stupid or biased to possibly be redeemed. Those emotions are too discordant. Democrats are the only political party that could imagine a future full of life, liberty and happiness for everyone currently living in the United States. That vision only works if everyone thinks they could be welcomed in to our community.

 


How Distracting “News” Works

As you may remember, Mike Pence went to the theatre a few weeks ago. Normally we wouldn’t care if a prominent politician went to see a Broadway play. However, Pence was booed when he walked in the theatre. Who would have thought that one of the most anti-gay politicians in America would be persona non grata on Broadway? It wasn’t “Chase Utley breaks Ruben Tejada’s leg then goes to Queens” booing. Nonetheless, news that Pence was booed on Broadway spread like wildfire. Then we got the seemingly inevitable backlash. Why were more people talking about Pence getting booed while watching Hamilton than Donald Trump settling the Trump University case by paying a $25 million judgment?

I’ll start with the most basic question: why were so many people talking about Pence getting booed? People can read the story and offer their snap judgment in under 30 seconds. There’s nothing more to the story than vice president-elect booed at theatre. People don’t need to know the plot of the play or Pence’s specific policies to ring in. The story encourages people to take clear sides: is booing the vice president-elect at the theatre a breach of decorum?

Because this is an entirely moral question, there isn’t a real risk of looking like a fool because we are poorly informed. I may not want to tweet about the Trump University case because I don’t know whether $25 million represents a large or small settlement compared to other cases like this. I don’t want to act like one of those PhDs who insists I know everything about everything! But you don’t need a PhD or even a high school degree to give an opinion on whether booing in the theatre is wrong. Middle schoolers could give a presentation to the class about it.

Debates over whether booing Pence or settling the Trump University case are more important say something more fundamental about news preferences. We normally think of news preferences as a list. So the list of things I thought were newsworthy that weekend went something like this:

  1. Trump settles Trump University case
  2. Trump nominates National Security Adviser whose rhetoric on Muslims fits ideally in to ISIS recruitment (they love the idea of an ideological holy war).
  3. UCLA is playing USC in the Crosstown Rivalry (* during the game this jumps to #1 through 100)
  4. It’s raining in LA and everyone forgot how to drive
  5. UCLA basketball looks good
  6. Trump’s other nominations
  7. I’m getting crushed in my NCAA confidence pool this week
  8. [Long list of stuff I don’t really care enough to offer in detail. I wrote the list down at the time, then wrote the rest of the post over a week later.]

Some of my list is pretty idiosyncratic. People who don’t care about college sports will cross off several items from this list. Since it’s a weekend with college football and basketball, both sports are well represented in 8-20 on my list. You probably have a different list of most newsworthy things from the weekend. That’s good! We are different people. We probably have different hobbies, different political priorities, and different emphasis on politics vs. other things in life. Maybe it’s a little frustrating that none of my Facebook friends enjoy the Piesman trophy. But life would be almost intolerably boring if we all agreed on everything.

Social Media Lists of Newsworthiness are Weird

You might assume that all of us have one internally consistent list of things we care about. In other words, the list of things we read, the list of things we share, and the list of things we comment on would all look the same. It turns out that may not be the case. How often have you liked or commented on someone’s post before actually reading the link? It turns out this happens a lot. People in new media production have realized there’s relatively little correlation between what people read and what people share or comment on. The list of things we find newsworthy enough to discuss on social media is not the same as the list of things we consume for our personal reading. A year ago, Atlantic writer Derek Thompson went through his top 100 tweets with links, trying to compare how often someone actually clicked on the link vs. other Twitter activity.

thompson-clickvengage

The scales on the graph are a bit wonky. I’m pretty sure the x-axis is a ran order from highest click through rate (a whopping 6 percent!) to his 100th best tweet (around 1% of readers clicking on the link). Thompson said his overall click-through rate was 1.7 percent. Now let’s focus on the big picture. If people had the same priorities for their personal reading and their social media discussions, these two lines would go in parallel. They don’t. This suggests there are some stories that people really enjoy talking about on social media, even if they wouldn’t dig deeper. Mike Pence getting booed during Hamilton is a perfect example. People can take sides without having to dig deeper.

Aggregating Individual News Preferences Makes Things Much Weirder

If we add all of our priorities together, you may expect another list: here’s what people think is the most important story, here’s number 2, and so on. That’s why we debate whether or not Hamilton is #1 as opposed to #2 or 5 or 25. If you look at how often people talk about each story, our group behavior is probably closer to a pyramid than a rank order list. A few events are near the top of enough individual lists so they shoot to the top of the news pyramid. Think of Super Bowls and presidential debates this year. It’s not just that the leader is #1 and the next most popular story is #2. The leader gets vastly more attention than #2, then the distance between 2 and 3 is smaller, and so on. Eventually we get to the point where the group is split. There may be a tie instead of a clear #5 story. The further down we go, the more we get to things that are on a bunch of lists but fairly low down, or things that are high on a few individual lists but don’t register on anyone else’s in the group.

If this seems a little abstract, let’s take a detour to the music industry. Every year, there is one artist who is the top seller. They usually have a crossover hit that fits in to some genre, pop, Top 40, and maybe some secondary genre. Then you have a few other hit albums that get crossover appeal. Then there is the larger group of albums that only sell in their genre, or maybe they have a few huge singles but can’t sell the album. At the bottom end, there are lots of people recording music at home who don’t earn any money.

News has the same unequal distribution, but the only way to notice is if we have a database of all the potential news stories that didn’t get in a news outlet. Most of us have never thought of news this way because journalists don’t exactly leave lists like this lying around. If you thought people second guess the media now, imagine what would happen if the New York Times published a list of “here are 50 stories we decided not to pursue further.” They’d never hear the end of it! We can come up with our own lists of stories we’d like to see and feel are left out just by using our imagination. That’s why we assume that no matter how many people we put together, we’d still get a rank order list. When I was a journalist, I assumed if I put every journalist together I’d get a clean rank order list, not a pyramid.

For my Master’s Thesis I wanted to look at whether politicians’ attempts to duck a question by talking about something else had any influence on what journalists wrote. I knew I couldn’t just look at news coverage to answer this question. I had to look at what a politician said and then what got published to make a before and after comparison. Because journalists won’t just hand over interview transcripts, I decided to use presidential press conferences as a dataset. The only way to make sure I separated the quotable statements from the unquotable statements, I had to analyze every single statement! Going through four conferences – a total of 1743 statements – took months. I wanted to code things like was the president criticizing someone, is he ducking a question, is he talking about the military vs. the economy, etc. Because any newspaper can be idiosyncratic, I used the New York Times, Washington Post, Los Angeles Times and USA Today. (Newspapers only is a bit old school, I know.) Out of those 1,743 statements, how many do you think were quoted in each newspaper?

 

{Here is some empty space so you can play the guessing game if you want to}

 

The correct answer is four! Leading newspapers tended to have some variety. Only 25 statements were quoted in three of the four newspapers. The full distribution looked like this:

quotefreq

I know, this may not be what you were expecting. When I presented my MA at the leading sociology conference, the veteran professor presiding over my panel didn’t understand this kind of statistical distribution. To be fair, I had to teach myself how to run statistical models with this kind of unequal distribution because it wasn’t covered in my grad level stats classes.

Here’s why it is so rare to have complete agreement on a quote. Part of it is New York Times and Washington Post allocated more space to presidential press conferences. The main explanation is that four writers covering the same story rarely choose the same quote if they have options to choose from. When George W. Bush spent five minutes criticizing Saddam Hussein, two reporters may choose criticism A and two may choose criticism B. This gets us to the upper-middle level of the pyramid. Presidents rarely say anything as direct as “We do not recognize the outcome of the election [in Zimbabwe] because we think it’s flawed.” When Bush said this in 2002, it was clearly a better quote than anything else he said about that election and each newspaper quoted it. Other scholars have seen similar unequal distributions with how often a particular person (van de Rijt et al 2013) or group (Amenta et al 2009) gets quoted in the news.

Mike Pence getting booed when he went to see Hamilton has a natural advantage for vaulting to the top of the pyramid. Pence didn’t say much of anything himself. Trump posted one tweet about how he was offended. The Hamilton cast read one reaction from the stage. Everyone talking about what happened will refer to the same very small set of information. I know, it seems like such a small thing that it’s not worth harping on. If you saw this story and thought “who cares if Pence got booed?” then me talking about a small set of shared information won’t make you care. It doesn’t make me have strong opinions on the morality of booing. The reason I’m talking about this small detail is because it has a surprisingly powerful effect in focusing aggregate behavior. When I looked at the most common phrases on the Internet in 2008, I had to control for the titles of songs, movies, TV shows and even video games. Since people repeated the title over and over, it biased my results for how often particular websites talked about politics compared to other topics.

Why Instigators Can Be So Much More Effective Today

If any simple story with a limited number of facts can rise to the top of our aggregated preferences, moral outrage is the rocket fuel. Stories like Pence getting booed encourage people to take sides. Any cultural instigator has a huge advantage in getting attention. They just need to make one offensive statement and it distracts people on both sides. Donald Trump used this strategy since the early days of his campaign. People were so busy talking about Trump and how offensive he was that they lost focus on how they would help voters’ lives. Republicans got caught in the web one by one. Hillary Clinton ran an almost entirely negative campaign about how Trump isn’t qualified instead of emphasizing how she would try to make people’s lives better.

It’s important to remember that Trump isn’t the first instigator to use these distraction tactics. The National Rifle Association has used them successfully for decades. NFL commissioner Roger Goddell deflects negative attention from team owners as they demand public resources for private stadiums.

It’s easy to blame Facebook, particularly with their fake news scandal. However, my press conference research largely predates Facebook. That being said, social media makes these problems worse because it aggregates individual decisions. Any story with least common denominator appeal will do better with the aggregate herd than with any individual. Stories that let people take sides on social media and advocate for their “team” have an even more powerful effect than what I saw from journalists. Individual journalists make relatively independent decisions. People on social media may get even more pleasure by talking about the thing that everyone else is talking about.

So How Can We Avoid Being Suckered in to These Stories?

It’s easy to point the finger at media organizations and say they should have better priorities, or point the finger at Facebook’s mysterious news algorithm. But that’s not really satisfying. I want to be able to take some control. Hopefully you do too. Well good news! One of the best ways to avoid being suckered in to low level scandals is to have strong independent judgment on what kinds of things matter. No one else is going to be the reliable voice saying “who cares about this nonsense?” The only people who bring up a story like Pence getting booed are going to be people who have strong opinions…or someone like me who really misses teaching from time to time.

The other key is to recognize that some people in your social media feeds will probably get suckered in to just about every minor story that lets them share their moral beliefs. No matter what happens, it just seems “too important” not to say how outraged they are. The people with the most influence over the process, starting the cascade of posts, are the people who tend to show the least restraint. Over the last few days I have talked to progressive, moderate, and conservative friends who have all said they are leaving social media. I didn’t even ask. They brought it up. Political posts keep rolling through their feed like crashing boulders, and they want to duck out of the way.

This is a good principle for self-preservation, but the only way to have meaningful change is to convince people to show some restraint before they push the petty outrage of the day on to the rest of us. I understand it’s hard to show restraint and let some things go. But I also know that if people can’t prioritize and let some stuff go, their social media feeds will turn in to a broken car alarm. It’s not a perfect metaphor. When it comes to politics some people actually love the sound of broken car alarms. They love outrage news and think every single action helps move a broader movement! But there are lots of people like me who don’t enjoy outrage news. Persuasion is about connecting with other people, not jumping up and down proclaiming how your morals are superior to everyone else. There’s little upside in going online to vent about every single petty grievance. If you voted against Trump because he can be taunted with a tweet, hold yourself to the same standard.

 


Scammers, Camelot, and the demand for fake news

Last week I walked past the single worst Black Friday ad I ever saw. A local clothing store advertised “openning” 10-6 on Thanksgiving. Yikes! Was this the worst Black Friday behavior I have ever seen in my neighborhood? It’s close, but I saw worse at the local Best buy a few years ago. While I was shopping for a laptop bag, a woman was complaining to customer service that she was locked out of her accounts. Apparently someone texted this woman claiming that she had won an award. She just needed to send her banking information to get paid. Of course, it’s a scam. I turned around to look at the low level best Buy employee and saw the quick look of terror on his face. How does he explain that this potential customer just got scammed and there’s nothing he can do to help? How can he be sympathetic to this confused woman walking in to Best Buy with her child instead of wanting to scold her for falling for such an obvious deception?

If you’re an old enough Internet user, you probably remember scams involving “Nigerian princes.” In case you forgot, this was a scam where someone sent bulk spam email claiming to be a Nigerian prince who has to move money offshore due to political unrest. If you give your bank account info, they would wire $10,000 to your account. Most people realized this was too good to be true, even before the scam became publicized and tech firms dedicated resources to blocking these spam e-mails. However, there were some people who desperately wanted to believe there was a Nigerian prince who would make them rich. Selfishness and laziness beat suspicion and careful research. The selfish and lazy might be pretty easy to exploit.

 

If you follow tech news over the last week, you saw headlines that the top 20 most shared stories on Facebook had more fake news stories than real ones. Google and Facebook both blocked fake news sites from their advertising sales networks this week – now that the US Presidential election is over. Facebook has always had an unusual set of “community standards” for regulating content. Visual depictions of violence and sexuality are generally banned. The company frequently claims it has tweaked its “News Feed” algorithm to show “higher quality content” as opposed to clickbait. However, Facebook has always strenuously objected to the idea that it is a media company with a profound influence on journalism. Here’s Mark Zuckerberg, trying to answer questions about whether his company helped Donald Trump win the 2016 election:

“Personally I think the idea that fake news on Facebook, which is a very small amount of the content, influenced the election in any way — I think is a pretty crazy idea. Voters make decisions based on their lived experience.”

I’m not sure anyone really believes this, even Zuckerberg. Facebook acted against fake news sites four days after Zuckerberg’s quote (and after Google’s ban). It’s a field day for people who want to blame Facebook’s lack of transparency – or social media more broadly – for Americans’ declining interest in facts and evidence. As much as people have a right to be frustrated that Facebook didn’t do anything about fake news until after the election, it’s not like Facebook was the birth of online scams. People have tried to use the Internet to try and exploit selfish and lazy users for decades. They used other technologies before the Internet. Instead of blaming Facebook, we should ask why would people want to spread misinformation with their friends and family?

camelot-12

My take here is probably different than most people because I actually covered a secession campaign. In 2002, the San Fernando Valley wanted to secede from the rest of Los Angeles. The secession movement started as part policy oriented and part symbolic. Every public school in Los Angeles County is in one school district. Valley voters wanted to break away from the unwieldy behemoth. They also believed their tax dollars were being used to subsidize the poorest neighborhoods of Los Angeles. On a symbolic level, Valley residents felt like they were taken for granted by a remote city hall. It wasn’t a rural / urban divide like presidential elections. If Valley voters formed their own city of Camelot, it would have been the seventh largest in the country! (Sidenote: Camelot won the vote for what to call the new city.)

By the time I started covering the story, Valley secession leaders had already conceded on their largest policy grievance. Camelot would still be part of the LA Unified School District. I talked to voters who said “what’s the point of seceding if we’re still tied to LAUSD?” Other reporters thought there was no way secessionists could get enough votes. They needed to run up enough votes from within the Valley to get a majority citywide. Secessionists didn’t fully want to campaign on keeping Valley tax revenue in the Valley either. The county ruled that Valley residents would have to financially compensate the rest of Los Angeles if secession passed, to make up for lost tax revenue.

With only a weak policy case, potholes became a major campaign issue! Some Valley residents saw every pothole as a reminder that their area didn’t get a “fair share” of city services. Mayor Hahn dispatched construction crews to smooth over problems, both literally and figuratively. (At this point I am obligated to say I don’t live in the Valley and my street gets enough flooding to become one lane only during moderate rain.) Valley secession leaders wanted voters to feel like City Hall was remote. They also reminded people that most local media organizations were located in the older area of the city and not the Valley, so they were biased against secession. The Los Angeles Daily News – which was based in the Valley – was decidedly pro-secession.

There are several things that make San Fernando Valley secession different than the 2016 presidential election. While the Valley has more Republicans than the rest of Los Angeles, it is still a majority Democratic area. Every voter is urban. The two sides had relatively similar arguments about what would happen if the Valley seceded. Valley secession leaders did minimize the potential disruptions. LA’s black neighborhoods emphasized how they would lose out financially if the Valley seceded, but there were few accusations of racism. In the end, the pro-secession movement was even more based on emotion than Donald Trump’s campaign. Trump promised to make American great again. He made incredibly vague policy promises. Trump’s promises may not be credible. But Valley secession leaders openly said they couldn’t deliver on their initial promises of divorcing LAUSD and keeping all the tax revenue.

A slight majority of San Fernando Valley voters still believed secession was a good idea and voted to leave the city! Why would they believe the promises of the secession campaign, even if all the evidence said secession wouldn’t provide tangible benefits for Valley residents?

  • Disrespect: Various activists had discussed secession for decades. They felt they were not given a full share of public services, even though they paid a disproportionately high bill compared to the rest of Los Angeles. I don’t remember anyone counting what percent of potholes were unfilled in the Valley as compared to downtown. “We aren’t getting a full share” may be one of those things that is entirely symbolic and not based on rational calculation.
  • If the moral claim rings true, people may turn a blind eye to empirical fact: The facts were not on Valley secession’s side. The county set the terms for secession after certifying that the Valley would be a viable independent city. The terms were not ideal for secession leaders. One balked and abandoned the campaign. The rest held on to their cause, despite mounting empirical facts about how any new city could not do what they wanted to.
  • People emphasized moral claims when policy issues were murky: In 2002 the Los Angeles Unified School Board was so dysfunctional that creating a new Valley School Board with new criteria and policies seemed a lot easier than fixing LAUSD. School board governance played a major role in the 2005 mayoral race and Antonio Villaragosa’s first two years as mayor. No one really knew how to solve the giant mess. No one had a good policy idea. Voters may have been quicker to embrace the symbolic politics of secession because no one offered a policy solution to the tangible problem of underperforming schools.

Now let’s think about what we know of Trump voters:

  • Disrespect: Definitely. Trump voters tend to say the federal government has forgotten them. The political class may not focus on rural areas. Remember, disrespect is a feeling that may or may not have a basis in fact. So is neglect. It’s entirely possible for multiple groups to feel disrespected by the power structure, and for those groups to hate each other.
  • If the moral claim rings true, people may turn a blind eye to empirical fact: Trump offered a wide range of campaign promises, and voters didn’t seem to mind when some of these contradicted each other. In particular, Trump’s tax policies clearly favored the rich. When I think of moral claims ringing true, I think back in the first primary debate. Trump was asked if he would back the Republican nominee no matter what. He refused to say yes. Later on he attacked other Republicans for being in lobbyists’ pockets and bragged about buying influence. The moral claim was very clear: “every politician is a self-serving asshole, but I’m the only one who is honest about being an asshole.” That’s when I thought Trump had staying power.
  • People emphasized moral claims when policy issues were murky: A lot of industrial workers are facing downward mobility. There’s a tendency to focus on Trump voters not being the absolute poorest, then discounting any kind of economic argument. But Trump voters are disproportionately older. Regardless of partisanship, most of the parents I have met care deeply about their children’s opportunity to have a good life. I spent my teenage years in an area that transformed drastically from farmland to suburbia. I left for college before the transformation was finished, so I’d go home and my parents were going to new malls that didn’t exist when I was growing up there. All of this was positive economic growth, but it’s still alienating. This affects how I think about declining industrial towns? Has any politician really offered a solution for declining industrial towns over the last 20-30 years? There isn’t a good plan for how to help workers whose skills are less valuable today, or the potential alienation of economic change. We got nostalgia and moralizing about trade instead of real solutions.

I can see reasons why the people who supported Trump would also be likely to buy in to fake news. I can see why people would believe the feelings contained in these stories and want to share them widely.

 

At this point, I think other left-leaning writers would just look down at Trump voters and stop writing. Buzzfeed’s story about fake news getting more Facebook engagement than real news feels plausible. It’s very plausible if you don’t know many Trump supporters and you’re looking for some explanation of how they got “fooled.” I retweeted the story without thinking twice. I didn’t even read the study! A friend of mine who voted for Trump posted a critique of the Buzzfeed study design over the weekend. I read the critique, then read the Buzzfeed methodology. Hate to say it, but Buzzfeed fooled me.

Here’s the short version of what Buzzfeed did wrong. They looked up the top 20 fake news stories and the top 20 real news stories. Top 20 lists are highly unequal. The #1 hit is far more popular than #2, but the gap between #2 and #3 is smaller, etc. One huge hit skews the entire set. Remember how Buzzfeed generated massive traffic by posting a dress where people disagreed on what color it was? To make things worse, fake news should have a natural advantage in this metric. If someone is creating fictional news, it is by definition a unique story. Legitimate news outlets don’t get many exclusives. Let’s say 10 people share a fake news story about a Trump-Clinton debate, 5 share the Washington Post’s lead story, 4 share their B story, and 3 more share their third story. More people shared information from the Washington Post than a fake news site, but the fake news site has the biggest single hit. In reality, the one fake news site is competing against dozens of high profile real media organizations and getting swamped in the total volume of Facebook engagement.

So why would people believe the Facebook fake news story?

  • Disrespect: Yes. Democrats’ general election campaign was mainly an argument that Donald Trump doesn’t represent the characteristics we want in a leader. Hillary Clinton won the popular vote but lost the election. Disrespect for progressive values may be an understatement for how progressives feel today, particularly if they are focused on identity politics.
  • If the moral claim rings true, people may turn a blind eye to empirical fact: The main people who bought in to Buzzfeed’s fake news story are Democrats who feel big media organizations didn’t do enough to clamp down on Trumpism. Remember how people bought the myth that network TV news was avoiding “issue” coverage – another study based on terrible methods. There that many sophisticated methodologists in the world. I can’t really fault people for not understanding the weird statistical distributions that biased the Buzzfeed study when they were barely mentioned in my years of graduate level statistics classes. (It’s going to take a separate full length post to explain in detail.)
  • People emphasized moral claims when policy issues were murky: In this case we need to delete “policy details” and replace it with “research methodology.” It’s easy to do a simple study of media content that compares apples to oranges. It’s much harder to compile a list of potential stories or sources and then analyze how different media organizations treat them. But this is the only way to see how rare breakout hits are and how much more attention they get than any other story or source. The statistical skills needed to analyze these data sets are also extremely rare. When I gave talks at academic conferences, most of the other panelists didn’t know what a negative binomial regression was, let alone the audience. That’s why the burden is on me to explain.

We might all be vulnerable to news that is factually incorrect but feels true. I bought in to a flawed study in an area where I spent a decade becoming an expert on that methodology, because I didn’t bother to check the facts! How can we avoid falling victim to our own weaknesses?

I think the key is to look for potentially disconfirming evidence. I wrote about this at more length yesterday, but here’s the short version. As a person sitting in my apartment writing a blog, I don’t think I have the power to affect the supply of fake, misleading and manipulative political posts. Sure, I could jump up and down blaming Facebook. But here’s the good news. Each of us has tremendous power over our own demand for fake and misleading news. I know exerting this power isn’t easy. It’s tempting to just look for evidence that supports our claims. If you are a debater or a lawyer, you want to make an argument based on the evidence that is the best possible interpretation for your side. Evidence that we might be wrong stinks. Most of the time we don’t want to look for it, and we feel like fools if we actually find it. So why bother looking for evidence that would hurt our side?

In the end, it comes down to a question of whether we want to focus on our own feelings or convincing other people. If you just want to make yourself feel good, there isn’t much of a reason to look for disconfirming evidence. Just remember that someone out there is going to recognize your laziness. If you’re lucky, they’ll just want to embarrass you for buying in to a myth. If you’re unlucky, they’ll see you as a mark, willing to hand over political power in exchange for the right set of feelings. The best way we can empower ourselves is by looking for disconfirming evidence. We can keep ourselves from being fooled. We can’t rely on others to do it for us. At the same time, knowing other belief systems is normally a pre-condition for persuading other people.


Forget “fake” news. Focus on “news” that lacks fact.

In the last week many of my academic friends who don’t study news have gotten a lot more interested in “fake news” as a potential social problem. First there was the Buzzfeed story claiming that the top 20 fake news stories during the last few months of the election got more Facebook engagement that the top 20 “real stories.” (I’ll talk more about that study itself separately.) Then there was the NPR story on a psychology experiment showing that students couldn’t adequately separate more and less credible sources of information. Since most people don’t have direct experience teaching about news media, let alone this new issue of fake news, there’s a lot of things I could share. It’s hard to know where to start. I’m going to write a few separate posts.

Let’s start with the most basic idea of how to stop fake news. Why not just hand students a list of websites and say “these websites are fake!” Google and Facebook blacklisted a set of websites after the election, trying to keep fake news from benefitting from their advertising networks. Giving people a list of websites makes me think of giving someone a fish versus teaching someone how to fish. Is fake political news written by teenagers in Macedonia more important than politicians selectively giving information to manipulate prestigious reporters? What about the growth in political memes that have no facts, only feelings? I think this New Yorker cartoon sums it up well:

newyorker-factsdontmatter-161205_a20602-1000

 

Caption: “I’m sorry, Jeannie, your answer was correct, but Kevin shouted his incorrect answer over yours, so he gets the points.”

I don’t know if the cartoonist is aware of the irony here. There’s a big banner saying “FACTS DON’T MATTER.” There’s a caption that captures part of the reason progressives resent Donald Trump and his electoral victory. But there are no actual facts in this political cartoon. We don’t know what Jeannie or Kevin said so we can judge the answers for ourselves. Of course, giving facts is not what political cartoons do. They try to present clever mockery. I understand why the cartoon feels true. But the key to distinguishing fake news and other kinds of emotional manipulation is being able to separate literal fact from arguments that feel true or symbolize truth without containing verifiable facts.

Just to give a preview of where I’m going, every style of telling stories has strengths and weaknesses. For my final in Sociology of Mass Communication a year ago I asked students how they would write about the Trump campaign. Why did they choose that style? What are the strengths and weaknesses of that approach? If a student couldn’t talk about the negative ramifications of their decision, they couldn’t get an A. I knew that students could think about the cons of each approach, they could walk out of my class knowing how people may try to use that style of story telling to manipulate them. Sometimes it’s politicians using the media. That’s been one of the main themes of this blog in the past. But since people are mainly worried about fake news today, I’m going to focus more on media producers trying to manipulate our emotions.

I didn’t teach about “fake news” per se when I taught sociology of mass communication a year ago. I’d only change one thing if I taught again this Winter or Spring, and it’s something much broader than fake vs. real news. Fake news is just one kind of manipulation. The New Yorker cartoon is another. Donald Trump dragging out the hot takes over Mike Pence getting booed while watching the play Hamilton is a third kind of manipulation. I’m less concerned about the differences between flat-out lies, tactical half-truths and people relying on emotional arguments because they don’t have facts or evidence to back up their claims. Each form of manipulation can be resisted by asking the same set of questions instead of taking content at face value.

1) How much does the article rely on factual claims or evidence? Some articles are entirely descriptive, trying to relay a set of facts for an audience who didn’t directly see what happened. Other articles rely heavily on moral claims and interpretation rather than empirical evidence. That’s a different type of argument and we’ll get to it in a bit. Traditional interview-based journalism offers quotes as a kind of evidence. Direct evidence from documents is rare.

2) If someone relies on factual claims, where does the evidence come from? Can you clearly trace how evidence traveled from the original source to intermediaries to your brain? For example, reporters interview people and quote them. We don’t know what the reporter decided to quote and what was left out. But we can be fairly certain that the person being quoted said those literal words. Then we can evaluate the reputation of the person being quoted. We can also evaluate the reporter’s reputation. If we can’t clearly trace the flow of information from one person to the next, they may want to hide something. Whistleblowers need anonymity for protection. However, a wide range of political operatives seek anonymity to promote half-truths and misinformation.

3) What emotions is someone trying to convey? Are they trying to make you feel a certain way about things? Some writers and meme creators’ goal is to convey a certain set of feelings. Think of the New Yorker cartoon: it wants to convey outrage. Most newspaper and network TV reporters work very hard not to convey any of their own emotions about the stories they are reporting on. This kind of stoic emotional restraint is pretty rare in other kinds of storytelling. My goal is make sure we all pause and consciously understand where a writer is coming from and what they want us to feel. I don’t want to get my emotions pushed around by anybody, even people I tend to agree with. Any time someone is giving us a set of feelings that we want to believe, we are at risk of not checking their facts and evidence as closely as we should.

4) How honest and up front is the writer about why they are doing what they are doing? I actually haven’t taught this before, but I think it’s an important follow-up to question 3. Every argument has assumptions. If someone is making an argument, how much are they willing to clearly state “here are my goals and my assumptions.” When someone is giving an interpretation of evidence, do they explain why they gave this interpretation? Do they acknowledge other potential explanations and make a case for why their interpretation is better? If someone can’t acknowledge that other interpretations exist, it’s probably because they can’t make a good case for why their interpretation is the best.

My own sense from spending my entire adult life working in or studying journalism is that it’s hard for a writer to excel at giving both factual evidence and feelings. I think it’s particularly hard to combine the two when writing about politics, since the main feelings people convey are moral outrage and judgment. It’s much easier for me to try and combine facts and feelings when recapping a baseball game than in writing this post. That’s why there are tradeoffs. No writer can be consistently good at everything. No one is perfect.

When I teach about journalism, my main goal is to get students to acknowledge these tradeoffs, then ground them in specific examples. Elite media organizations that have access and avoid reporters’ personal judgments tend to defer to sources in order to protect access. When Trump lied on Twitter about the popular vote, many leading news organizations copied his claim in the headline without any critical skepticism. Large news organizations tend to fear an inability to prove an elite source is lying more than they fear publishing an elite’s statement that is probably false. Nixon campaign aides first took advantage of this in 1968 (see Crause’s Boys on the Bus), and it’s been a staple in political operatives’ playbook ever since.

Writers who emphasize moralistic takes and emotion have more incentive to hide, selectively misinterpret or fabricate factual evidence. Someone who really wants to convince me that Trump voters are all racist isn’t all that likely to bring up other reasons why they support Trump. On the other hand, Trump voters who are not explicit supporters of the KKK are trying to emphasize all the non-racial reasons why someone would vote for Trump. Three weeks after the election and I still see both messages from friends, like it was the day after the election. That’s why things like the New Yorker cartoon stick out to me. They encapsulate outrage and victimization, but are not going to persuade anyone who doesn’t already have those feelings deep in their heart before reading the cartoon.

Being self-conscious about what we want from news is hard. I think it has always been hard. We don’t want to acknowledge that every genre of media is imperfect. People who want all-facts news may not want to acknowledge how reporters can be manipulated by powerful sources. People who want a certain set of emotions, moral stance or political ideology may not want to acknowledge there are times they put feelings before facts. Trump exploited this his entire campaign, skewing this election almost entirely towards emotion. Remember that Democrats’ main campaign theme was that Trump was emotionally unstable and personally unqualified for office. We took the bait instead of focusing on a positive message. It’s easy to see something on social media, get agitated, and react right away. This is a more pervasive and bipartisan problem than “fake news.” For another example of what makes this so hard, let’s take the following passage from the end of an article Dara Lind wrote for Vox:

Journalists have long been sensitive to the prevalence of misogyny on social media. In 2016, they’ve become alarmed by anti-Semitism on social media as well. Journalists know and work among women; they know and work among Jews.

Many of them don’t know and work among many people of color. The amount of attention paid to racism on social media (or in real life) among journalists is, accordingly, often disproportionately small — or delayed.

Let’s think about how to factually evaluate the claim that journalists pay more attention to misogyny and anti-Semitism than racism. We could try to construct a database with a list of misogynist incidents, religious bigotry and racism, and then construct a second list of writers and what they wrote about. How often did a particular group of writers tackle a particular topic? This is incredibly difficult, painstaking work. I spent years working on a project like this dealing with media and blog posts from the 2008 election as part of my dissertation. In the end, I could produce criteria for defining statements on race, gender, religion and a large number of other topics. I could produce data on how much a particular set of news organizations preferred or dispreferred phrases on each topic, relative to any other topic.

Even if I provide facts, there is no factual basis for saying whether enough attention is being paid to racism or misogyny or any other issue. The current level of attention is a fact. The ideal level of attention is a feeling. It’s a moral stance. I chose this passage from Lind’s somewhat unrelated article because it does a great job of showing how 100% fact based story telling only goes so far. A description of how much attention is currently being paid to race with no moral claim about how much attention should be paid to race will be unsatisfying for many audiences. Trust me, I have the negative reviews to prove it. On the other hand, moralistic claims that lack evidence are unsatisfying for a different audience. Lind claimed that journalists pay a disproportionately small amount of attention to racism. The rest of the article doesn’t give any additional evidence to support this claim since it is largely focused elsewhere. Unfortunately, that means I have no idea if Lind is trying to manipulate me or not.

If you want to teach critical thinking about media content and not just give students a list of fake news sites, you have to empower students to offer different moral priorities than you. I know some students in my last class liked outrage news a lot more than I did. I assume some of my readers will like it more than I do. That’s fine. My students also liked Buzzfeed’s day-to-day content a lot more than I did, while I wrote lectures while listening to three hours of college football podcasts. I made a point to illustrate a few of my eccentric non-political preferences to set a tone that I didn’t expect them to copy my political, moral preferences either. My goal is to help people make better informed choices about what media we read so we can be aware of what we are not getting. I want us to be able to protect ourselves from all different kinds of deception in the news – particularly from writers we tend to trust the most.


Glad I’m Not Covering Clinton

In the last day or so I have seen a number of contacts retweet the following:

It’s a provocative claim! Since I spent years working on how to count news coverage in different ways, I thought it would be interesting to take a look at the methodology used here. Boehlert and his colleagues at Media Matters didn’t do the counting themselves. They picked up on “recent tabulations from Tyndall Report, which for decades has tracked the flagship nightly news programs.” I’ve never heard of Tyndall Report before. (The about page is extremely cryptic.) That not a good sign, but it could also be a good way to learn new things.

Boehlert wrote up this report as something groundbreaking, but he didn’t notice obvious red flags. He copies the Tyndall finding that 2008 was a high water mark for “issues” coverage with 220 minutes. Does 220 minutes for a year’s worth of news seem odd to you? Let’s do a little math. If we are looking at nightly news programs that only broadcast 5 days a week, that is approximately 220 weekdays from Jan 1, 2008 through election day. Which is more plausible: networks haven’t combined for more than one minute per day of “issues” coverage since 1980, or someone is using an awfully narrow definition of issues coverage.

Media Matters only offered the analysis, but I was able to quickly trace the link back to see the author(s) define their methodology:

Issues coverage is differentiated from candidate coverage thus: it takes a public policy, outlines the societal problem that needs to be addressed, describes the candidates’ platform positions and proposed solutions, and evaluates their efficacy.

The amount of time spent on issues coverage represents the attempt by television news to establish a political agenda that is driven by the perceived problems that the country faces rather than those talking points that the candidates select to promote their own causes.

This looks like an incredibly strict definition of “issues” coverage. The author(s) only include stories where the anchors sat down and said “we want to cover issue X” in detail. Bernie Sanders spent a lot of his campaign going from city to city, giving his stump speech. He talked about a lot of issues in his stump speech, like health care and the minimum wage. Certainly the progressives at Media Matters and their core audience remember this. But any media coverage of Bernie Sanders speeches or interviews with him talking about issues would be excluded from this count. Anything candidates say in a debate would be excluded.

The Tyndall Report isn’t counting how much time TV network news spends on issues. It is counting how much time TV networks spend on a very specific “where do candidates stand on the issues” type of feature. I’m not surprised TV networks have moved away from this feature. It works much better online. People can point and click to compare candidates or take interactive quizzes to see how their views line up with candidates.

I think people buy in to this report because it feels true. A study with more methodological rigor would probably find a decrease in time spent on issues. However, one of the main reasons for this is Donald Trump doesn’t spend as much time talking about issues. Hillary Clinton has responded by campaigning about Trump’s negative personality traits. As Boehlert notes, Clinton has 38 issues on her website and 112,735 words of policy fact sheets (he gives AP credit for these facts, which were published on Aug 29). This doesn’t mean Clinton has talked about each issue in detail or emphasized it on the campaign trail.

I could keep blasting “biased” media coverage if I wanted to – it’s an easy bell to ring. But I want to end on a different question. Let’s assume that out of the things coming from the Clinton camp, reporters currently consider her email server to be the most newsworthy. Could Clinton have done something different to change the narrative? Now I’ll explain why I think the answer is yes. When I studied the 2008 general election I found TV networks interest in a topic was somewhat contingent on candidates bringing up that topic. The national elite media organizations that had access to candidates followed the candidates’ agenda, while sites that lacked access were more independent.

Paradoxically, all the coverage of Clinton’s e-mails and the Wikileaks is an unintended consequence of how she chose to present herself for the general election. Clinton’s policies come off as technical, well-polished versions of fairly standard Democratic ideas for the most part. There isn’t much in terms of new thinking to capture people’s imagination. Instead, the way that Clinton has tried to capture hearts and minds is to emphasize personality traits: her experience versus Trump’s poor temperament. If both candidates want the race to primarily be about judgment, any “scandal” about Clinton will stick more.

When I was a reporter I liked writing the kind of stories that the author(s) of the Tyndall Report crave. But I would be bored out of my mind trying to write these stories in 2016. It’s not because Trump is vague on policy. I loved the challenge of trying to show when officials didn’t understand what they were talking about while still conforming to the norms of objectivity. What would bore me is writing about Hillary Clinton’s policy preferences. It feels like a long list of ideas I have heard before. Don’t get me wrong – most of these policy proposals need to be repeated because they never got a fair hearing in Congress. I’m just saying as a former newsman I recognize the lack of new. I’d rather write in detail about a new Clinton policy proposal that shakes up the Democratic status quo, but it isn’t there. New policy ideas and policy differences would be a better topic for Clinton, they would benefit the audience, and they would give reporters a more well rounded diet of things to write about. It would have been to everyone’s advantage. But contrary to the assumptions of the Tyndall report, the only way to get coverage of new policy ideas is if a candidate emphasizes their new policy ideas.

As a national reporter I might be forced to write more about Clinton’s email as the least bad option for Clinton coverage. Then I’d cry and ask for a new beat. I’d rather do features on the voters or ballot propositions than be on the Clinton plane. Ideally I’d get to use Simpsons quotes! For all the attention being paid to the Presidential race, there isn’t a whole lot of actual news, particularly from Clinton.