Monday, November 28, 2011

Weighing in on the Podcast Wars: Mormon Expression vs. Mormon Stories

Mormon Expression did a podcast last week in which they responded to criticisms from people who said their tone had become too negative lately. It unleashed a lot of strong comments from listeners (both those who agreed with the criticisms and those who wanted to defend Mormon Expression). A lot of the defenders said some unkind things about John Dehlin (who runs the Mormon Stories and Mormon Matters podcasts), prompting another Mormon Expression listener to call them on the carpet for that.

I'm going to go Swiss on this whole debate. I'm neutral on this matter because I like both of these podcasts. (I'll go ahead and lump Mormon Stories and Mormon Matters in together.) I'm a paying subscriber to both, giving both an equal financial contribution. I like them both for what they're trying to do. And I would defend both of them from criticisms if the opportunity arose.

But how do they each stack up in terms of their credibility? Read on to find out...


Criteria for Evaluating Resources
My main responsibility as an educator at UVU is to teach students how to think critically. One of the key tasks involved in critical thought is learning how to determine whether a particular source is credible and trustworthy or not. Since your argument is only as strong as your evidence/sources, you need to make sure your sources are reliable.

I teach my students that there are seven criteria for determining whether you should use a source to support your argument in a paper:
  1. Authoritativeness - The root word of "authoritativeness" is "author" and it therefore refers to the background of the author and the reputation of the publisher. Is the author an expert (an authority) in their field? Do they have some sort of strong educational or personal background that qualifies them to make an informed statement on this topic? Does the publisher have a good reputation for publishing trustworthy materials?
  2. Quality of Research and Methodology - Are the sources that they use to back their argument reliable and trustworthy (preferably scholarly and peer-reviewed as opposed to being journalistic or web-based)? Did they include formal citations accurately so that others could verify their resources were credible? If they conducted an experiment, were the conditions of the experiment sound, using basic scientific principles to control for all factors?
  3. Objectivity and/or Degree of Advocacy - This refers to whether they are adopting an objective tone or not. There's nothing wrong with arguing a particular position, but are they doing so in a way that is respectful of counterarguments or of alternate viewpoints? If they are arguing a position, how strongly are they arguing for that position? Are they using black-and-white, polemical language or are they showing the complexity of the topic by examining all possible viewpoints on the matter? Are they pushing an agenda or are they willing to let the audience reach their own conclusions on the matter?
  4. Timeliness and Currency - Has the source been published in the last 5 or 10 years? Does it reflect the most current research and perspectives on this topic? This is especially important when researching medical topics, as our academic knowledge about human health becomes updated very rapidly. This is less important when studying historical topics, but it is till a good rule-of-thumb.
  5. Aimed at a Scholarly vs. a Popular Audience - Is it written for other scholars who are experts in the field or is it written for a mainstream audience? Scholarly texts can be more challenging to read and understand, but texts for a popular audience can sometimes water down the information or accidentally distort the information in the process of making it more palatable. Another important consideration is whether they are trying to make a profit off the information or not. Are they publishing it for the purpose of advancing scholarly knowledge on the topic or are they publishing it for a more self-interested purpose?
  6. Primary vs. Secondary Source - Primary sources are documents created by people with first-hand experience with a topic. Secondary sources are created second-hand. The authors were not directly involved in the topic themselves. In academia, a primary document would be a scholarly article reporting on the results of an experiment conducted by the authors. A secondary document would be a journalist who is reporting about that experiment in a magazine. In historical research, a primary document would be a letter, journal entry, interview, or some other record from a person who experienced that historical event first-hand. A secondary document would be a person writing about the event afterwards who did not experience it first-hand. Whenever possible, primary sources are preferable because secondary sources can sometimes lose something in translation.
  7. Usefulness - This is a catch-all category. How useful is the source to what you are particularly trying to accomplish in your research? That can vary from source to source depending on what you're trying to do.
Now, just because a particular resource is weak in one of those areas doesn't necessarily mean that you should throw it out. Think of these seven criteria as being seven channels of input that you can use to determine the resource's overall credibility, kind of like the buttons on an audio equalizer:



If a particular resource is high on all 7 channels, it's definitely a good resource. If it's mostly high, it's probably still reliable, but you should take it with a grain of salt. If it's low on most of these channels, you should probably avoid it.

With that in mind, let's pit John vs. John and evaluate how both Mormon Expression and Mormon Stories/Matters stands up to this criteria.


Mormon Expression

Authoritativeness: I give them an A or an A- on this category. Mormon Expression features a lot of interviews with scholars and others who are authorities in their field. Either that or the interviewees have studied the topic personally in a great deal of depth. When the podcast is a panel discussion, all of the panelists are expected to have heavily researched their topics beforehand or to have some extensive first-hand experience in the matter. Some panelists are occasionally weaker than others (depending on the topic), but all in all, they are generally well-informed.

Quality of Research and Methodology: I give them an A- or B+ on this category. I probably would have given them a higher score on this, but one complaint I have about Mormon Expression is that they don't always indicate where their information comes from. I prefer going to primary sources when I can so that I can study the topic further or determine whether I agree with the panelists' interpretation of the evidence. But they do sometimes cite their sources informally and, when they do, the sources seem relatively credible and scholarly.

Objectivity and/or Degree of Advocacy: This one is difficult to quantify, but I think I'd give them a B+ on this one. It's difficult to evaluate this because I think they make a genuine effort to have balance in the panelists that they invite to discuss topics on the show. I like the new believing voices they've been having on the show (like Brandt and Jessie) because they do a good job of arguing for their position while still being respectful of divergent viewpoints. However, John Larsen is usually the moderator on Mormon Expression and, as such, he exerts some control over the conversation. This sometimes makes the conversation weigh in favor of the ex-Mormon position a little bit. Plus, John has been ramping up his use of polemical language a bit more lately. I generally agree with his arguments, but the use of polemics is occasionally troubling because it reminds me too much of the black-and-white thinking that I distrust (whether it's coming from the church, from FoxNews or from the Internet). Any time I hear an extreme position being taken, it sets off my internal warning bells. It doesn't mean I throw it out, but it means that I proceed with caution. I've learned that every issue worth talking about is more complex than absolutist logic allows for. Mormonism is no exception.

Timeliness and Currency: Sure, I'll give it an A. It's not really an applicable category here, but they do talk frequently about current events. And when they're talking about historical topics, timeliness is not as important.

Aimed at a Scholarly vs. Popular Audience: I'll give it an A- or B+ here. It's definitely aimed at a popular audience and it's trying to be good entertainment. Therefore, the information or the evidence can sometimes be diluted in translation. However, I don't think they have any kind of desire to profit from Mormon Expression. Donations to the podcast go to running the podcast itself and nothing else. They're doing the podcast because they find the topic interesting and they want to think/talk about Mormon issues. In essence, they really do want to advance a scholarly discussion about Mormonism---but in an accessible form.

Primary vs. Secondary Source: I'll give it a A- or a B+ here as well. It's obviously a secondary source itself, but they try to research using primary documentation whenever possible. Again, I might give them a more solid A- if they cited their research better.

Usefulness: This is going to fluctuate from listener to listener, but for me personally, I'll give it an A-. I have found that it definitely expanded my understanding of my religion. I prefer academic, scholarly examinations of Mormonism that are grounded in good research and good arguments. Mormon Expression satisfies this need for me. What I especially like about Mormon Expression is how democratic it is. If you want to voice an opinion, you can do it on Mormon Expression. They'll let anyone who has something useful to say onto the podcast. No censorship. Just democratic exchange. That's Mormon Expression's greatest strength. It can sometimes backfire on them, but it's ultimately what makes their podcast so great. It's like one giant peer review.

Overall Grade: It's in the A- or B+ range, depending on the episode.


Mormon Stories/Mormon Matters

Authoritativeness: I'll give them an A in this category. They tend to have experts on the podcast to talk about their area or expertise or they feature people who have had first-hand experience with the topic. This is a strength of the podcast.

Quality of Research and Methodology: I'll give them an A- in this category. They usually informally cite their sources and their sources tend to be scholarly and trustworthy. Sometimes they link to their sources in the podcast notes, which is helpful. It's clear they put a lot of pre-discussion and research into their podcasts.

Objectivity and/or Degree of Advocacy: I'll give them a B+ in this category. They try very deliberately to be accepting of lots of points of view and they often succeed, but it does sometimes feel like they push the "Stay LDS" agenda a little rigorously. They've also been known to delete comments and things that are not in keeping with their mission or tone. That's good for PR, but the tradeoff is that it can shut down the democratic exchange of ideas by not allowing all viewpoints onto the table. Although there is an element of censorship to it, I will grant them a pass if they are removing comments from people who are making unfair character attacks or being unnecessarily abrasive. Plus, I recognize that podcasts do have some responsibility to ensure that people who agree to appear on your podcast will not be treated rudely by listeners. Otherwise you risk of getting a bad reputation and alienating potentially good guests from coming on the podcast in the future. Good guests are the lifeblood of a podcast and a bad reputation can kill you off. (I've seen this happen with movie podcasts I listen to.)

Timeliness and Currency: I'll give them an A on this one for the same reasons I gave Mormon Expression an A too. This category doesn't apply so much when they discuss historical topics and they do a good job of discussing topics that are current events in Mormonism.

Aimed at a Scholarly vs. Popular Audience: I'll give them the same score as Mormon Expression on this one: a B+. And pretty much for all of the same reasons (see above).

Primary vs. Secondary Source: I'll give them an B+ here. Like Mormon Expression, they are a secondary source. They do draw on primary sources for inspiration, but less so than Mormon Expression does. (Like I'm thinking of how the Mormon Expression folks will actually read primary documents such as scriptures, hymns, or discourses in their discussions.)

Usefulness: Again, this will also fluctuate from individual to individual. For me personally, I'll give it a B+ at this point in time. Since my faith in Mormonism is at 1-2% (meaning, it's not very strong), Mormon Stories and Mormon Matters are not as relevant to me in my spiritual journey as they were in the past. However, they were very, very important to me at one point. They provide a safe place where people can transition to wherever it is they need to go on their faith journey. Even though they're somewhat more boring (sorry!) compared to Mormon Expression, I still think they have valid arguments and interesting perspectives on Mormon issues. And I do appreciate their attempts at balanced discussion.

Overall Grade: A general A-, possibly a B+.


Conclusion
For me, both podcasts come out equal in the end. They both have good content. They just have different scopes, purposes, and audiences. In some ways, it really does come down to the usefulness category and what you look for in a podcast. I think I personally prefer Mormon Expression because I prefer democratic exchange, because the topics on Mormon Expression are a little more interesting and also because of where I'm at in my life right now. But how lovely that I don't have to choose. I can listen to and enjoy them both for what they're worth. Mormon Stories/Matters appeals to my heart and Mormon Expression appeals to my head. That seems like a good balance.

Feel free to chime in and let me know if you agree or disagree with my assessment. As I said, I'm a big fan of democratic dialogue, so your two cents matter to me. :)

    Wednesday, November 16, 2011

    Changing Leaves, Changing Callings, Changing Feelings

    This image is from a page of my journal earlier this year. It's a graphical representation of how I "outgrew" Mormonism, if you will. I recently shared it with the Mormon Expression folks as part of an episode on which my husband and I appear:


    So, one Sunday about a month and a half ago, my husband and I were playing a video game in our living room when there was a knock at the door. It was the 2nd counselor in the Bishopric, stopping by for a surprise visit. It made me nervous instantly. My pulse went up; my muscles tensed. What was he doing stopping by our house for a surprise visit?

    It turns out he wanted to give us a new calling to serve as Primary Teachers to the 6-7 year olds. They've been having lots of problems staffing the Primary and so we had been substitute teaching quite a bit the last year. I guess they decided to make us official members of the Primary staff. We asked the 2nd counselor if we could step into our bedroom and discuss whether we should take the calling or not.

    The discussion was a vigorous one. I had previously made a promise to myself that I would not accept another calling so that we could gradually transition out of the church. But then when push came to shove, I chickened out. I didn't want to deal with the consequences of "coming out" about being non-believers at that exact moment. The timing felt too sudden. At that immediate moment, I just wanted the 2nd counselor to go away and saying yes seemed like the easiest and most direct way to make that happen. Besides, I kind of liked the 6-7 year olds, so it couldn't be that bad.

    Now that a month has gone by, I feel that working in the Primary has been a mixed bag. On the one hand, it's a lot more work to prepare a lesson every week. (I'm a perfectionist, so I can't just phone it in---which makes this calling sometimes very time-consuming and occasionally stressful.) But on the other hand, it's actually been easier to just go back to the basics. I feel like I can teach general humanistic principles in Mormon terms without compromising my integrity too much. And it's been really nice not to attend Sunday School or Relief Society---where the lessons range from being mind-numbingly boring (at best) to offensive (at worst).

    As a result of being in Primary, there have been times when I've started to feel somewhat complacent about being at church---and sometimes even comfortable. But just when I start to feel that way, something always seems to come along to take me out of that state, to remind me that I don't really belong here because I'm not a believer.

    For example, last Sunday we were assigned a new home teacher who I'll refer to as "Brother W." Brother W. is an uber-Mormon. Very much the TBM, seminary-teacher type. He's probably the only guy in the ward who actually does his home teaching. So, why was he suddenly assigned to us? It could be just a benign decision, but part of me feels paranoid that I've said too much, that I've made it onto somebody's radar, that we're being "watched over." It's irrational and silly, but I can't quite shake the feeling I'm being scrutinized by the people around me. I was really paranoid at church this last week, watching what everyone said to me, how they looked at me, etc. I was frustrated with my own heightened sense of self-consciousness, honestly. It felt like being a teenager again.

    Anyhow, since I no longer teach Relief Society, I think I'm going to delve into the archives of the Gospel Principles lessons I taught in the past and continue working through those in my blog. I'll try to shoot for one lesson a month as my free time permits. So, stay tuned!