Any mods that pass by, please feel free to delete the first entire "messed up HTML" post above. Sorry for the hassle! :-/
/ag
Part 3, continued...
http://www.leadershipcouncil.org/Research/Disinformation_book/Rind_SorA/rind_sora.html
Science or Propaganda? An examination of Rind, Tromovitch & Bauserman (1998)
by Stephanie J. Dallam
Reference: Dallam, S. J. (2002). Science or Propaganda? An examination of Rind, Tromovitch and Bauserman (1998). Journal of Child Sexual Abuse, 9(3/4), 109-134.
(Simultaneously published as a chapter in Misinformation Concerning Child Sexual Abuse and Adult Survivors (Charles L. Whitfield, MD, FASAM; Joyanna Silberg, PhD; and Paul Jay Fink, MD, Eds.) Haworth Press, 2002)
Summary. An article, ?A Meta-analytic Examination of Assumed Properties of Child Sexual Abuse Using College Samples,? published in the July 1998 edition of the Psychological Bulletin resulted in an unprecedented amount of media attention and became the first scientific article to be formally denounced by the United States House of Representatives. The study?s authors analyzed the findings of 59 earlier studies on child * page 110 * sexual abuse (CSA) and concluded that mental health researchers have greatly overstated CSA?s harmful potential. They recommended that a willing encounter with positive reactions no longer be considered to be sexual abuse; instead, it would simply be labeled adult-child sex. The study?s conclusions and recommendations spawned a debate in both the popular and scholarly press. A number of commentators suggested that the study is pedophile propaganda masquerading as science. Others claimed that the authors are victims of a moralistic witch-hunt and that scientific freedom is being threatened. After a careful examination of the evidence, it is concluded that Rind et al. can best be described as an advocacy article that inappropriately uses science in an attempt to legitimize its findings.
Article copies available for a fee from The Haworth Document Delivery Service: 1-800-HAWORTH. E-mail address [email protected] Webiste: http://www.HaworthPress.com ©2001 by The Haworth Press, Inc. All rights reserved.
Keywords. American Psychological Association, child sexual abuse, ethics, pedophilia, sexual politics, scientific freedom, United States Congress.
The Controversy
A study entitled ?A Meta-analytic Examination of Assumed Properties of Child Sexual Abuse Using College Samples,? published in the July 1998 edition of the prestigious Psychological Bulletin, resulted in enormous social controversy and debate. The study?s authors, Rind, Tromovitch and Bauserman, analyzed 59 studies of college students and concluded that mental health researchers have greatly overstated the harmful potential of being abused. Despite finding that students who reported a history of child sexual abuse (CSA) were less well adjusted in 17 of the 18 types of psychological adjustment examined, Rind et al. (1998) suggested that the relationship may be spurious due to the confounding of CSA with family dysfunction. Rind et al. also reported that ?men reacted much less negatively than women? (p. 22) and that ?consent? was an important moderator of adjustment in males. They later summarized their findings, stating: ?We showed that for boys in nonclinical populations, willing relations are generally experienced positively or neutrally and are not associated with maladjustment? (Rind, Bauserman, & Tromovitch, 1999, p. 2185). Rind et al. (1998) went on to suggest that when labeling events that have ?heretofore been defined sociolegally as CSA,? scientists should focus on the young person?s perception of the experience: A willing encounter * page 111* with positive reactions would no longer be considered to be sexual abuse; instead, it would ?be labeled simply adult-child sex? (p. 46).
Not surprisingly, the study was immediately embraced by pedophile organizations. The North American Man/Boy Love Association (NAMBLA), a political and educational organization that advocates for the decriminalization of ?consensual? pedophilic relationships, stated that the study confirmed that, ?the current war on boy-lovers has no basis in science.? NAMBLA also publicly thanked the American Psychological Association (APA) for ?having the courage? to publish the paper (Saunders, 1999).
The study did not come to the general public?s attention until almost 9 months after its publication. Alerted by a listener, popular radio talk-show host Dr. Laura Schlessinger discussed the study?s findings on her show. On March 22, 1999, she told her 18 million listeners that she feared that the study ?could be used to normalize pedophilia, to change the legal system? (Duin, 1999). Soon after Schlessinger aired her concerns, a number of other public commentators severely criticized the study and the APA?s role in printing it. For example, in an article titled ?Lolita Nation,? newspaper columnist Debra Saunders (1999) stated that ?the APA showed appalling judgment in printing this pedophilia propaganda.?
Political leaders were also disturbed by the study?s conclusions. Dr. Tom Coburn (R-Okla.) stated: As a practicing physician trained in science, I am shocked that the Psychological Association would publish a study that is clearly pedophilia propaganda masquerading as science.... The APA has brought itself and the entire psychological profession in disrepute by failing to filter junk science from a scientific journal. (Myers, 1999, p. 11)
In Alaska, Rep. Fred Dyson introduced a resolution (HJR 36)1 calling on the APA to repudiate the study. The resolution was unanimously passed on April 30, 1999 and became a model for similar efforts in California, Delaware, Louisiana, Pennsylvania, Illinois, and the U.S. Congress.
Negative publicity resulted in a number of press releases and statements by APA leaders. On March 23, 1999, APA released a statement that reaffirmed its strong historical stand against CSA and stated that, ?publication of the findings of a research project within an APA journal is in no way an endorsement of a finding by the Association? (American Psychological Association, 1999). However, on May 14, 1999, APA Chief Executive Officer Raymond D. Fowler, Ph.D., defended the study on national television (MSNBC), stating: ?It isn?t a bad study, it?s been peer-reviewed . . . it?s a good study.? On May 25, 1999, Fowler defended the study again in a letter emailed to APA division offi- * page 112* cers. Fowler said that the study passed a rigorous peer review process ?and has, since the controversy, been reviewed again by an expert in statistical analysis who affirmed that it meets current standards and that the methodology, which is widely used by the National Institutes of Health (NIH) to develop guidelines, is sound.? Suggesting that politicians and members of the media were misrepresenting the study?s findings to further their political agenda, Fowler assured the officers that the APA was, ?working hard to try to correct the record with those politicians and members of the media who care about the facts.?
The study was also criticized by several scientific organizations. On May 24, 1999, the Leadership Council on Mental Health, Justice and the Media, whose mission includes ensuring that the ?the public receives accurate information about mental health issues,? issued a press release noting that Rind et al. improperly generalized from studies of predominantly noncontact experiences during adolescence in formulating some of their conclusions about the relative harmlessness of sex between adults and children. A few days later (May 27, 1999), Steven M. Mirin, MD, Medical Director of the American Psychiatric Association, expressed the Psychiatric Association?s disagreement ?with the implications of the authors? conclusions.? Mirin stated, ?From a psychological perspective, sex between adult and child is always abusive and exploitative because the adult always holds the power in the relationship.... Academic hair-splitting over whether the act should be considered adult-child sex or child sexual abuse . . . is not in the public interest and obfuscates the moral issues involved? (?Psychiatric Association Criticizes,? 1999). (well said!/ag)
Apparently, the continued negative public reaction led Fowler to reconsider his support of the study. On June 9, 1999, Fowler hand-carried a letter to Majority Whip Tom DeLay (R-Tex) in which he admitted that the APA failed to ?evaluate the article based on its potential for misinforming the public policy process.? Fowler also acknowledged that ?some of the language in the article when examined from a public policy perspective is inflammatory? and includes opinions ?inconsistent? with APA?s policy on child protection issues. Fowler pledged that in the future his organization would be more cognizant of the potential for publications to misinform the public on important issues. Fowler also announced that for the first time in its 107-year history of publishing it has sought independent expert evaluation of the scientific quality of an article. The next day, Fowler (June 10, 1999) announced that the American Association for the Advancement of Science (AAAS) had been asked to do the review, ?because its credibility is unquestioned.?
In July 1999, the meta-analysis by Rind et al. became the first scientific study to be formally denounced by the United States Congress. The House of Representatives and Senate both unanimously passed a resolution which re- * page 113* jected ?the conclusions of a recent article published in the Psychological Bulletin, a journal of the American Psychological Association, that suggests that sexual relationships between adults and children might be positive for children.? The resolution explained that ?elected officials have a duty to inform and counter actions they consider damaging to children, parents, families, and society? (House Con. Res. 107).2
In response to criticism of their study, Rind, Tromovitch and Bauserman released a number of statements vigorously defending their results and conclusions. They claimed that their research ?brought methodological rigor into an area that needed this? (Rind, Tromovitch, & Bauserman., November 6, 1999), and suggested that they had ?an ethical duty? to report their findings (Rind, Tromovitch, & Bauserman, May 12, 1999). Claiming to be victims of political persecution, the authors characterized their critics as ?religious and moralistic zealots? (e.g., Rind et al., November 6, 1999). A flyer for a continuing education workshop about the controversy offered by Rind and Carol Tavris stated: The enemies of Galileo and Darwin, the enemies of the natural science model are alive and well.... Not only are the ?offending? data dismissed or trivialized, but the messengers can themselves be pressured into silence, recantation, or more simply be vilified by organs of academe and government alike. (?When Politics Clashes with Science,? 2000)3
Concerned that the denouncement by Congress posed a threat to scientific freedom, a number of psychologists rushed to the study?s defense (e.g., Berry, 2000; Tavris, 1999; Woll, 1999). For example, Stanley Woll (July 26, 1999), Professor of Psychology at California State-Fullerton, suggested that Rind et al. were victims of a ?McCarthyesque witch hunt? which represented ?a dangerous assault on the process of scientific research in general.?
The AAAS?s Committee of Scientific Freedom and Responsibility ultimately declined APA?s request for a review of the study saying they saw ?no reason to second-guess the process of peer review used by the APA journal in its decision to publish the article in question? (McCarty, 1999, p. 2). AAAS also reported that they ?saw no clear evidence of improper application of methodology or other questionable practices on the part of the article?s authors? (p. 3). However, they added that, ?if there were such problems, uncovering them would be the task of those reviewing it prior to publication or to readers of the published article? (p. 3). AAAS further noted, ?The fact that the Committee has chosen not to proceed with an evaluation of the article in the Psychological Bulletin should not be seen either as endorsement or criticism of it? (p. 3). Despite the disclaimer, Rind and Tromovitch viewed the AAAS?s * page 114* decision as a vindication of their work. Tromovitch stated: ?Their comments indicate to me that they consider our work to be up to par? (Burling, 1999).
The APA indicated that it had no plans to ask any other organization to review the study. In early December 1999, Ray Fowler went on a protracted sick leave citing stress. The debate over the study?s merit remained unresolved. The purpose of the present article is to examine whether Rind et al. (1998) is best characterized as unpopular science or pedophile propaganda.
THE SCIENTIFIC EVIDENCE
When anybody makes a claim that is surprising or seems to be unlikely, science demands evidence. Thus, the first step in evaluating the conflicting views of the merit of Rind et al.?s (1998) work is to evaluate whether their findings are supported by appropriate data. Some have suggested that the results of the study by Rind et al. must be correct because the study passed peer review;4 however, it is important to note that passing peer review is no guarantee that a study?s results are correct. Without access to the original data, peer reviewers are often unable to determine the validity of a study?s results (Whitely, Rennie & Hafner, 1994). There are really only two ways to determine whether the results of a study are valid: (1) replication of the study?s findings using equal or higher quality methods, and (2) critical examination of the investigators? data and methodology.
Comparisons with Studies Using Equal or Superior Methodology
A review of the empirical literature examining the long-term consequences of CSA (child sexual abuse) call into question the validity of many of Rind et al.?s (1998) key findings and conclusions. For example, Rind et al.?s conclusion about the relative harmlessness of CSA conflicts with the findings of three previous meta-analyses of the relationship between CSA and maladjustment (e.g., Jumper, 1995; Neuman, Houskamp, Pollock, & Briere, 1996; Oddone & Genuis, 1996). In addition, little support can be found for Rind et al. conclusion that the significant relationship they found between CSA and maladjustment was likely spurious due to confounding between CSA and family environment. Table 1 summarizes the results of large scale representative studies, prospective studies, and co-twin studies using nonclinical samples. These studies, which are considered the gold standard in terms of validity and reliability, almost uniformly reported significant associations between reporting CSA and a wide variety of mental, physical, behavioral problems which persist even after controlling for family dysfunction.
* page 115*
Table 1. Results of Well-Designed Nonclinical Studies Which Controlled for Family Dysfunction
Study Method Results
Boney-McCoy & Finkelhor (1995)
Random, nationally representative probability sample of 2,000 youths aged 10-16 years
After controlling for family dysfunction, significant associations were found between CSA and increased levels of PTSD symptoms and school difficulties. Abused boys reported significantly more sadness then other children.
Boney-McCoy & Finkelhor (1996)
Longitudinal: Reinterviewed 1995 sample 15 months later
Sexual abuse during the 15-month interim was associated with PTSD-related symptoms and depression not present prior to the assault.
Dinwiddie et al. (2000)
Co-twin: Examined twins discordant for CSA drawn from 5,995 Australian male and female twins.
The twin reporting CSA consistently displayed more psychopathology then their nonabused co-twin. However, only a single outcome reached statistical significance - the association between CSA and suicidal ideation in males.
Fergusson et al. (1996)
Prospective study of a birth cohort of 1,019 male and female youths
After controlling for family dysfunction, significant associations were found between CSA and higher rates of major depression, anxiety disorder, conduct disorder, substance use disorder, and suicidal behavior. Those whose abuse involved intercourse had the highest risk of disorder.
Fleming et al. (1999)
Subsample of 710 women selected from a larger study involving women randomly selected from electoral rolls in Australia
After controlling for family dysfunction, significant associations were found between CSA and higher reports of domestic violence, rape, sexual problems, mental health problems, low self-esteem, and problems with intimate relationships. CSA involving intercourse was associated with the highest risk of disorder.
Johnson et al. (1999)
Prospective study of a representative community sample of 639 youths
After controlling for family dysfunction, significant associations were found between CSA and increased rates of personality disorders during early adulthood.
Kendler et al. (2000)
Co-twin: Examined twins discordant for CSA drawn from a sample of 1,411 adult female twins
The twin reporting CSA was consistently at higher risk for lifetime psychiatric and substance use disorders compared to their nonabused co-twin with odds ratios generally increasing with the severity of the abuse.
Mullen et al. (1993)
Stratified, random community sample of 1,376 adult women in New Zealand
After controlling for family dysfunction, significant associations were found between CSA and higher levels of psychopathology, along with higher rates of substance abuse and suicidal behavior. A dose-response relationship (wonder what that means? drugs?) was found with those suffering the most severe forms of abuse having the greatest level of psychopathology.
Stein et al. (1988)
Random community sample of 3,132 male and female adults.
After controlling for family dysfunction, significant associations were found between CSA and meeting diagnostic criteria for at least one lifetime psychiatric disorder, especially substance abuse disorders, major depression, phobia, panic disorder, and antisocial personality.
Rind et al.?s (1998) finding that men react less negatively to CSA than women is another result that has not been supported by large scale studies of nonclinical populations. In this instance, Rind et al.?s conclusions are limited by the fact that studies of college students have almost exclusively examined internalizing behaviors such as depression, anxiety, or eating disorders.
* page 116*
Studies which include measures of externalizing behaviors have demonstrated that the aftermath for abused boys may be worse or more complex for boys than for abused girls. For instance, Chandy, Blum and Resnick (1996) studied over 3,000 high school students. They found that sexually abused male adolescents were at higher risk for poor school performance, delinquent activities, and sexual risk taking. Sexually abused female adolescents, on the other hand, showed higher risk for suicidal ideation and behavior as well as disordered eating. Similar findings were reported by Garnefski and Arends (1998) who studied a large representative community sample of adolescents. They reported that the experience of sexual abuse carried far more negative consequences for boys than for girls regarding the use of alcohol, aggressive/criminal behavior, use of drugs, and the amount of truancy, as well as regarding suicidal thoughts and behavior.
Critical Reviews of Rind et al. (1998)
Critical reviews of Rind et al. (1998) have raised serious concerns with the study?s design, statistical analyses, and conclusions. Some of the major criticisms are summarized below (also see Whittenburg et al. in this issue).
Sample bias. A number of critics have noted that by restricting their analysis to convenience samples of college students, Rind et al. introduced a systematic bias in favor of their conclusion. Spiegel (2000) noted, ?By design, Rind et al. ignored those so mired in drug abuse, criminal activity, prostitution, or financial and educational hardship, that they could not get it to college? (p. 64). Dallam et al. (in press) raised similar concerns and cited research showing a strong relationship between CSA and academic difficulties or dropping out of high school. Dallam et al. also demonstrated that Rind et al.?s contention that ?the college data were completely consistent with data from national samples? (p. 22) was erroneous and was based on the misleading presentation of data from selected studies.
Duncan (2000) tested Rind et al.?s (1998) contention that studies of CSA in college populations should be considered generalizable to the population as a whole. She compared the semester-by-semester enrollment of college students with and without histories of abuse and found that students with a history of CSA were more likely than their nonabused peers to display symptoms of post-traumatic stress and to prematurely drop out of college, especially after only attending one semester. Duncan concluded that it was likely that investigators using college samples see ?only the healthiest of survivors? (p. 987).
* page 117*
Measurement problems. Several critical reviews faulted Rind et al. for not standardizing their treatment of either their independent or dependent variables. For instance, Dallam et al. (in press) noted that Rind et al. uncritically combining data from studies of CSA with data from studies looking at other phenomena including consensual peer experiences, sexual experiences that occurred during adulthood, and homosexual approaches during adolescence.
Holmes and Slap (1999) noted that Rind et al. uncritically combined psychological outcomes measured by different instruments with varying validity, relevance, and different interval scaling and cut points. After reviewing the Rind et al.?s study, Holmes and Slap concluded, ?meta-analysis is not appropriate when methodological rigor, let alone the question asked, is so varied? (p. 2186).
Statistical analyses. Dallam et al. (in press) demonstrated numerous problems with Rind et al.?s statistical methods. For example, they noted that Rind et al. eliminated from analysis the studies of CSA which showed the highest degree of harm, while including studies that did not even purport to examine CSA. Dallam et al. also documented numerous instances in which Rind et al. misreported or miscoded the original data from the studies they analyzed. Moreover, these errors were consistently in the direction of CSA being portrayed as less harmful than the findings of the original study suggested.
More importantly, Dallam et al. demonstrated that many of the findings that Rind et al. reported as being significant were actually statistical artifacts caused by their failure to correct for base rate differences in the rates of CSA in male and female samples. In this case, lower base rates of CSA in male samples caused effects sizes estimates for males to be attenuated and created the illusion that males were less harmed by CSA. After correcting for base-rate attenuation, Dallam et al. demonstrated that effect sizes for male and female samples were nearly identical.5 In other words, contrary to Rind et al.?s claims, males were not less affected by their abuse.
Dallam et al. also found serious problems with Rind et al.?s moderator analysis of ?consent? by gender. Based on their analysis, Rind, Bauserman and Tromovitch (1999) reported that with abused boys ?willing relations . . . are not associated with maladjustment? (p. 2185). Dallam et al. reviewed the analysis and found that Rind et al. claimed to have measured a variable (i.e., willingness) that was not examined in the original studies. To get around this fact, Rind et al. assumed that detectable amounts of ?willing? sexual experiences were included in any study that did not explicitly state that the student should report only unwanted experiences. Dallam et al. examined the original studies and replicated the moderator analysis. They found no evidence to support Rind et al.?s assumption that the studies in the ?consent? group contained significant amounts of willing CSA. Moreover, after correcting for miscalculated effect * page 118* sizes and base rate attenuation, Dallam et al. found no significant effects for male gender and ?level of consent.?
continued below