1st Edition
Top 10 Flashpoints in Student Ratings and the Evaluation of Teaching What Faculty and Administrators Must Know to Protect Themselves in Employment Decisions
ATTENTION: ALL FACULTY & ADMINISTRATORS“Another book on student ratings? Are you kidding me?” “Nope, but this one is REALLY different.” Another review of the research or step-by-step on how to develop and interpret rating scales? NOT! (Berk did that with Thirteen Strategies) Designed to solve YOUR problems, conflicts, and confusion about how to evaluate teaching. Written expressly for YOU with Berk’s signature sense of humor.FLASHPOINT: a critical stage in a process, trouble spot, contentious issue, volatile hot button, or lowest temperature at which a flammable liquid will give off enough vapor to igniteThe “flashpoints” covered are the topics that pop up the most frequently and heatedly on listservs, blogs, and the literature. Each flashpoint is defined succinctly, options are presented, and then evidence-based recommendations for concrete action steps are proffered in an effort to stop the popping.The recommendations are grounded in psychometric, professional, and legal standards. The last-named, in particular, can protect you from costly litigation. If you hire, promote, demote, and fire full- and part-time faculty based on student ratings and other measures, then you are vulnerable to violations of federal anti-discrimination laws. Several flashpoints address procedures you can take to stay out of court. If you are a faculty member, you need to know whether your institution’s measures of teaching are appropriate and defensible, and what you should do if they are not.Four sample “flashpoints” and solutions:• Use of global items for summative decisions. SOLUTION: “Cease & desist” and use scale and subscale ratings• Low response rate in online administrations. SOLUTION: 20 strategies to increase rates• Scales to evaluate online and blended/hybrid courses. SOLUTION: 7 strategies are suggested and evaluated • Use of ratings for contract renewal, pay raise, teaching awards, and promotion and tenure. SOLUTION: Applying 80/20 rule for adverse impact to avoid lawsuits related to unequal pay, gender, race, ethnicity, and age discrimination
Acknowledgments Foreword Introduction Fractured, Semi-Factual History of Student Ratings of TeachingA Parody Flashpoint TerminologyStudent Evaluation of Teaching (SET. vs. Student Rating Scale Flashpoint 1Student Ratings vs. Multiple Sources of Evidence Flashpoint 2Sources of Evidence vs. Decisions. Which Come First? Flashpoint 3Quality of “Home-Grown” Rating Scales vs. Commercially-Developed Scales Flashpoint 4Paper-and-Pencil vs. Online Scale Administration Flashpoint 5Standardized vs. Unstandardized Online Scale Administration Flashpoint 6Low Online Administration Response Rates Flashpoint 7Global Items vs. Total Scale Rating Flashpoint 8Scoring “Neutral,” “Not Applicable,” “Not Observed,” and “Blank” Answers Flashpoint 9Criterion-Referenced vs. Norm-Referenced Rating Interpretations Flashpoint 10Face-to-Face vs. Online Course Rating Scales Top 10 RecommendationsReferences Index
Biography
Ronald A. Berk is Professor Emeritus of Biostatistics and Measurement and former Assistant Dean for Teaching, The Johns Hopkins University. He received the University’s Alumni Association Excellence in Teaching Award in 1993 and Caroline Pennington Award for Teaching Excellence in 1997 and was inducted as a Fellow in the Oxford Society of Scholars in 1998. He has published 11 books and 130 journal articles / chapters. These publications reflect his unwavering commitment to mediocrity and his motto: “Go for the Bronze!” He is a popular speaker on teaching and assessment throughout the U.S. and Europe.
