Office of Institutional Research and Effectiveness

Institutional Effectiveness Committee

MSU established the Institutional Effectiveness (IE) Committee, a standing committee that reports to the Provost and Executive Vice President. This committee provides oversight for the annual self-assessment process. It reviews all IE Reports, provides feedback to units, and coordinates with the SACSCOC reaffirmation process. Membership consists of elected and appointed administrators, faculty, and staff.

Committee Members for 2016-2017

Name Title/Dept.
Willard, Scott
(Chair, IE Committee)
Associate Dean and Professor, College of Ag & Life Sciences
Andrews, Heather Director of Development Strategy, MSU Foundation
Baham, Tracey Associate Director, Office of Institutional Research & Effectiveness
Berman, Mitchell Professor & Head, Psychology
Black, Michael Academic Coordinator, Biological Sciences
Brain, Stephen Associate Professor, History
Carr, Ann Sr. Associate Athletic Director SWA/Student Athlete Services, Athletics - General Administration/Athletics
Chrisman, Jim Professor & Head, Management & Information Systems
Cirlot-New, Janie Director, T.K. Martin Center
Coleman, Tammy Academic Coordinator, Mechanical Engineering
Cunetto, Stephen System Administrator, General Library
Dechert, Ed Writing Coordinator, Quality Enhancement Plan
Downey, Laura Assistant Extension Professor, School of Human Science
Dunne, Jim Professor & Interim Director, Physics & Astronomy
Edelblute, Kevin Controller & Treasurer, Office of the Controller/Treasurer
Forde, Connie Professor & Head, Instructional Systems & Workforce Development
Forrester, Kylie Director, Orientation & Events
Forsythe, Kiley Writing Coordinator, Quality Enhancement Plan
Franz, Dana Associate Professor, Curriculum, Instruction & Special Education
Frey, Brent Assistant Professor, FWRC - Forestry
Gammill, Teresa Assistant VP, Vice President for Research
Grado, Steve Professor, FWRC - Forestry
Green, Robert Undergraduate Coordinator, Dean of Engineering
Hall, Greg Associate Dean of CAAD
Hallberg, Cappe Student Services Coordinator, School of Human Sciences
Hardman, Alisha Assistant Professor, School of Human Sciences
Henshaw, Chelsea Writing Coordinator, Quality Enhancement Plan
Hopper, Missy Associate Professor, Curriculum, Instruction & Special Education
Jayroe, Terry Associate Dean & Professor, Dean of Education
Johnson, Jada Instructor, Sociology
Johnson, Mitzy Assistant Dean, College of Education
Karriem, Dinetta Associate Professor & Director, Counseling & Educational Psychology
Kelley, James Associate Professor, Meridian Division of Arts & Sciences
Ladner, Bonnie Office Associate, Industrial & Systems Engineering
Lee, Deborah Professor & Co-Director, QEP
Lueg (Ponder), Nicole Professor, Marketing/Quantitative Analysis/Business Law
Malley, Jane Contract & Grant Specialist, Mississippi State Chemical Lab
Martin, Bill Director, Franklin Furniture Institute - FWRC
McLaughlin, Ronald Associate Dean/Professor, CVM Office of the Dean
Miller, Beth Professor & Director, Interior Design
Miller, Debbie Project Coordinator, Franklin Furniture Institute, FWRC
Montgomery, Marian Lead Coordinator, Center for Distance Education
Munn, Ian Associate Dean/Professor, FWRC, Director
Newman, Michael Professor & Director, School of Human Sciences
Parrott, Steve Director, User Services, ITS
Peace, Brian Coordinator, Assessment & Testing Services
Potts, Les Financial Analyst, Associate VP for Budget & Planning
Prabhu, Rajkumar (Raj) Assistant Research Professor, Agricultural and Biological Engineering
Punday, Dan Professor and Head, English
Rader, Nicole Interim Associate Dean/Associate Professor, College of Arts & Sciences
Reeves, Kari Associate Dean and Professor, College of Engineering
Remillard, Naron Director, Student Recruitment
Rendon, Andrew Director, Assessment Office
Rogers, Kevin Associate Dean & Professor, College of Business
Ryan, Peter Associate Provost of Academic Affairs & Professor, Office of the Provost
Schauwecker, Tim Associate Professor, Landscape Architecture
Seymour, Dana Project Manager, Research Curriculum Unit
Shaw, Emily Director of Undergraduate & Grad Advising, College of Agriculture & Life Sciences
Smith, Cindy Director, Distance & Exec Educ, Business
Spurlock, Ann Instructor & Co Director, QEP
Strickland, Kacey Director, Regulatory Compliance and Safety
Swindell, Marian Associate Professor, Meridian Division of Arts & Sciences
Swortzel, Kirk Professor, School of Human Sciences
Threadgill, Paula Associate Director, Family Consumer Sciences & 4H & Extension Professor
Turner, Jenny Assistant Coordinator, Curriculum & Scheduling
Vaughn, Mary Associate Director, Assessment & Testing Services
Vickers, Brad Associate Professor, Department of Kinesiology
Warnock, James Associate Dean of College of Engineering

Review Process

The IE Committee review process begins in October or November of each year and in December of January. Each fall, the Chair of the committee convenes a meeting to review the Institutional Effectiveness process. Members are paired with a partner, and all of the university's IE reports are allocated among the teams (each team usually has between 10 and 15 reports to review). No member of the IE Committee may review a program within his or her own college or unit. The committee has designated rubrics for evaluating each IE report: academic and non-academic. Based on these rubrics, members review the IE reports individually and then meet with their partners to discuss their scores. The team then settles on a validated score, which is logged into the university's ClassClimate system. The validated scores are compiled into feedback reports, which each unit receives during the spring semester as they begin planning the next year's assessment cycle. Based on the results of the feedback reports, OIRE staff may take actions such as provide more training to the personnel responsible for completing the annual IE reports.

Improvement in the Institutional Effectiveness Process

Mississippi State's Institutional Effectiveness process has improved over the years thanks to the peer review process of the IE Committee and staff within OIRE. Based on the IE Committee rubric, much improvement can be seen from the state of IE reports in 2010 to 2016. In particular, the number and appropriateness of outcomes and assessment procedures has improved dramatically over the years.

2010 2016
3-5 outcomes are reasonable 58.7% 93.4%
3-5 outcomes can be assessed 50.8% 79.8%
Instructional units have learning outcomes 54.1% 89.1%
Assessment procedures measure outcomes 34.4% 69.8%
Assessment procedures are appropriate 34.1% 88.5%
Adequate number of procedures 41.6% 91.3%
Provides sufficient data for results 42.8% 66.7%
Action has been taken for improvement 31.4% 40.0%

Although results and use of results have increased scores, more work is needed in these areas. OIRE hypothesizes that an adjustment in the assessment procedures to move from quality assurance to excellence may help improve the overall scores for results and use of results in future assessment cycles. During spring 2016, staff within institutional effectiveness created an internal rubric to distinguish aspects of quality assurance from excellence. This work concentrates on improving the assessment procedures, which in turn could lead to more meaningful and actionable results.

Direct Assessment Measures

Indirect Assessment Measures

Excellence

QA

Excellence

QA

Criterion is based on a scale with a benchmark that was not set at a level they can achieve readily. These can be distinguished from QA based on the criterion, whether it was met or not, and/or the responses in use of results. So even if they met the criterion but highlighted an area of weakness, then it would be excellence over QA.

Criterion is based on a scale, but the benchmark is set at a level that they can easily achieve or that they’ve met many times over. These types of assessments cannot improve a program, but help maintain a program.

Criterion is based on a survey (or other form of self-report) scale that was not necessarily at a level that the program could meet readily.

Criterion is based on a survey (or other form of self-report) scale that can easily be achieved or that they’ve met for many years.

 

Contact Information

269-A Allen Hall
Mailstop: 9712

Phone: 662.325.3920
Fax: 662.325.3514
oir@ir.msstate.edu