The purpose of the contemporary research was the determination of the validity and reliability of the graduating senior exit survey (GSS) as a possible supplementary instrument, to assess faculty on teaching effectiveness at a university in the southeastern US. The research approach was quantitative, and the dataset was the 426 students’ responses on specific elements of teaching effectiveness for the fall 2016 semester GSS survey at the university. Applying the Cronbach’s alpha statistic, the findings revealed the alpha for the 9 elements on the rating scale, which together assessed teaching effectiveness at the university, was .95, an indication the elements established a scale that had practical internal stability reliability for the GSS instrument. In addition, applying the principal axis factoring with varimax rotation, indicated the three indexes of teaching effectiveness, including motivation, competence, and expertise had strong positive loadings of > .40, and interconnected significantly with teaching effectiveness, thus endorsing the construct validity of the GSS instrument in assessing teaching efficacy. However, the research was limited to one semester analysis of the GSS instrument, which may be inadequate to establish the generalizability of the instrument as a measurement of teaching efficiency. Subsequent studies must include additional semesters to determine generalizability.
Agbetsiafa, D. (2010). Evaluating effective teaching in college level economics using student
ratings of instruction: A factor analytic approach. Journal of College Teaching & Learning, 7(5), 57-66. Retrieved from https://www.cluteinstitute.com/journals/journal-of-college-teaching-learning-tlc/
Apodaca, P., & Grad, H. (2005). The dimensionality of student ratings of teaching: Integration of uni-and multidimensional models. Studies in Higher Education, 30(6), 723-748. doi: 10.1080/03075070500340101
Anastasiadou, S. D. (2011). Reliability and validity testing of a new scale for measuring attitudes toward learning statistics with technology. Acta Didactica Napocensia, 4(1), 1-10. Retrieved from http://adn.teaching.ro/
Barry, R. A. (2010). Teaching effectiveness and why it matters. Marylhurst, OR: Marylhurst University and the Chalkboard Project. Retrieved from https://chalkboardproject.org/sites/default/files/teacher-effectiveness-and-why-it-matters.pdf
Beran, T., & Rokosh, J. (2009). Instructors’ perspectives on the utility of student ratings of
instruction. Instructional Science, 37(2), 171-184. doi:10.1007/s11251-007-9045-2
Beran T., Violato C. (2005). Ratings of university teacher instruction: How much do student and course characteristics really matter? Assessment and Evaluation in Higher Education, 30, 593–601. doi:10.1080/02602930500260688
Berk, R. A. (2005). Survey of 12 strategies to measure teaching effectiveness. International
Journal of Teaching and Learning in Higher Education, 17(1), 48-62. Retrieved from http://www.isetl.org/ijtlhe/
Bolhuis, S. (2003). Towards process-oriented teaching for self-directed lifelong learning: A multidimensional perspective. Learning and Instruction, 13(3), 327–347. Retrieved from https://www.journals.elsevier.com/learning-and-instruction/
Chen, G., & Watkins, D. (2010). Stability and correlates of student evaluations of teaching at a
Chinese university. Assessment & Evaluation in Higher Education, 35(6), 675-685. doi:10.1080/02602930902977715
Chen, Y., & Hoshower, L. B. (2003). Student evaluation of teaching effectiveness: An assessment of student perception and motivation., 28(1), 71-88. doi: 10.1080/0260293032000033071
Clayson, D. E. (2009). Student evaluations of teaching: Are they related to what students learn?.
Journal of Marketing Education, 31(1), 16-30. Retrieved from http://journals.sagepub.com/home/jmd
Cohen, P. A. (1981) Student ratings of instruction and student achievement: A meta-analysis of
multisection validity studies. Review of Educational Research, 51, 281–309. Retrieved from http://journals.sagepub.com/home/rre
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334. Retrieved from https://www.psychometricsociety.org/content/psychometrika
Daugherty, K. J., & Natow, R. S. (2015). The politics of performance funding for higher education: Origins, discontinuations, and transformations. Baltimore, MD: JHU Press.
de Winter, J. C. F., & Doduo, D. (2012). Factor recovery by principal axis factoring and maximum likelihood factor analysis as a function of factor pattern and sample size. Journal of Applied Statistics, 39,(4), 695-710. Retrieved from http://www.tandfonline.com/toc/cjas20/current
Dodeen, H. (2013). Validity, reliability, and potential bias of short forms of students' evaluation of teaching: The case of UAE University. Journal Educational Assessment, 18(4), 235-250. doi: 10.1080/10627197.2013.846670
Donnon, T., Delver, H., & Beran, T. (2010). Student and teaching characteristics related to
ratings of instruction in medical sciences graduate programs. Medical Teacher, 32(4), 327-332. doi:10.3109/01421590903480097
El Hassan, K. (2009). Investigating substantive and consequential validity of student ratings of
instruction. Higher Education Research & Development, 28(3), 319-333. doi:10.1080/07294360902839917
Ellis, R., & Bowden, R. (2014). Performance based funding: Changing the paradigm for higher education. British Journal of Education, Society & Behavioral Sciences, 4(7), 942-952. Retrieved from http://www.sciencedomain.org/journal/21
Entwistle, N. J. (1987). Understanding classroom learning. London, UK: Hodder and Stoughton.
Feldman, K. A. (1989) Instructional effectiveness of college teachers themselves, current and
former students, colleagues, administrators, and external (neutral) observers. Research
in Higher Education, 30, 137–193. Retrieved from
https://link.springer.com/journal/11162
Field, A. (2013). Discovering statistics using SPSS (3rd ed.). Thousand Oaks, CA: SAGE Publications Inc.
Fraser, B. J., Walberg, H. J., Welch, W. W., & Hattie, J. A. (1987). Syntheses of educational productivity research. International Journal of Educational Research, 11, 145–252. Retrieved from https://www.journals.elsevier.com/international-journal-of-educational-research
Galbraith, C. S., & Merrill, G. B. (2012). Predicting student achievement in university-level business and economics classes: Peer observation of classroom instruction and student ratings of teaching effectiveness. College Teaching, 60(2), 48-55. doi: 10.1080/87567555.2011.627896
Haladyna, T. M., & Amrein-Beardsley, A. (2009). Validation of a research-based student survey
of instruction in a college of education. Educational Assessment, Evaluation and Accountability, 21(3), 255-276. doi:10.1007/s11092-008-9065-8
Hassel, B. C. (2009). How should state define teacher effectiveness? Washington, DC: Center for American Progress. Retrieved from https://www.americanprogress.org/
Hatfield, C. L., & Coyle, E. A. (2013). Factors That Influence Student Completion of Course and Faculty Evaluations. American Journal of Pharmaceutical Education, 77(2), 27. http://doi.org/10.5688/ajpe77227
Heckert, T. M., Latier, A., Ringwald-Burton, A., & Drazen, C. (2006). Relations among student effort, perceived class difficulty appropriateness, and student evaluations of teaching: Is it possible to "Buy" better evaluations through lenient grading? College Student Journal, 40(3), 588. Retrieved from http://www.projectinnovation.com/college-student-journal.html
Héfer, B. (2009). Teaching effectiveness, course evaluation, and academic performance: The role of academic delay of gratification. Journal of Advanced Academics, 20(2), 326-355. Retrieved from http://journals.sagepub.com/home/joa
Hillman, N. W., Tandberg, D. A., & Fryar, A. H. (2015). Evaluating the impacts of “New”
performance funding in higher education. Educational Evaluation and Policy Analysis,
37(4), 501-519. doi: 10.3102/0162373714560224
Jones, B. (2010). An examination of motivation model components in face-to-face and online
instruction. Electronic Journal of Research in Educational Psychology, 8(3), 915-944. Retrieved from http://investigacion-psicopedagogica.org/revista/new/english/index.php
Keeley, J. W., English, T., Irons, J., & Henslee, A. M. (2013). Investigating halo and ceiling effects in student evaluations of instruction. Educational and Psychological Measurement, 73(3), 440-457. Retrieved from http://journals.sagepub.com/home/epm
Kneipp, L. B., Kelly, K. E., Biscoe, J. D., & Richard, B. (2010). The impact of instructor's
personality characteristics on quality of instruction. College Student Journal, 44(4), 901-905. Retrieved from http://www.projectinnovation.com/college-student-journal.html
Leech, N. A., Barrett, K. C., Morgan, G. A. (2014). IBM: SPSS for intermediate statistics use and interpretation (5th ed.). New York, NY: Routledge.
Leedy, P. D., & Ormrod, J. E. (2015). Practical research: Planning and design (11th ed.). Upper
Saddle River, NJ: Pearson Education Inc.
Liu, O. L. (2012). Student evaluation of instruction: In the new paradigm of Distance Education. Research in Higher Education, 53(4), 471–486. doi: 10.1007/s11162-011-9236-1
Madden, T. J., Dillon, W. R., & Leak, R. L. (2010). Students’ evaluation of teaching: Concerns
of item diagnosticity. Journal of Marketing Education, 32(3), 264-274. doi:10.1177/0273475310377759
Marsh, H. W. (2007). Students’ evaluations of university teaching: Dimensionality, reliability,
validity, potential biases, and usefulness. In R. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 319-383). Netherlands: Springer.
Marsh, H. W., Ginns, P., Morin, A. S., Nagengast, B., & Martin, A. J. (2011). Use of student ratings to benchmark universities: Multilevel modeling of responses to the Australian Course Experience Questionnaire (CEQ). Journal of Educational Psychology, 103(3), 733-748. doi:10.1037/a0024221
McKeachie, W. J. (1979). Student ratings of faculty: A reprise. Academe, 65, 384-397. Retrieved from https://www.aaup.org/academe
McKeachie, W. J. (2007). Good teaching makes a difference-And we know what it is. In R. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education. An evidence-based perspective (pp. 457-474). Netherlands: Springer. doi: 10.1007/1-4020-5742-3_11
Miao, K. (2012). Performance-based funding of higher education: A detailed look at best practices in 6 states. Washington, DC: Center for American Progress. Retrieved from https://www.americanprogress.org/issues/education/reports/2012/08/07/12036/performance-based-funding-of-higher-education/
Mitchell, M., & Leachman, M. (2015). Years of cuts threaten to put college out of reach for more students. Washington, DC: The Center on Budget and Policy Priorities. Retrieved from http://www.cbpp.org/research/state-budget-and-tax/years-of-cuts-threaten-to-put-college-out-of-reach-for-more-students
Mittal, S., & Gera, R. (2013). Student evaluation of teaching effectiveness (SET) in higher education in India. International Journal of Business and Social Science, 4(10), 289-298. Retrieved from http://www.ijbssnet.com/
Ngure, J. N, & Kihoro, J. M., & Waititu (2015). Principal component and principal axis factoring of factors associate with high population in urban areas: A case study of Juja and Thika, Kenya. American Journal of Theoretical and Applied Statistics, 4,(4), 258-263. Retrieved from http://www.sciencepublishinggroup.com/journal
/archive.aspx?journalid=146&issueid=-1
O’Shaughnessy, L. (2013, January 16). 6 Challenges facing state universities. CBSNews. Retrieved from http://www.cbsnews.com/news/6-challenges-facing-state-universities/
Osler, J. E., & Mansaray, M. A. (2013). Applied mathematical statistical modeling to determine the validity and reliability of independent instructional measures. Journal on Mathematics, 2(3), 12-31. Retrieved from http://www.imanagerpublications.com/
Osler, J. E., & Mansaray M. A. (2015). Educational technology assessment: A model for analyzing online psychometric tests for course evaluations. In S. J. Keengwe (Eds.), Handbook of research on educational technology integration and active learning (pp. 215-246). Hershey, PA: IGI.
Pounder, J. (2007). Is student evaluation of teaching worthwhile? An analytical framework for
answering the question. Quality Assurance in Education, 18(1), 47-63. Retrieved from http://www.emeraldinsight.com/loi/qae
Rutherford, A., & Rabovsky, T. (2014). Evaluating impacts of performance funding policies on student outcomes in higher education. The Annals of the American Academy of Political and Social Science, 655, 185-208. doi: 10.1177/0002716214541048
Sanford, T., & Hunter, J. M. (2011). Impact of performance-funding on retention and graduation rates. Education Policy Analysis Archives, 19(33), 1-30. Retrieved from http://epaa.asu.edu/ojs/
Safavi, S., Bakar, K., Tarmizi, R., & Alwi, N. (2012). The role of student ratings of instruction
from perspectives of the higher education administrators. International Journal of Business and Social Science, 3(9), 233-239. Retrieved from http://www.ijbssnet.com/
Scheerens, J., & Bosker, R. J. (1997). The foundations of educational effectiveness. Oxford, UK: Pergamon.
Schrodt, P., Witt, P. L., Myers, S. A., Turman, P. D., Barton, M. H., & Jernberg, K. A. (2008).
Communication Education, 57(2), 180-200. doi:10.1080/03634520701840303
Seidel, T., & Shavelson, R. J. (2007). Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis results. Review of Educational Research, 77(4), 454-499. doi: 10.3102/0034654307310317
Seyedeh, A. S., & Kamariah, A. B. (2013). The utility of student evaluations for medical sciences teachers and administrators. International Journal of Business and Social Science, 4(13) Retrieved from http://www.ijbssnet.com/
Shevlin, M., Banyard, P., Davies, M., & Griffiths, M. (2000). The validity of student evaluation of teaching in higher education: Love me, love my lectures?. Assessment & Evaluation in Higher Education, 25(4), 397-405. doi: 10.1080/713611436
Shin, J. C. (2010). Impacts of performance-based accountability on institutional performance in the U.S. Higher Education, 60, 47-68. Retrieved from https://link.springer.com/journal/10734
Skowronek, J., Friesen, B., & Masonjones, H. (2011). Developing a statistically valid and
practically useful student evaluation instrument. International Journal for the Scholarship of Teaching and Learning, 5(1), 1-19. Retrieved from http://digitalcommons.georgiasouthern.edu/ij-sotl/
Slocombe, T., Miller, D., & Hite, N. (2011). A survey of student perspectives toward faculty evaluations. American Journal of Business Education, 4(7), 51-58. Retrieved from https://www.cluteinstitute.com/journals/american-journal-of-business-education-ajbe/
Smith, D.L., Cook, P., & Buskist, W. (2011). An experimental analysis of the relation between assigned grades and instructor evaluations. Teaching of Psychology, 38 (4), 225-228. Retrieved from http://journals.sagepub.com/home/top
Spooren, P., Brockx, B., & Mortelmans, (2013) On the validity of student evaluation of teaching: The state of the art. Review of Educational Research, 83(4), 598-642. Retrieved from http://journals.sagepub.com/doi/abs/10.3102/0034654313496870
Sprinkle, J. E. (2008). Student perceptions of effectiveness: An examination of the influence of
student biases. College Student Journal, 42(2), 276-293. Retrieved from http://www.projectinnovation.com/college-student-journal.html
Stowell, J. R., Addison, W. E., & Smith, J. L. (2012). Comparison of online and classroom-based
student evaluations of instruction. Assessment & Evaluation in Higher Education, 37(4), 465-473. doi:10.1080/02602938.2010.545869
Taylor, C. L., Grey, N., & Satterthwaite, J. D. (2013). Assessing the clinical skills of dental students: A review of the literature. Journal of Education and Learning, 2(1), 20-31. Retrieved from http://www.ccsenet.org/journal/index.php/jel
Umbricht, M. R., Fernandez, F., & Ortagus, J. C. (2015). An examination of the (Un)intended consequences of performance funding in higher education. Educational Policy, 1-31. doi: 10.1177/0895904815614398
Vroom, V. C. (1964). Work and motivation (1st ed.). San Franscisco, CA: Jossey-Bass.
Zhao, J., & Gallant, D. J. (2012). Student evaluation of instruction in higher education: exploring
issues of validity and reliability. Assessment & Evaluation In Higher Education, 37(2), 227-235. doi:10.1080/02602938.2010
Zuberi, R. W., Bordage, G., & Norman, G. R. (2007). Validation of the SETOC instrument –
student evaluation of teaching in outpatient clinics. Advances in Health Sciences Education, 12(1), 55-69. doi:10.1007/s10459-005-2328-y
Mansaray, M. A., & Mutisya, P. M. (2017). Applied Statistical Models of Assessment and Evaluation of Instructional Efficiency. International Journal of Academic Research in Business and Social Sciences, 7(5), 213-235.
Copyright: © 2017 The Author(s)
Published by Human Resource Management Academic Research Society (www.hrmars.com)
This article is published under the Creative Commons Attribution (CC BY 4.0) license. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this license may be seen at: http://creativecommons.org/licences/by/4.0/legalcode
