The purpose of this study was to evaluate the face and content validity of an instrument that had been developed to assess the relevance and comprehensiveness of instructional technology competencies as perceived by Malaysian university lecturers. The face validity and content validity of the instrument was investigated based on the opinions of experts. The item content validity index (I-CVI) and scale content validity index (S-CVI) were calculated by adopting the mean approach and inter-rater agreement. The scale was revised based on comments from a panel of three experts in the qualitative review stage, and thereafter, evaluated by another group of five experts in the quantitative review stage. The findings at the face validity stage yielded 8 domains with 71 items being retained, based on 75 percent or more agreement from expert responses. The content validity of the instrument was assessed by S-CVI/UA and S-CVI/Ave, yielding scores of .81 and .90 respectively. Findings indicated that this instrument had excellent face and content validity and could thus be used to assess the relevance and comprehensiveness of instructional technology competencies as perceived by Malaysian university lecturers.
Archambault, L. (2011). The practitioner’s perspective on teacher education: Preparing for
the K-12 online classroom. Journal of Technology and Teacher Education, 19(1), 73-91.
Retrieved from https://www.learntechlib.org/p/31410/.
Barbour, M. K., Siko, J., Gross, E., & Waddell, K. (2013). Virtually unprepared: Examining
the preparation of K-12 online teachers. In R. Hartshorne, T. Heafner, & T. Petty (Eds.),
Teacher education programs and online learning tools: Innovations in teacher
preparation (pp. 60-81). Hershey, PA: Information Science Reference. doi:10.4018/978-1-4666-1906-7.ch004
Benjamin, J. (2003). Revision and validation of the revised teacher beliefs survey. Paper
presented at the Annual Meeting of the American Educational Research Association
(Chicago, IL, April 21-25, 2003). Retrieved from
http://files.eric.ed.gov/fulltext/ED476126.pdf.
Bloom, B. S. (1964). Taxonomy of educational objectives (Ed.). New York: David McKay
Company Inc.
Cardullo, V. M. (2013). Cyber-place learning in an online teacher preparation program:
Engaging learning opportunities through collaborations and facilitation of learning. In R. Hartshorne, T. Heafner, & T. Petty (Eds.), Teacher education programs and online
learning tools: Innovations in teacher preparation (pp.181-196). Hershey, PA:
Information Science Reference. doi:10.4018/978-1-4666-1906-7.ch010.
Chiwaridzo, M., Chikasha, T. N., Naidoo, N., Dambi, J. M., Tadyanemhandu, C., Munambah,
N., & Chizanga, P. T. (2017). Content validity and test-retest reliability of a low back
pain questionnaire in Zimbabwean adolescents. Archives of Physiotherapy, 7(3), 1-12.
doi: 10.1186/s40945-017-0031-y
Crawford, C. M., & Smith, R. A. (2012). Rethinking teacher education programs: Engaging
in traditional face-to-face instructional modeling with integrated, parallel online
instructional modeling. Society for Information Technology & Teacher Education
International Conference. March, pp. 291-298.
Davis, L. L. (1992). Instrument review: Getting the most from a panel of experts. Applied
Nursing Research. 5(4), 194–7. doi: 10.1016/S0897-1897(05)80008-4
DeVellis, R. F. (2012). Scale development: Theory and application. Newbury Park, CA: Sage.
Dutt, A. S. Chen, I. & Nair, R. (2016). Reliability and validity of skills and needs inventories
in functional behavior assessments and interventions for school personnel. Journal of
Special Education, 49(4), 232-242.
Gall, M. D., Borg, W. R., & Gall, J. P. (2003). Educational research: An introduction (7th
eds.). White Plains, NY: Longman Publisher.
Goldin, I. M., Pinkus, R. L., & Ashley, K. (2015). Validity and reliability of an instrument
for assessing case analyses in bioengineering ethics education. Science and Engineering Ethics, 21(3), 789–807. doi: 10.1007/s11948-015-9644-2
Hernández-Garbanzo, Y. M. (2011). Measuring the impact of youth EFNEP: Questionnaire
development and validation (Doctoral dissertation). Retrieved from ProQuest
Dissertations and Theses database. (UMI No: 3469533)
Ibrahim, A. I. (2003). Design and initial validation of an instrument for measuring teacher
beliefs and experiences related to inquiry teaching and learning and scientific inquiry
(Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database.
(UMI No: 3124086)
International Board of Standards for Training, Performance and Instruction (IBSTPI). (2017).
The 2012 instructional designer competencies. Retrieved from:
http://ibstpi.org/instructional-design-competencies/
Journell, W., Beeson, M. W., Crave, J. J., Gomez, M., Linton, J. N., & Taylor, M. O. (2013).
Training teachers for virtual classrooms: A description of an experimental course in
online pedagogy. In R. Hartshorne, T. Heafner, & T. Petty (Eds.), Teacher education
programs and online learn
In-Text Citation: (Lam, Hassan, Sulaiman, & Kamarudin, 2018)
To Cite this Article: Lam, K. W., Hassan, A., Sulaiman, T., & Kamarudin, N. (2018). Evaluating the Face and Content Validity of an Instructional Technology Competency Instrument for University Lecturers in Malaysia. International Journal of Academic Research in Business and Social Sciences, 8(5), 363–381.
Copyright: © 2018 The Author(s)
Published by Human Resource Management Academic Research Society (www.hrmars.com)
This article is published under the Creative Commons Attribution (CC BY 4.0) license. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this license may be seen at: http://creativecommons.org/licences/by/4.0/legalcode
