Adaptation and evidences of validity of the Remote Teaching Reactions Scale in Exact Sciences
Keywords:
Education, distance, Educational measurement, Engineering, Evidence synthesisAbstract
The objective of this study was to adapt and verify the validity evidence of a Reactions Scale to Instructional Procedures in Distance Education. The investigation was carried out in a Brazilian federal public university and 507 students participated in the study. Descriptive and exploratory factor analyses were used. The Scale of Reactions to Instructional Procedures in Remote Teaching was obtained, with a KMO of 0.91 and two factors. Factor 1, Instruction Planning, grouped 10 items, with an excellent internal consistency index of 0.90 and factor loadings between 0.43 and 0.75. Factor 2, called Instructional Events showed an internal consistency index of 0.82 for 2 items, with factor loadings of 0.81 and 0.82. The suggestion to maintain the bifactorial structure was motivated based on Gagné’s theory, which can support the
Downloads
References
Abbad, G. S. (1999). Um modelo integrado de avaliação de impacto de treinamento no trabalho [Tese de doutorado não publicada]. Universidade de Brasília.
Abbad, G. S., Gama, A. L., & Borges-Andrade, J. E. (2000). Treinamento: análise do relacionamento da avaliação nos níveis de reação, aprendizagem e impacto no trabalho. Revista de Administração Contemporânea, 14(3), 25-45. https://www.scielo.br/scielo.php?pid=S141565552000000300003&script=sci_arttext
Abreu, V. F., & Oliveira-Melo, F. G. (2020). Tecnologias educacionais utilizadas por monitores dos cursos de engenharia. Revista de Ensino de Engenharia, 39. http://revista.educacao.ws/revista/index.php/abenge/article/view/1636
Alqurashi, E. (2019). Predicting student satisfaction and perceived learning within online learning environments. Distance Education, 40(1), 133-148. https://www.tandfonline.com/doi/abs/10.1080/01587919.2018.15 53562
Alsabahi, M. A., Bahador, K. M. K., Saat, R. M., & Ntim, C. G. (2021). The influence of personal characteristics and workplace learning on information technology competency among external auditors: The role of organisational culture as a moderator. Cogent Business & Management, 8(1). https://www.tandfonline.com/doi/full/10.1080/23311975.2021.1899625
Amaral, E., & Polydoro, S. (2020). Os desafios da mudança para o ensino remoto emergencial na graduação na Unicamp–Brasil. Linha Mestra, 41a, 52-62. http://lm.alb.org.br/index.php/lm/article/view/392
Assumpção, G., Hamada, P. C., & Castro, A. (2018). Análise do perfil dos alunos do primeiro curso de EaD em Engenharia de Produção em instituição de ensino superior pública. Revista Produção Online, 18(2), 404-423. https://producaoonline.org.br/rpo/article/view/2757
Bloom, B. S., Krathwohl, D. R., & Masia, B. B. (1972). Taxonomia de objetivos educacionais, compêndio primeiro: domínio cognitivo. Globo.
Borges-Andrade, J. E. (2006). Avaliação integrada e somativa em TD&E. In J. E. Borges-Andrade, G. Abbad, & L. Mourão (Orgs.), Treinamento, desenvolvimento e educação em organizações e trabalho: fundamentos para a gestão de pessoas (pp. 343-358). Artmed.
Borsa, J. C., Damásio, B. F., & Bandeira, D. R. (2012). Adaptación y validación de instrumentos psicológicos entre culturas: Algunas consideraciones. Paidéia (Ribeirão Preto), 22(53), 423-432. https://www.scielo.br/j/paideia/a/cbRxjMqmbZddKpwywVM8mJv/?format=pdf&lang=pt
Carlisle, J., Bhanugopan, R., & D’netto, B. (2019). Enhancing task performance through effective training: The mediating role of work environment and moderating effect of non-mandatory training. Journal of Business Research, 104, 340-349. https://doi.org/10.1016/j.jbusres.2019.07.033
Carvalho, R. S., & Abbad, G. (2006). Avaliação de treinamento a distância: reação, suporte à transferência e impactos no trabalho. Revista de Administração Contemporânea, 10, 95-116. https://www.scielo.br/j/rac/a/vzNZjG54nNmnLB85KzckYWz/?format=pdf&lang=pt
Dolch, C., & Zawacki-Richter, O. (2018). Are students getting used to learning technology? Changing media usage patterns of traditional and non-traditional students in higher education. Research in Learning Technology, 26, 20-38. https://journal.alt.ac.uk/index.php/rlt/article/view/2038
Eom, S. B., & Ashill, N. J. (2018). A system’s view of e-learning success model. Decision Sciences Journal of Innovative Education, 16(1), 42-76. https://onlinelibrary.wiley.com/doi/abs/10.1111/dsji.12144
Ferreira, D. M., & Mourão, L. (2020). Panorama da educação a distância no ensino superior brasileiro. Revista Meta: Avaliação, 12(34), 247-280. http://dx.doi.org/10.22347/2175-2753v12i34.2318
Gagné, R. M. (1985). The conditions of learning and theory of instruction (4th ed.). Holt, Rinchardt and Winston.
Giray, G. (2021). An assessment of student satisfaction with e-learning: An empirical study with computer and software engineering undergraduate students in Turkey under pandemic conditions. Education and Information Technologies, 26(6), 6651-6673. https://doi.org/10.1007/s10639-021-10454-x
Hamblin, A. C. (1978). Avaliação e controle do treinamento. McGraw-Hill do Brasil.
Iglesias-Pradas, S., Hernández-García, A., Chaparro-Peláez, J., & Prieto, J. L. (2021). Emergency remote teaching and students’ academic performance in higher education during the COVID-19 pandemic: A case study. Computers in Human Behavior, 119, 106-713. https://www.sciencedirect.com/science/article/abs/pii/S0747563221000352
Kebritchi, M., Lipschuetz, A., & Santiague, L. (2017). Issues and challenges for teaching successful online courses in higher education: A literature review. Journal of Educational Technology Systems, 46(1), 4-29. https://doi.org/10.1177/0047239516661713
Kirkpatrick, D. L. (1976). Evaluation of training. In R. L. Craig (Org.), Training and Development Handbook (pp. 18.1-18.27). Mc Graw-Hill.
Martins, L. B., & Zerbini, T. (2015). Evidências de validade de instrumentos de reações no ensino superior a distância. Estudos e Pesquisas em Psicologia, 15(1), 116-134. https://www.redalyc.org/pdf/4518/451844503008.pdf
Martins, L. B., Zerbini, T., & Medina, F. J. (2018). Course reaction scale in e-learning: Adaptation and factor structure. Psicologia: Teoria e Prática, 20(1), 223-234. https://www.scielo.br/scielo.php?script=sci_arttext&pid=S010279722018000103107
Mayer, R. E. (2019). Thirty years of research on online learning. Applied Cognitive Psychology, 33(2), 152-159. https://onlinelibrary.wiley.com/doi/abs/10.1002/acp.3482
Meneses, P. P. M., Zerbini, T., & Abbad, G. (2010). Manual de treinamento organizacional. Artmed.
Murphy, L., Eduljee, N. B., & Croteau, K. (2020). College student transition to synchronous virtual classes during the COVID-19 pandemic in northeastern United States. Pedagogical Research, 5(4). https://eric.ed.gov/?id=EJ1275517
Naji, K. K., Du, X., Tarlochan, F., Ebead, U., Hasan, M. A., & Al-Ali, A. K. (2020). Engineering students’ readiness to transition to emergency online learning in response to COVID-19: Case of Qatar. EURASIA Journal of Mathematics, Science and Technology Education, 16(10). https://www.ejmste.com/download/engineeringstudents-readiness-to-transition-to-emergency-online-learning-in-response-to-covid-198474.pdf
Nauman, S., Bathi, S., Jalil, F., & Riaz, M. B. E. (2020). How training at work influences employees’ job satisfaction: roles of affective commitment and job performance. International Journal of Training Research, 1-16. https://www.tandfonline.com/doi/abs/10.1080/14480220.2020.1864444
Nguyen, K. D., Enos, T., Vandergriff, T., Vasquez, R., Cruz, P. D., Jacobe, H. T., & Mauskar, M. M. (2020). Opportunities for education during the COVID-19 pandemic. JAAD International, 1(1), 21-21. https://doi.org/10.1016/j.jdin.2020.04.003
Noe, R. A., & Schmitt, N. (1986). The influence of trainee attitudes on training effectiveness: Test of a model. Personnel Psychology, 39(3), 497-523. https://onlinelibrary.wiley.com/doi/abs/10.1111/j.1744-6570.1986.tb00950.x
Pasquali, L. (2009). Psicometria. Revista da Escola de Enfermagem da USP, 43, 992-999. https://www.redalyc.org/pdf/3610/361033301002.pdf
Peimani, N., & Kamalipour, H. (2021). Online Education and the COVID-19 Outbreak: A Case Study of Online Teaching During Lockdown. Education Sciences, 11(2), 72. https://doi.org/10.3390/educsci11020072
Phillips, J. M., & Gully, S. M. (1997). Role of goal orientation, ability, need for achievement, and locus of control in the self-efficacy and goal-setting process. Journal of Applied Psychology, 82(5). https://www.proquest.com/openview/f77762b9b6cf0c2f9becbb4877bd0d6a/1?pqorigsite=gscholar&cbl=60903
Rapanta, C., Botturi, L., Goodyear, P., Guàrdia, L., & Koole, M. (2020). Online university teaching during and after the Covid-19 crisis: Refocusing teacher presence and learning activity. Postdigital Science and Education, 2(3), 923-945. https://doi.org/10.1007/s42438-020-00155-y
Sade, P. M. C., Peres, A. M., Zago, D. P. L., Matsuda, L. M., Wolff, L. D. G., & Bernardino, E. (2020). Assessment of continuing education effects for nursing in a hospital organization. Acta Paulista de Enfermagem, 33(2), 1-8. https://actaape.org/wp-content/uploads/articles_xml/1982-0194-ape33eAPE20190023/1982- 0194-ape-33-eAPE20190023-en.pdf
Simms, L. J., Zelazny, K., Willians, T. F., & Bernstein, L. (2019). Does the number of response options matter? Psychometric perspectives using personality questionnaire data. Psychological Assessment, 31(4), 5-57. https://www.jite.org/documents/Vol15/JITEv15ResearchP157-190Sun2138.pdf
Sun, A., & Chen, X. (2016). Online education and its effective practice: A research review. Journal of Information Technology Education, 15, 157-190. https://hagamoshistoria.pe/uploads/file/OnlineEducationAndEffectivePractice.pdf
Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics. Harper-Collins College Publishers.
Warr, P., Bird, M., & Rackham, N. (1970). Evaluation of Management Training. London.
Watermeyer, R., Crick, T., Knight, C., & Goodall, J. (2021). COVID-19 and digital disruption in UK universities: Afflictions and affordances of emergency online migration. Higher Education, 81, 623-641. https:// doi.org/10.1007/s10734-020-00561-y
Zerbini, T., & Abbad, G. (2008). Estratégias de aprendizagem em curso a distância: validação de uma escala. Psico-USF, 13(2), 177-187. https://www.scielo.br/j/pusf/a/7WDStVBjCsKkDmpSszBNkXq/?lang=pt
Zerbini, T., & Abbad, G. (2009). Reação aos procedimentos instrucionais de um curso via internet: validação de uma escala. Estudos de Psicologia (Campinas), 26(3), 363-371. https://www.scielo.br/scielo.php?pid=S0103166X2009000300009&script=sci_abstract&tlng=es
Zhang, W., Zhang, W., Wang, Y., Yang, L., & Wang, C. (2020). Suspending Classes without Stopping Learning: China’s Education Emergency Management Policy in the COVID-19 Outbreak. Journal of Risk and Financial Management, 13(5). https://econpapers.repec.org/article/gamjjrfmx/v_3a13_3ay_3a2020_3ai_3a3_3ap_3a55_3ad_3a332192.htm
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Thaís Zerbini, Betânia Mafra Kaizer
This work is licensed under a Creative Commons Attribution 4.0 International License.
