Validation of a questionnaire on the use of Interactive Response System in Higher Education

Mingorance-Estrada, Ángel Custodio; Granda-Vera, Juan; Rojas-Ruiz, Gloria; Alemany-Arrebola, Inmaculada

doi:10.1590/1518-8345.3374.3418

Acessibilidade / Reportar erro

Brasil

Revista Latino-Americana de Enfermagem

Español English

Brasil

Español English

sumário « anterior atual seguinte »

Sumário

Original Article • Rev. Latino-Am. Enfermagem 29 • 2021 • https://doi.org/10.1590/1518-8345.3374.3418 copy

Validation of a questionnaire on the use of Interactive Response System in Higher Education

Authorship SCIMAGO INSTITUTIONS RANKINGS

Objetivo:

this study aims to design and validate a questionnaire to measure the students’ perception of the use of IRS as a technopedagogical resource in the classroom.

Method:

a 24 items questionnaire (Interactive Response System for the Improvement of the Teaching-Learning Process) was designed ad hoc for this research and applied to 142 university students.

Results:

both the exploratory and confirmatory factorial analysis yielded 3 dimensions: classroom environment, teaching-learning processes and learning assessment. The results obtained both in reliability (Cronbach’s alpha= 0.955) and in the Confirmatory Factor Analysis (χ2/df=1.944, CFI=0.97; GFI=0.78; RMR=0.077; RMSEA=0.08) reveal highly satisfactory indices.

Conclusion:

statistical analyses confirm that this instrument is a valid, reliable, and easy-to-apply tool for professors to evaluate the student perception of student-centred learning.

Descriptors:
Education; Higher Education; Learning; Validation Study; Surveys and Questionnaires; Technology Education

Nº	Items	M^* * M = Mean;	SD^† † SD = Standard deviation	Asymmetry	Correl. item-total
1	I am more focused during the classes since the implementation of IRS	3.40	1.15	-0.477	0.689
2	Thanks to IRS, I measure if I am following correctly the contents of the subject during the classes	3.81	1.01	-0.658	0.619
5	During my experience with the IRS I have a good time learning	3.52	1.18	-0.559	0.566
9	IRS is used to find out the initial knowledge of the students	3.54	1.258	-0.595	0.488
10	The use of IRS is carried out by experienced professors to provide good feedback	3.97	0.891	-0.616	0.610
14	The use of IRS helps me to develop my comprehension on the contents I am working on	3.59	1.162	-0.666	0.639
15	The use of the IRSs makes the classes enjoyable and dynamic	3.82	1.119	-0.877	0.656
18	The use of IRS improves my learning performance	3.76	1.129	-0.653	0.762
19	The continuous use of the IRS increases my class attendance	3.70	1.266	-0.793	0.579
20	The use of IRS allows you to know and compare your colleagues' answers with your own answers	3.42	1.234	-0.646	0.441
21	The use of the IRS allows to correct mistakes or misunderstandings about the subject contents during the classes	3.71	1.121	-1.032	0.558
22	I am more interested in classes when using IRS	3.65	1.066	-0.698	0.768
24	I like the use of IRS as an attendance control	3.65	1.005	-0.605	0.699
29	The use of IRS improves motivation during classes	3.83	1.111	-0.825	0.753
30	The use of IRS allows active discussion of misconceptions to build knowledge	3.80	1.168	-0.771	0.792
35	The use of the IRS evaluates my comprehensive knowledge of the contents in each of the topics covered during the classes	3.99	0.971	-1.211	0.788
36	The use of IRS promotes regular study of the subject to be better prepared for classes	3.64	1.094	-0.762	0.715
42	The use of IRS allows you to be more confident when asking questions during classes	3.76	1.254	-0.739	0.787
46	The use of the IRS is done at the end of the classes to review the contents explained during the session	3.80	1.100	-0.736	0.772
47	The use of IRS makes the classes more pleasant and interactive compared to traditional classes	3.86	1.082	-0.804	0.769
48	The use of IRS improves your participation in classes behind anonymity	3.87	1.104	-0.773	0.712
53	The answers provided through the IRS increase my confidence in the classes after verifying that I answered correctly	3.44	1.164	-0.420	0.700
59	IRS provides valuable information to improve your learning process	4.09	1.017	-1.007	0.687
65	The use of IRS improves the understanding of the contents explained in class	3.87	1.160	-0.911	0.727

Alpha, Factor loadings	Items,factors and variance explained	1	2	3	h2^* * h2 = Communality;	α^† † α= Cronbach's alpha
FACTOR 1: Learning environment
F1 51.07%	15.The use of IRS makes the classes enjoyable and dynamic	0.759		0.625		0.926
	30. The use of IRS allows active discussion of misconceptions to build knowledge	0.748	0.303	0.736
	48. The use of IRS improves your participation in classes behind anonymity	0.731		0.650
	42. The use of IRS allows you to be more confident when asking questions during classes	0.685	0.403	0.673
	53. The answers provided through IRS increase my confidence in the classes after verifying that I answered correctly	0.640		0.537
	5.During my experience with IRS I have a good time learning	0.602	0.347	0.484
	22. I am more interested in classes when using IRS	0.577	0.497	0.641
	47. The use of IRS makes the classes more pleasant and interactive compared to traditional classes	0.562	0.491	0.644
	24. I like the use of IRS as an attendance control	0.538	0.480	0.590
	1. I am more focused during the classes since the implementation of IRS	0.483	0.560	0.564
FACTOR 2: Teaching-learning process
F2 5.47%	18. The use of IRS improves my learning performance	0.404	0.726	0.740		0.869
	9. The IRS is used to find out the initial knowledge of the students		0.725	0.550
	2. Thanks to the IRS I measure if I am following correctly the contents of the subject during the classes		0.702	0.599
	59. IRS provides valuable information to improve your learning process		0.628	0.512
	10. The use of IRS is carried out by experienced professors to provide good feedback	0.324	0.576	0.483
	46.The use of the IRS is done at the end of the classes to review the contents explained during the session		0.402	0.687
	19. The continuous use of the IRS increases my class attendance		0.516	0.422
FACTOR 3: Learning Assessment
F3 5.07%	20. The use of IRS allows you to know and compare your colleagues' answers with your own answers			0.864	0.755	0.871
	36.The use of IRS promotes regular study of the subject to be better prepared for classes	0.403		0.678	0.686
	21. The use of the IRS allows to correct mistakes or misunderstandings about the subject contents during the classes		0.361	0.641	0.576
	35. The use of the IRS evaluates my comprehensive knowledge of the contents in each of the topics covered during the classes	0.604		0.523	0.715
	29. The use of IRS improves motivation during classes	0.391		0.491	0.680
	65. The use of IRS improves the understanding of the contents explained in class		0.332	0.486	0.602

Factors	CF^* * CF= Composite Reliability;	MEV^† † MEV = Mean Extracted Variance
F1: Learning Environment	0.955	0.544
F2: Teaching-learning process	0.930	0.508
F3: Learning assessment	0.863	0.540

Escola de Enfermagem de Ribeirão Preto / Universidade de São Paulo Av. Bandeirantes, 3900, 14040-902 Ribeirão Preto SP Brazil, Tel.: +55 (16) 3315-3451 / 3315-4407 - Ribeirão Preto - SP - Brazil
E-mail: rlae@eerp.usp.br

Acompanhe os números deste periódico no seu leitor de RSS

[1] Corresponding author: Ángel Custodio Mingorance Estrada E-mail: amingoe@ugr.es https://orcid.org/0000-0003-4478-3011