Scientific production of flipped learning and flipped classroom in Web of Science

Produção científica de aprendizagem invertida e sala de aula invertida em Web of Science

Abstract

This study focuses on knowing the scientific production of the terms flipped learning and flipped classroom in specialized literature, determining their conceptual evolution, the most relevant topics and the most prolific authors. A bibliometric study has been carried out supported by a structural and dynamic analysis of co-words. Both terms have been analyzed in the Web of Science, reporting 2968 documents and observing a much higher production in the flipped classroom. Despite the fact that both terminologies are frequently used as synonyms, in the scientific community they are differentiated, observing different trends and fields of study according to the concept. The results may promote the search for a terminological consensus that clearly delimits the area covered by each concept.

Keywords:
Bibliometric study; Flipped learning; Flipped classroom; Analysis of co-words; Web of Science database

Resumo

O objetivo deste estudo é conhecer a produção científica dos termos flipped learning e flipped classroom na literatura especializada, determinando sua evolução conceitual, os temas mais relevantes e os autores mais prolíficos. Foi realizado um estudo bibliométrico apoiado por uma análise estrutural e dinâmica de co-palavras. Ambos os termos foram analisados na Web of Science, relatando 2.968 documentos e observando uma produção muito maior na sala de aula invertida. Apesar de ambas as terminologias serem frequentemente utilizadas como sinônimos, na comunidade científica elas se diferenciam, observando diferentes tendências e campos de estudo de acordo com o conceito. Os resultados podem promover a busca por um consenso terminológico que delimite claramente a área de abrangência de cada conceito.

Palavras-chave:
Estudo bibliométrico; Aprendizagem invertida; Sala de aula invertida; Análise de co-palavras; Banco de dados da Web of Science

Resumen

El objetivo de este estudio es conocer la producción científica de los términos aprendizaje invertido y aula invertida en la literatura especializada, determinando su evolución conceptual, los temas más relevantes y los autores más prolíficos. Se realizó un estudio bibliométrico apoyado en un análisis estructural y dinámico de co-palabras. Ambos términos fueron analizados en la Web of Science, reportando 2.968 documentos y observando una producción mucho mayor en el aula invertida. Aunque ambas terminologías se utilizan a menudo indistintamente, en la comunidad científica se diferencian, observando diferentes tendencias y campos de estudio según el concepto. Los resultados pueden promover la búsqueda de un consenso terminológico que delimite claramente el alcance de cada concepto.

Palabras clave:
Estudio bibliométrico; Aprendizaje invertido; Aula invertida; Análisis de co-palavras; Base de datos de Web of Science

1 Introduction

The present work deals with the state of the question in the scientific literature of one of the didactic approaches that are booming in the field of education: the emerging methodology known as flipped learning or flipped classroom (CABI, 2018; CHEN; HUANG y HWANG, 2019; ZAINUDDIN y col., 2019). Due to its dual denomination, this study emerges to explore in the different scientific works about the state, development, as well as the similarities and differences between both terms. The relevance of this research is based on the novelty of this study in the impact literature. With the completion of this literary analysis, the gap between the conceptual level and the generation of new knowledge about the state of the matter have been closed since no work has been reported to date to achieve the aforementioned purposes.

This innovative learning model has been implemented in the field of education for almost a decade. Its origin dates back to 2011, when its predecessors -Jonathan Bergmann and Aaron Sams- carried out a teaching praxis through audiovisual materials hosted on the Internet, so that students with regular attendance problems could view it and -consequently- follow the same learning rhythm as the rest of peers (BERGMANN y SAMS, 2012).

At present, education is positioned as one of the most promising approaches in the technopedagogical field (HINOJO LUCENA y col., 2019), due to the potentialities it is offering in the action of teaching and learning (HE y col., 2016), where in addition to relying on the use of ICT, it promotes project-based teaching and problem solving, thus making the learning process attractive (KOSTARIS y col., 2017).

This approach is pedagogically based on a mixed formative practice in which the digital plane is combined with the face-to-face (LEE; LIM y KIM, 2017), the technological with practicality (FROEHLICH, 2018). The instructive act begins outside the traditional learning environment (BORAO MORENO y PALAU MARTÍN, 2016), that is, in any space where the learner visualizes the audiovisual contents provided by the teaching staff, which will later be dealt with in the classroom in greater depth (EL MIEDANY, 2019; LONG; CUMMINS y WAUGH, 2017). All this gives the model a high component of ubiquity and flexibility, while the students can access the materials from any place and as many times as required, adapting to the needs and concerns (BLAU y SHAMIR-INBAL, 2017; BOELENS; VOET y DE WEVER, 2018; PEREIRA; FILLOL y MOURA, 2019). However, this innovative approach requires the involvement and commitment of learners to achieve good results in its application (TOURÓN y SANTIAGO, 2015), as well as the availability of mobile technology, digital content and the willingness of learners, aspects which are considered fundamental to generate an ecology of effective learning (HINOJO-LUCENA y col., 2018). In addition, it is also necessary to have a propitious physical environment where to visualize the contents, as well as a level of digital skills on the part of the teaching staff (LÓPEZ-BELMONTE; POZO SÁNCHEZ y col., 2019).

This emerging model makes better use of the classroom, since the time allocated to content delivery has been reduced thanks to the virtual complement produced in the learning phase (BAUER-RAMAZANI y col., 2016). This results in an exchange of roles between the agents involved, with the student assuming an active and practical profile in the face-to-face session (AHMED, 2016; MORTENSEN y NICHOLSON, 2015), where they interact with other learners, encouraging collaborative work (MACLEOD y col., 2018), as well as with the contents, with the teacher, and with the problems raised during daily practice (CASTELLANOS SÁNCHEZ; SÁNCHEZ ROMERO y CALDERERO HERNÁNDEZ, 2017; HWANG; LAI y WANG, 2015), evoking the student to the deployment of a higher order thought (UNIVERSITY OF OTAGO WELLINGTON, NEW ZEALAND y col., 2017). In this sense, the physical classroom is transformed into a dynamic and creative space (NOURI, 2016), where assimilated knowledge converges and is put into practice in a virtual way (ABEYSEKERA y DAWSON, 2015).

An important aspect to highlight is that explanations are never abandoned in the classroom. In order to achieve its effectiveness, it is recommended that the first minutes of the face-to-face session should be used to clarify any doubts that may have arisen in the students during the visualization of the audiovisual contents (MOK, 2014). On the benefits of their practice reported in the students, the literature reveals an increase in their motivation (SHIH y TSAI, 2016; TSE; CHOI y TANG, 2019), even higher than that originated by other technopedagogical approaches (THAI; DE WEVER y VALCKE, 2017). At the same time, it is encouraged the self-regulation and protagonism of the learners (MIÑO-PUIGCERCÓS; DOMINGO-COSCOLLOLA y SANCHO-GIL, 2018), autonomy (LLANOS GARCIA y BRAVO-AGAPITO, 2019), participation (CHYR y col., 2017), commitment (BRAVO; ALARCIA y GARCÍA, 2019; YILMAZ, 2017), responsibility (HUANG; HEW y LO, 2019), positive attitude towards learning (LEE; PARK y DAVIS, 2018; MCNALLY y col., 2017), collaborative work (BÁEZ PÉREZ y CLUNIE BEAUFOND, 2019; KWON y WOO, 2018; WU; HSIEH y YANG, 2017), problem-solving capacity (BOGNAR; SABLIĆ y ŠKUGOR, 2019; DELOZIER y RHODES, 2017) and class attendance (BLAIR; MAHARAJ y PRIMUS, 2016; MINGORANCE ESTRADA y col., 2017).

All these indicators result in improved performance (SOLA MARTÍNEZ y col., 2019) and, consequently, in the results obtained (FISHER y col., 2017; SACRISTÁN SAN CRISTÓBAL y col., 2017), in the scope of the learning purposes (AWIDI y PAYNTER, 2019; KAZANIDIS y col., 2019) and in the overall productivity of the training action (YOSHIDA, 2016), a situation that favours the students’ satisfaction by making them feel useful and productive (ROMERO; BUZÓN-GARCÍA y TOURON, 2019).

2 Material and methods

2.1 Research objectives and design

Given the transcendence of this emerging methodology in the impact literature -justified in the potentialities reported by its application- the interest of this research focuses on the analysis of scientific production on the two terms used (flipped learning and flipped classroom) that allude to such an innovative approach to teaching-learning. Therefore, the general objectives are established:

• To know the performance and scientific production of the terms flipped learning and flipped classroom in specialized literature.

• To determine the scientific evolution of flipped learning and flipped classroom.

• To find out the most relevant topics in the scientific production of both concepts.

• To identify the most relevant authors with the greatest trends in flipped learning and in flipped classroom.

For this purpose, a bibliometric cutting methodology has been followed, based on a series of procedures for estimating, quantifying and evaluating scientific production (MARTÍNEZ y col., 2015). Analytical tracking and documentary measurement techniques have been used by means of indicators (variables) of literary production (Cuadro 1), based on the PRISMA-P matrix protocols. Likewise, both the study topics and their evolution have been detected through scientific mapping (LÓPEZ-ROBLES y col., 2019; LÓPEZ-BELMONTE; MORENO-GUERRERO y col., 2019b).

Cuadro 1
Production indicators and inclusion criteria.

Indicators	Criteria
Year of publication	All documents are contemplated
Language	All languages are contemplated
Publication area	x ≥ 15
Type of documents	All documents are contemplated
Organisations	x ≥ 8
Sources of origin	x ≥ 19
Authors	x ≥ 6
Countries	x ≥ 18
Number of citations	x ≥ 18

• Fuente: own elaboration.

2.2 Procedure, data cleansing and analysis

The database used as a reference for the analysis was Web of Science (WoS), covering all its main collection:

• Science Citation Index.

• Social Science Citation Index.

• Arts & Humanities Citation Index.

• Conference Proceedings Citation Index Sciences/Social Sciences & Humanities.

• Book Citation Index Science/Social Sciences & Humanities.

• Emerging Sources Citation Index.

With respect to the search process, the key words that would be used to report bibliometric information were first specified. For this purpose, the consultation was carried out in different thesauri (ERIC and UNESCO), which did not register any standardized concept that agglutinates the methodology in question, so it was decided to use flipped learning (FLLE) and flipped classroom (FLCL), as they are called in the impact studies. These concepts were then introduced into the WoS database independently and covering all existing scientific production to perform the search process in metadata alluding to the title, abstract and keywords. The tracking phase began in April 2019 and ended in December 2019. The unit of analysis reported was 3314 documents (FLLE=526; FLCL=2788), meeting the inclusion requirements of Cuadro 1.

The structural and dynamic study of both terms has been carried out through a co-words analysis (HIRSCH, 2005), taking as references -among others- the index-h (COBO y col., 2011). Thus, a science map was designed and performance was analyzed with the purpose of locating and delimiting the subdomains of such concepts in the field of research, as well as their evolution.

To analyze the performance the tools have been used WoS’ Analyze Results and Creation Citation Report. These programs provide different bibliometric indicators that facilitate the analysis of reported documents. SciMAT software has been used for structural and dynamic development, as a specialized program to conduct a longitudinal co-word study. For this purpose, the following processes have been deployed:

• Recognition of the topics: Starting from the 2788 references in FLCL and 526 in FLLE, a mapping has been made to choose only those containing the keywords previously established, eliminating the rest of documentary units. The repeated references have been unified, resulting in a total of 2680 in FLCL and 497 in FLLE, which have created a co-occurrence network by means of nodes, which generate a normalized network of co-words through a clustering algorithm.

• Reproduction of the themes: It was produced with the creation of a strategic diagram and through a thematic network. In its realization, different dimensions were taken into account, such as density and centrality. This resulted in four thematic sectors (Top left: Developed but isolated themes; Top right: driving and fundamental themes; Bottom left: emergence of themes or in the process of disappearance; Bottom right: simple themes with little development and of a transversal nature).

• Determination of thematic focuses: Taken in the analysis of the evolution of the nodes in several time intervals. The strength of the association between the themes occurs in the volume of common keywords. The following periods (Pe) were established for FLCL: 2011-2013 (Pe1); 2014 (Pe2); 2015 (Pe3); 2016 (Pe4); 2017 (Pe5); 2018 (Pe6) and 2019 (Pe7), and the following for FLLE: 2012-2015 (Pe1); 2016 (Pe2); 2017 (Pe3); 2018 (Pe4); 2019 (Pe5). The periods have been configured in such a way as to bring together a minimum of 100 references in each of them.

• erformance: The keywords have a chain of links between them and with other concepts that delimit the trend of the node, thereby reporting information on its use by the scientific community. Its analysis has taken place observing the following protocol (Cuadro 2).

Cuadro 2
Performance analysis.

Configuration		Values
Analysis unit	Keywords author
	Keywords WoS
Frequency threshold	FLCL	Pe1 (2), Pe2 (2), Pe3 (3), Pe4 (5), Pe5 (5), Pe6 (5), Pe7 (2
	Authors FLCL	3
	FLLE	Pe1 (2), Pe2 (2), Pe3 (2), Pe4 (2), Pe5 (2)
	Authors FLLE	2
Type of network	Co-occurrence
Threshold union value co-occurrence	FLCL	Pe1 (1), Pe2 (1), Pe3 (2), Pe4 (2), Pe5 (2), Pe6 (2), Pe7 (2)
	Authors FLCL	2
	FLLE	Pe1 (1), Pe2 (1), Pe3 (1), Pe4 (1), Pe5 (1)
	Authors FLLE	1
Standardisation measure	Equivalence index
Clustering Algorithm	Maximum size: 9; Minimum size: 3
	Jaccard Index
	Inclusion index

• Fuente: own elaboration.

3 Results

3.1 Performance and scientific production

A total of 3177 documents (FLLE=84.36%; FLCL=15.64%) composed of various types of scientific texts have been analysed, from 2011, when scientific production begins, to the present (Cuadro 3).

Cuadro 3
Diachronic analysis of all scientific production.

Year	FLLE	FLCL	Σ
2019	99	399	498
2018	111	527	638
2017	117	657	774
2016	94	494	588
2015	55	395	450
2014	17	147	164
2013	3	51	54
2012	1	9	10
2011	-	1	1
Total	497	2680	3177

• Fuente: own elaboration.

The greatest scientific production is observed, both for FLLE and FLCL, in the year 2017, being from its beginnings until such date a constant development. On the other hand, it is from the following year when production begins to decline (Figura 1).

Figura 1
Evolution of scientific production.

The predominant language used by researchers in this branch of knowledge is English, both in FLLE and FLCL studies, considerably distanced from the next most widely used language, Spanish (Cuadro 4).

Cuadro 4
Scientific language used.

Language	FLLE	FLCL	Σ
English	467	2525	2992
Spanish	20	84	104
Chinese	1	41	42
Portuguese	4	11	15
Russian	1	6	7
German	-	4	4
Korean	2	1	3
Italian	1	1	2
French	-	2	2
Turkish	-	2	2
Bulgarian	1	1	2
Catalan	-	1	1
Hungarian	-	1	1

• Fuente: own elaboration.

The area of knowledge of reference in the studies developed in both terms is that alluding to ”Education Educational Research”, concentrating there the greatest amount of production. In spite of this, there is a considerable variety of areas that deal with the subject to a lesser extent (Cuadro 5). The type of publication used primarily to reveal research findings is congress communications, closely followed by articles. The other publications are poorly represented (Cuadro 6).

Cuadro 5
Areas of knowledge.

Publication area	FLLE	FLCL	Σ
Education Educational Research	402	1859	2261
Computer Science	59	404	463
Engineering	51	293	344
Social Science other topics	11	285	296
Business Economics	9	188	197
Linguistics	22	71	93
Chemistry	11	72	83
Arts Humanites other topics	2	66	68
Nursing	12	51	63
Health Care Science Services	2	48	50
General Internal Medicine	3	42	45
Psychology	5	37	42
Pharmacology Pharmacy	-	39	39
Science Technology Other Topics	9	25	34
Communication	5	23	28
Information Science Library Science	2	25	27
Biochemistry Molecular Biology	-	26	26
Literature	-	24	24
Cell biology	-	24	24
Telecommunications	2	22	24
Dentristry Oral Surgery Medicine	-	21	21
Art	-	15	15

• Fuente: own elaboration.

Cuadro 6
Type of document.

Type	FLLE	FLCL	Σ
Communications	210	1339	1549
Papers	235	1051	1286
Abstracts	6	105	111
Book Chapters	23	63	86
Editorial material	4	45	49
Revisions	8	44	52
Letters	2	15	17
Early access	5	4	9
Newsitem	-	6	6
Book reviews	3	3	6
Corrections	1	2	3
Books	-	2	2
Reissues	-	1	1

• Fuente: own elaboration.

The reference institution for the FLCL is the University of North Carolina, while for FLLE it is the National Taiwan University of Science Technology. The rest of the institutions have a medium or low incidence in scientific production (Cuadro 7).

Cuadro 7
Institutions.

Denomination	FLLE	FLCL	Σ
University of North Carolina	4	48	52
University of Carolina Systems	-	31	31
University of Hong Kong	11	20	30
Harvard University	1	29	30
State University System of Florida	1	28	29
National Taiwan University of Science Technology	14	13	27
University of North Carolina Chapel Hill	1	25	26
Pennsylvania Common Wealth System of Higher Education	1	25	26
University System of Georgia	-	22	22
Universidad Politécnica de Madrid	2	20	22
Universitat Politécnica de Valencia	5	17	22
National Taiwan Normal University	5	15	20
University of Sydney	6	14	20
Universidad de Zaragoza	6	15	21
California State University System	2	16	18
Bohai University	-	17	17
University of Michigan System	-	17	17
Monash University	1	16	17
Universidad de Extremadura	2	15	17
Polytechnic Institute of Porto	3	14	17
State University of New York Suny System	-	16	16
University of Michigan	-	16	16
Ohio State University	-	15	15
Va Boston Healthcare System	1	13	14
Northeast Normal University China	-	13	13
MEF Universitesi	8	1	9

• Fuente: own elaboration.

The main author in FLLE is Hwang, G.J., while in FLCL there are several authors with a high output, such as Keengwe, J., Oigara, J.N. and Onchwari, G (Cuadro 8). It also reflects the presence of authors who develop works using both terms.

Cuadro 8
Most prolific authors.

Authors	FLLE	FLCL	Σ
Hwang, G.J.	19	10	29
Keengwe, J.	-	18	18
Oigara, J.N.	-	17	17
Onchwari, G.	-	17	17
Zainuddin, Z.	4	9	13
Jeong, J.S.	1	11	12
McLaughlin, J.E.	1	11	12
Scheg, A.G.	3	9	12
Liu, Y.	-	11	11
Canada-Canada, F.	1	9	10
González-Gómez, D.	1	9	10
Wang, L.	1	9	10
Hew, K.F.	4	6	10
Lo, C.K.	4	6	10
Chen, N.S.	2	7	9
Artal-Sevil, J.S.	3	6	9
Hung, H.T.	3	6	9
Li, Y.	-	8	8

• Fuente: own elaboration.

Regarding the source of publication (Cuadro 9), the collection ”Advances in Social Science Education and Humanities Research”, is the one that most publishes on FLCL, while on the FLLE concept is the collection ”INTED Proceedings”.

Cuadro 9
Most prolific authors.

Denomination	FLLE	FLCL	Σ
Advances in Social Science Education and Humanities Research	5	174	179
INTED Proceedings	47	101	148
EDULEARN Proceedings	40	104	144
ICERI Proceedings	23	72	95
12TH International Technology Education and Development Conference INTED	17	32	49
ACSR Advances in computer Science Research	-	46	46
Destech Transactions on Social Science Education and Human Science	2	41	43
Frontiers in Education Conference	3	40	43
EDULEARN 8TH International Conference on Education and New Learning Technology	13	29	42
INTED 2017 11TH International technology education and Development Conference	14	27	41
Lecture Notes in Managements Science	3	36	39
10TH International Conference of Education Research and Innovation	10	23	33
Educational Technology Society	7	23	30
Computers Education	7	22	29
INTED 2016 10th International Technology Education and Development Conference	9	20	29
Abstracts of Papers of the American Chemical Society	2	26	28
Journal Of Chemical Education	2	26	28
EDULEARN 15 7TH International Conference on Education and New Learning Technologies	4	22	26
American Journal of Pharmaceutical Education	-	25	25
Lecture Notes in Computer Science	3	20	23
Advances in intelligent systems research	1	21	22
Faseb journal	-	21	21
International Journal of Emerging Technologies in Learning	1	20	21
Advancesin Education Research	-	19	19

• Fuente: own elaboration.

The country of reference in the scientific production on both concepts is the United States, although China follows closely, especially in the production concerning FLCL (Cuadro 10).

Cuadro 10
Relationship of countries with production on the theme.

Country	FLLE	FLCL	Σ
United States	89	741	830
China	32	682	714
Spain	48	196	244
Taiwan	51	115	166
Australia	25	98	123
England	23	72	95
Turkey	27	42	69
Canada	8	56	64
Malaysia	14	42	56
South Korea	33	22	55
Germany	4	50	54
Japan	17	27	44
Italy	13	28	41
Indonesia	8	27	35
Norway	5	29	34
Russia	6	28	34
Brazil	2	29	31
Portugal	7	25	32
South Africa	2	22	24
India	3	20	23
Singapore	4	19	23
Thailand	5	17	22
Netherlands	3	17	20
Sweden	-	18	18

• Fuente: own elaboration.

The most outstanding references, both in FLLE (Cuadro 11) and in FLCL (Cuadro 12), show significant differences in relation to the importance and incidence in the scientific community itself, resulting in a higher citation index in the studies covered by the term FLCL.

Cuadro 11
FLLE: most-cited articles.

References	Citations
CHEN, Y.L., WANG, Y.P., KINSHUK, & CHEN, N.S. (2014). Is FLIP enough? Or should we use the FLIPPED model instead?. Computers & Education, 79, 16-27.	165
TRAVIS, R. (2014). Student perceptions toward flipped learning: New methods to increase interaction and active learning in economics. International review of Economics Education, 17, 74-84.	119
LAI, C.L., & HWANG, G.J. (2016). A self-regulated flipped classroom approach to improving students’ learning performance in a mathematics course. Computers & Education, 100, 126-140.	104
HWANG, G.J., LAI, C.L., & WANG, S.Y. (2015). Seamless flipped learning: a mobile technology-enhanced flipped classroom with effective learning strategies. Journal of computers in education, 2(4), 449-473.	96
SEERY, M.K. (2015). Flipped learning in higher education chemistry: emerging trends and potential directions. Chemistry education research and practice, 16(4), 758-768.	72

• Fuente: own elaboration.

Cuadro 12
FLCL: most-cited articles.

References	Citations
O´FLAHERTY, J., & PHILLIPS, C. (2015). The use of flipped class- rooms in higher education: A scoping review. Internet and Higher edu cation, 25, 85-95. doi: 10.1016/j.iheduc.2015.02.002	413
MCLAUGHLIN, JE, ROTH, MT, GLATT, DM, GHARKHOLONARE-CHE, N., DAVIDSON, C.A., GRIFFIN, L.M., ESSERMAN, D.A.,& MUMPER, R.J. (2014). The flipped classroom: a course redesign to Foster learning and engagement in a health professions school. AcademicMedicine, 89(2), 236-243.	375
ABEYSEKERA, L., & DAWSON, P. (2015). Motivation and cognitive load in the flipped classroom: definition, rationale and a call for research. Higher Education Research & Development, 34(1), 1-14.	310
MASON, G.S., SHUMAN, T.R., & KATHLEEN, E. (2013). Comparing the effectiveness of an inverted classroom to a traditional classroom in an upper-division engineering course. IEEE Transactions on Education, 56(4), 430-435.	293
DAVIES, R.S., DEAN, D.L., & BALL, N. (2013). Flipping the classroom and instructional technology integration in a college-level information systems spreadsheet course. Etr&D-Educational Technology research development, 61(4), 563-580	258

• Fuente: own elaboration.

3.2 Structural and thematic development

With respect to the continuity produced in the keywords in the delimited periods, it shows a more established thematic predominance in FLCL than in FLLE, given that the percentage of similarity between dates is higher in the former than in the latter, there being similarities between the years 2017-2018 and 2018-2019. Likewise, an evolution of key words is observed from the beginning established until the year 2018, in which there is a slight decrease in FLCL and -very similar- in FLLE (Figura 2).

Figura 2
Continuity of keywords between contiguous periods. Note: (a) FLCL; (b) FLLE.

As shown in Cuadro 13, in relation to FLCL, there is a thematic plurality in the different established periods, given the variety in the research reported in this field of knowledge, but with a continuous line between periods, if we bear in mind the different bibliometric indicators. Specifically, in 2014 and 2015 the concept with the most indices was ”blended learning”, while from 2016 to 2018 the ”flipped classroom” theme is included in the witness. It is in 2019 that a radical change in research perspectives is shown, with new topics and new lines of study being offered.

Cuadro 13
Thematic performance in FLCL.

Period 2011-2013
Denomination	Works	h-index	g-index	hg-index	q2-index	Citations
Education	10	5	7	5.92	17.75	481
Classroom	2	1	1	1	2.65	7
Problem based learning	2	2	2	2	11.22	101
Period 2014
Denomination	Works	h-index	g-index	hg-index	q2-index	Citations
Model	4	4	4	4	18.97	242
On-line	7	5	6	5.48	9.22	263
Inverted classroom	16	5	8	6.32	12.25	406
Blended learning	12	5	8	6.32	20.12	472
MOOC	2	0	0	0	0	0
School	2	1	1	1	1.41	2
Period 2015
Denomination	Works	h-index	g-index	hg-index	q2-index	Citations
Quality	3	1	1	1	4.69	22
First Year Undergraduate	10	8	10	8.94	11.31	166
Blended learning	42	12	20	15.49	18	433
Students	16	9	14	11.22	19.21	855
Active learning	13	7	13	9.54	10.91	264
Technology	11	2	3	2.45	3.74	10
Physiology	3	2	2	2	7.48	30
Collaboration	3	0	0	0	0	0
MOOC	4	2	3	2.45	4.47	13
Period 2016
Denominación	Works	h-index	g-index	hg-index	q2-index	Citations
Flipped classroom	126	16	25	20	22.27	799
Performance	21	11	17	13.67	14.46	319
Student performance	15	8	15	10.95	18.55	364
Classroom	10	3	10	5.48	9.49	229
Design	4	4	4	4	5.66	40
Learning	5	2	3	2.45	4.9	25
College English	5	0	0	0	0	0
Period 2017
Denomination	Works	h-index	g-index	hg-index	q2-index	Citations
Medical education	28	11	17	13.67	12.85	328
Flipped classroom	201	12	19	15.1	17.32	600
Experience	25	8	13	10.2	11.31	193
Classroom	21	4	6	4.9	6.63	52
Flipped learning	17	5	9	6.71	6.71	83
Learning	5	2	2	2	2.45	6
Design	7	2	4	2.83	3.74	17
Student centered learning	3	0	0	0	0	0
MOOC	11	3	4	3.46	3.87	20
Period 2018
Denomination	Works	h-index	g-index	hg-index	q2-index	Citations
Flipped classroom	163	7	9	7.94	7.48	246
Impact	13	4	5	4.47	4.9	36
Motivation	31	3	6	4.24	5.2	59
Skills	22	3	4	3.46	3.87	36
Perceptions	16	4	4	4	4.9	34
Outcomes	8	3	5	4.24	6.48	47
Flipped learning	6	1	1	1	1	3
Learning management systems	4	1	1	1	1	1
Learners	4	1	2	1.41	3	10
College English	4	1	1	1	2	4
Period 2019
Denomination	Works	h-index	g-index	hg-index	q2-index	Citations
Motivation	41	4	6	4.9	6.32	50
Design	58	4	6	4.9	6.63	63
Curriculum	21	2	5	3.16	6.48	31
Technology	23	2	3	2.45	3.16	12
Model	16	2	3	2.45	3.16	11
Active-learning	14	2	2	2	2	6
Perceptions	14	2	2	2	2.83	7
Principles	5	1	1	1	1.41	2
Medical education	6	0	0	0	0	0
Student performance	6	1	1	1	1.41	2
Learning strategies	2	1	1	1	2	4
ICT	3	1	1	1	1.41	2
Strategies	3	1	1	1	1	2
Courses	2	0	0	0	0	0

• Fuente: own elaboration.

With respect to FLLE, like its homonym, it also offers thematic varieties in the various defined periods (Cuadro 14), but with a line established if bibliometric indicators are taken into account. From 2012 to 2016, the main concept is ”flipped classroom”, becoming in 2017 ”university” and in 2018 ”flipped learning”. In the data recorded to date, the year 2019 offers new perspectives and trends in research, focusing on ”performance”, “classroom model” and ”motivation”.

Cuadro 14
Thematic performance in FLLE.

Period 2012-2015
Denomination	Works	h-index	g-index	hg-index	q2-index	Citations
Classroom	6	3	4	3.46	11.09	118
Flipped classroom	20	3	9	5.2	5.2	96
Environment	3	3	3	3	14.9	220
Pedagogy	2	1	1	1	1.41	2
Organic-Chemistry	3	3	3	3	6.71	90
Period 2016
Denomination	Works	h-index	g-index	hg-index	q2-index	Citations
Achievement	3	3	3	3	11.87	113
Environment	3	3	3	3	8.66	112
Engineering education	2	1	1	1	1	1
Flipped classroom	11	5	10	7.07	8.06	108
Experience	2	2	2	2	9.7	53
Period 2017
Denomination	Works	h-index	g-index	hg-index	q2-index	Citations
On line academic help seeking	2	2	2	2	3.16	8
Student Centered learning	6	4	6	4.9	5.66	36
Motivation	6	5	5	5	6.32	63
University	7	6	7	6.48	7.75	73
Students	15	5	8	6.32	7.42	66
Student performance	8	4	6	4.9	6.32	45
Flipped learning	21	5	7	5.92	6.32	65
Education	3	1	1	1	1	1
Mobile technology	2	1	1	1	2.65	7
Collaborative learning	2	1	1	1	1.41	2
Period 2018
Denomination	Works	h-index	g-index	hg-index	q2-index	Citations
Middle school	5	2	2	2	4.47	14
Percepctions	6	1	1	1	2	4
Design	9	3	4	3.46	3.87	22
Learning analytics	7	1	2	1.41	2	7
Educational technology	4	1	2	1.41	2	5
Flipped learning	30	3	5	3.87	3.87	31
Flipped classroom	11	2	3	2.45	3.16	12
Video	2	0	0	0	0	0
Learners	2	1	1	1	1.73	3
Innovation	2	0	0	0	0	0
Period 2019
Denomination	Works	h-index	g-index	hg-index	q2-index	Citations
Classroom model	5	2	2	2	5.83	19
Performance	15	2	4	2.83	5.83	22
Satisfaction	7	2	2	2	2.45	6
Flipped learning	20	1	1	1	1.73	3
Motivation	6	2	2	2	5.83	19
Medical Education	2	0	0	0	0	0
Learners	3	1	1	1	1	1

• Fuente: own elaboration.

Analyzing the different diagrams of the periods established in the FLCL, it can be observed that ”flipped classroom” is the theme that has been the most established in time, given that it has been a relevant theme from 2016 to 2018, continuing -in the same way- in the studies that are developed, focused mainly on ”Blended learning”, ”Higher education”, ”students” and ”active learning”. In recent years (2018-2019), there has been a growing trend in aspects related to motivation, impact on students and performance. As shown in both periods, attention should be paid to the topics ”ICT”, ”strategies”, ”student performance” and ”medical education”, as they are concepts whose durability implies a mystery, and may disappear in the future or emerge as driving themes (Figuras 3a a 3g).

Figura 3
Strategic diagram by FLCL h-index.

In the strategic diagrams of the dates configured for FLLE -in contrast to what happened with FLLE- there is no motor theme settled in time, showing changes in each of the periods. The only theme that repeats as the driving theme is ”motivation”, which appears in 2017 and 2019, although with different research perspectives, given that in 2017, the research focuses on oral training, technology, reading, class models, language students, collaboration and acceptance by users; while in 2019, it is associated with classroom approach, blended learning, self regulated learning perceptions e-learning, skills and achievement. For the coming years, the themes of ”motivation” and ”learners” should be taken into consideration, given that their location in the diagram places them as emerging or disappearing themes (Figuras 4a a 4d).

Figura 4
Strategic diagram by FLLE h-index.

3.3 Thematic evolution of terms

Considering the thematic evolution shown in Figuras 5a y 5b, attention should be paid to the type of line of connections made. The solid line shows a conceptual relationship and the dashed line reflects a non-conceptual relationship, given that the connection is through key words.

Figura 5
Thematic evolution by h-index.

In FLCL, there is no constant line from the beginning of the research in the established field until now, there are conceptual gaps between the marked periods. The themes ”blended learning”, ”design”, ”learning”, ”MOOC” offer thematic connections and reveal continuity in at least two established periods, while ”flipped classroom” is the one that shows itself to be more constant in time and with greater thematic connection force. Likewise, the connecting force maintained by ”MOOC” and ”College English” between the 2017 and 2018 periods is one of the highest that is reflected throughout the period analysed. With respect to the rest of the connections, there are quite a number of links - both conceptual and non-conceptual- between the established periods, although these connections are with different concepts, offering a constant and variable line on the part of the scientific community. FLLE shows an analogous circumstance, with conceptual gaps between the established periods, with the ”flipped learning” theme marking a constant and conceptual trend from the 2017 period to the present. The established connections, both conceptual and non-conceptual, present a low relationship strength. Nevertheless, there are many connections between diverse themes, which mark the constant and variable tendency in the experts of this field of knowledge.

3.4 Authors with the highest relevance index

As for the authors, and bearing in mind all the years of production, there is a variety of authorship according to the field of study observed (Figuras 6a y 6b). In this case, in FLCL the most relevant authors -given their location in the diagram- are Lyons, M., Rodríguez, M. and Jeong, J.M., while in FLLE are Rajalekshmi, K.G., Uosaki, N., and Tsai, C.W. For the next few years -due to their situation in the quadrant- Chen, N.S. and Isenhardt, I. in FLCL and Kim H.S., and Fanguy, M. in FLLE should be taken into consideration.

Figura 6
Strategic diagram of authors of the entire production.

4 Discussion and Conclusions

Both flipped learning and flipped classroom are newly created teaching methodologies that are gaining more prominence among teachers and researchers (HINOJO-LUCENA y col., 2018). Its pedagogical essence is based on the inversion of the moments of learning to combine the digital and face-to-face spaces (LEE; LIM y KIM, 2017), in such a way that the instructional process begins outside the conventional classroom (BORAO MORENO y PALAU MARTÍN, 2016) when the students visualize the audiovisual content provided by the teacher (EL MIEDANY, 2019; LONG; CUMMINS y WAUGH, 2017) and continues in the classroom itself promoting project-based learning, problem solving and -in short- enhancing the attractiveness of the learning process (KOSTARIS y col., 2017). This research has focused on providing the scientific community with the terminological standardization necessary to guide their research to relevant topics in each of the fields studied. In addition, it will allow a prior and reflective analysis of the terminological choice (FLLE or FLCL) according to the research perspective to be proposed. The added value of the study is that there is currently no study that arises or analyzes the differences between the two terms, used in certain fields and in certain branches as synonyms, although the scientific community really makes differences in its research.

Although both the concept of flipped learning and that of flipped classroom are generally used as synonyms by teachers and researchers, the results obtained in this bibliometric study differ from this usual synonymic use due to certain different markers.

The scientific output of FLCL is far superior to that of FLLE. For FLCL the type of document used by the scientists is communications, the main organization/institution is the University of North Carolina, the reference author is Keengwe, J., the source used is Advances in Social Science Education and Humanities Research and the authorship of the most cited article is McLaughlin y col. (2014). On the other hand, in FLLE, the type of document used by the scientific community to show the results is the article, the main organization is the National Taiwan University of Science Technology, the reference author is Hwang, G.J., the source is INTED Proceedings and the most cited article is by Chen, Wang y col. (2014).

Despite these concomitants, both terms share Education Educational Research as the main area of publication, English as the most widely used language and the United States as the country of reference.

The themes of studies of both concepts vary from each other. While for FLCL the relevant concept -according to the bibliometric indicators- is ”blended learning”; for FLLE the most predominant concepts are ”university” and ”flipped learning”, although they maintain a common nexus between them, ”flipped classroom”, which appears to be relevant in both terms.

Differences are also observed if relevance is taken into account by periods, where FLCL shows a more settled line, centred on the ”flipped classroom” theme, while for FLLE there is diversity between the different periods, being the ”motivation” theme the only one that is repeated at least twice.

The marked connections between themes of the different periods offer a constant line, due to the marked terminological connections between the different concepts, but variants due to conceptual gaps and continuous terminological changes. In FLCL, ”flipped classroom” is the concept that shows the greatest consistency and continuity over time; for FLLE, on the other hand, it is ”flipped learning”. Furthermore, in FLCL the conceptual connections established between themes are stronger than those marked in FLLE.

Moreover, it is pertinent to point out that the authors of greatest relevance in scientific production vary according to the field of study. While Lyons, M., Rodríguez, M. and Jeong, J.M. are for FLCL, Rajalekshmi, K.G., Uosaki, N., and Tsai, C.W. are for FLLE, not coinciding with the authors with greater production in their respective subjects. Likewise, the strategic diagrams allow us to glimpse that the authors with the greatest volume of production do not coincide with the most relevant authors for both FLCL and FLLE.

From the above, it can be concluded that FLCL and FLLE terminologies -despite being used by literature as synonyms or similar terminologies- in the scientific community are distinguished and differentiated, observing different trends and fields of study according to the concept used. In this fact lies -precisely- the prospective of the study, since it allows the scientific community to show the most appropriate fields of knowledge according to their line of research. In addition, it can be a starting point for seeking a terminological consensus that clearly delimits the field of terminology that encompasses each of the concepts analyzed.

Definitely, based on the prospect of this study, the results shown here are intended to solve an existing terminological problem in the scientific landscape. Consequently, it has been found that there are differences between the terms flipped classroom and flipped learning, so the educational community must keep both terms in mind and identify the specific connotations of each of them in order to present the results of their research. Therefore, it will allow the scientific community to know which are the main fields of research in each of the topics presented (FLLE and FLCL) and to know the main authors, the most productive countries and all the bibliometric factors related to each subject.

Among the limitations of the research is -on the one hand- the fact of compiling the diverse references and purifying the database in WoS and -on the other hand- the organizational reconstruction of the study at a temporal level, which led to new analyses and searches of the latest studies produced more immediately. Likewise, it should be noted that the results shown here have been approached from a general perspective and showing an intermediate level of specificity. Therefore, as a future line of research, it is proposed to expand the configuration of performance analysis to expand new connections and address other issues. Other notable options would be to carry out a study of a similar design, but using other relevant databases within the scientific field. In addition, it is proposed to investigate the existence of similar situations in which two concepts were applied under a synonym relationship to carry out their bibliometric study.

Referencias

• ABEYSEKERA, Lakmal y DAWSON, Phillip. Motivation and cognitive load in the flipped classroom: definition, rationale and a call for research. Higher Education Research & Development, v. 34, n. 1, p. 1-14, ene. 2015. DOI: 10.1080/07294360.2014.934336. Disponible en: <Disponible en: http://www.tandfonline.com/doi/abs/10.1080/07294360.2014.934336 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1080/07294360.2014.934336» http://www.tandfonline.com/doi/abs/10.1080/07294360.2014.934336
• AHMED, Hanaa Ouda Khadri. Flipped learning as a new educational paradigm: an analytical critical study. European Scientific Journal, ESJ, v. 12, n. 10, p. 417-417, abr. 2016. DOI: 10.19044/esj.2016.v12n10p417. Disponible en: <Disponible en: https://eujournal.org/index.php/esj/article/view/7335 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.19044/esj.2016.v12n10p417» https://eujournal.org/index.php/esj/article/view/7335
• AWIDI, Isaiah T. y PAYNTER, Mark. The impact of a flipped classroom approach on student learning experience. Computers & Education, v. 128, p. 269-283, ene. 2019. ISSN 03601315. DOI: 10.1016/j.compedu.2018.09.013. Disponible en: <Disponible en: https://linkinghub.elsevier.com/retrieve/pii/S0360131518302495 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1016/j.compedu.2018.09.013» https://linkinghub.elsevier.com/retrieve/pii/S0360131518302495
• BÁEZ PÉREZ, Carmen Inés y CLUNIE BEAUFOND, Clifton Eduardo. Una mirada a la Educación Ubicua. RIED. Revista Iberoamericana de Educación a Distancia, v. 22, n. 1, pág. 325, ene. 2019. DOI: 10.5944/ried.22.1.22422. Disponible en: <Disponible en: http://revistas.uned.es/index.php/ried/article/view/22422 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.5944/ried.22.1.22422» http://revistas.uned.es/index.php/ried/article/view/22422
• BAUER-RAMAZANI, Christine y col. Flipped Learning in TESOL: Definitions, Approaches, and Implementation. TESOL Journal, v. 7, n. 2, p. 429-437, jun. 2016. DOI: 10.1002/tesj.250. Disponible en: <Disponible en: http://doi.wiley.com/10.1002/tesj.250 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1002/tesj.250» http://doi.wiley.com/10.1002/tesj.250
• BERGMANN, Jonathan y SAMS, Aaron. Flip your classroom: reach every student in every class every day. Eugene, Or: International Society for Technology in Education, 2012.
• BLAIR, Erik; MAHARAJ, Chris y PRIMUS, Simone. Performance and perception in the flipped classroom. Education and Information Technologies, v. 21, n. 6, p. 1465-1482, nov. 2016. DOI: 10.1007/s10639-015-9393-5. Disponible en: <Disponible en: http://link.springer.com/10.1007/s10639-015-9393-5 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1007/s10639-015-9393-5» http://link.springer.com/10.1007/s10639-015-9393-5
• BLAU, Ina y SHAMIR-INBAL, Tamar. Re-designed flipped learning model in an academic course: The role of co-creation and co-regulation. Computers & Education, v. 115, p. 69-81, dic. 2017. DOI: 10.1016/j.compedu.2017.07.014. Disponible en: <Disponible en: https://linkinghub.elsevier.com/retrieve/pii/S036013151730177X >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1016/j.compedu.2017.07.014» https://linkinghub.elsevier.com/retrieve/pii/S036013151730177X
• BOELENS, Ruth; VOET, Michiel y DE WEVER, Bram. The design of blended learning in response to student diversity in higher education: Instructors’ views and use of differentiated instruction in blended learning. Computers & Education , v. 120, p. 197-212, mayo 2018. DOI: 10.1016/j.compedu.2018.02.009. Disponible en: <Disponible en: https://linkinghub.elsevier.com/retrieve/pii/S0360131518300423 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1016/j.compedu.2018.02.009» https://linkinghub.elsevier.com/retrieve/pii/S0360131518300423
• BOGNAR, Branko; SABLIĆ, Marija y ŠKUGOR, Alma. Flipped Learning and Online Discussion in Higher Education Teaching. In: DANIELA, Linda (Ed.). Didactics of Smart Pedagogy. Cham: Springer International Publishing, 2019. p. 371-392. DOI: 10.1007/978-3-030-01551-0_19. Disponible en: <Disponible en: http://link.springer.com/10.1007/978-3-030-01551-0_19 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1007/978-3-030-01551-0_19» http://link.springer.com/10.1007/978-3-030-01551-0_19
• BORAO MORENO, Laura y PALAU MARTÍN, Ramon Félix. Análisis de la implementación de Flipped Classroom en las asignaturas instrumentales de 4º Educación Secundaria Obligatoria. Edutec. Revista Electrónica de Tecnología Educativa, n. 55, mar. 2016. DOI: 10.21556/edutec.2016.55.733. Disponible en: <Disponible en: http://www.edutec.es/revista/index.php/edutec-e/article/view/733 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.21556/edutec.2016.55.733» http://www.edutec.es/revista/index.php/edutec-e/article/view/733
• BRAVO, Isabel del Arco; ALARCIA, Óscar Flores y GARCÍA, Patricia Silva. El desarrollo del modelo flipped classroom en la universidad: impacto de su implementación desde la voz del estudiantado. Revista de Investigación Educativa, v. 37, n. 2, p. 451-469, jun. 2019. DOI: 10.6018/rie.37.2.327831. Disponible en: <Disponible en: https://revistas.um.es/rie/article/view/327831 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.6018/rie.37.2.327831» https://revistas.um.es/rie/article/view/327831
• CABI, Emine. The Impact of the Flipped Classroom Model on Students’ Academic Achievement. The International Review of Research in Open and Distributed Learning, v. 19, n. 3, jul. 2018. DOI: 10.19173/irrodl.v19i3.3482. Disponible en: <Disponible en: http://www.irrodl.org/index.php/irrodl/article/view/3482 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.19173/irrodl.v19i3.3482» http://www.irrodl.org/index.php/irrodl/article/view/3482
• CASTELLANOS SÁNCHEZ, Almudena; SÁNCHEZ ROMERO, Cristina y CALDERERO HERNÁNDEZ, José Fernando. Nuevos modelos tecnopedagógicos. Competencia digital de los alumnos universitarios. Revista Electrónica de Investigación Educativa, v. 19, n. 1, pág. 1, ene. 2017. DOI: 10.24320/redie.2017.19.1.1148. Disponible en: <Disponible en: http://redie.uabc.mx/redie/article/view/1148 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.24320/redie.2017.19.1.1148» http://redie.uabc.mx/redie/article/view/1148
• CHEN, Chun-Kuei; HUANG, Neng-Tang Norman y HWANG, Gwo-Jen. Findings and implications of flipped science learning research: A review of journal publications. Interactive Learning Environments, p. 1-18, nov. 2019. DOI: 10.1080/10494820.2019.1690528. Disponible en: <Disponible en: https://www.tandfonline.com/doi/full/10.1080/10494820.2019.1690528 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1080/10494820.2019.1690528» https://www.tandfonline.com/doi/full/10.1080/10494820.2019.1690528
• CHEN, Yunglung; WANG, Yuping y col. Is FLIP enough? Or should we use the FLIPPED model instead? Computers & Education , v. 79, p. 16-27, oct. 2014. ISSN 03601315. DOI: 10.1016/j.compedu.2014.07.004. Disponible en: <Disponible en: https://linkinghub.elsevier.com/retrieve/pii/S0360131514001559 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1016/j.compedu.2014.07.004» https://linkinghub.elsevier.com/retrieve/pii/S0360131514001559
• CHYR, Wen-Li y col. Exploring the Effects of Online Academic HelpSeeking and Flipped Learning on Improving Students’ Learning. Educational Technology & Society, v. 20, n. 3, p. 11-23, 2017. Disponible en: <https://pdfs.semanticscholar.org/9431/67d5104f67c9ce4361e07332ef784a3c27a2.pdf>.
  » https://pdfs.semanticscholar.org/9431/67d5104f67c9ce4361e07332ef784a3c27a2.pdf
• COBO, M.J. y col. Science mapping software tools: Review, analysis, and cooperative study among tools. Journal of the American Society for Information Science and Technology, v. 62, n. 7, p. 1382-1402, jul. 2011. DOI: 10.1002/asi.21525. Disponible en: <Disponible en: http://doi.wiley.com/10.1002/asi.21525 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1002/asi.21525» http://doi.wiley.com/10.1002/asi.21525
• DELOZIER, Sarah J. y RHODES, Matthew G. Flipped Classrooms: a Review of Key Ideas and Recommendations for Practice. Educational Psychology Review, v. 29, n. 1, p. 141-151, mar. 2017. DOI: 10.1007/s10648-015-9356-9. Disponible en: <Disponible en: https://doi.org/10.1007/s10648-015-9356-9 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1007/s10648-015-9356-9» https://doi.org/10.1007/s10648-015-9356-9
• EL MIEDANY, Yasser. Flipped Learning. In: RHEUMATOLOGY Teaching. Cham: Springer International Publishing , 2019. p. 285-303. DOI: 10.1007/978-3-319-98213-7_15. Disponible en: <Disponible en: http://link.springer.com/10.1007/978-3-319-98213-7_15 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1007/978-3-319-98213-7_15» http://link.springer.com/10.1007/978-3-319-98213-7_15
• FISHER, Rosemary y col. Flipped learning, flipped satisfaction, getting the balance right. Teaching & Learning Inquiry, v. 5, n. 2, pág. 114, sep. 2017. DOI: 10.20343/teachlearninqu.5.2.9. Disponible en: <Disponible en: https://journalhosting.ucalgary.ca/index.php/tli/article/view/57358 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.20343/teachlearninqu.5.2.9» https://journalhosting.ucalgary.ca/index.php/tli/article/view/57358
• FROEHLICH, Dominik Emanuel. Non-Technological Learning Environments in a Technological World: Flipping Comes To The Aid. Journal of New Approaches in Educational Research, v. 7, n. 2, p. 88-92, jul. 2018. DOI: 10.7821/naer.2018.7.304. Disponible en: <Disponible en: https://naerjournal.ua.es/article/view/v7n2-2 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.7821/naer.2018.7.304» https://naerjournal.ua.es/article/view/v7n2-2
• HE, Wenliang y col. The effects of flipped instruction on out-of-class study time, exam performance, and student perceptions. Learning and Instruction, v. 45, p. 61-71, oct. 2016. DOI: 10.1016/j.learninstruc.2016.07.001. Disponible en: <Disponible en: https://linkinghub.elsevier.com/retrieve/pii/S0959475216300664 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1016/j.learninstruc.2016.07.001» https://linkinghub.elsevier.com/retrieve/pii/S0959475216300664
• HINOJO LUCENA, Francisco J. y col. Influencia del aula invertida en el rendimiento académico. Una revisión sistemática. Campus Virtuales, v. 8, n. 1, p. 9-18, 2019. Disponible en: <http://www.uajournals.com/campusvirtuales/journal/14/1.pdf>.
  » http://www.uajournals.com/campusvirtuales/journal/14/1.pdf
• HINOJO-LUCENA, Francisco y col. Incidence of the Flipped Classroom in the Physical Education Students’ Academic Performance in University Contexts. Sustainability, v. 10, n. 5, pág. 1334, abr. 2018. DOI: 10.3390/su10051334. Disponible en: <Disponible en: http://www.mdpi.com/2071-1050/10/5/1334 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.3390/su10051334» http://www.mdpi.com/2071-1050/10/5/1334
• HIRSCH, J. E. An index to quantify an individual’s scientific research output. Proceedings of the National Academy of Sciences, v. 102, n. 46, p. 16569-16572, nov. 2005. DOI: 10.1073/pnas.0507655102. Disponible en: <Disponible en: http://www.pnas.org/cgi/doi/10.1073/pnas.0507655102 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1073/pnas.0507655102» http://www.pnas.org/cgi/doi/10.1073/pnas.0507655102
• HUANG, Biyun; HEW, Khe Foon y LO, Chung Kwan. Investigating the effects of gamification-enhanced flipped learning on undergraduate students’ behavioral and cognitive engagement. Interactive Learning Environments, v. 27, n. 8, p. 1106-1126, nov. 2019. DOI: 10.1080/10494820.2018.1495653. Disponible en: <Disponible en: https://www.tandfonline.com/doi/full/10.1080/10494820.2018.1495653 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1080/10494820.2018.1495653» https://www.tandfonline.com/doi/full/10.1080/10494820.2018.1495653
• HWANG, Gwo-Jen; LAI, Chiu-Lin y WANG, Siang-Yi. Seamless flipped learning: a mobile technology-enhanced flipped classroom with effective learning strategies. Journal of Computers in Education, v. 2, n. 4, p. 449-473, dic. 2015. DOI: 10.1007/s40692-015-0043-0. Disponible en: <Disponible en: http://link.springer.com/10.1007/s40692-015-0043-0 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1007/s40692-015-0043-0» http://link.springer.com/10.1007/s40692-015-0043-0
• KAZANIDIS, Ioannis y col. Can the flipped classroom model improve students’ academic performance and training satisfaction in Higher Education instructional media design courses? British Journal of Educational Technology, v. 50, n. 4, p. 2014-2027, jul. 2019. DOI: 10.1111/bjet.12694. Disponible en: <Disponible en: https://onlinelibrary.wiley.com/doi/abs/10.1111/bjet.12694 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1111/bjet.12694» https://onlinelibrary.wiley.com/doi/abs/10.1111/bjet.12694
• KOSTARIS, Christoforos y col. Investigating the potential of the Flipped Classroom Model in K-12 ICT teaching and learning: an action research study. Educational Technology & Society , v. 20, n. 1, p. 261-273, 2017.
• KWON, Jung Eon y WOO, Hyung Rok. The impact of Flipped Learning on cooperative and competitive mindsets. Sustainability , v. 10, n. 1, p. 1-15, 2018. ISSN https://doi.org/10.3390/su10010079 DOI: 10.3390/su10010079.
  » https://doi.org/10.3390/su10010079» https://doi.org/10.3390/su10010079
• LEE, Jihyun; LIM, Cheolil y KIM, Hyeonsu. Development of an instructional design model for flipped learning in higher education. Educational Technology Research and Development, v. 65, n. 2, p. 427-453, abr. 2017. DOI: 10.1007/s11423-016-9502-1. Disponible en: <Disponible en: http://link.springer.com/10.1007/s11423-016-9502-1 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1007/s11423-016-9502-1» http://link.springer.com/10.1007/s11423-016-9502-1
• LEE, Jihyun; PARK, Taejung y DAVIS, Robert Otto. What affects learner engagement in flipped learning and what predicts its outcomes?: FL engagement and outcomes. British Journal of Educational Technology , nov. 2018. DOI: 10.1111/bjet.12717. Disponible en: <Disponible en: http://doi.wiley.com/10.1111/bjet.12717 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1111/bjet.12717» http://doi.wiley.com/10.1111/bjet.12717
• LLANOS GARCIA, Gonzalo y BRAVO-AGAPITO, Javier. Flipped classroom como puente hacia nuevos retos en la educación primaria. Revista Tecnología, Ciencia y Educación, n. 8, p. 39-49, 2019. Disponible en: <http://www.revistasocitec.org/index.php/TCE/article/download/153/125>.
  » http://www.revistasocitec.org/index.php/TCE/article/download/153/125
• LONG, Taotao; CUMMINS, John y WAUGH, Michael. Use of the flipped classroom instructional model in higher education: instructors’ perspectives. Journal of Computing in Higher Education, v. 29, n. 2, p. 179-200, ago. 2017. DOI: 10.1007/s12528-016-9119-8. Disponible en: <Disponible en: http://link.springer.com/10.1007/s12528-016-9119-8 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1007/s12528-016-9119-8» http://link.springer.com/10.1007/s12528-016-9119-8
• LÓPEZ-BELMONTE, Jesús; MORENO-GUERRERO, Antonio-José y col. Analysis of the Productive, Structural, and Dynamic Development of Augmented Reality in Higher Education Research on the Web of Science. Applied Sciences, v. 9, n. 24, pág. 5306, dic. 2019b. DOI: 10.3390/app9245306. Disponible en: <Disponible en: https://www.mdpi.com/2076-3417/9/24/5306 >. Acceso en: 12 mar. 2021.
  » https://doi.org/10.3390/app9245306» https://www.mdpi.com/2076-3417/9/24/5306
• LÓPEZ-BELMONTE, Jesús ; POZO SÁNCHEZ, Santiago y col. Creación de contenidos y flipped learning: un binomio necesario para la educación del nuevo milenio. Revista Española de Pedagogía, v. 77, n. 274, p. 535-555, sep. 2019. DOI: 10.22550/REP77-3-2019-07. Disponible en: <Disponible en: https://revistadepedagogia.org/lxxvii/no-274/creacion-de-contenidos-y-flipped-learning-un-binomio-necesario-para-la-educacion-del-nuevo-milenio/101400075517/ >. Acceso en: 12 mar. 2021.
  » https://doi.org/10.22550/REP77-3-2019-07» https://revistadepedagogia.org/lxxvii/no-274/creacion-de-contenidos-y-flipped-learning-un-binomio-necesario-para-la-educacion-del-nuevo-milenio/101400075517/
• LÓPEZ-ROBLES, José-Ricardo y col. El profesional de la información (EPI): Bibliometric and thematic analysis (2006-2017). El Profesional de la Información, v. 28, n. 4, ago. 2019. DOI: 10.3145/epi.2019.jul.17. Disponible en: <Disponible en: https://revista.profesionaldelainformacion.com/index.php/EPI/article/view/epi.2019.jul.17 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.3145/epi.2019.jul.17» https://revista.profesionaldelainformacion.com/index.php/EPI/article/view/epi.2019.jul.17
• MACLEOD, Jason y col. Technological factors and student-to-student connected classroom climate in cloud classrooms. Journal of Educational Computing Research, v. 56, n. 6, p. 826-847, oct. 2018. DOI: 10.1177/0735633117733999. Disponible en: <Disponible en: http://journals.sagepub.com/doi/10.1177/0735633117733999 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1177/0735633117733999» http://journals.sagepub.com/doi/10.1177/0735633117733999
• MARTÍNEZ, Ma Angeles y col. Analyzing the Scientific Evolution of Social Work Using Science Mapping. Research on Social Work Practice, v. 25, n. 2, p. 257-277, mar. 2015. DOI: 10.1177/1049731514522101. Disponible en: <Disponible en: http://journals.sagepub.com/doi/10.1177/1049731514522101 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1177/1049731514522101» http://journals.sagepub.com/doi/10.1177/1049731514522101
• MCLAUGHLIN, Jacqueline E. y col. The Flipped Classroom: a course redesign to foster learning and engagement in a health professions school. Academic Medicine, v. 89, n. 2, p. 236-243, feb. 2014. DOI: 10.1097/ACM.0000000000000086. Disponible en: <Disponible en: http://journals.lww.com/00001888-201402000-00017 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1097/ACM.0000000000000086» http://journals.lww.com/00001888-201402000-00017
• MCNALLY, Brenton y col. Flipped classroom experiences: student preferences and flip strategy in a higher education context. Higher Education, v. 73, n. 2, p. 281-298, feb. 2017. DOI: 10.1007/s10734-016-0014-z. Disponible en: <Disponible en: http://link.springer.com/10.1007/s10734-016-0014-z >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1007/s10734-016-0014-z» http://link.springer.com/10.1007/s10734-016-0014-z
• MINGORANCE ESTRADA, Ángel Custodio y col. Mejora del rendimiento académico a través de la metodología de aula invertida centrada en el aprendizaje activo del estudiante universitario deficiencias de la educación. Journal of Sport and Health Research, v. 9, n. 1, p. 129-136, 2017. Disponible en: <http://www.journalshr.com/papers/Vol%5C%209_suplemento/JSHR%5C%20V09_supl_05.pdf>.
  » http://www.journalshr.com/papers/Vol%5C%209_suplemento/JSHR%5C%20V09_supl_05.pdf
• MIÑO-PUIGCERCÓS, Raquel; DOMINGO-COSCOLLOLA, María y SANCHO-GIL, Juana M. Transforming the teaching and learning culture in higher education from a DIY perspective. Educación XX1, v. 22, n. 1, nov. 2018. DOI: 10.5944/educxx1.20057. Disponible en: <Disponible en: http://revistas.uned.es/index.php/educacionXX1/article/view/20057 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.5944/educxx1.20057» http://revistas.uned.es/index.php/educacionXX1/article/view/20057
• MOK, Heng Ngee. Teaching tip: the Flipped Classroom. Journal of Information Systems Education, v. 25, n. 1, p. 7-11, 2014. Disponible en: <https://ink.library.smu.edu.sg/cgi/viewcontent.cgi?referer=https://scholar.google.com/&httpsredir=1&article=3363&context=sis_research>.
  » https://ink.library.smu.edu.sg/cgi/viewcontent.cgi?referer=https://scholar.google.com/&httpsredir=1&article=3363&context=sis_research
• MORTENSEN, C. J. y NICHOLSON, A. M. The flipped classroom stimulates greater learning and is a modern 21st century approach to teaching today’s undergraduates. Journal of Animal Science, v. 93, n. 7, p. 3722-3731, jul. 2015. DOI: 10.2527/jas.2015-9087. Disponible en: <Disponible en: https://academic.oup.com/jas/article/93/7/3722/4701924 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.2527/jas.2015-9087» https://academic.oup.com/jas/article/93/7/3722/4701924
• NOURI, Jalal. The flipped classroom: for active, effective and increased learning - especially for low achievers. International Journal of Educational Technology in Higher Education , v. 13, n. 1, pág. 33, dic. 2016. DOI: 10.1186/s41239-016-0032-z. Disponible en: <Disponible en: http://educationaltechnologyjournal.springeropen.com/articles/10.1186/s41239-016-0032-z >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1186/s41239-016-0032-z» http://educationaltechnologyjournal.springeropen.com/articles/10.1186/s41239-016-0032-z
• PEREIRA, Sara; FILLOL, Joana y MOURA, Pedro. Young people learning from digital media outside of school: The informal meets the formal. Comunicar, v. 27, n. 58, p. 41-50, ene. 2019. DOI: 10.3916/C58-2019-04. Disponible en: <Disponible en: https://www.revistacomunicar.com/index.php?contenido=detalles№=58&articulo=58-2019-04 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.3916/C58-2019-04» https://www.revistacomunicar.com/index.php?contenido=detalles№=58&articulo=58-2019-04
• ROMERO, María del Carmen; BUZÓN-GARCÍA, Olga y TOURON, Javier. The flipped learning model in online based education for secondary teachers. Journal of Technology and Science Education, v. 9, n. 2, pág. 109, mar. 2019. DOI: 10.3926/jotse.435. Disponible en: <Disponible en: http://www.jotse.org/index.php/jotse/article/view/435 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.3926/jotse.435» http://www.jotse.org/index.php/jotse/article/view/435
• SACRISTÁN SAN CRISTÓBAL, Mara y col. Flipped classroom y didáctica de las matemáticas en la formación online de Maestros de Educación Infantil. Revista Electrónica Interuniversitaria de Formación del Profesorado, v. 20, n. 3, pág. 1, jul. 2017. DOI: 10.6018/reifop.20.3.292551. Disponible en: <Disponible en: http://revistas.um.es/reifop/article/view/292551 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.6018/reifop.20.3.292551» http://revistas.um.es/reifop/article/view/292551
• SHIH, Wen-Ling y TSAI, Chun-Yen. Students’ perception of a flipped classroom approach to facilitating online project-based learning in marketing research courses. Australasian Journal of Educational Technology, dic. 2016. DOI: 10.14742/ajet.2884. Disponible en: <Disponible en: http://ajet.org.au/index.php/AJET/article/view/2884 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.14742/ajet.2884» http://ajet.org.au/index.php/AJET/article/view/2884
• SOLA MARTÍNEZ, Tomás y col. Eficacia del Método Flipped Classroom en la universidad: meta-análisis de la producción científica de impacto. REICE. Revista Iberoamericana sobre Calidad, Eficacia y Cambio en Educación, v. 17, n. 1, pág. 25, dic. 2019. DOI: 10.15366/reice2019.17.1.002. Disponible en: <Disponible en: https://revistas.uam.es/index.php/reice/article/view/10432 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.15366/reice2019.17.1.002» https://revistas.uam.es/index.php/reice/article/view/10432
• THAI, Ngoc Thuy Thi; DE WEVER, Bram y VALCKE, Martin. The impact of a flipped classroom design on learning performance in higher education: Looking for the best “blend” of lectures and guiding questions with feedback. Computers & Education , v. 107, p. 113-126, abr. 2017. DOI: 10.1016/j.compedu.2017.01.003. Disponible en: <Disponible en: https://linkinghub.elsevier.com/retrieve/pii/S0360131517300039 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1016/j.compedu.2017.01.003» https://linkinghub.elsevier.com/retrieve/pii/S0360131517300039
• TOURÓN, Javier y SANTIAGO, Raúl. El modelo Flipped learning y el desarrollo del talento en la escuela. Revista de educación, n. 368, p. 196-231, 2015. Disponible en: <https://sede.educacion.gob.es/publiventa/detalle.action?cod=20325>.
  » https://sede.educacion.gob.es/publiventa/detalle.action?cod=20325
• TSE, Wai S.; CHOI, Lai Y. A. y TANG, Wing S. Effects of video-based flipped class instruction on subject reading motivation: Flipped class instruction. British Journal of Educational Technology , v. 50, n. 1, p. 385-398, ene. 2019. DOI: 10.1111/bjet.12569. Disponible en: <Disponible en: http://doi.wiley.com/10.1111/bjet.12569 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1111/bjet.12569» http://doi.wiley.com/10.1111/bjet.12569
• UNIVERSITY OF OTAGO WELLINGTON, NEW ZEALAND y col. “Just tell me what I need to know to pass the exam!” Can active flipped learning overcome passivity? The Asia Pacific Scholar, v. 2, n. 1, p. 1-6, ene. 2017. DOI: 10.29060/TAPS.2017-2-1/OA1007. Disponible en: <Disponible en: https://medicine.nus.edu.sg/taps/just-tell-me-what-i-need-to-know-to-pass-the-exam-can-active-flipped-learning-overcome-passivity/ >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.29060/TAPS.2017-2-1/OA1007» https://medicine.nus.edu.sg/taps/just-tell-me-what-i-need-to-know-to-pass-the-exam-can-active-flipped-learning-overcome-passivity/
• WU, Wen-Chi Vivian; HSIEH, Jun Scott Chen y YANG, Jie Chi. Creating an online Learning community in a Flipped Classroom to enhance EFL learners’ Oral Proficiency. Educational Technology & Society , v. 20, n. 2, p. 142-157, 2017. Disponible en: <https://eric.ed.gov/?id=EJ1137524>.
  » https://eric.ed.gov/?id=EJ1137524
• YILMAZ, Ramazan. Exploring the role of e-learning readiness on student satisfaction and motivation in flipped classroom. Computers in Human Behavior, v. 70, p. 251-260, mayo 2017. DOI: 10.1016/j.chb.2016.12.085. Disponible en: <Disponible en: https://linkinghub.elsevier.com/retrieve/pii/S0747563216309141 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.1016/j.chb.2016.12.085» https://linkinghub.elsevier.com/retrieve/pii/S0747563216309141
• YOSHIDA, Hiroki. Perceived usefulness of ”Flipped Learning” on instructional design for elementary and secondary education: with focus on pre-service Teacher education. International Journal of Information and Education Technology, v. 6, n. 6, p. 430-434, 2016. DOI: 10.7763/IJIET.2016.V6.727. Disponible en: <Disponible en: http://www.ijiet.org/show-73-816-1.html >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.7763/IJIET.2016.V6.727» http://www.ijiet.org/show-73-816-1.html
• ZAINUDDIN, Zamzami y col. How do students become self-directed learners in the EFL flipped-class pedagogy? A study in higher education. Indonesian Journal of Applied Linguistics, v. 8, n. 3, pág. 678, ene. 2019. DOI: 10.17509/ijal.v8i3.15270. Disponible en: <Disponible en: http://ejournal.upi.edu/index.php/IJAL/article/view/15270 >. Acceso en: 5 mar. 2021.
  » https://doi.org/10.17509/ijal.v8i3.15270» http://ejournal.upi.edu/index.php/IJAL/article/view/15270

Edited by

Editado por:

Daniervelin Pereira

Publication Dates

• Publication in this collection
  27 June 2022
• Date of issue
  2021

History

• Received
  15 Nov 2020
• Accepted
  07 Jan 2021
• Published
  12 Mar 2021