Acessibilidade / Reportar erro

PROTOCOL FOR THE ASSESSMENT OF INDIVIDUAL TACTICAL BEHAVIOR (PADTI) - VALIDATION AND REPRODUCIBILITY: PRELIMINARY EVIDENCE

PROTOCOLO DE AVALIAÇÃO DO DESEMPENHO TÁTICO INDIVIDUAL (PADTI) - VALIDAÇÃO E REPRODITIBLIDADE: EVIDÊNCIAS PRELIMINARES

ABSTRACT

In order to carry out the process of validation and reproducibility of the Protocol for the Assessment of Individual Tactical Behavior of Soccer athletes (PADTI), a study was carried out divided into three stages: I) preparation of the PADTI; II) logical, content and construct validation and; III) reproducibility. The PADTI was developed based on the 8 fundamental tactical principles of soccer, which were inserted in a Microsoft Excel® spreadsheet, used to collect, store and process the tactical actions of soccer players during the game. The PADTI validity process was performed by 8 professionals, using a spreadsheet to account for items using a Likert scale (5 points). Reproducibility was carried out in two moments with an interval of 15 days, using as a sample the tactical behaviors of the athletes of the Brazilian team, during a soccer match of the 2018 world cup. validity (IV) of 90%. There were no significant differences between the responses of the evaluators (χ² = 12.199; p = 0.094). The intraclass correlation (ICC) values were greater than 0.814 (CI: 95%: 0.251 - 0.954; p <0.001) and Cronbach's Alpha values were greater than α = 0.814. The results indicated that the PADTI is a valid and useful methodology for assessing the tactical performance of soccer players in a game situation.

Keywords:
Tactical behavior in soccer, Tactical principles in soccer; Evaluation of tactical principles in soccer

RESUMO

Com o objetivo de realizar o processo de validação e reprodutibilidade do Protocolo de Avaliação do Comportamento Tático Individual de atletas de Futebol (PADTI), foi realizado um estudo dividido em três etapas: I) elaboração do PADTI; II) validação lógica, de conteúdo e constructo e; III) reprodutibilidade. O PADTI foi elaborado com base nos 8 princípios táticos fundamentais do futebol, os quais foram inseridos em uma planilha do programa Microsoft Excel®, utilizada para coletar, armazenar e processar as ações táticas dos atletas de futebol durante o jogo. O processo de validade do PADTI, foi realizado por 8 profissionais, por meio de uma planilha para contabilizar os itens utilizando-se de uma escala likert (5 pontos). A reprodutibilidade foi realizada em dois momentos com intervalo de 15 dias, utilizando como amostra os comportamentos táticos dos atletas da seleção brasileira, durante uma partida de futebol da copa do mundo de 2018. O PADTI foi aprovado pela maioria dos avaliadores especialistas, com índice de validade (IV) de 90%. Não foram observadas diferenças significantes entre as repostas dos avaliadores (χ²=12,199; p = 0,094). Os valores de correlação intraclasse (ICC) foram superiores a 0,814 (IC: 95%: 0,251 - 0,954; p< 0,001) e os valores de Alpha de Cronbach foram superiores a α= 0,814. Os resultados indicaram que o PADTI é uma metodologia válida e útil para avaliação do desempenho tático de atletas de futebol em situação de jogo.

Palavras-chave:
Comportamento tático no futebol, Princípios táticos no futebol; Avaliação de princípios táticos no futebol

Introduction

The evolution and organization process of soccer has influenced decisively its practice around the world. This way, as a result of this evolution process, game analysis provides important data on collective and individual actions of athletes on the field11. Lago C. The influence of match location, quality of opposition, and match status on possession strategies in professional association football. J Sports Sci. 2009;27(13):1463-9. DOI: 10.1080/02640410903131681
https://doi.org/10.1080/0264041090313168...
),(22. Praça GM, Lima BB, Bredt S da GT, Clemente FM, Andrade AGP de. Influence of match status on players’ prominence and teams’ network properties during 2018 FIFA World Cup. Front Psychol. 2019;10: 695. 110.3389/fpsyg.2019.00695
https://doi.org/110.3389/fpsyg.2019.0069...
, contributing to identification of success factors for teams and athletes11. Lago C. The influence of match location, quality of opposition, and match status on possession strategies in professional association football. J Sports Sci. 2009;27(13):1463-9. DOI: 10.1080/02640410903131681
https://doi.org/10.1080/0264041090313168...
),(22. Praça GM, Lima BB, Bredt S da GT, Clemente FM, Andrade AGP de. Influence of match status on players’ prominence and teams’ network properties during 2018 FIFA World Cup. Front Psychol. 2019;10: 695. 110.3389/fpsyg.2019.00695
https://doi.org/110.3389/fpsyg.2019.0069...
),(33. Lepschy H, Wäsche H, Woll A. Success factors in football: an analysis of the German Bundesliga. Int J Perform Anal Sport. 2020;20(2):150-64. DOI:10.1080/24748668.2020.1726157
https://doi.org/10.1080/24748668.2020.17...
),(44. Fernandez-Navarro J, Fradua L, Zubillaga A, Ford PR, McRobert AP. Attacking and defensive styles of play in football: analysis of Spanish and English elite teams. J Sports Sci. 2016;34(24):2195-204. 110.1080/02640414.2016.1169309
https://doi.org/110.1080/02640414.2016.1...
),(55. Pratas J, Volossovitch A, P Ferreira A. The Effect of Situational Variables on Teams’ Performance in Offensive Sequences Ending in a Shot on Goal. A Case Study. Open Sports Sci J. 2012[cited on03.15.2022];5(1). Available from: Available from: https://opensportssciencesjournal.com/VOLUME/5/PAGE/193/PDF/
https://opensportssciencesjournal.com/VO...
),(66. Pollard R, Armatas V. Factors affecting home advantage in football World Cup qualification. Int J Perform Anal Sport. 2017;17(1-2):121-35. DOI:10.1080/24748668.2017.1304031
https://doi.org/10.1080/24748668.2017.13...
),(77. Maleki M, Dadkhah K, Alahvisi F. Ball recovery consistency as a performance indicator in elite football. Rev bras Cineantropom Desempenho Hum. 2016;18(1):72-8. DOI:10.5007/1980-0037.2016v18n1p72
https://doi.org/10.5007/1980-0037.2016v1...
.

Initially, researches on athletes’ performance during matches aimed at their individual technical and tactical actions, but as of the 80s, research shifted focus to collective tactical behaviors88. García López LM, González Víllora S, Gutiérrez D, Serra J. Development and validation of the Game Performance Evaluation Tool (GPET) in football. Sport TK. 2013[cited on03.15.2022]; 2 (1): 89-99. Available from:Available from:https://digitum.um.es/xmlui/bitstream/10201/40003/1/185791-673431-1-SM.pdf
https://digitum.um.es/xmlui/bitstream/10...
. In this sense, over the last few years, there was a significant increase in the volume of studies on the tactical behaviors of soccer players99. Borges PH, Guilherme J, Rechenchosky L, da Costa LCA, Rinadi W. Fundamental tactical principles of football: a comparison of different age groups. J Hum Kinet. 2017; 58:207. 110.1515/hukin-2017-0078
https://doi.org/110.1515/hukin-2017-0078...
),(1010. Correia da Silva D, Teoldo da Costa V, Casanova F, Manuel Clemente F, Teoldo I. Comparison between teams of different ranks in small-sided and conditioned games tournaments. Int J Perform Anal Sport. 2019;19(4):608-23. DOI:10.1080/24748668.2019.1643598
https://doi.org/10.1080/24748668.2019.16...
, evidencing the interest of researchers and coaches in better understanding the moves and movements that occur with and without the ball during a soccer game44. Fernandez-Navarro J, Fradua L, Zubillaga A, Ford PR, McRobert AP. Attacking and defensive styles of play in football: analysis of Spanish and English elite teams. J Sports Sci. 2016;34(24):2195-204. 110.1080/02640414.2016.1169309
https://doi.org/110.1080/02640414.2016.1...
),(1111. Clemente FM, Martins FML, Kalamaras D, Wong PD, Mendes RS. General network analysis of national football teams in FIFA World Cup 2014. Int J Perform Anal Sport. 2015;15(1):80-96. 110.1080/24748668.2015.11868778
https://doi.org/110.1080/24748668.2015.1...
.

Thus, as a natural evolution arising from the curiosity of coaches and researchers on this topic, several strategies and instruments were developed to assess the individual and collective tactical behavior of soccer players, such as protocols in closed environment or laboratories1212. Hackfort D, Kilgallen C, Hao L. The Action Theory-Based Mental Test and Training System (MTTS). In: Psychology of Sport Excellence [Internet]. 2009[cited on 03.15.2022]. p. 15-24. Available from: Available from: https://www.researchgate.net/publication/353237269
https://www.researchgate.net/publication...
, reduced width and length games 1313. Oslin JL, Mitchell SA, Griffin LL. The game performance assessment instrument (GPAI): Development and preliminary validation. J Teach Phys Educ. 1998;17(2):231-43. 110.1123/jtpe.27.2.220
https://doi.org/110.1123/jtpe.27.2.220...
),(1414. Costa IT da, Garganta J, Greco PJ, Mesquita I. Proposta de avaliação do comportamento tático de jogadores de Futebol baseada em princípios fundamentais do jogo. Motriz rev. educ. fís. 2011[cited on 03.15.2022];17(3):511-24. Available from: Available from: https://www.scielo.br/j/motriz/a/M8CWpR4z8JxgQxQvtKS8LJn/?lang=pt
https://www.scielo.br/j/motriz/a/M8CWpR4...
),(1515. Van Maarseveen MJ, Oudejans RR, Savelsbergh GJ. System for notational analysis in small-sided football games. Int J Sports Sci Coach. 2017;12(2):194-206. 110.1177/1747954117694922
https://doi.org/110.1177/174795411769492...
) and even game situation analysis88. García López LM, González Víllora S, Gutiérrez D, Serra J. Development and validation of the Game Performance Evaluation Tool (GPET) in football. Sport TK. 2013[cited on03.15.2022]; 2 (1): 89-99. Available from:Available from:https://digitum.um.es/xmlui/bitstream/10201/40003/1/185791-673431-1-SM.pdf
https://digitum.um.es/xmlui/bitstream/10...
),(1616. Grehaigne J-F, Godbout P, Bouthier D. Performance assessment in team sports. J Teach Phys Educ. 1997;16(4):500-16. DOI:10.1123/jtpe.16.4.500
https://doi.org/10.1123/jtpe.16.4.500...
. An example of these protocols is the FUT-SAT1414. Costa IT da, Garganta J, Greco PJ, Mesquita I. Proposta de avaliação do comportamento tático de jogadores de Futebol baseada em princípios fundamentais do jogo. Motriz rev. educ. fís. 2011[cited on 03.15.2022];17(3):511-24. Available from: Available from: https://www.scielo.br/j/motriz/a/M8CWpR4z8JxgQxQvtKS8LJn/?lang=pt
https://www.scielo.br/j/motriz/a/M8CWpR4...
, an instrument that assesses the tactical behavior of indoor soccer and soccer athletes, under the perspective of fundamental tactical principles, specifically during training, through small-sized games dispute99. Borges PH, Guilherme J, Rechenchosky L, da Costa LCA, Rinadi W. Fundamental tactical principles of football: a comparison of different age groups. J Hum Kinet. 2017; 58:207. 110.1515/hukin-2017-0078
https://doi.org/110.1515/hukin-2017-0078...
.

Notwithstanding the great usefulness of these instruments, as well as their contribution to understanding the game and the athletes' tactical behavior22. Praça GM, Lima BB, Bredt S da GT, Clemente FM, Andrade AGP de. Influence of match status on players’ prominence and teams’ network properties during 2018 FIFA World Cup. Front Psychol. 2019;10: 695. 110.3389/fpsyg.2019.00695
https://doi.org/110.3389/fpsyg.2019.0069...
),(99. Borges PH, Guilherme J, Rechenchosky L, da Costa LCA, Rinadi W. Fundamental tactical principles of football: a comparison of different age groups. J Hum Kinet. 2017; 58:207. 110.1515/hukin-2017-0078
https://doi.org/110.1515/hukin-2017-0078...
),(1010. Correia da Silva D, Teoldo da Costa V, Casanova F, Manuel Clemente F, Teoldo I. Comparison between teams of different ranks in small-sided and conditioned games tournaments. Int J Perform Anal Sport. 2019;19(4):608-23. DOI:10.1080/24748668.2019.1643598
https://doi.org/10.1080/24748668.2019.16...
),(1111. Clemente FM, Martins FML, Kalamaras D, Wong PD, Mendes RS. General network analysis of national football teams in FIFA World Cup 2014. Int J Perform Anal Sport. 2015;15(1):80-96. 110.1080/24748668.2015.11868778
https://doi.org/110.1080/24748668.2015.1...
, there is a gap in the scientific literature on the assessment of individual tactical behavior in a real game situation (without changing the structure of soccer games), specially using the fundamental tactical principles. In this sense, the objective of this study is to describe the preliminary procedures for the elaboration, validation and reproducibility of the Individual Tactical Behavior Assessment Protocol (PADTI) of soccer players in a game situation.

Methods

This work is as a descriptive and correlational study, with the purpose of carrying out the validation and reproducibility procedures of PADTI Protocol. The study has three stages: I) PADTI preparation; II) logic, content and construct validation, and; III) Test and Retest Reproducibility procedures, as shown in Figure 01.

Figure 01
Procedure flowchart

This work was prepared from concepts established in the scientific literature about the fundamental tactical principles of soccer1717. Bayer, C. O ensino dos desportos colectivos. 1st ed.Lisboa: Dinalivro, 1994.),(1818. Garganta J, Guilherme J, Barreira D, Brito J, Rebelo A. Fundamentos e práticas para o ensino e treino do futebol. In Tavares F (Ed), Jogos desportivos coletivos. Ensinar a jogar. Porto: FADEUP, 2013.),(1919. Costa IT da, Silva JMG da, Greco PJ, Mesquita I. Princípios táticos do jogo de futebol: conceitos e aplicação. Motriz. 2009[cited on 03.15.2022];657-68. Available from:Available from:https://www.periodicos.rc.biblioteca.unesp.br/index.php/motriz/article/view/2488/2534
https://www.periodicos.rc.biblioteca.une...
. Specialized literature on the topic was the basis for content validation, as well as the construct validation tried to identify how PADTI measures the hypothetical construct named individual tactical performance2020. Thomas JR, Nelson JK, Silverman SJ. Métodos de pesquisa em atividade física. 6st ed.Porto Alegre: Editora; 2009.. At this stage, an initial version of PADTI went under evaluation by an expert committee. For the validation procedures, the concepts of logic, content, and construct validity, and test and retest reproducibility assessed the intra-evaluator error.

Preparation of the Individual Tactical Behavior Assessment Protocol

PADTI was prepared with the central objective of analyzing the tactical performance of athletes throughout and through all actions in the match, to track and evaluate offensive and defensive actions during the entire time the ball is in play. The PADTI is based on fundamental tactical principles relating to collective sports games2121. Cabral F de A, Morales JCP, Alves KCR, Praça GM, Greco PJ. Validação de conteúdo do teste de conhecimento tático declarativo para o futsal. Rev Bras Ciênc Esporte. 2021; 43: e000520. 110.1590/rbce.43.e000520
https://doi.org/110.1590/rbce.43.e000520...
using 8 principles for tactical performance assessment of athletes in game situation, of which four are offensive (penetration, offensive coverage, depth mobility and width and length) and four defensive (delay, defensive coverage, balance and concentration). These principles were selected because they represent the internal logic of the soccer game, being fundamental to understand the dynamics and interactions composing the organization of a soccer game1717. Bayer, C. O ensino dos desportos colectivos. 1st ed.Lisboa: Dinalivro, 1994.),(1818. Garganta J, Guilherme J, Barreira D, Brito J, Rebelo A. Fundamentos e práticas para o ensino e treino do futebol. In Tavares F (Ed), Jogos desportivos coletivos. Ensinar a jogar. Porto: FADEUP, 2013.),(1919. Costa IT da, Silva JMG da, Greco PJ, Mesquita I. Princípios táticos do jogo de futebol: conceitos e aplicação. Motriz. 2009[cited on 03.15.2022];657-68. Available from:Available from:https://www.periodicos.rc.biblioteca.unesp.br/index.php/motriz/article/view/2488/2534
https://www.periodicos.rc.biblioteca.une...
.

The game structure (field measures and goals, number of athletes in the field and game time) used for performance analysis, in this assessment, is the same one used on FIFA and associated federations regulated games and championships. This way, the analysis of the athletes’ performance is the closest to the one found in the most important sports moment, i.e. competition, enabling the investigation of the athletes' actions with and without the ball, as they occur in this context.

PADTI was prepared with the Microsoft Excel® program, Figure 02 show the examples of initial screens of the instrument in that program. The instrument is composed of three spreadsheets that collect, store and process information related to the frequency of tactical actions performed by each player over a soccer game. In this spreadsheet, it is also possible to compute the time of actual participation of each athlete in the game, allowing the calculation of individual indexes. The tool is available for download at the following link: https://docs.google.com/spreadsheets/d/1Tt_OTIXAmH_o_GGgBZDI6m-ihCgtMa4X/edit?usp=sharing&ouid=109131047682870646375&rtpof=true&sd=true. (PADTI formulas do not work in the online version of Microsoft Excel software, it is necessary to download the file for the tool to work properly).

Figure 02
Organization of the Individual Tactical Behavior Assessment Protocol of Soccer athletes in the Microsoft Excel® program

The first spreadsheet contains data related to tactical actions based on Fundamental Offensive Tactical Principles (PTFO): Penetration, Offensive coverage, Depth mobility and Width and length. The second spreadsheet computes data related to tactical actions of the Fundamental Defensive Tactical Principles (PTFD): Delay, Defensive coverage, Balance and Concentration. Both spreadsheets have tags for easy viewing and data insertion at the time of analysis. Moreover, the spreadsheets have separate columns for actions performed and not performed assessed from the comparison of the actions of each player with a PADTI conceptualization sheet.

The third spreadsheet computes the time (minutes) of each player in the game, being divided in time where the team possesses the ball (considered as an offensive phase) and the time where the opposing team possesses the ball (defensive phase). In addition to those spreadsheets, PADTI has a conceptualization sheet and a list of formulas. The conceptualization sheet characterizes the tactical actions, and their relation with specific tactical principles, it is composed of eight specific tactical principles of soccer used in the assessment protocol. The purpose of this sheet is to frame each tactical action of the player evaluated and classify these actions into “Performed” and “Not Performed”, following the theoretical concepts related to each principle. The conceptualization sheet describes all characteristics that the actions must have, in order to have the best characterization as possible.

Complementarily, PADTI has a list of formulas necessary for the calculations of indexes generated by the protocol. The computing of the frequencies of each player's tactical actions and game time generates the Tactical Performance Index (IT), Offensive Performance Index (IO), Defensive Performance Index (ID), Total Tactical Actions per Minute (ATM), Offensive Tactical Actions per Minute (AOM), Defensive Tactical Actions per Minute (ADM) and Tactical Actions Not Performed per Minute (ANRM).

CHART 1
PADTI Index Calculation Formulas.

Tactical performance indices are calculated using a simple mathematical formula based on the arithmetic mean of tactical actions performed and not performed in relation to the total of defensive and offensive actions separately, considering the time that each athlete remained in the game, considering the different types of tactical actions performed (defensive and offensive) correctly and incorrectly.

PADTI Validation Procedures: logic, construct and content

The 17 soccer professionals with different academic titles (specialization, master’s and doctor’s degree) were invited for the PADTI validation procedure. From the professionals invited, 2 refused the invitation, and 7 failed to reply to the e-mail, and did not participate in the research. The PADTI’s content was assessed by a panel of Eight professionals, 4 of which were soccer professionals (with employment relation with teams of the Brazilian A Series Soccer Championship), 3 with master’s degree and 1 with doctor’s degree (with employment relation with Federal/State Universities). The evaluators declared to have between 5 and 20 years of experience with performance analysis in team sports. In addition, the group was divided into 2, since half of the evaluators showed greater proximity to theoretical concepts (masters and doctors who teach classes at universities) and the other half showed greater proximity to knowledge related to daily practice (working in clubs). Thus, the protocol evaluation was performed based on practical and theoretical knowledge, not prioritizing just one type.

The sample selection criteria and PADTI content evaluation procedures were similar to those applied in studies of the same nature2222. Alves MAR, Graça DCD, Travassos B. Construction and validation of an observation tool of the imbalance pass in futsal. Rev bras Cineantropom Desempenho Hum. 2022; 24; e77265. 110.1590/1980-0037.2022v24e77265
https://doi.org/110.1590/1980-0037.2022v...
),(2323. Clemente FM, Martins FML, Mendes RS, Figueiredo AJ. A systemic overview of football game: the principles behind the game. J Hum. Sport Exercise. 2014;9(2):656-67. 110.14198/jhse.2014.92.05
https://doi.org/110.14198/jhse.2014.92.0...
. All invitees signed the Free and Informed Term of Consent. The Ethics Committee of Universidade Tecnológica Federal do Paraná approved the project through opinion n. 2.063.607.

Logic, Construct and Content Validation

For the logic, construct and content validation procedures, the 8 soccer professionals previously selected, evaluated the PADTI. They received the material to proceed with the evaluations, which consisted of sheets and spreadsheets to compute the items assessed. In the evaluation process, the experts assessed 12 items using a 5-point Likert scale: 1 - Totally Inappropriate; 2 - Inappropriate; 3 - Partially Appropriate; 4 - Appropriate; and, 5 - Totally Appropriate. In addition to the scale score, the evaluators could make suggestions, comments and justifications related to the items evaluated, as a way to assist or improve each item assessed (the answers had no suggestions to change the protocol).

The items assessed were: Importance of tactical principles presented to tactical assessment in soccer; Importance of tactical principles presented in the training of soccer athletes; Definition and concepts of tactical principles; Application of concepts of each tactical principle; Conceptualization (performed and not performed) of tactical actions according to each principle; Number of athletes, field size and game time estimated for the assessment; Positioning of cameras in relation to the game field, and; Evaluation sheet.

Each item created relates to the contents of the analysis and conceptualization sheets, as well as the methodology used during the application of the protocol. Throughout this process, each evaluator received a document explaining the entire protocol utilization process, and, in case they had any doubts, they should be cured before the protocol evaluation.

After the evaluators’ analysis, we computed the Validity Index (IV) of each item in order to know whether it should suffer any alteration. For the item to be considered valid, it should obtain a minimum consensus of 75% of the total points each item could obtain, that is, it should score, at least, 30 points, in the sum of all grades from the evaluators. If an index fails to reach a minimum consensus, said index should be changed or reviewed, going through the validation process again until it reaches minimum consensus. The IV was calculated by the sum of the value of each concept given by the evaluators, (5 being “totally appropriate”, 4 “appropriate”, 3 “partially appropriate”, 2 “inappropriate” and 1 “totally inappropriate”).

Test and Retest Reproducibility Procedure and Reliability

For the instrument reliability evaluation, in relation to reproducibility and reliability, we intentionally selected 1 (one) 2018 World Cup game. The duration of the game was 97 minutes, divided into 6 parts, where T3: 17 minutes; T6: 20 minutes and the others 15 minutes each). In the first evaluation (test), we analyzed the entire game, and we observed 9377 (100%) tactical actions. The same evaluators carried out the second evaluation (retest), 15 days after the first evaluation. In this case, T1 was randomly selected, through a draw from the six parts previously divided of the game. After analysis, we computed 1662 tactical actions, representing 17% of the entire game. The same evaluator, who was already familiar with the analysis protocol, carried out all evaluations.

We analyzed all effective actions pursuant to concepts of fundamental tactical principles collected from the observation of recorded images of games broadcasted on open TV (public domain). The game was stored in a notebook (brand Acer Aspire E15) for later analysis. We projected the game recording in a monitor (brand AOC Sniper G60VQ6). The analysis referring to the test (observation of the entire game) had a duration of 9 hours. We performed the reproducibility analysis only in segment T1, which had a duration of approximately 1 hour and 30 minutes. The same observer analyzed the game in two different moments.

We transferred the PADTI spreadsheet data to the statistical software SPSS®️ version 25.0, and analyzed it according to descriptive statistics, considering the occurrence of offensive and defensive tactical principles, as well as individual tactical indexes. For the calculation of the intra-evaluator error and reliability indexes, we used the Intraclass Correlation Coefficient (ICC) and Cronbach’s alpha, respectively. We considered a statistical significance of p<0.05.

Results

Logic and content validation

After data tabulation, with analysis criteria previously defined, we carried out the analysis of the evaluations and suggestions recommended by the experts committee, the results were analyzed individually. Considering the total number of evaluators, we observed 61 evaluations classified as “Totally Appropriate”; 23 “Appropriate”; 11 “Partially Appropriate”; 1 “Inappropriate” and no evaluation classified as “Totally Inappropriate”.

Table 1
Validity indexes obtained by PADTI, pursuant to expert evaluation.

With a total 96 grades and the score of each concept, the protocol received 432 points from a total of 480, reaching a validity index (IV) of 90%. In relation to the concepts for each evaluated criteria, all concepts obtained indexes superior to 75% of approval from the evaluators, considered satisfactory. In addition, we used the Friedman test to verify the existence of significant differences between the responses of the evaluators in each concept; the test indicated that there was no statistically significant difference between the responses.

Intra-evaluator Reproducibility

The results found in the intra-evaluator reproducibility are in Table 2, showing that all indexes and principles have high intraclass correlation values (ICC), superior to 0.814 (IC: 95%: 0.251 - 0.954; p< 0.001) and inferior to 0.992 (IC 95%: 0.966 - 0.998; p< 0.001).

Table 2
Reproducibility indicators of tactical principles, total numbers and tactical performance assessment indexes (n=1662 tactical actions)

Discussion

The purpose of this study is to describe the preparation, validation and reproducibility preliminary procedures of the Individual Tactical Behavior Assessment Protocol (PADTI) for soccer athletes in game situation. The purpose of the PADTI is to analyze the defensive and offensive tactical principles of athletes as a method of assistance and control of individual and collective tactical performance in games and championships.

In the PADTI preparation and validation process, we adopted the main procedures recommended by the scientific literature in the area: logic, construct and content validation, as well as the reproducibility procedures and reliability2424. Barquero-Ruiz C, Arias-Estero, JL, Kirk D. Assessment for tactical learning in games: A systematic review. Eur Phy Educ Rev. 2020; 26(4); 827-847. 110.1177/1356336X19889649
https://doi.org/110.1177/1356336X1988964...
. In the validation process, from the 12 criteria evaluated, 11 showed an index equal or superior to 50% of the evaluations in the category “Very Appropriate”, showing that the protocol could be a useful tool in the evaluation of the tactical performance of players during soccer games. In addition, considering the evaluation in its entirety, the majority of the expert evaluators approved the PADTI (IV= 90%).

Other athletes tactical behavior evaluation protocols went through the same validation process during their preparation, such as the FUTSAT1414. Costa IT da, Garganta J, Greco PJ, Mesquita I. Proposta de avaliação do comportamento tático de jogadores de Futebol baseada em princípios fundamentais do jogo. Motriz rev. educ. fís. 2011[cited on 03.15.2022];17(3):511-24. Available from: Available from: https://www.scielo.br/j/motriz/a/M8CWpR4z8JxgQxQvtKS8LJn/?lang=pt
https://www.scielo.br/j/motriz/a/M8CWpR4...
, the Decision Making Assessment Instrument for soccer athletes2525. Copetti GL. Elaboração e validação preliminar de um instrumento de avaliação da tomada de decisão no futebol em situações reais [Dissertação]. [Brasília]: Universidade de Brasília; 2012., the tactical skills development profile for indoor soccer athletes2626. Guimarães LC. Perfil de desenvolvimento das habilidades táticas: validação preliminar da versão para avaliar jogadores de futsal [Dissertação]. [Brasília]: Universidade de Brasília; 2011., and the Technical-Tactical Performance Assessment Instrument (IAD-VB) for volleyball athletes2727. Collet C, Nascimento JV do, Ramos V, Stefanello JMF. Construção e validação do instrumento de avaliação do desempenho técnico-tático no voleibol. Rev bras Cineantropom Desempenho Hum. 2011;13(1):43-51. 110.5007/1980-0037.2011v13n1p43
https://doi.org/110.5007/1980-0037.2011v...
. Although the validation procedures of these instruments are diverse, due to different characteristics of the tools and specifics of each sport, the authors adopted an IV index of 80% for the criteria to be considered valid and approved.

In this sense, the consulted experts granted the PADTI a general IV of 90%, much higher than other previously validated instruments. For comparison effects, IAD-VB adopted an index of 85% to consider satisfactory the expert evaluation, and reached 92.9% of general index for content validation, values close to those found in this study2727. Collet C, Nascimento JV do, Ramos V, Stefanello JMF. Construção e validação do instrumento de avaliação do desempenho técnico-tático no voleibol. Rev bras Cineantropom Desempenho Hum. 2011;13(1):43-51. 110.5007/1980-0037.2011v13n1p43
https://doi.org/110.5007/1980-0037.2011v...
. When comparing the evaluators’ grades, there were no statistically significant differences between the evaluators’ responses (χ²=12.199; p = 0.094).

In the validation process of technical and tactical evaluation instruments in sports, it is common to test the reproducibility of instruments. Collet et al.2727. Collet C, Nascimento JV do, Ramos V, Stefanello JMF. Construção e validação do instrumento de avaliação do desempenho técnico-tático no voleibol. Rev bras Cineantropom Desempenho Hum. 2011;13(1):43-51. 110.5007/1980-0037.2011v13n1p43
https://doi.org/110.5007/1980-0037.2011v...
and Costa et al.1414. Costa IT da, Garganta J, Greco PJ, Mesquita I. Proposta de avaliação do comportamento tático de jogadores de Futebol baseada em princípios fundamentais do jogo. Motriz rev. educ. fís. 2011[cited on 03.15.2022];17(3):511-24. Available from: Available from: https://www.scielo.br/j/motriz/a/M8CWpR4z8JxgQxQvtKS8LJn/?lang=pt
https://www.scielo.br/j/motriz/a/M8CWpR4...
) found high reliability values inter and intra-evaluators in their relevant instruments. In relation to intra-evaluator reproducibility, PADTI evidenced intra-class correlation indicators (ICC), superior to 0.814 (IC: 95%: 0.251 - 0.954; p < 0.001) for all variables analyzed, as well as, good internal consistency, presenting a Cronbach’s alpha superior to 0.814, reflecting high rates of reproducibility and reliability.

There are several instruments for evaluating the tactical behavior of soccer athletes2828. González‑Víllora S, Serra‑Olivares J, Pastor‑Vicedo JC, Costa IT da. Review of the tactical evaluation tools for youth players, assessing the tactics in team sports: football. SpringerPlus. 2015; 4:663. 110.1186/s40064-015-1462-0
https://doi.org/110.1186/s40064-015-1462...
, however, for an adequate and effective tactical assessment, quality measurement instruments are needed. In this sense, for a tactical behavior assessment tool to be considered valid and consistent, it must present in its elaboration a detailed and well-described methodological process, paying attention to the processes of face validity, content validity, construct validity, as well as such as inter and intra-evaluator reliability procedures, as well as, it must be easy to apply and consider the real context of the game2424. Barquero-Ruiz C, Arias-Estero, JL, Kirk D. Assessment for tactical learning in games: A systematic review. Eur Phy Educ Rev. 2020; 26(4); 827-847. 110.1177/1356336X19889649
https://doi.org/110.1177/1356336X1988964...
. In this context, PADTI complied with the main requirements in its elaboration and validation process.

Unlike the various protocols available in the literature, which assess the tactical performance of soccer players in different contexts (small games), modifying rules, number of players, time and field dimensions, or making a tactical assessment through technical indicators1313. Oslin JL, Mitchell SA, Griffin LL. The game performance assessment instrument (GPAI): Development and preliminary validation. J Teach Phys Educ. 1998;17(2):231-43. 110.1123/jtpe.27.2.220
https://doi.org/110.1123/jtpe.27.2.220...
),(1414. Costa IT da, Garganta J, Greco PJ, Mesquita I. Proposta de avaliação do comportamento tático de jogadores de Futebol baseada em princípios fundamentais do jogo. Motriz rev. educ. fís. 2011[cited on 03.15.2022];17(3):511-24. Available from: Available from: https://www.scielo.br/j/motriz/a/M8CWpR4z8JxgQxQvtKS8LJn/?lang=pt
https://www.scielo.br/j/motriz/a/M8CWpR4...
),(1515. Van Maarseveen MJ, Oudejans RR, Savelsbergh GJ. System for notational analysis in small-sided football games. Int J Sports Sci Coach. 2017;12(2):194-206. 110.1177/1747954117694922
https://doi.org/110.1177/174795411769492...
. PADTI provides an analysis in real game context using the tactical actions of athletes as a parameter. This characteristic gives greater external validity to the PADTI, as it is capable of evaluating the tactical performance of the soccer athlete in the real context of the game, making the PADTI closer to the reality of soccer athletes and the expectation of the coaching staff.

Likewise, and as an original proposal, PADTI can provide a series of indicators of tactical performance of each athlete (individually) and the team evaluated (collectively). This was observed during the reproducibility procedures, where the frequencies of each player's tactical actions and each athlete's game time generated the following indicators: Tactical Performance Index (IT), Offensive Performance Index (IO), Defensive Performance Index (ID), Total Tactical Actions per Minute (ATM), Offensive Tactical Actions per Minute (AOM), Defensive Tactical Actions per Minute (ADM), and Tactical Actions Not Performed per Minute (ANRM).

During the reproducibility procedures, we computed 1662 (17%) actions from the part of the game previously selected (T1), categorized into offensive and defensive actions. From these indicators it was possible to compare the athletes' tactical performance and classify them as the best and worst tactical performance. Taking the IT as a parameter, we realized that over the assessed period, defense athletes (full-backs, defense and defensive midfielder) obtained a better tactical performance than attack players (midfield and forward).

Lower reproducibility indices were found in relation to the variables mobility (depth mobility), space (width and length) and balance. It is important to highlight that, during a real soccer game, these variables occur less frequently, when compared to the others, as they vary a lot according to the positioning and function performed by the athletes on the field. In this sense, because they have a lower frequency, they are more likely to change between one assessment and another of reproducibility. However, even with this variation, the results indicate satisfactory indices of reproducibility for these variables.

PADTI in its essence has an innovative and original purpose regarding the evaluation of tactical behavior of soccer players in game situation. As it enables a tactical performance analysis with images from a real soccer game, time where the athlete, theoretically, should present his best physical, emotional, technical and tactical performance. As emotions resulting from soccer game situations and other factors involved in the field (adversary, supporters, game time, weather, championship situation, game place, and others) can modify the player’s performance throughout the game, which is reduced in a training environment11. Lago C. The influence of match location, quality of opposition, and match status on possession strategies in professional association football. J Sports Sci. 2009;27(13):1463-9. DOI: 10.1080/02640410903131681
https://doi.org/10.1080/0264041090313168...
),(22. Praça GM, Lima BB, Bredt S da GT, Clemente FM, Andrade AGP de. Influence of match status on players’ prominence and teams’ network properties during 2018 FIFA World Cup. Front Psychol. 2019;10: 695. 110.3389/fpsyg.2019.00695
https://doi.org/110.3389/fpsyg.2019.0069...
),(33. Lepschy H, Wäsche H, Woll A. Success factors in football: an analysis of the German Bundesliga. Int J Perform Anal Sport. 2020;20(2):150-64. DOI:10.1080/24748668.2020.1726157
https://doi.org/10.1080/24748668.2020.17...
),(44. Fernandez-Navarro J, Fradua L, Zubillaga A, Ford PR, McRobert AP. Attacking and defensive styles of play in football: analysis of Spanish and English elite teams. J Sports Sci. 2016;34(24):2195-204. 110.1080/02640414.2016.1169309
https://doi.org/110.1080/02640414.2016.1...
),(66. Pollard R, Armatas V. Factors affecting home advantage in football World Cup qualification. Int J Perform Anal Sport. 2017;17(1-2):121-35. DOI:10.1080/24748668.2017.1304031
https://doi.org/10.1080/24748668.2017.13...
),(2929. Brito de Souza D, Campo L-D, Blanco-Pita H, Resta R, Del Coso J. An extensive comparative analysis of successful and unsuccessful football teams in LaLiga. Front Psychol. 2019; 10:2566. DOI:10.3389/fpsyg.2019.02566
https://doi.org/10.3389/fpsyg.2019.02566...
.

Another point to be emphasized in the PADTI methodology is its low utilization cost. This tool only needs a game that can be recorded by a camera, or from television broadcasts, a computer with Microsoft Excel ® to carry out the analysis, and previous knowledge on the tactical principles used. PADTI is a viable alternative to clubs and technical committees that intend to use performance analysis based on specific tactical principles of soccer to contribute with the improvement of tactical performance of athletes and teams.

On the other hand, as its main limitations PADTI does not have the capacity to evaluate the tactical performance of the athletes in dead-ball situations (fouls and corners). Likewise, when using television images, they can omit specific positions of some athletes, which suggests that the indicators presented should be analyzed with caution. Although previous studies of protocol validation for team sports2222. Alves MAR, Graça DCD, Travassos B. Construction and validation of an observation tool of the imbalance pass in futsal. Rev bras Cineantropom Desempenho Hum. 2022; 24; e77265. 110.1590/1980-0037.2022v24e77265
https://doi.org/110.1590/1980-0037.2022v...
have used a smaller sample than the one used in the present study, a greater number of team sports specialists can be used in the subsequent phases of validation of the PADTI. Ultimately, as a suggestion for future studies, this study recommends that the objectivity of the protocol be investigated, i.e., the inter-evaluators error, specially, with the use of images obtained directly at games site, using an open angle camera in order to analyze all actions and participations of athletes in a more comprehensive manner.

Conclusion

In the PADTI preparation process, we observed rigorous methodological processes, obeying criteria established by the specialized scientific literature. In the validity stage, the experts committee issued expressive logical, construct and content validity indexes, making possible the PADTI validation.

During the reproducibility and reliability processes, PADTI showed high statistical indicators related to the Intraclass Correlation Coefficient, which can be interpret as low intra-evaluator error and high reliability indexes.

We conclude that the indexes were high for all variables analyzed, such as: Tactical Performance Index (IT), Offensive Performance Index (IO), Defensive Performance Index (ID), Total Tactical Actions per Minute (ATM), Offensive Tactical Actions per Minute (AOM), Defensive Tactical Performance per Minute (ADM) and Tactical Actions Not Performed per Minute (ANRM). Therefore, we consider PADTI a valid and useful methodology to evaluate the tactical performance of soccer athletes in game situation.

References

  • 1
    Lago C. The influence of match location, quality of opposition, and match status on possession strategies in professional association football. J Sports Sci. 2009;27(13):1463-9. DOI: 10.1080/02640410903131681
    » https://doi.org/10.1080/02640410903131681
  • 2
    Praça GM, Lima BB, Bredt S da GT, Clemente FM, Andrade AGP de. Influence of match status on players’ prominence and teams’ network properties during 2018 FIFA World Cup. Front Psychol. 2019;10: 695. 110.3389/fpsyg.2019.00695
    » https://doi.org/110.3389/fpsyg.2019.00695
  • 3
    Lepschy H, Wäsche H, Woll A. Success factors in football: an analysis of the German Bundesliga. Int J Perform Anal Sport. 2020;20(2):150-64. DOI:10.1080/24748668.2020.1726157
    » https://doi.org/10.1080/24748668.2020.1726157
  • 4
    Fernandez-Navarro J, Fradua L, Zubillaga A, Ford PR, McRobert AP. Attacking and defensive styles of play in football: analysis of Spanish and English elite teams. J Sports Sci. 2016;34(24):2195-204. 110.1080/02640414.2016.1169309
    » https://doi.org/110.1080/02640414.2016.1169309
  • 5
    Pratas J, Volossovitch A, P Ferreira A. The Effect of Situational Variables on Teams’ Performance in Offensive Sequences Ending in a Shot on Goal. A Case Study. Open Sports Sci J. 2012[cited on03.15.2022];5(1). Available from: Available from: https://opensportssciencesjournal.com/VOLUME/5/PAGE/193/PDF/
    » https://opensportssciencesjournal.com/VOLUME/5/PAGE/193/PDF/
  • 6
    Pollard R, Armatas V. Factors affecting home advantage in football World Cup qualification. Int J Perform Anal Sport. 2017;17(1-2):121-35. DOI:10.1080/24748668.2017.1304031
    » https://doi.org/10.1080/24748668.2017.1304031
  • 7
    Maleki M, Dadkhah K, Alahvisi F. Ball recovery consistency as a performance indicator in elite football. Rev bras Cineantropom Desempenho Hum. 2016;18(1):72-8. DOI:10.5007/1980-0037.2016v18n1p72
    » https://doi.org/10.5007/1980-0037.2016v18n1p72
  • 8
    García López LM, González Víllora S, Gutiérrez D, Serra J. Development and validation of the Game Performance Evaluation Tool (GPET) in football. Sport TK. 2013[cited on03.15.2022]; 2 (1): 89-99. Available from:Available from:https://digitum.um.es/xmlui/bitstream/10201/40003/1/185791-673431-1-SM.pdf
    » https://digitum.um.es/xmlui/bitstream/10201/40003/1/185791-673431-1-SM.pdf
  • 9
    Borges PH, Guilherme J, Rechenchosky L, da Costa LCA, Rinadi W. Fundamental tactical principles of football: a comparison of different age groups. J Hum Kinet. 2017; 58:207. 110.1515/hukin-2017-0078
    » https://doi.org/110.1515/hukin-2017-0078
  • 10
    Correia da Silva D, Teoldo da Costa V, Casanova F, Manuel Clemente F, Teoldo I. Comparison between teams of different ranks in small-sided and conditioned games tournaments. Int J Perform Anal Sport. 2019;19(4):608-23. DOI:10.1080/24748668.2019.1643598
    » https://doi.org/10.1080/24748668.2019.1643598
  • 11
    Clemente FM, Martins FML, Kalamaras D, Wong PD, Mendes RS. General network analysis of national football teams in FIFA World Cup 2014. Int J Perform Anal Sport. 2015;15(1):80-96. 110.1080/24748668.2015.11868778
    » https://doi.org/110.1080/24748668.2015.11868778
  • 12
    Hackfort D, Kilgallen C, Hao L. The Action Theory-Based Mental Test and Training System (MTTS). In: Psychology of Sport Excellence [Internet]. 2009[cited on 03.15.2022]. p. 15-24. Available from: Available from: https://www.researchgate.net/publication/353237269
    » https://www.researchgate.net/publication/353237269
  • 13
    Oslin JL, Mitchell SA, Griffin LL. The game performance assessment instrument (GPAI): Development and preliminary validation. J Teach Phys Educ. 1998;17(2):231-43. 110.1123/jtpe.27.2.220
    » https://doi.org/110.1123/jtpe.27.2.220
  • 14
    Costa IT da, Garganta J, Greco PJ, Mesquita I. Proposta de avaliação do comportamento tático de jogadores de Futebol baseada em princípios fundamentais do jogo. Motriz rev. educ. fís. 2011[cited on 03.15.2022];17(3):511-24. Available from: Available from: https://www.scielo.br/j/motriz/a/M8CWpR4z8JxgQxQvtKS8LJn/?lang=pt
    » https://www.scielo.br/j/motriz/a/M8CWpR4z8JxgQxQvtKS8LJn/?lang=pt
  • 15
    Van Maarseveen MJ, Oudejans RR, Savelsbergh GJ. System for notational analysis in small-sided football games. Int J Sports Sci Coach. 2017;12(2):194-206. 110.1177/1747954117694922
    » https://doi.org/110.1177/1747954117694922
  • 16
    Grehaigne J-F, Godbout P, Bouthier D. Performance assessment in team sports. J Teach Phys Educ. 1997;16(4):500-16. DOI:10.1123/jtpe.16.4.500
    » https://doi.org/10.1123/jtpe.16.4.500
  • 17
    Bayer, C. O ensino dos desportos colectivos. 1st ed.Lisboa: Dinalivro, 1994.
  • 18
    Garganta J, Guilherme J, Barreira D, Brito J, Rebelo A. Fundamentos e práticas para o ensino e treino do futebol. In Tavares F (Ed), Jogos desportivos coletivos. Ensinar a jogar. Porto: FADEUP, 2013.
  • 19
    Costa IT da, Silva JMG da, Greco PJ, Mesquita I. Princípios táticos do jogo de futebol: conceitos e aplicação. Motriz. 2009[cited on 03.15.2022];657-68. Available from:Available from:https://www.periodicos.rc.biblioteca.unesp.br/index.php/motriz/article/view/2488/2534
    » https://www.periodicos.rc.biblioteca.unesp.br/index.php/motriz/article/view/2488/2534
  • 20
    Thomas JR, Nelson JK, Silverman SJ. Métodos de pesquisa em atividade física. 6st ed.Porto Alegre: Editora; 2009.
  • 21
    Cabral F de A, Morales JCP, Alves KCR, Praça GM, Greco PJ. Validação de conteúdo do teste de conhecimento tático declarativo para o futsal. Rev Bras Ciênc Esporte. 2021; 43: e000520. 110.1590/rbce.43.e000520
    » https://doi.org/110.1590/rbce.43.e000520
  • 22
    Alves MAR, Graça DCD, Travassos B. Construction and validation of an observation tool of the imbalance pass in futsal. Rev bras Cineantropom Desempenho Hum. 2022; 24; e77265. 110.1590/1980-0037.2022v24e77265
    » https://doi.org/110.1590/1980-0037.2022v24e77265
  • 23
    Clemente FM, Martins FML, Mendes RS, Figueiredo AJ. A systemic overview of football game: the principles behind the game. J Hum. Sport Exercise. 2014;9(2):656-67. 110.14198/jhse.2014.92.05
    » https://doi.org/110.14198/jhse.2014.92.05
  • 24
    Barquero-Ruiz C, Arias-Estero, JL, Kirk D. Assessment for tactical learning in games: A systematic review. Eur Phy Educ Rev. 2020; 26(4); 827-847. 110.1177/1356336X19889649
    » https://doi.org/110.1177/1356336X19889649
  • 25
    Copetti GL. Elaboração e validação preliminar de um instrumento de avaliação da tomada de decisão no futebol em situações reais [Dissertação]. [Brasília]: Universidade de Brasília; 2012.
  • 26
    Guimarães LC. Perfil de desenvolvimento das habilidades táticas: validação preliminar da versão para avaliar jogadores de futsal [Dissertação]. [Brasília]: Universidade de Brasília; 2011.
  • 27
    Collet C, Nascimento JV do, Ramos V, Stefanello JMF. Construção e validação do instrumento de avaliação do desempenho técnico-tático no voleibol. Rev bras Cineantropom Desempenho Hum. 2011;13(1):43-51. 110.5007/1980-0037.2011v13n1p43
    » https://doi.org/110.5007/1980-0037.2011v13n1p43
  • 28
    González‑Víllora S, Serra‑Olivares J, Pastor‑Vicedo JC, Costa IT da. Review of the tactical evaluation tools for youth players, assessing the tactics in team sports: football. SpringerPlus. 2015; 4:663. 110.1186/s40064-015-1462-0
    » https://doi.org/110.1186/s40064-015-1462-0
  • 29
    Brito de Souza D, Campo L-D, Blanco-Pita H, Resta R, Del Coso J. An extensive comparative analysis of successful and unsuccessful football teams in LaLiga. Front Psychol. 2019; 10:2566. DOI:10.3389/fpsyg.2019.02566
    » https://doi.org/10.3389/fpsyg.2019.02566

Edited by

Editor: Moacir Marocolo

Publication Dates

  • Publication in this collection
    29 May 2023
  • Date of issue
    2023

History

  • Received
    05 Dec 2022
  • Reviewed
    27 Feb 2023
  • Accepted
    28 Feb 2023
Universidade Estadual de Maringá Avenida Colombo, 5790 - cep: 87020-900 - tel: 44 3011 4315 - Maringá - PR - Brazil
E-mail: revdef@uem.br