Acessibilidade / Reportar erro

MODELING THE INFLUENCE OF BASKETBALL GAME PARAMETERS ON THE FINAL RESULT IN TOKYO 2020

MODELANDO A INFLUÊNCIA DOS PARÂMETROS DO JOGO DE BASQUETEBOL NO RESULTADO FINAL EM TÓQUIO 2020

ABSTRACT

This study aims to ascertain the significance of the basketball game parameters which discriminated between winning and losing teams in matches played. The study sample comprises matches played at the men’s basketball tournament at the XXXII Olympic Games in Tokyo. Four regression models were formed. Due to the size of the sample, the number of explaining variables was reduced using factor analysis, followed by stepwise regression to ascertain the statistical significance of the obtained models summarily, which were then broken down into individual parameters. This study indicates: (1) one of the four set regression models was summarily highly statistically significant; (2) out of the remaining models, two were eliminated due to the presence of multicollinearity, and one model did not exhibit high statistical significance; (3) the final score was most influenced by the variables of two- and three-point shot percentages, number of three-point shots, turnovers, defensive rebounds, and true shooting percentage. The results of the study corroborated the results of other studies which were carried out in recent years, that the game of basketball is trending towards three-point shots and lay-ups, reduction of turnovers when passing, and defensive rebounds have been confirmed to be greatly significant.

Keywords:
Olympic Tournament; game parameters; winning in game; regression model

RESUMO

Este estudo tem como objetivo verificar a significância dos parâmetros do jogo de basquetebol que discriminam entre equipes vencedoras e perdedoras em partidas disputadas. A amostra do estudo compreende partidas disputadas no torneio de basquete masculino dos XXXII Jogos Olímpicos de Tóquio. Quatro modelos de regressão foram formados. Devido ao tamanho da amostra, o número de variáveis explicativas foi reduzido por meio de análise fatorial, seguida de regressão stepwise para verificar sumariamente a significância estatística dos modelos obtidos, que foram então decompostos em parâmetros individuais. Este estudo indica: (1) um dos quatro modelos de regressão definidos foi sumariamente altamente estatisticamente significativo; (2) dos demais modelos, dois foram eliminados devido à presença de multicolinearidade e um modelo não apresentou alta significância estatística; (3) a pontuação final foi mais influenciada pelas variáveis porcentagem de arremessos de dois e três pontos, número de arremessos de três pontos, turnovers, rebotes defensivos e porcentagem de arremessos verdadeiros. Os resultados do estudo corroboraram os resultados de outros estudos que foram realizados nos últimos anos, que o jogo de basquete está tendendo a arremessos de três pontos e bandejas, redução de turnovers ao passar e rebotes defensivos foram confirmados muito significativo.

Palavras-chave:
Torneio Olímpico de Baquetebol; parâmetros de jogo do basquetebol; vitórias no basquetebol; modelo regressão

Introduction

The performance or productivity of athletes in matches was the subject of numerous academic studies, and performance indicators in basketball are usually explored using biomechanical and notational analysis1Sindik J. Performance indicators of the top basketball players: Relations with several variables. Coll. Antropol. 2015[cited on Jun 10, 2022];39(3):617-24. Available from: Available from: https://www.collantropol.hr/antropo/article/view/844/1357
https://www.collantropol.hr/antropo/arti...
. Notational analysis is a tool for objectively gathering statistical data on player skills2Reilly T. Assessment of performance in team games. In: Roger E, Reilly T, editors. Kinanthropometry and exercise physiology laboratory manual: Test, procedures, and date. 3 ed. Vol. 1. New York: Routledge; 2009. p. 184-96.. In fact, it is the transformation of events in the field into numbers, which the coach can interpret and use for targeted training to mitigate deficiencies of both individual players and the team as a whole3Ciampolini V, do Nascimento JV, Ibáñez SJ, de Oliveira Nicolazzi L, Camaroto M, Schmitt Rocha JC, Saad MA. Offensive technical-tactical analysis on NBA finalist teams: A case study. Int. J. Phys. Educ. 2018;29:e2931. DOI: https://doi.org/10.4025/jphyseduc.v29i1.2931
https://doi.org/10.4025/jphyseduc.v29i1....
.

Henry Chadwicks, the famous sports journalist, was the first to see the need to analyse player performance as early as 1858, so he devised his “box score” for gathering data from baseball matches. In early 20th century the first academic paper was published on performance analysis, by Hugh Stuart Fullerton III, on baseball in 1910. The game of baseball can be modelled as a separate set of individual plays, whereas basketball is a continuous set of interactions which are harder to convert into numbers4Millas J. Decision-making in the National Basketball Association: The interaction of advanced analytics and traditional evaluation methods. [Doctoral dissertation]. Eugene, OR: University of Oregon. Lundquist College of Business; 2015.. But still, basketball is a sport with a long history of notational analysis. The first papers on this topic in basketball were published by Lloyd Lovell Messersmith. Further development of gathering “statistics” and the development of notational analysis in basketball followed the development of basketball on one hand, and the academic development of notational analysis on the other. It can be said that basketball has historically been very dependent on statistics - in order to provide an analytical tool for both the coaches and the media. For a long time now, the natural development of sports in general, and hence basketball as well, has included records kept for matches, which helped with statistical analysis5Rose L. The basketball handbook. Leeds, United Kingdom: Human Kinetics; 2004..

Men’s basketball was included as an Olympic sport at the 1936 Games in Berlin, and women’s basketball at the 1976 Games in Montreal. At the 1936 Olympics only the score was recorded. But in the following Olympic Games in 1948, the basic variables related to the match were also recorded: Free throws, personal fouls and field goals per individual player. Unlike in the NBA, field goals were not being recorded until 1964. In the 1970s and 1980s, basketball grew greatly in popularity across the world, which led to the recording of rebounds, assists, turnovers and steals, following the NBA model. When the three-point line was introduced at the 1984 Olympic tournament, the three-point shot began to be recorded separately6Blake B. Evaluating the validity of a basketball performance metric in correlation with winning and losing games. [Master thesis]. Cardiff, United Kingdom: Cardiff School of Sport; 2015..

Notational analysis in basketball based on statistical data and game indicators is very popular among coaches, while serious scientific studies on the usefulness of these variables in understanding skill in matches is fairly recent. Bryson Johnson points out that “basketball in particular has seen a drastic rise in the use of analytics”7Johnson B. Analytics and free throw shooting: Perception vs. reality. [Master thesis]. Fairfax, VA: George Mason University; 2017.);(2Reilly T. Assessment of performance in team games. In: Roger E, Reilly T, editors. Kinanthropometry and exercise physiology laboratory manual: Test, procedures, and date. 3 ed. Vol. 1. New York: Routledge; 2009. p. 184-96., because after each match there is a statistical report available which “provides for each player and each team, quantitative information on 15 variables”8Celeux G, Robert V. Towards an objective team efficiency rate in basketball. J Soc Fr Statistique 2015[cited onJun 10, 2022];156(2):51-68. Available from: Available from: https://hal.inria.fr/hal-01020295v2/document
https://hal.inria.fr/hal-01020295v2/docu...
);51 . Or, in other words: “one of the main differences between basketball teams and other sports comes from the availability of information”9Blanco V, Salmerón R, Gómez-Haro S. A multiplication selection system based on player performance: Case study - The Spanish ACB Basketball League. arXiv 2018;802.07039[math.OC],27:1029-46. DOI: https://doi.org/10.1007/s10726018-9593-9
https://doi.org/10.1007/s10726018-9593-9...
);(2Reilly T. Assessment of performance in team games. In: Roger E, Reilly T, editors. Kinanthropometry and exercise physiology laboratory manual: Test, procedures, and date. 3 ed. Vol. 1. New York: Routledge; 2009. p. 184-96.. Technological advancements and the need for a better and deeper understanding of the players’ technical and tactical performance make this topic increasingly interesting for academic circles. There are various ways in which researchers analyze structure. Martinez ascertained that there are over 200 systems for objective assessment of performance in basketball and that finding the best way to valuate basketball players is looking more and more like the quest for the “Holy Grail”10Martinéz JA. Factors determining production (FDP) in basketball. Econ. Bus. Lett. 2012;1(1):21-9..

The first to use the stepwise regression statistical method in assessing value in a basketball match was Kathleen Shanahan11Shanahan KJ. A model for predicting the probability of a win in basketball. [Master thesis]. Iowa City, IA: University of Iowa; 1984.. Eric Scot Jones used the stepwise selection technique in his Master’s theses to “determine which of the variables are significant and to develop both the point spread and the logistic models”12Jones EC. Predicting outcomes of NBA basketball games. [Master thesis]. Fargo, ND: North Dakota State University of Agriculture and Applied Science; 2016.. In his Doctoral dissertation, which he defended at the United States Sports Academy in 2020, Hugh Morrissey pointed out that one of the methods used in previous studies on basketball parameters that affect game outcome in basketball is stepwise regression analysis, citing two papers by the first two authors of this study13Morrissey H. Basketball game-related statistics which discriminate winners and losers in the ASC. [Doctoral dissertation]. Daphne, AL:; United States Sports Academy 2020..

This manuscript aims to use stepwise regression, following the selection of independent variables, to ascertain which basketball game parameters discriminated winners and losers in matches played at the latest men’s Olympic basketball tournament in Tokyo.

Methods

Sample

The study sample in this paper comprises matches (n=26) played at the men’s basketball tournament at the XXXII Olympic Games in Tokyo. The tournament was played between 24 July and 08 August 2021 at the Saitama Super Arena in Saitama. The participants of the men’s Olympic basketball tournament were 12 national teams: Argentina, Australia, Czech Republic, France, Germany, Iran, Italy, Japan, Nigeria, Slovenia, Spain and the United States. The preliminary round of this competition followed the single round robin system, where the national teams were divided into three groups of four teams each. The best two teams from each group advanced to the second, knockout stage, along with the two best-ranked third-placed teams. The knockout stage took place in three rounds (the quarterfinals, semi-finals and finals)

Procedures

The team that scores more points in a basketball match, under the rules of the game of basketball, is the team that wins the match. This regulation was used for the purposes of this study in such a way that the difference in points scored (∆PTS) was taken as a dependable variable in the formed regression models. The difference in points is a consequence, or better said, is a function of all the observed game parameters.

A problem that arises in modelling is the optimal selection of the included independent variables. It should be noted that including a large number of parameters into the model does not mean that the error margin will be reduced to zero. More often than not the opposite occurs: introducing a large number of predictive factors increases the error factor. Hence, we can speak of multiple models, All the more so because of the fact that some of the variables which were used have been derived from others, indicating that such models cannot be assessed.

Because of all the above, for the purposes of this study, several models were formed. The models have the following mathematical form:

Y i = β 0 + i = 1 j β j X j i + ε j

j = 1,2, ... (9, 13, 16).

In model 1, X 1 =∆A2 (difference two points attempted), X 2 =∆A2 (difference two points made), X 3 =∆A3 (difference three points attempted), X 4 =∆M3 (difference three points made), X 5 =∆FTA (difference free throws attempted), X 6 =∆FTM (difference free throws made), X 7 =∆OR (difference offensive rebounds), X 8 =∆DR (difference defensive rebounds), X 9 =∆AS (difference assists), X 10 =∆PF (difference personal fouls), X 11 =∆TO (difference turnovers), X 12 =∆ST (difference steals), and X 13 =∆BS (difference blocked shots).

Model 2, aside from the variables already included in the basic model (X1 =∆A2; X2 = ∆M2; X3 =∆A3, X4 = ∆M3, X7 = ∆FTA, X8 = ∆FTM, X9 = ∆OR, X10 = ∆DR, X12 = ∆AS, X13 = ∆PF, X14 = ∆TO, X15 = ∆ST and X16 = ∆BS) also includes: X 5 =∆FGA (difference field goals attempted), which is obtained by the sum ∆A2+∆A3, X 6 =∆FGM (difference field goals made), which is obtained by the sum ∆M2+∆M3 and X 11 =∆TR (difference total rebounds), which is obtained by the sum ∆OR+∆DR. These variables are provided in the official statistical report published by FIBA after each match.

Experts’ experience, prior studies by other authors and these authors, and ultimately the results of this study as well, indicate the significance of shot for the outcome of a match in basketball. In accordance with that, Model 3 was formed out of parameters which track a team’s shot performance during a match: X 1 =∆2inPTS% (difference in percentage of two points made in relation to the total points made ((M2x2)/PST)x100), X 2 =∆3inPTS% (difference in percentage of three points made in relation to the total points made ((M3x3)/PST)x100), X 3 =∆FTinPTS% (difference in percentage of free throws made in relation to the total points made (FTM/PST)x100), X 4 =∆2% (difference in percentage of two points made (M2/A2)x100), X 5 =∆3% (difference in percentage of three points made (M3/A3)x100), X 6 =∆FG% (difference in percentage of field goals made (FGM/FGA)x100), X 7 =∆FT% (difference in percentage of free throws made (FTM/FTA)x100), X 8 =∆2PTS eff (difference in two-point shot efficiency coefficient 2×M2×2%), X9 =∆3PTSeff (difference in three-point shot efficiency coefficient 3×𝑀3×3%), X10 =∆FTPTSeff (difference in free throw efficiency coefficient FT x FT%), X11 =∆eFG% (difference in field goal effective percentage (M2+1.5xM3)/(A2+A3)), X12 =∆TS% (difference in true shooting percentage PTS/2x(FGA+0.44xFTA)) and X13 =∆FTr (difference in free throw rate FTM/(A2+A3).

The last, fourth model was built on relative game parameters from the basic model (basic parameters which were so far used to derive relative parameters). In addition to the already mentioned shot percentages (∆2%, ∆3%, ∆FG% and ∆FT%), there are also: X5 =∆OR% (difference in offensive rebound percentage (OR/(OR+DRopp ))x100)), X6 =∆DR% (difference in defensive rebound percentage (DR/(DR+ORopp ))x100), X7 =∆AS% (difference in assists percentage (AS/FGM)x100)), X8 =∆TO% (difference in turnover percentage (TO/(FGA+0.44xFTA+TO))x100)) and X9 =∆BS% (difference in blocked shot percentage (BS/FGAopp)x100)).

Statistical analysis

Having in mind the relatively small sample (n = 26), and a relatively large number of observed independent variables, a dimensionality reduction was carried out, using factor analysis. The principal component method and varimax rotation were used to obtain factor scores, which were further regressed to the set of the original variables. Based on the obtained results of regression analysis, five of the original independent variables were kept in each of the four observed models.

The information on the interconnections and interrelations of the observed variables was obtained based on the correlation coefficient, adjusted multiple coefficients of determination and partial correlation coefficients.

The stepwise regression method was used to evaluate the regression models, and this paper present only the most important results of the obtained regression models. The presence of outliers was analyzed and adjustments were made as needed. The variable inclusion criterion for the stepwise regression was the level F = 0.05, and the exclusion criterion was F = 0.10. The presence of multicollinearity, heteroscedasticity and autocorrelation were then tested.

Further analysis determined the statistical significance of the obtained models overall and broken down into individual parameters. After that, based on the values of the obtained coefficients in the models and based on the results of establishing the relationship between the regressors in such obtained models and the dependent variable, and also based on the appropriate coefficients of partial correlation, statistical significance was determined regarding the level of importance of the included independent variables.

It is especially important to note that all the steps in the quantitative analysis were accompanied by continuous qualitative analysis, while respecting the theoretic framework and empirical experiences in the field of basketball.

Results

The sample comprised 26 matches. As it was the case with prior studies on this topic, the limitation of observing a competition is the fact that the sample includes all the observed cases. For this study, the analysis of the presence of outliers (atypical values) showed that the match USA vs Iran (∆PTS is 54) is an atypical value, so it was eliminated from further analyses, reducing the sample to 25 matches (n = 25).

The most important results of the factor analysis for all the models have been provided in Figure 1.

Figure 1
Total explained variability and rotated components

Regression results for individual factors in relation to the appropriate original variables have been given in Table 1.

Table 1
Regression of individual factors in relation to original variables

Table 2 provides the final models where the dependant variable is ∆𝑃𝑇𝑆, while independent variables are the original variables obtained by dimensionality reduction based on factor and regression analysis.

Table 2
Parameters of the models used in the study according to the results of the stepwise regression

In further interpretation of the results, models 1b, 2a, 2b and 4a were dismissed due to very low values of the adjusted multiple determination coefficient. Specifically, the multiple determination coefficient of Model 1b is R2=.397, F=16.831, p=.000; Model 2a (R2=.298, F=11.180, p=.000), Model 2b (R2=.397, F=16.831, p=.000) and Model 4a (R2=.250, F=9.021, p=.006).

The values of the adjusted multiple determination coefficients of the remaining three models indicate that these models are statistically representative. The best statistical model is Model 4b (R2=.872, F=42.004, p=.000), i.e. the results of this model explain 87.2% of the variations of the dependable variable, followed by: Model 1a ( R2=.684, F=48.305, p=.000) and Model 3 (R2=.667, F=49.021, p=.000).

According to the values of the standardized coefficient in model 1, it can be concluded that the greatest contribution is in variations of the dependable variable ΔDR (b8 * = 1.236, p < .000), ΔTO (b8 *= -1.057, p < .000) and ΔA3 (b8 * = .241, p < .091). This almost entirely coincides with the partial correlation coefficients which are largest for the explanatory variables ΔDR (rp = .766), ΔTO (rp = -.698) and ΔA3 (rp = .361). In model 3, only one difference variable was extracted, true shooting percentage - ΔTS% ( 𝑏 12 ∗ = .825, p < .000, rp = .825). In model 4, the winners of matches at the Tokyo 2020 Olympic basketball tournament benefited the most from: Δ2% ( 𝑏 1 ∗ = .912, p < .000, rp = .929), Δ3% (b2 *= .839, p < .000, rp = .909), ΔTO% (b8 *= -.706, p < .000, rp = -.859) and ΔDR% (b6 *= .535, p < .000, rp = .804) (Figure 2).

Figure 2
Variables that discriminated between winners and losers at the Tokyo 2020 men’s Olympic basketball tournament

Discussion

Game-related statistics allows for the application of prospective research, with the use of statistical methods to improve the qualities of a team’s performance (skills, mental strength, anthropometric characteristics etc.) and achieve success. Ilkag Doğan and Yasin Ersoz found that a high level of these team characteristics provides game-related statistical data and allow for success14Doğan İ, Ersöz Y. The important game-related statistics for qualifying next rounds in Euroleague. Montenegrin J. Sports Sci. Med. 2019;8(1):43-50. DOI: https://doi.org/10.26773/mjssm.190307
https://doi.org/10.26773/mjssm.190307...
. Game-related statistics is used to describe variables which may aid in differentiating successful teams in relation to other teams. In the past decades we are witness to an incessant quest for understanding and interpretation of the complex actions which are present in basketball, which has lead authors and coaches to use “statistics techniques”15Peters AS. Analysis of game-related statistics which discriminate between winning and losing in Brazilian professional basketball. Rev. Bras. Educ. Fís. Esporte2015;29(4):551-8..

In this study, the four set models were used to extract eight variables which discriminated between winners and losers in this competition. Out of the eight variables, four (or 50%) relate to shooting skills. Shooting is a key element of basketball technique and is congruent with the first rule of basketball, which says: the team that has scored the greater number of game points at the end of playing time shall be the winner16International Basketball Federation. 2020 Official basketball rules: Basketball rules and basketball equipment. Mies, Switzerland: FIBA; 2020[cited on Jun 10, 2022]. Available from:Available from:https://www.fiba.basketball/documents/official-basketball-rules/2020.pdf
https://www.fiba.basketball/documents/of...
. A shot attempt is the final action that leads to scoring a field goal in basketball17Ciampolini V, Ibáñez SJ, Nunes ELG, Borgatto AF, Nascimento JV. Factors associated with basketball field goals made in the 2014 NBA finals. Mot., Rev. Educ. Fis. 2017;23(4):e1017105. DOI: https://doi.org/10.1590/S1980-6574201700040008
https://doi.org/10.1590/S1980-6574201700...
.

Although the other basketball skills that we call fundamental (passing, dribbling, defence and rebounding) may provide a high shot percentage for a player, he or she still has to be able to score. It is clear that team with the higher percentage of field goals made has a higher chance to win the match. If they have a lower percentage of field goals made than the opponent, they can only win the match if they have more field goal attempts, more free throws or a better percentage of free throws, which is not the case in the observed competition. Winners had a greater difference in two-point shot percentage-∆2% (M = 58.997, SD = 9.549) and three-point shot percentage -∆3% (M = 37.833, SD = 7.637), in true shooting percentage -∆TS% (M = 60.662, SD = 6.121) as well as three-point shot attempts -∆A3 (M = 31.654, SD = 6.032) in relation to the losers: ∆2% (M = 49.060, SD = 8.305), ∆3% (M = 34.254, SD = 7.619), ∆TS% (M = 53.051, SD = 5.398) and ∆A3 (M = 28.577, SD = 6.344). If we observe the matches individually, we can see that in six matches (24%) the losing teams had a better two-point shot percentage (∆2%) than the winners, and in 10 matches (40%) a better three-point shot percentage (∆3%). It is important to note here that in only one of these matches the losing team had a higher percentage of both two-point and three-point shots. The winners made up for the disbalance with a larger number of two-point shot attempts (on average for these matches 5.667 attempts more) and three-point shot attempts (1.800). Studies on men’s Olympic tournaments have also found that field goals have a significant impact on the match outcome: Athens 2004, Beijing 200818Sampaio J, Lago C, Drinkwater E. Explanations for the United States dominance in basketball at the Beijing Olympic games. J. Sports Sci. 2010;28(2):147-52. DOI: https://doi.org/10.1080/02640410903380486
https://doi.org/10.1080/0264041090338048...
)-(19Pojskić H, Šeparović V, Užičanin E. (2009). Differences between successful and unsuccessful basketball teams on the final Olympic tournament. Acta Kinesiol. [cited on Jun 10, 2022];3(2):110-4. Available from:Available from:http://actakinesiologica.com/wp-content/uploads/2017/11/04-CL-18-HP-1.pdf
http://actakinesiologica.com/wp-content/...
, London 201220Milanović D, Štefan L, Škegro D. Situational efficiency parameters of successful and unsuccessful top male basketball teams in the Olympic Tournament games in London 2012. Balt. j., sport, health sci. 2016;100(1):31-7. Available from: https://journals.lsu.lt/baltic-journal-of-sport-health/article/view/44
https://journals.lsu.lt/baltic-journal-o...
and Rio 201621Leicht AS, Gómez MA, Woods CT. Explaining match outcome during the Men’s basketball tournament at the Olympic Games. J. Sports Sci. Med. 2017;16(4):468-73. Available from:https://www.jssm.org/jssm-16-468.xml%3EFulltext
https://www.jssm.org/jssm-16-468.xml%3EF...
.

Prior studies have shown that shot percentage, and not number of shot attempts, is the parameter with a decisive impact on the final score22Price M, Yan J. The effects of the NBA COVID bubble on the NBA playoffs: A case study for home-court advantage. arXiv 2021;ID:2103.02832. Available from: https://arxiv.org/abs/2103.02832
https://arxiv.org/abs/2103.02832...
. The impact of shot percentage on the final score was also found in prior studies of men’s Olympic basketball tournaments: In Beijing, the impact of the two-point shot percentage19Pojskić H, Šeparović V, Užičanin E. (2009). Differences between successful and unsuccessful basketball teams on the final Olympic tournament. Acta Kinesiol. [cited on Jun 10, 2022];3(2):110-4. Available from:Available from:http://actakinesiologica.com/wp-content/uploads/2017/11/04-CL-18-HP-1.pdf
http://actakinesiologica.com/wp-content/...
, and in Athens, Beijing, London and Rio, the field goal percentage21Leicht AS, Gómez MA, Woods CT. Explaining match outcome during the Men’s basketball tournament at the Olympic Games. J. Sports Sci. Med. 2017;16(4):468-73. Available from:https://www.jssm.org/jssm-16-468.xml%3EFulltext
https://www.jssm.org/jssm-16-468.xml%3EF...
. In this study, we can see that the extracted variables are 𝛥2% and 𝛥3%. The difference in two-point shot percentages is greater than the difference in three-point shot percentages for the simple reason that a smaller shot distance leads to greater shot precision. Winners in this tournament had a slightly larger number of two-point shots (M = 38.963, SD = 5.072), which accounted for a total of 55.174% of all field goals in relation to the losers (M = 18.115, SD = 7.024) i.e. 57.121% of field goals, which is incongruent with what has been followed in terms of trends of game dynamics and evolution. Individual linear regression models, especially in studies done in recent years, have shown that the final score in a match is very significantly influenced by the three-point shot (in this study, out of the eight variables that have proven to be significant for the final score, two are in the domain of the three-point shot -∆3% and 𝐴3). Authors have then rightly asked the question what brings about such a trend, despite the fact that the probability to score points decreases with shot distance23Harmon M, Ebrahimi A, Lucey P, Klabjan D. Predicting shot making in basketball using convolutional neural networks learnt from adversarial multiagent trajectories. Stat.ML 2016; ID.13974398. Available from: https://arxiv.org/abs/1609.04849
https://arxiv.org/abs/1609.04849...
. Studies that have dealt with player interaction found that space-time coordination across the longitudinal axis (i.e. Interaction between inside and outside play) is a key element in player performance in a match24Lapresa D, Alsasua R, Arana J, Anguera MT, Garzón B. Observational analysis of the construction of offensive sequences that end in a shot in youth basketball. Rev. de Psicol. del Deporte 2014[cited onJun 10, 2022];23(2):365-76. Available from: Available from: https://www.redalyc.org/pdf/2351/235131674016.pdf
https://www.redalyc.org/pdf/2351/2351316...
. The inside and outside player coordination increases the number of short distance shots, but also increases the possibilities of longer distance shots after open passes. Studies have found that offensive efficiency is higher when the ball is dribbled closer to the basket. In any case, offensive efficiency in modern basketball depends on the balance between inside and outside play25Courel-Ibañez J, Mcrobert A, Ortega E, Vélez DC. Collective behaviour in basketball: A systematic review. Int. J. Perform. Anal. Sport 2017;17(1):44−64. DOI: https://doi.org/10.1080/24748668.2017.1303982
https://doi.org/10.1080/24748668.2017.13...
. The reasons for the fault in the logic can be also found by analyzing defensive play. It is obvious that most basketball coaches base their defensive philosophies on stopping close-range shots, which leads to more shots being made from a distance and behind the three-point line (set shot) after outside passing following a penetration or after back passes from low-post positions26Messina E. My favourite drills [Internet]. FIBA Europe - Coaching Clinics. [cited onJun 10, 2022] Available from: Available from: http://coaching.fibaeurope.com/Default.asp?cid={E8DBEC51-0212-4C9D-B3874CB5D1D3A722}&coid={F3FDEF06-32B7-42F3-AED2-7EE3A4BF9483}&articleMode=on&
http://coaching.fibaeurope.com/Default.a...
.

Following the evolution of basketball, it can be foreseen that group-tactical behaviour will go towards open three-point shots during set play and transition (e.g. inside and outside passing) and easy scoring during quick counterattacks (e.g. quick plays following a defensive rebound)27Courel-Ibáñez J, McRobert AP, Ortega E, Cárdenas D. Inside game effectiveness in NBA basketball: Analysis of collective interactions. Kinesiology2018;50(2):218-27. DOI: 10.26582/k.50.2.5
https://doi.org/10.26582/k.50.2.5...
. The results of this study have confirmed this trend, but have also again confirmed the correlation between shot dynamics and basketball rule changes. Namely, the skill of the half-distance shot is increasingly stepping down for the skills of the lay-up shot and the three-point shot.

What is also interesting are the results of Model 3, which contains all the variables related to shooting in basketball. Only one variable was extracted, difference of the true shooting percentage ∆TS%, which is the indicator of the true shooting efficiency, and which now includes field goals and free throw shots. It is obvious that these new, derived variables warrant more attention in future studies.

Out of the variables that are not in shot domain the extracted variables indicate the significance of the difference in balls won by defensive rebounds and the difference in turnovers, both in the model where absolute values were observed (∆DR and ∆TO) and in the model where relative values were observed (∆DR% and ∆TO%).

Turnovers discriminated between winners and losers in Athens, Beijing, London and Rio20Milanović D, Štefan L, Škegro D. Situational efficiency parameters of successful and unsuccessful top male basketball teams in the Olympic Tournament games in London 2012. Balt. j., sport, health sci. 2016;100(1):31-7. Available from: https://journals.lsu.lt/baltic-journal-of-sport-health/article/view/44
https://journals.lsu.lt/baltic-journal-o...
)-(21Leicht AS, Gómez MA, Woods CT. Explaining match outcome during the Men’s basketball tournament at the Olympic Games. J. Sports Sci. Med. 2017;16(4):468-73. Available from:https://www.jssm.org/jssm-16-468.xml%3EFulltext
https://www.jssm.org/jssm-16-468.xml%3EF...
, while offensive rebounds did in London19Pojskić H, Šeparović V, Užičanin E. (2009). Differences between successful and unsuccessful basketball teams on the final Olympic tournament. Acta Kinesiol. [cited on Jun 10, 2022];3(2):110-4. Available from:Available from:http://actakinesiologica.com/wp-content/uploads/2017/11/04-CL-18-HP-1.pdf
http://actakinesiologica.com/wp-content/...
. When we talk about turnovers, we actually mean ball passing in basketball, which is a fundamental technique of player cooperation. After shot technique, it is the second most used technique in a match. Moreover, some coaches believe that passing is the most important technical element of offence because it tolerates a very low level of error, if any. If a player makes the slightest mistake, the pass ends in loss of the ball. In contrast, it is assumed that a player should have a shot percentage of around 50%28Chang SC. Capability and opportunity in hot shooting performance: Evidence from top-scoring NBA leaders. PLoS ONE 2018;13(2). Doi: https://doi.org/10.1371/journal.pone.0179154
https://doi.org/10.1371/journal.pone.017...
. Turnovers reduce the shot percentage and increase the opponents’ shot percentage, which can be seen as a double inefficiency29Trninić S. Analysis and teaching of the basketball game. Pula, Croatia: Vitka; 1995.. Losers in this competition had an average of 2.364 more lost balls than the winners. Consequently, they had a greater percentage of lost balls (M = 16.898, SD = 5.358) in relation to the winners (M = 14.030, SD = 4.771).

The team that control rebounding in a match, controls the match itself, i.e. higher rebounds provide for a better chance of winning the match30Stavropoulos N, Kolias P, Papadopoulou, Stavropoulou G. Game related predictors discriminating between winning and losing teams in preliminary, second and final round of basketball world cup 2019. Int. J. Perform. Anal. Sport2021;21(3):383-95. Doi: https://doi.org/10.1080/24748668.2021.1901437.
https://doi.org/10.1080/24748668.2021.19...
. Even though many of the standardly observed variables have evolved over time, defensive rebounds were and have remained stable over the years, with an impact on the outcome of the match31Gómez MÁ, Medina R, Leicht AS, Zhang S, Vaquera A. The performance evolution of match play styles in the Spanish Professional Basketball League. Appl. Sci. 2020;10:7056. Doi: https://doi.org/10.3390/app10207056.
https://doi.org/10.3390/app10207056...
. The sum of the gathered data alone, especially when it comes to rebounds, is not sufficient or a detailed analysis of all the events that take place during a match, meaning that the “consequences of rebounding percentages should be used both in offense and in defence instead of the number of rebounds”32Csataljay G, James N, Hughes M, Dancs H. Performance differences between winning and losing basketball teams during close, balanced and unbalanced quarters. J. Hum. Sport Exerc. 2012;7(2):356-64. DOI: https://doi.org/10.4100/jhse.2012.72.02
https://doi.org/10.4100/jhse.2012.72.02...
);363 . In other words, the winning team forced their opponents to miss field goal attempts, which opened up space for more attempts of defensive rebounds - which is, in turn, a key indicator of the efficiency of both defence and rebounds29Trninić S. Analysis and teaching of the basketball game. Pula, Croatia: Vitka; 1995.. When a team on the defence acquire the ball with a rebound, they decrease the opponents’ number of field goal attempts and has an opportunity for a quick counterattack. Accelerating play through counterattacks creates opportunities for scoring “easy points” with a two-point shot from close proximity to the basket and for open three-point shots, which has had an impact on the shot dynamic in this competition. This is visible in the extracted variables which discriminated between winners and losers at the Tokyo 2020 Games.

The impact of winning the ball with defensive rebounds on the final score was ascertained in the Olympic basketball tournaments from Athens to Rio21Leicht AS, Gómez MA, Woods CT. Explaining match outcome during the Men’s basketball tournament at the Olympic Games. J. Sports Sci. Med. 2017;16(4):468-73. Available from:https://www.jssm.org/jssm-16-468.xml%3EFulltext
https://www.jssm.org/jssm-16-468.xml%3EF...
, which was also corroborated by separate studies for Beijing19Pojskić H, Šeparović V, Užičanin E. (2009). Differences between successful and unsuccessful basketball teams on the final Olympic tournament. Acta Kinesiol. [cited on Jun 10, 2022];3(2):110-4. Available from:Available from:http://actakinesiologica.com/wp-content/uploads/2017/11/04-CL-18-HP-1.pdf
http://actakinesiologica.com/wp-content/...
and London20Milanović D, Štefan L, Škegro D. Situational efficiency parameters of successful and unsuccessful top male basketball teams in the Olympic Tournament games in London 2012. Balt. j., sport, health sci. 2016;100(1):31-7. Available from: https://journals.lsu.lt/baltic-journal-of-sport-health/article/view/44
https://journals.lsu.lt/baltic-journal-o...
. At the Tokyo Olympic tournament, winning teams had a total of 4.500 rebounds per match more than the losing teams in those matches. But more importantly, the winners had a 5.988 higher percentage of defensive rebound efficiency.

The limitations of such studies pertain primarily to the nature of notational analysis. This is not the case in our study. Namely, the greatest objection is in gathering data on efficiency in matches, because the data is gathered by third persons who may make mistakes in the gathering process. This endangers the validity and reliability of the study findings. This study analyzed data from a top-tier basketball event, the Olympic basketball tournament - from the management and organization of the competition to the quality of the participating national teams. The source for the data was the official website: https://www.fiba.basketball/olympics/men/2020, while the statistics for this competition were recorded in line with the FIBA Statistician’s Manual. Further, it is generally accepted that in most sporting events a “systematic advantage does exist for the home team”33Watkins P. Revisiting the home court advantage in College Basketball. International Journal of Sport Society2013;3(1):33-42. DOI: https://doi.org/10.18848/2152-7857/CGP/v03i01/53892
https://doi.org/10.18848/2152-7857/CGP/v...
);(34Keele L, Kell NJ. Dynamic models for dynamic theories: The ins and outs of lagged dependent variables. Polit Anal2006;14(2):186-205. DOI: https://doi.org/10.1093/pan/mpj006
https://doi.org/10.1093/pan/mpj006...
. This is also not the case in this study, because all the matches were played in one place, and it was only the Japan national team that could have had the home field advantage (they came in 11th in the tournament).

In basketball, statistical analysis is of special importance for predicting match outcome and the evaluation of the teams’ capabilities. Identifying the strong and weak sides of a basketball team or player and what should be improved is the key to progress and good performance in matches. The combinations of performance variables selected for analysis indicate that certain aspects have a significant impact on the final scores in competitions. They represent the starting point in preparing a team’s match strategy and allows for individual and team assessments. What is certain is that the significance of the practical application of the results of a study on game-related statistics is undeniable both in prior34Keele L, Kell NJ. Dynamic models for dynamic theories: The ins and outs of lagged dependent variables. Polit Anal2006;14(2):186-205. DOI: https://doi.org/10.1093/pan/mpj006
https://doi.org/10.1093/pan/mpj006...
and in more recent studies35Gryko K, Mikołajec K, Marszałek J, Adamczyk JG, Molik B, Waśkiewicz Z, Nikolaidis P, Knechtle B. How did basketball teams win EuroBasket 2015? A non-standard analysis of performance based on passes, dribbling and turnovers. Int. J. Perform. Anal. Sport2020;20(3):339-56. DOI: https://doi.org/10.1080/24748668.20 20.1749013
https://doi.org/10.1080/24748668.20 20.1...
)-(36Mikołajec K, Banyś D, Żurowska-Cegielska J, Zawartka M, Gryko K. How to win the Basketball Euroleague? Game performance determining sports results during 2003-2016 matches. J. Hum. Kinet. 2021;77:287-96. DOI: https://doi.org/10.2478/ hukin-2021-0050
https://doi.org/10.2478/ hukin-2021-0050...
.

The authors of this paper are aware that the obtained answers are not final and unambiguous. This is primarily because of the complexity of relations in sports, i.e. in every individual match, where it is difficult to create models that would encompass the full scale of activity of all the factors being monitored, because of the differences in their effect, i.e. intensity, direction and time of activity. In addition, it is certain that the final score is affected by other factors which are not being monitored, because they are seemingly less important, or are not measurable etc. There are other models and methods and other analytical procedures, which may induce some other results and conclusions, which is understandable given that the fundamental characteristic of sport is competition and is especially pronounced in basketball. Not being able to predict the result of a match with certainty may well be a fortunate thing after all, because if we knew the outcome in advance, the sporting event would lack one of its fundamental characteristics and would likely not appeal to spectators. Prognostic analytics should be pursued, but there should also be room for suspense in anticipation of the result and the sweet taste of victory. In his book “Sacred hoops: Spiritual lessons of a hardwood warrior”, Phil Jackson said: “Like life, basketball is messy and unpredictable. It has its way with you, no matter how hard you try to control it. The trick is to experience each moment with a clear mind and open heart. When you do that, the game - and life - will take care of itself”37Jackson, P. Sacred hoops: Spiritual lessons of a hardwood warrior. 2nd ed. New York, NY: Hachette Book Group; 2006);(19Pojskić H, Šeparović V, Užičanin E. (2009). Differences between successful and unsuccessful basketball teams on the final Olympic tournament. Acta Kinesiol. [cited on Jun 10, 2022];3(2):110-4. Available from:Available from:http://actakinesiologica.com/wp-content/uploads/2017/11/04-CL-18-HP-1.pdf
http://actakinesiologica.com/wp-content/...
.

Conclusion

The results of this study may lead to the conclusion that only one statistical regression model is highly representative. One model (2) did not show high representativeness. Two models (1 and 4), due to the evident detrimental impact of multicollinearity, underwent the necessary adjustments and re-evaluation, which yielded statistically significant models. Two out of three of the obtained regression models may lead to the conclusion that the final score at the men’s Olympic basketball tournament in Tokyo, when it comes to the standardly observed parameters of the game of basketball, was impacted by the variables related to field goals (three-point shot and two-point shot), turnovers and defensive rebounds. This is congruent with the findings of prior studies carried out on men's Olympic basketball tournaments since 2004, as well as with the evolution of the game of basketball and trends in men's basketball in recent years. When it comes to the complex variable of true shooting percentage, it came into use in recent years, especially in the NBA. This study has recognized its significance, and future studies are needed to examine its impact on tendencies in modern-day basketball.

References

  • Sindik J. Performance indicators of the top basketball players: Relations with several variables. Coll. Antropol. 2015[cited on Jun 10, 2022];39(3):617-24. Available from: Available from: https://www.collantropol.hr/antropo/article/view/844/1357
    » https://www.collantropol.hr/antropo/article/view/844/1357
  • Reilly T. Assessment of performance in team games. In: Roger E, Reilly T, editors. Kinanthropometry and exercise physiology laboratory manual: Test, procedures, and date. 3 ed. Vol. 1. New York: Routledge; 2009. p. 184-96.
  • Ciampolini V, do Nascimento JV, Ibáñez SJ, de Oliveira Nicolazzi L, Camaroto M, Schmitt Rocha JC, Saad MA. Offensive technical-tactical analysis on NBA finalist teams: A case study. Int. J. Phys. Educ. 2018;29:e2931. DOI: https://doi.org/10.4025/jphyseduc.v29i1.2931
    » https://doi.org/10.4025/jphyseduc.v29i1.2931
  • Millas J. Decision-making in the National Basketball Association: The interaction of advanced analytics and traditional evaluation methods. [Doctoral dissertation]. Eugene, OR: University of Oregon. Lundquist College of Business; 2015.
  • Rose L. The basketball handbook. Leeds, United Kingdom: Human Kinetics; 2004.
  • Blake B. Evaluating the validity of a basketball performance metric in correlation with winning and losing games. [Master thesis]. Cardiff, United Kingdom: Cardiff School of Sport; 2015.
  • Johnson B. Analytics and free throw shooting: Perception vs. reality. [Master thesis]. Fairfax, VA: George Mason University; 2017.
  • Celeux G, Robert V. Towards an objective team efficiency rate in basketball. J Soc Fr Statistique 2015[cited onJun 10, 2022];156(2):51-68. Available from: Available from: https://hal.inria.fr/hal-01020295v2/document
    » https://hal.inria.fr/hal-01020295v2/document
  • Blanco V, Salmerón R, Gómez-Haro S. A multiplication selection system based on player performance: Case study - The Spanish ACB Basketball League. arXiv 2018;802.07039[math.OC],27:1029-46. DOI: https://doi.org/10.1007/s10726018-9593-9
    » https://doi.org/10.1007/s10726018-9593-9
  • Martinéz JA. Factors determining production (FDP) in basketball. Econ. Bus. Lett. 2012;1(1):21-9.
  • Shanahan KJ. A model for predicting the probability of a win in basketball. [Master thesis]. Iowa City, IA: University of Iowa; 1984.
  • Jones EC. Predicting outcomes of NBA basketball games. [Master thesis]. Fargo, ND: North Dakota State University of Agriculture and Applied Science; 2016.
  • Morrissey H. Basketball game-related statistics which discriminate winners and losers in the ASC. [Doctoral dissertation]. Daphne, AL:; United States Sports Academy 2020.
  • Doğan İ, Ersöz Y. The important game-related statistics for qualifying next rounds in Euroleague. Montenegrin J. Sports Sci. Med. 2019;8(1):43-50. DOI: https://doi.org/10.26773/mjssm.190307
    » https://doi.org/10.26773/mjssm.190307
  • Peters AS. Analysis of game-related statistics which discriminate between winning and losing in Brazilian professional basketball. Rev. Bras. Educ. Fís. Esporte2015;29(4):551-8.
  • International Basketball Federation. 2020 Official basketball rules: Basketball rules and basketball equipment. Mies, Switzerland: FIBA; 2020[cited on Jun 10, 2022]. Available from:Available from:https://www.fiba.basketball/documents/official-basketball-rules/2020.pdf
    » https://www.fiba.basketball/documents/official-basketball-rules/2020.pdf
  • Ciampolini V, Ibáñez SJ, Nunes ELG, Borgatto AF, Nascimento JV. Factors associated with basketball field goals made in the 2014 NBA finals. Mot., Rev. Educ. Fis. 2017;23(4):e1017105. DOI: https://doi.org/10.1590/S1980-6574201700040008
    » https://doi.org/10.1590/S1980-6574201700040008
  • Sampaio J, Lago C, Drinkwater E. Explanations for the United States dominance in basketball at the Beijing Olympic games. J. Sports Sci. 2010;28(2):147-52. DOI: https://doi.org/10.1080/02640410903380486
    » https://doi.org/10.1080/02640410903380486
  • Pojskić H, Šeparović V, Užičanin E. (2009). Differences between successful and unsuccessful basketball teams on the final Olympic tournament. Acta Kinesiol. [cited on Jun 10, 2022];3(2):110-4. Available from:Available from:http://actakinesiologica.com/wp-content/uploads/2017/11/04-CL-18-HP-1.pdf
    » http://actakinesiologica.com/wp-content/uploads/2017/11/04-CL-18-HP-1.pdf
  • Milanović D, Štefan L, Škegro D. Situational efficiency parameters of successful and unsuccessful top male basketball teams in the Olympic Tournament games in London 2012. Balt. j., sport, health sci. 2016;100(1):31-7. Available from: https://journals.lsu.lt/baltic-journal-of-sport-health/article/view/44
    » https://journals.lsu.lt/baltic-journal-of-sport-health/article/view/44
  • Leicht AS, Gómez MA, Woods CT. Explaining match outcome during the Men’s basketball tournament at the Olympic Games. J. Sports Sci. Med. 2017;16(4):468-73. Available from:https://www.jssm.org/jssm-16-468.xml%3EFulltext
    » https://www.jssm.org/jssm-16-468.xml%3EFulltext
  • Price M, Yan J. The effects of the NBA COVID bubble on the NBA playoffs: A case study for home-court advantage. arXiv 2021;ID:2103.02832. Available from: https://arxiv.org/abs/2103.02832
    » https://arxiv.org/abs/2103.02832
  • Harmon M, Ebrahimi A, Lucey P, Klabjan D. Predicting shot making in basketball using convolutional neural networks learnt from adversarial multiagent trajectories. Stat.ML 2016; ID.13974398. Available from: https://arxiv.org/abs/1609.04849
    » https://arxiv.org/abs/1609.04849
  • Lapresa D, Alsasua R, Arana J, Anguera MT, Garzón B. Observational analysis of the construction of offensive sequences that end in a shot in youth basketball. Rev. de Psicol. del Deporte 2014[cited onJun 10, 2022];23(2):365-76. Available from: Available from: https://www.redalyc.org/pdf/2351/235131674016.pdf
    » https://www.redalyc.org/pdf/2351/235131674016.pdf
  • Courel-Ibañez J, Mcrobert A, Ortega E, Vélez DC. Collective behaviour in basketball: A systematic review. Int. J. Perform. Anal. Sport 2017;17(1):44−64. DOI: https://doi.org/10.1080/24748668.2017.1303982
    » https://doi.org/10.1080/24748668.2017.1303982
  • Messina E. My favourite drills [Internet]. FIBA Europe - Coaching Clinics. [cited onJun 10, 2022] Available from: Available from: http://coaching.fibaeurope.com/Default.asp?cid={E8DBEC51-0212-4C9D-B3874CB5D1D3A722}&coid={F3FDEF06-32B7-42F3-AED2-7EE3A4BF9483}&articleMode=on&
    » http://coaching.fibaeurope.com/Default.asp?cid={E8DBEC51-0212-4C9D-B3874CB5D1D3A722}&coid={F3FDEF06-32B7-42F3-AED2-7EE3A4BF9483}&articleMode=on&
  • Courel-Ibáñez J, McRobert AP, Ortega E, Cárdenas D. Inside game effectiveness in NBA basketball: Analysis of collective interactions. Kinesiology2018;50(2):218-27. DOI: 10.26582/k.50.2.5
    » https://doi.org/10.26582/k.50.2.5
  • Chang SC. Capability and opportunity in hot shooting performance: Evidence from top-scoring NBA leaders. PLoS ONE 2018;13(2). Doi: https://doi.org/10.1371/journal.pone.0179154
    » https://doi.org/10.1371/journal.pone.0179154
  • Trninić S. Analysis and teaching of the basketball game. Pula, Croatia: Vitka; 1995.
  • Stavropoulos N, Kolias P, Papadopoulou, Stavropoulou G. Game related predictors discriminating between winning and losing teams in preliminary, second and final round of basketball world cup 2019. Int. J. Perform. Anal. Sport2021;21(3):383-95. Doi: https://doi.org/10.1080/24748668.2021.1901437.
    » https://doi.org/10.1080/24748668.2021.1901437
  • Gómez MÁ, Medina R, Leicht AS, Zhang S, Vaquera A. The performance evolution of match play styles in the Spanish Professional Basketball League. Appl. Sci. 2020;10:7056. Doi: https://doi.org/10.3390/app10207056.
    » https://doi.org/10.3390/app10207056
  • Csataljay G, James N, Hughes M, Dancs H. Performance differences between winning and losing basketball teams during close, balanced and unbalanced quarters. J. Hum. Sport Exerc. 2012;7(2):356-64. DOI: https://doi.org/10.4100/jhse.2012.72.02
    » https://doi.org/10.4100/jhse.2012.72.02
  • Watkins P. Revisiting the home court advantage in College Basketball. International Journal of Sport Society2013;3(1):33-42. DOI: https://doi.org/10.18848/2152-7857/CGP/v03i01/53892
    » https://doi.org/10.18848/2152-7857/CGP/v03i01/53892
  • Keele L, Kell NJ. Dynamic models for dynamic theories: The ins and outs of lagged dependent variables. Polit Anal2006;14(2):186-205. DOI: https://doi.org/10.1093/pan/mpj006
    » https://doi.org/10.1093/pan/mpj006
  • Gryko K, Mikołajec K, Marszałek J, Adamczyk JG, Molik B, Waśkiewicz Z, Nikolaidis P, Knechtle B. How did basketball teams win EuroBasket 2015? A non-standard analysis of performance based on passes, dribbling and turnovers. Int. J. Perform. Anal. Sport2020;20(3):339-56. DOI: https://doi.org/10.1080/24748668.20 20.1749013
    » https://doi.org/10.1080/24748668.20 20.1749013
  • Mikołajec K, Banyś D, Żurowska-Cegielska J, Zawartka M, Gryko K. How to win the Basketball Euroleague? Game performance determining sports results during 2003-2016 matches. J. Hum. Kinet. 2021;77:287-96. DOI: https://doi.org/10.2478/ hukin-2021-0050
    » https://doi.org/10.2478/ hukin-2021-0050
  • Jackson, P. Sacred hoops: Spiritual lessons of a hardwood warrior. 2nd ed. New York, NY: Hachette Book Group; 2006

Publication Dates

  • Publication in this collection
    12 Dec 2022
  • Date of issue
    2022

History

  • Received
    21 Mar 2022
  • Accepted
    16 May 2022
  • Accepted
    16 May 2022
Universidade Estadual de Maringá Avenida Colombo, 5790 - cep: 87020-900 - tel: 44 3011 4315 - Maringá - PR - Brazil
E-mail: revdef@uem.br