Acessibilidade / Reportar erro

Committee neural network and weighted multiple regression to predict the energetic values of poultry feedstuffs

Comitê de redes neurais e regressão múltipla ponderada para a predição de valores energéticos de alimentos para aves de corte

Abstract:

The objective of this work was to compare the committee neural network (CNN) and weighted multiple linear regression (WMLR) models, in order to estimate the nitrogen-corrected apparent metabolizable energy (AMEn) of poultry feedstuffs. The prediction equation was adjusted by using a WMLR model and the meta-analysis principle. The models were compared by considering the correct prediction percentages, based on the classic prediction intervals and on the highest-probability density intervals, and by using a comparison test for proportions. The accuracy of the models was evaluated based on the values of the mean squared error, coefficient of determination, mean absolute deviation, mean absolute percentage error, and bias. Data from metabolic trials were used to compare the selected models. The committee neural network is the model that showed the highest accuracy of prediction, being recommended as the most accurate model to predict AMEn values for energetic concentrate feedstuffs used by the poultry feed industry.

Index terms:
broilers; highest-probability density interval; meta-analysis; metabolizable energy; percentage of success

Resumo:

O objetivo deste trabalho foi comparar o modelo comitê de redes neurais e o modelo de regressão linear múltipla ponderada (RLMP), para estimar a energia metabolizável aparente corrigida por nitrogênio (EMAn) de alimentos para aves. A equação de predição foi ajustada por RLMP e pelo princípio da meta-análise. Os modelos foram comparados tendo-se considerando as percentagens de acerto de predição, com base em intervalos de predição clássicos e intervalos de credibilidade da máxima densidade de probabilidade, e utilizado um teste para comparação de proporções. A acurácia dos modelos foi avaliada com base nos valores de erro médio quadrático, coeficiente de determinação, desvio médio absoluto, erro percentual absoluto médio e viés. Dados provenientes de ensaios metabólicos foram utilizados na comparação dos modelos selecionados. O comitê de redes neurais é o modelo que forneceu predições mais acuradas, sendo recomendado como o de maior acurácia, para prever os valores de EMAn de alimentos concentrados utilizados na indústria alimentícia para aves.

Termos para indexação:
frangos de corte; intervalo de credibilidade da máxima probabilidade; meta-análise; energia metabolizável; percentagem de acerto

Introduction

The diversity of feedstuffs and their byproducts used in the formulation of poultry feeds lead to the need of a precise knowledge of the chemical composition and the metabolizable energy values of feedstuffs to allow of an adequate supply of energy to the animals. The chemical composition determination is much easier and less costly than determining the metabolizable energy of feedstuffs. One of the most direct ways to determine the metabolizable energy is to use prediction equations (Nascimento et al., 2011NASCIMENTO, G.A.J.; RODRIGUES, P.B.; FREITAS, R.T.F.; REIS NETO, R.V.; LIMA, R.R.; ALLAMAN, I.B. Equações de predição para estimar valores da energia metabolizável de alimentos concentrados energéticos para aves utilizando meta-análise. Arquivo Brasileiro de Medicina Veterinária e Zootecnia, v.63, p.222-230, 2011. DOI: https://doi.org/10.1590/S0102-09352011000100032.
https://doi.org/10.1590/S0102-0935201100...
).

Classical statistical methods have been applied to obtain prediction equations of the nitrogen-corrected apparent metabolizable energy (AMEn) of poultry feeds. In these equations, the energy values of the feedstuffs are established according to their chemical compositions. In the methods used to obtain these prediction equations two ways can be considered to develop a multiple linear regression, as follows: using a classical multiple regression analysis without any restriction or weighting (Rodrigues et al., 2002RODRIGUES, P.B.; ROSTAGNO, H.S.; ALBINO, L.F.T.; GOMES, P.C.; NUNES, R.V.; TOLEDO, R.S. Valores energéticos da soja e subprodutos da soja, determinados com frangos de corte e galos adultos. Revista Brasileira de Zootecnia, v.31, p.1771-1782, 2002. DOI: https://doi.org/10.1590/s1516-35982002000700020.
https://doi.org/10.1590/s1516-3598200200...
); or using the principle of meta-analysis, in which homogeneous groups are established as weighting factors (Nascimento et al., 2009NASCIMENTO, G.A.J. do; RODRIGUES, P.B.; FREITAS, R.T.F. de; BERTECHINI, A.G.; LIMA, R.R. de; PUCCI, L.E.A. Equações de predição para estimar os valores energéticos de alimentos concentrados de origem vegetal para aves utilizando a metanálise. Revista Brasileira de Zootecnia, v.38, p.1265-1271, 2009. DOI: https://doi.org/10.1590/S1516-35982009000700015.
https://doi.org/10.1590/S1516-3598200900...
; Mariano et al., 2012MARIANO, F.C.M.Q.; LIMA, R.R. de; RODRIGUES, P.B.; ALVARENGA, R.R.; NASCIMENTO, G.A.J. do. Equações de predição de valores energéticos de alimentos obtidas utilizando meta-análise e componentes principais. Ciência Rural, v.42, p.1634-1640, 2012. DOI: https://doi.org/10.1590/S0103-84782012005000061.
https://doi.org/10.1590/S0103-8478201200...
).

Artificial neural network (ANN) models have recently been used in the prediction of energy values of feedstuffs for poultry (Perai et al., 2010PERAI, A.H.; MOGHADDAM, H.N.; ASADPOUR, S.; BAHRAMPOUR, J.; MANSOORI, G. A comparison of artificial neural networks with other statistical approaches for the prediction of true metabolizable energy of meat and bone meal. Poultry Science, v.89, p.1562-1568, 2010. DOI: https://doi.org/10.3382/ps.2010-00639.
https://doi.org/10.3382/ps.2010-00639...
; Mariano et al., 2013MARIANO, F.C.M.Q.; PAIXÃO, C.A.; LIMA, R.R.; ALVARENGA, R.R.; RODRIGUES, P.B.; NASCIMENTO, G.A.J. Prediction of the energy values of feedstuffs for broilers using meta-analysis and neural networks. Animal, v.7, p.1440-1445, 2013. DOI: https://doi.org/10.1017/S1751731113000712.
https://doi.org/10.1017/S175173111300071...
). Due to these models’ great capacity of learning from examples and generalizing the learned information, as well as of giving coherent answers to unknown data, it is possible to state that the application of an ANN goes beyond simply mapping relations of input and output. For this reason, statistic methods and ANN methods have competed with each other for space in the construction of models in several areas (Shi et al., 2012SHI, H.-Y.; LEE, K.-T.; LEE, H.-H.; HO, W.-H.; SUN, D.-P.; WANG, J.-J.; CHIU, C.-C. Comparison of artificial neural network and logistic regression models for predicting in-hospital mortality after primary liver cancer surgery. PLoS ONE, v.7, e35781, 2012. DOI: https://doi.org/10.1371/journal.pone.0035781.
https://doi.org/10.1371/journal.pone.003...
; Anyaeche & Ighravwe, 2013ANYAECHE, C.O.; IGHRAVWE, D.E. Predicting performance measures using linear regression and neural network: a comparison. African Journal of Engineering Research, v.1, p.84-89, 2013. ). ANN models have also shown superior performance to regression methods in the area of animal production and nutrition (Ahmadi & Golian, 2010AHMADI, H.; GOLIAN, A. Growth analysis of chickens fed diets varying in the percentage of metabolizable energy provided by protein, fat, and carbohydrate through artificial neural network. Poultry Science, v.89, p.173-179, 2010. DOI: https://doi.org/10.3382/ps.2009-00125.
https://doi.org/10.3382/ps.2009-00125...
; Perai et al., 2010PERAI, A.H.; MOGHADDAM, H.N.; ASADPOUR, S.; BAHRAMPOUR, J.; MANSOORI, G. A comparison of artificial neural networks with other statistical approaches for the prediction of true metabolizable energy of meat and bone meal. Poultry Science, v.89, p.1562-1568, 2010. DOI: https://doi.org/10.3382/ps.2010-00639.
https://doi.org/10.3382/ps.2010-00639...
; Wang et al., 2012WANG, B.Y.; CHEN, S.A.; ROAN, S.W. Comparison of regression and artificial neural network models of egg production. Journal of Animal and Veterinary Advances, v.11, p.2503-2508, 2012. DOI: https://doi.org/10.3923/javaa.2012.2503.2508.
https://doi.org/10.3923/javaa.2012.2503....
).

However, to obtain even more accurate results from ANN models, it is recommended the use of a committee networks. A committee network represents the aggregation of more than one component or network to reach a global solution that is supposedly superior to that obtained by any of the isolated components (Haykin, 2007HAYKIN, S. Neural networks: a comprehensive foundation. Upper Saddle River: Prentice Hall, 2007. ). The goal of a committee network is to increase the capacity of estimators’ generalization, avoiding the over-adjustment of data and convergence of the network to a local minimum.

In the poultry science area, Mariano et al. (2014)MARIANO, F.C.M.Q.; LIMA, R.R.; ALVARENGA, R.R.; RODRIGUES, P.B.; LACERDA, W.S. Neural network committee to predict the AMEn of poultry feedstuffs. Neural Computing and Applications, v.25, p.1903-1911, 2014. DOI: https://doi.org/10.1007/s00521-014-1680-3.
https://doi.org/10.1007/s00521-014-1680-...
have developed a committee network to predict the AMEn of poultry, in which the mode of the empirical distribution was the estimator that ensured more accurate predictions for these energy values. Furthermore, they recommended its use because it allows associating some uncertainty with the prediction, using a highest probability density (HPD) interval. In the literature, studies have compared the use of neural networks and regression models in animal science, but not regression models to the committee networks for AMEn predictions.

The objective of this work was to compare the committee neural network (CNN) and weighted multiple linear regression (WMLR) models, in order to estimate the nitrogen-corrected apparent metabolizable energy of poultry feedstuffs. Furthermore, besides considering the main effects and interactions between the explanatory variables to adjust the WMLR model, this work also sought to control the variability of the data set, creating a treatment variable by combining the levels of the categorical variables related to specifications of the feedstuff. These models were obtained for the rapid prediction of AMEn values of several concentrate feedstuffs commonly used in feeds for broilers.

Materials and methods

The dataset used to adjust the weighted multiple linear regression (WMLR) model was previously described by Nascimento et al. (2009)NASCIMENTO, G.A.J. do; RODRIGUES, P.B.; FREITAS, R.T.F. de; BERTECHINI, A.G.; LIMA, R.R. de; PUCCI, L.E.A. Equações de predição para estimar os valores energéticos de alimentos concentrados de origem vegetal para aves utilizando a metanálise. Revista Brasileira de Zootecnia, v.38, p.1265-1271, 2009. DOI: https://doi.org/10.1590/S1516-35982009000700015.
https://doi.org/10.1590/S1516-3598200900...
. This dataset referring to 568 experimental results corresponds to 370 energetic concentrate samples and 198 protein concentrate samples evaluated in experiments carried out in Brazil from 1967 to 2007.

The test data used in the comparison of the models refer to 48 samples of energetic concentrate and protein concentrate feedstuffs, which were determined in metabolic bioassays conducted in the Poultry Section of the Departamento de Zootecnia, of the Universidade Federal de Lavras, in Lavras, Minas Gerais state, Brazil. Among these data are the experimental results described by Alvarenga et al. (2011ALVARENGA, R.R.; RODRIGUES, P.B.; ZANGERONIMO, M.G.; FREITAS, R.T.F.; LIMA, R.R.; BERTECHINI, A.G.; FASSANI, E.J. Energetic values of feedstuffs for broilers determined with in vivo assays and prediction equations. Animal Feed Science and Technology, v.168, p.257-266, 2011. DOI: https://doi.org/10.1016/j.anifeedsci.2011.04.092.
https://doi.org/10.1016/j.anifeedsci.201...
, 2015)ALVARENGA, R.R.; RODRIGUES, P.B.; ZANGERONIMO, M.G.; OLIVEIRA, E.C.; MARIANO, F.C.M.Q.; LIMA, E.M.C.; GARCIA JR., A.A.P.; NAVES, L.P.; NARDELLI, N.B.S. Validation of prediction equations of energy values of a single ingredient or their combinations in male broilers. Asian-Australasian Journal of Animal Sciences, v.28, p.1335-1344, 2015. DOI: https://doi.org/10.5713/ajas.14.0339.
https://doi.org/10.5713/ajas.14.0339...
. The protein feedstuffs used in those metabolic bioassays were samples from six commercial brands of soybean meal, one of semi-integral soybean meal, one of extruded whole soybean, one of textured soybean protein, two of integral micronized soy, two of maize gluten meal at 60%, and one of a roasted whole soybean. The energetic feedstuffs included samples of four maize hybrids, three of sorghum, one of pre-gelatinized maize, one of broken maize, one of wheat meal, one of integral rice meal, one of broken rice, and one of defatted maize germ.

The observed values of apparent metabolizable energy (AMEn), chemical composition - crude protein (CP), ether extract (EE), ash, and crude fiber (CF) -, the classification of the feedstuff category (1 for energetic concentrate, 2 for protein concentrate), the type of ingredient (1 for maize, or soybean meal, and 2 for maize byproduct, or other soybean byproduct, and 3 for other feedstuff), and the type of animal used in the bioassay (1 for chick, and 2 for rooster) were defined for each feedstuff. All the feedstuffs considered are of plant origin, and are commonly used in poultry feeds.

In the present study, a multilayer-perceptron (MLP) committee neural network was considered, which was developed to predict AMEn values of energetic and protein concentrates for poultry (Mariano et al., 2014MARIANO, F.C.M.Q.; LIMA, R.R.; ALVARENGA, R.R.; RODRIGUES, P.B.; LACERDA, W.S. Neural network committee to predict the AMEn of poultry feedstuffs. Neural Computing and Applications, v.25, p.1903-1911, 2014. DOI: https://doi.org/10.1007/s00521-014-1680-3.
https://doi.org/10.1007/s00521-014-1680-...
). All networks considered in the committee had the same MLP architecture 7-5-3-1, which represents: 7 inputs, 5 neurons in the first hidden layer, 3 neurons in the second hidden layer, and 1 output. The same training algorithm, Levenberg-Marquardt, was used in all settings, but with the initial weights and the division between the training and validation data randomly defined by the Matlab R2012b (The Mathworks Inc., Natick, Massachusetts, USA). The Matlab offers a very efficient ANN toolbox and, therefore, it was used to implement the networks.

After testing committees with different numbers of networks, the committee N = 1,000 networks guaranteed the most accurate predictions, and the mode estimator of the empirical distribution was used as the combinator of expert networks. The choice of this committee was based on the value of the 95.83% correct predictions. Further information on the development of this committee can be obtained from Mariano et al. (2014)MARIANO, F.C.M.Q.; LIMA, R.R.; ALVARENGA, R.R.; RODRIGUES, P.B.; LACERDA, W.S. Neural network committee to predict the AMEn of poultry feedstuffs. Neural Computing and Applications, v.25, p.1903-1911, 2014. DOI: https://doi.org/10.1007/s00521-014-1680-3.
https://doi.org/10.1007/s00521-014-1680-...
.

Mariano et al. (2012)MARIANO, F.C.M.Q.; LIMA, R.R. de; RODRIGUES, P.B.; ALVARENGA, R.R.; NASCIMENTO, G.A.J. do. Equações de predição de valores energéticos de alimentos obtidas utilizando meta-análise e componentes principais. Ciência Rural, v.42, p.1634-1640, 2012. DOI: https://doi.org/10.1590/S0103-84782012005000061.
https://doi.org/10.1590/S0103-8478201200...
proposed and evaluated some of the AMEn prediction equations of poultry feedstuffs based on their chemical composition. These prediction equations were adjusted by WMLR models, considering the principle of the meta-analysis, and the technique of principal components was used in the formation of homogeneous groups of experimental results. In the present work, a weighted multiple linear regression equation was adjusted following the methodology of Mariano et al. (2012)MARIANO, F.C.M.Q.; LIMA, R.R. de; RODRIGUES, P.B.; ALVARENGA, R.R.; NASCIMENTO, G.A.J. do. Equações de predição de valores energéticos de alimentos obtidas utilizando meta-análise e componentes principais. Ciência Rural, v.42, p.1634-1640, 2012. DOI: https://doi.org/10.1590/S0103-84782012005000061.
https://doi.org/10.1590/S0103-8478201200...
, and using the set of 568 experimental results. Firstly, the TRAT variable was created by combining the levels of the categorical variables of the data set (feedstuff category, type of ingredient, and type of animal used in the bioassay). Thus, it the main effects and interactions between the explanatory variables (CP; EE; ash; CF; and TRAT) were considered in this model adjustment. EqPred denoted this prediction equation.

For comparison of the models considered in this paper, the percentage of correct predictions (PCP) in the test dataset was used. This percentage was obtained considering the frequency by which, in the test set, the observed values (real values) of the feedstuffs were within their respective intervals of prediction or of HPD.

The credibility intervals are the Bayesian correspondents to the confidence intervals in the classical approach. In general, the HPD interval is desirable, as it ensures that the interval is minimal (Carvalho, 2009CARVALHO, D.C. de O. Gráficos de controle Bayesianos em alguns processos da família exponencial. 2009. 47p. Dissertação (Mestrado) - Universidade Federal do Pará, Belém.). However, the construction of the HPD interval is usually based on samples from some distribution. In the present study, it is assumed that the empirical distribution approximates the desired distribution. Then, based on the property that HPD is the smallest of all ranges, the implementation finds the shortest range boundaries with the values of the ordered sample, considering the desired level of credibility, as presented by Ribeiro Jr et al. (2012).RIBEIRO JR, P.J.; BONAT, W.H.; KRAINSKI, E.T.; ZEVIANI, W.M. Métodos computacionais para inferência estatística. In: SIMPÓSIO NACIONAL DE PROBABILIDADE E ESTATÍSTICA, 20., 2012, João Pessoa. Minicurso. João Pessoa: Associação Brasileira de Estatística, 2012.

For the WMLR model, the prediction confidence interval (Ferreira, 2009FERREIRA, D.F. Estatística básica. 2.ed. rev. Lavras: UFLA, 2009. 663p.) was calculated for each feedstuff in the test set. For the committee networks, the HPD credible interval of predictions was considered, as the empirical distribution of the predictions coming from the neural networks that composed the committee was asymmetric (Ribeiro Jr et al., 2012RIBEIRO JR, P.J.; BONAT, W.H.; KRAINSKI, E.T.; ZEVIANI, W.M. Métodos computacionais para inferência estatística. In: SIMPÓSIO NACIONAL DE PROBABILIDADE E ESTATÍSTICA, 20., 2012, João Pessoa. Minicurso. João Pessoa: Associação Brasileira de Estatística, 2012.). The level of confidence and/or credibility considered was 95%.

The steps to obtain the HPD credible interval for each feedstuff in the test set were: (i) to consider the predictions corresponding to N = 1,000 committee networks; (ii) to obtain the empirical distribution of the 1,000 predictions of the feedstuff; (iii) to obtain, from the empirical distribution, the interval of smaller length that includes the points of highest density, that is, the HPD interval.

This way, the PCP can be expressed by the following ratio:

P C P = i = 1 k I ( L I i Y O B S i L S i ) K × 100,

in which: I(.) is an indicator function bellow,

I ( . ) = { 1, if Y O B S i interval 0, other case

LIi and LSi are, respectively, the lower and upper limits of the prediction intervals, or the HPD credible intervals, calculated for the ith feedstuff; YOBSi is the observed value of AMEn (real value) for the ith feedstuff; and K is the number of feedstuffs contained in the test set.

In the equation, it is said that there is no evidence that the predicted value is different from that observed, when the observed value of a feedstuff is within its respective interval, which should result in the success of this event. Thus, the calculation of the PCP is nothing more than an average of a simple random sample of a population with Bernoulli distribution.

The comparison of the obtained proportions in PCP was performed by applying the Pearson’s asymptotic chi-squared test, as defined in Biase & Ferreira (2009)BIASE, N.G.; FERREIRA, D.F. Comparações múltiplas e testes simultâneos para parâmetros binomiais de k populações independentes. Revista Brasileira de Biometria, v.27, p.301-323, 2009.. The nullity hypothesis of this test is the equality of the binomial proportions H0: PCP1 = PCP2, in which PCPi is the estimator of the correct proportion of each of the selected models. That is, PCP1 and PCP2 refer, respectively, to percentages of hits (successes) using the EqPred and the committee networks considered in the present study. By this test, it is possible to verify whether the proportions differ from each other. The statistic of this test has an asymptotic chi-squared distribution with ν = k - 1 degrees of freedom, in which k is the number of populations (in the present study, the number of selected models). The adopted level of significance was 5% for the test of comparison of proportions.

The quality of the adjustment and the accuracy of the AMEn prediction models, from both the prediction equation and the committee networks, were evaluated with the test data. The statistics used in this process, based on the errors between observed and predicted AMEn values, were as follows: R2 (coefficient of determination), MSE (mean squared error), MAD (mean absolute deviation), MAPE (mean absolute percentage error) and bias (systematic deviation), as defined by Mariano et al. (2014)MARIANO, F.C.M.Q.; LIMA, R.R.; ALVARENGA, R.R.; RODRIGUES, P.B.; LACERDA, W.S. Neural network committee to predict the AMEn of poultry feedstuffs. Neural Computing and Applications, v.25, p.1903-1911, 2014. DOI: https://doi.org/10.1007/s00521-014-1680-3.
https://doi.org/10.1007/s00521-014-1680-...
and Perai et al. (2010)PERAI, A.H.; MOGHADDAM, H.N.; ASADPOUR, S.; BAHRAMPOUR, J.; MANSOORI, G. A comparison of artificial neural networks with other statistical approaches for the prediction of true metabolizable energy of meat and bone meal. Poultry Science, v.89, p.1562-1568, 2010. DOI: https://doi.org/10.3382/ps.2010-00639.
https://doi.org/10.3382/ps.2010-00639...
. Thus, the closer to one is the value of R2, the closer to zero is the bias value, and the smaller the values of MSE, MAPE, and MAD, the more accurate the model. All statistical analyses were performed in free software R (R Core Team, 2019R CORE TEAM. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing, 2019. Software.).

Results and discussion

The EqPred model was adjusted, in order to search for a better predictive capacity among the usual statistical methods, considering the main effects and interactions between the explanatory variables. The adjustment of the proposed model is based on 12 regression equations (Table 1) due to the creation of the TRAT variable. Thus, TRATijk represents the particular equation, when the feedstuff is related to the ith feedstuff category, the jth type of ingredient, and the kth type of animal, in which: i = 1, energetic concentrate; or 2, protein concentrate; j = 1, maize, or soybean meal; 2, maize byproduct, or other soybean byproduct; 3, other feedstuff; k = 1, chick, or 2, rooster.

Table 1
Specific prediction equations for apparent metabolizable energy (AMEn) values of feedstuffs for broilers, for each combination of TRATi jk variable.

The models selected in the present study - EqPred and committee neural network - were developed for the prediction of AMEn of both energetic and protein concentrate feedstuffs. The use of these models is still more appropriate to estimate the AMEn of feedstuffs such as maize, sorghum, soybean, soybean meal, wheat and wheat meal (Mariano et al., 2012MARIANO, F.C.M.Q.; LIMA, R.R. de; RODRIGUES, P.B.; ALVARENGA, R.R.; NASCIMENTO, G.A.J. do. Equações de predição de valores energéticos de alimentos obtidas utilizando meta-análise e componentes principais. Ciência Rural, v.42, p.1634-1640, 2012. DOI: https://doi.org/10.1590/S0103-84782012005000061.
https://doi.org/10.1590/S0103-8478201200...
, 2013MARIANO, F.C.M.Q.; PAIXÃO, C.A.; LIMA, R.R.; ALVARENGA, R.R.; RODRIGUES, P.B.; NASCIMENTO, G.A.J. Prediction of the energy values of feedstuffs for broilers using meta-analysis and neural networks. Animal, v.7, p.1440-1445, 2013. DOI: https://doi.org/10.1017/S1751731113000712.
https://doi.org/10.1017/S175173111300071...
). These models were indicated because these feedstuffs had greater representativeness in the dataset used in the development of the models.

For the committee networks model, HPD intervals were considered, as the empirical distribution of predictions, coming from the 1,000 neural networks that composed the committee, was asymmetric. This way, the best interval to be calculated was the prediction credibility interval that included the points of highest density and shorter length, that is, the HPD interval (Ribeiro Jr et al., 2012RIBEIRO JR, P.J.; BONAT, W.H.; KRAINSKI, E.T.; ZEVIANI, W.M. Métodos computacionais para inferência estatística. In: SIMPÓSIO NACIONAL DE PROBABILIDADE E ESTATÍSTICA, 20., 2012, João Pessoa. Minicurso. João Pessoa: Associação Brasileira de Estatística, 2012.). For the prediction equation models, intervals of prediction (IP) were considered, which can also be defined as HPD intervals, since they correspond to the smallest interval of maximum coverage due to the normal symmetrical distribution assumed by the use of multiple linear regression.

The observed AMEn values in metabolic assays and their respective intervals referring to the models considered in this study are presented in Table 2. These intervals were calculated for the 48 feedstuffs of the test set. The mean amplitude of the HPD credible intervals were higher than the mean amplitude of the prediction intervals. The estimation of the HPD credible intervals allowed of the association of some uncertainty to the predicted values, increasing the reliability in the committee neural networks. In addition, constructed intervals were used as control limits to verify the PCP of the selected models (Table 3).

Table 2.
Observed values, intervals of prediction (IP), and the highest probability density (HPD) credible intervals, related to the test dataset of apparent metabolizable energy (AMEn) prediction models of poultry feedstuffs(1).
Table 3.
Percentage of correct predictions (PCP) of models for the prediction of apparent metabolizable energy (AMEn) values of feedstuffs for broilers, considering test data obtained in metabolic bioassay(1).

The equality of the binomial proportions was verified by Pearson’s asymptotic chi-squared test, which showed a significant result among the proportions (p-value <0.01). Therefore, the PCP obtained with the use of the committee networks was observed as greater than the proportion of successes obtained by the EqPred prediction equation (Table 3).

Statistical results associated to the models selected in this paper for the prediction of AMEn values of feedstuffs for broilers are presented in Table 4. The committee neural networks shows the lowest values for MAD, MAPE, and MSE, as well as R2 value closer to one, and bias closer to zero, than the EqPred. These results, obtained by the suitability criteria of models, showed that the committee networks provide more accurate predictions against the adjusted WMLR model, which is consistent with the fact that the committee model guarantees a higher PCP. Furthermore, the tendency of independent variables to be strongly correlated with one another and the existence of even significant quadruple interactions make the practical application of EqPred unfeasible for nutritionists of animal sector. In contrast, in the committee model, it is possible to use many variables that interfere in the variability of metabolizable energy, which is not always feasible in a multiple regression model.

Table 4.
Adequacy of the adjustment and accuracy of the selected models.

Therefore, the committee model composed of N = 1,000 networks, considering as best estimator the empirical mode of the predictions, had a good generalization, and will be made available for use with new input data. For this, an easy to use tool, created by Mariano et al. (2013)MARIANO, F.C.M.Q.; PAIXÃO, C.A.; LIMA, R.R.; ALVARENGA, R.R.; RODRIGUES, P.B.; NASCIMENTO, G.A.J. Prediction of the energy values of feedstuffs for broilers using meta-analysis and neural networks. Animal, v.7, p.1440-1445, 2013. DOI: https://doi.org/10.1017/S1751731113000712.
https://doi.org/10.1017/S175173111300071...
, can be improved for nutritionists of the animal area.

In the comparison of the predicted value with the real value, it was observed that the values predicted by the committee networks tended to follow the same patterns as the observed data, since points near the identity line indicate that the predicted values are more similar to those observed (Figure 1). In other words, it was possible to verify the good adjustment of the model for the prediction of AMEn of energetic and protein concentrates in feedstuffs, commonly used in the formulation of feeds for broilers.

Figure 1.
Predicted vs observed apparent metabolizable energy (AMEn) values obtained in the test data for concentrate feedstuffs for broilers, via committee neural networks.

The results obtained in this work reinforce the conclusions of previous studies that the use of models related to ANN guarantees more accurate predictions than those obtained by classical statistical methods, in the area of nutrition and animal production. Perai et al. (2010)PERAI, A.H.; MOGHADDAM, H.N.; ASADPOUR, S.; BAHRAMPOUR, J.; MANSOORI, G. A comparison of artificial neural networks with other statistical approaches for the prediction of true metabolizable energy of meat and bone meal. Poultry Science, v.89, p.1562-1568, 2010. DOI: https://doi.org/10.3382/ps.2010-00639.
https://doi.org/10.3382/ps.2010-00639...
noted that the ANN model produced more accurate predictions of true metabolizable energy (TMEn) values of meat and bone meal samples than the partial least square models and multiple linear regression. Wang et al. (2012)WANG, B.Y.; CHEN, S.A.; ROAN, S.W. Comparison of regression and artificial neural network models of egg production. Journal of Animal and Veterinary Advances, v.11, p.2503-2508, 2012. DOI: https://doi.org/10.3923/javaa.2012.2503.2508.
https://doi.org/10.3923/javaa.2012.2503....
showed that the ANN method is more accurate than traditional regression models for predicting egg production in Taiwan. Ahmadi & Golian (2010)AHMADI, H.; GOLIAN, A. Growth analysis of chickens fed diets varying in the percentage of metabolizable energy provided by protein, fat, and carbohydrate through artificial neural network. Poultry Science, v.89, p.173-179, 2010. DOI: https://doi.org/10.3382/ps.2009-00125.
https://doi.org/10.3382/ps.2009-00125...
verified that the radial basis functions neural networks model (RBFN) showed more accurate predictions of broiler growth than those obtained by multiple regression models; these broilers fed diets with different percentages of metabolizable energy provided by protein, fat, and carbohydrate.

For future studies, the use some method that makes it possible to evaluate the significance of input variables should be considered in the expert networks that will compose the committee, such as Bayesian networks. The objective is to improve the accuracy of the committee network model, in the prediction of AMEn for concentrate feedstuffs used in the formulation of poultry feeds. Furthermore, new regression models should be adjusted, and a more detailed analysis about prediction intervals should be considered.

Conclusions

  1. The use of the committee neural networks show more accurate predictions of apparent metabolizable energy of energetic and protein concentrates, in feedstuffs commonly used in the formulation of feeds for broilers, than those obtained by the prediction equation adjusted by a weighted multiple linear regression model.

  2. The committee with N = 1,000 networks, using the mode of the empirical distribution of the predictions in the combination of the results, guarantees a greater accuracy in the prediction of the test set.

Acknowledgments

To Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (Capes), for scholarship granted (Finance code 001).

References

  • AHMADI, H.; GOLIAN, A. Growth analysis of chickens fed diets varying in the percentage of metabolizable energy provided by protein, fat, and carbohydrate through artificial neural network. Poultry Science, v.89, p.173-179, 2010. DOI: https://doi.org/10.3382/ps.2009-00125.
    » https://doi.org/10.3382/ps.2009-00125
  • ALVARENGA, R.R.; RODRIGUES, P.B.; ZANGERONIMO, M.G.; FREITAS, R.T.F.; LIMA, R.R.; BERTECHINI, A.G.; FASSANI, E.J. Energetic values of feedstuffs for broilers determined with in vivo assays and prediction equations. Animal Feed Science and Technology, v.168, p.257-266, 2011. DOI: https://doi.org/10.1016/j.anifeedsci.2011.04.092.
    » https://doi.org/10.1016/j.anifeedsci.2011.04.092
  • ALVARENGA, R.R.; RODRIGUES, P.B.; ZANGERONIMO, M.G.; OLIVEIRA, E.C.; MARIANO, F.C.M.Q.; LIMA, E.M.C.; GARCIA JR., A.A.P.; NAVES, L.P.; NARDELLI, N.B.S. Validation of prediction equations of energy values of a single ingredient or their combinations in male broilers. Asian-Australasian Journal of Animal Sciences, v.28, p.1335-1344, 2015. DOI: https://doi.org/10.5713/ajas.14.0339.
    » https://doi.org/10.5713/ajas.14.0339
  • ANYAECHE, C.O.; IGHRAVWE, D.E. Predicting performance measures using linear regression and neural network: a comparison. African Journal of Engineering Research, v.1, p.84-89, 2013.
  • BIASE, N.G.; FERREIRA, D.F. Comparações múltiplas e testes simultâneos para parâmetros binomiais de k populações independentes. Revista Brasileira de Biometria, v.27, p.301-323, 2009.
  • CARVALHO, D.C. de O. Gráficos de controle Bayesianos em alguns processos da família exponencial. 2009. 47p. Dissertação (Mestrado) - Universidade Federal do Pará, Belém.
  • FERREIRA, D.F. Estatística básica. 2.ed. rev. Lavras: UFLA, 2009. 663p.
  • HAYKIN, S. Neural networks: a comprehensive foundation. Upper Saddle River: Prentice Hall, 2007.
  • MARIANO, F.C.M.Q.; LIMA, R.R. de; RODRIGUES, P.B.; ALVARENGA, R.R.; NASCIMENTO, G.A.J. do. Equações de predição de valores energéticos de alimentos obtidas utilizando meta-análise e componentes principais. Ciência Rural, v.42, p.1634-1640, 2012. DOI: https://doi.org/10.1590/S0103-84782012005000061.
    » https://doi.org/10.1590/S0103-84782012005000061
  • MARIANO, F.C.M.Q.; LIMA, R.R.; ALVARENGA, R.R.; RODRIGUES, P.B.; LACERDA, W.S. Neural network committee to predict the AMEn of poultry feedstuffs. Neural Computing and Applications, v.25, p.1903-1911, 2014. DOI: https://doi.org/10.1007/s00521-014-1680-3.
    » https://doi.org/10.1007/s00521-014-1680-3
  • MARIANO, F.C.M.Q.; PAIXÃO, C.A.; LIMA, R.R.; ALVARENGA, R.R.; RODRIGUES, P.B.; NASCIMENTO, G.A.J. Prediction of the energy values of feedstuffs for broilers using meta-analysis and neural networks. Animal, v.7, p.1440-1445, 2013. DOI: https://doi.org/10.1017/S1751731113000712.
    » https://doi.org/10.1017/S1751731113000712
  • NASCIMENTO, G.A.J. do; RODRIGUES, P.B.; FREITAS, R.T.F. de; BERTECHINI, A.G.; LIMA, R.R. de; PUCCI, L.E.A. Equações de predição para estimar os valores energéticos de alimentos concentrados de origem vegetal para aves utilizando a metanálise. Revista Brasileira de Zootecnia, v.38, p.1265-1271, 2009. DOI: https://doi.org/10.1590/S1516-35982009000700015.
    » https://doi.org/10.1590/S1516-35982009000700015
  • NASCIMENTO, G.A.J.; RODRIGUES, P.B.; FREITAS, R.T.F.; REIS NETO, R.V.; LIMA, R.R.; ALLAMAN, I.B. Equações de predição para estimar valores da energia metabolizável de alimentos concentrados energéticos para aves utilizando meta-análise. Arquivo Brasileiro de Medicina Veterinária e Zootecnia, v.63, p.222-230, 2011. DOI: https://doi.org/10.1590/S0102-09352011000100032.
    » https://doi.org/10.1590/S0102-09352011000100032
  • PERAI, A.H.; MOGHADDAM, H.N.; ASADPOUR, S.; BAHRAMPOUR, J.; MANSOORI, G. A comparison of artificial neural networks with other statistical approaches for the prediction of true metabolizable energy of meat and bone meal. Poultry Science, v.89, p.1562-1568, 2010. DOI: https://doi.org/10.3382/ps.2010-00639.
    » https://doi.org/10.3382/ps.2010-00639
  • R CORE TEAM. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing, 2019. Software.
  • RIBEIRO JR, P.J.; BONAT, W.H.; KRAINSKI, E.T.; ZEVIANI, W.M. Métodos computacionais para inferência estatística. In: SIMPÓSIO NACIONAL DE PROBABILIDADE E ESTATÍSTICA, 20., 2012, João Pessoa. Minicurso. João Pessoa: Associação Brasileira de Estatística, 2012.
  • RODRIGUES, P.B.; ROSTAGNO, H.S.; ALBINO, L.F.T.; GOMES, P.C.; NUNES, R.V.; TOLEDO, R.S. Valores energéticos da soja e subprodutos da soja, determinados com frangos de corte e galos adultos. Revista Brasileira de Zootecnia, v.31, p.1771-1782, 2002. DOI: https://doi.org/10.1590/s1516-35982002000700020.
    » https://doi.org/10.1590/s1516-35982002000700020
  • SHI, H.-Y.; LEE, K.-T.; LEE, H.-H.; HO, W.-H.; SUN, D.-P.; WANG, J.-J.; CHIU, C.-C. Comparison of artificial neural network and logistic regression models for predicting in-hospital mortality after primary liver cancer surgery. PLoS ONE, v.7, e35781, 2012. DOI: https://doi.org/10.1371/journal.pone.0035781.
    » https://doi.org/10.1371/journal.pone.0035781
  • WANG, B.Y.; CHEN, S.A.; ROAN, S.W. Comparison of regression and artificial neural network models of egg production. Journal of Animal and Veterinary Advances, v.11, p.2503-2508, 2012. DOI: https://doi.org/10.3923/javaa.2012.2503.2508.
    » https://doi.org/10.3923/javaa.2012.2503.2508

Publication Dates

  • Publication in this collection
    16 Mar 2020
  • Date of issue
    2020

History

  • Received
    18 Dec 2018
  • Accepted
    29 Jan 2020
Embrapa Secretaria de Pesquisa e Desenvolvimento; Pesquisa Agropecuária Brasileira Caixa Postal 040315, 70770-901 Brasília DF Brazil, Tel. +55 61 3448-1813, Fax +55 61 3340-5483 - Brasília - DF - Brazil
E-mail: pab@embrapa.br