Acessibilidade / Reportar erro

Knowledge Management Patterns Model for a Flight Test Environment

ABSTRACT

This paper investigates how Knowledge Management patterns in a Brazilian Air Force flight test environment can be simulated using a System Dynamics approach. The research has been conducted initially by a literature review on the main Knowledge Management and System Dynamics theories. Data for this research has been collected in a previous study consisted of documental research regarding the flight test environment Knowledge Management and a questionnaire-based survey which identified both a low Knowledge Management maturity level and the flight test core competence as the capability of performing flight test campaigns. The issued problem was the tradeoff between actions focused on performing flight test campaigns versus Knowledge Management to transfer the core competence inside organization in order to keep it in a high level. A system dynamics quantitative model has been developed as a result of this research. Fluxes and stokes were identified within the model and the relation between them emerged by identifying systemic feedback loops that may compromise the Knowledge Management and the core competence transferring. These features enable a holistic visualization and better understanding of the problem as well as the possibilities of identifying ways of improvement.

KEYWORDS
Systems dynamics; Core competence; Knowledge transferring; Quantitative model

INTRODUCTION

The Flight Test (FT) activity is based on knowledge attained by experience or research, and its core competence, for the Brazilian Air Force, may be expressed as “the capability of performing flight test campaigns” (Follador and Trabasso 2015Follador RC, Trabasso LG (2015) Knowledge Management maturity level in a Brazilian Air Force flight test environment. Proceedings of the 2015 Portland International Conference on Management of Engineering and Technology (PICMET); Portland, USA.) and should be kept and propagated inside the organization.

The mission of the Flight Test Organization (FTO) reads: “It is a Brazilian Air Force Organization specialized in the field of Science and Technology and its mission is to deliver specialized technological services regarding flight test, aircraft instrumentation and data telemetry to support research, development and certification of aeronautical products and to train specialized personal in flight test” (Brasil 2011Brasil, Ministério da Defesa (2011) Comando da Aeronáutica. RICA 21-99: regimento interno do Instituto de Pesquisas e Ensaios em Voo. São José dos Campos: Ministério da Defesa., p. 7).

The FTO executes great part of the Brazilian Air Force (BAF) activities regarding flight test and offers training courses for BAF test pilots, test engineers, instrumentation engineers and flight test technical personnel. Knowledge inside the FTO environment, mainly that related to its core competence, must be preserved and the activities regarding Knowledge Management (KM) must be developed such as genesis, maturation, use, preservation and dissemination.

Follador and Trabasso (2015)Follador RC, Trabasso LG (2015) Knowledge Management maturity level in a Brazilian Air Force flight test environment. Proceedings of the 2015 Portland International Conference on Management of Engineering and Technology (PICMET); Portland, USA. presented a documental research regarding the flight test environment and also submitted a questionnaire for KM maturity level assessment, identifying a low KM maturity level inside the FTO in BAF and the flight test core competence as the capability of performing flight test campaigns. These findings, in addition to a high demanding activity in performing Flight Test Campaigns, indicated that may exist a commitment between actions focused on performing flight test campaigns versus KM activities regarding the transference of the core competence inside the organization preventing an ideal sharing of important knowledge.

The objective of this paper is to simulate and analyze the KM patterns, in a BAF FTO, in order to apprehend the relationship between the activities of performing flight test campaigns and those of KM within the organization. This problem has been addressed using a system dynamics approach, where a quantitative model is proposed to identify the main stakeholders of the FTO KM system, pointing out fluxes and stocks as well as the relationships between them.

This article is organized as follows: the second section presents the literature review and describes the contribution of this paper. The third section describes the methodology used to construct the model. The following section presents the results and discussions about FT KM model, regarding the commitment between performing flight test campaigns and KM activities necessary to maintain the core competence in the organization. The final section summarizes the contribution of this research and discusses future studies.

LITERATURE REVIEW

Sterman (2002)Sterman JD (2002) Systems dynamics modeling: tools for learning in a complex world. IEEE Eng Manag Rev 30(1):42-42. doi: 10.1109/EMR.2002.1022404
https://doi.org/10.1109/EMR.2002.1022404...
suggested that, in a world of accelerating complexity and change, thoughtful leaders increasingly recognize that the management tools that had been used have not only failed to solve the persistent problems encountered, but may, in fact, be causing them. Examples of organizational policy resistance are: well-intentioned efforts to solve pressing problems create unanticipated side effects. “Learning about complex systems when you also live in them is difficult. We are all passengers on an aircraft, we must not only fly but redesign in flight” (Sterman 2002Sterman JD (2002) Systems dynamics modeling: tools for learning in a complex world. IEEE Eng Manag Rev 30(1):42-42. doi: 10.1109/EMR.2002.1022404
https://doi.org/10.1109/EMR.2002.1022404...
, p. 4).

To understand the system a literature review was performed on the topics of KM, System Dynamics (SD) and FT.

KNOWLEDGE MANAGEMENT

KM has been researched in the last decades (Davenport and Prusak 1998Davenport TH, Prusak L (1998) Working knowledge: how organizations manage what they know. New York: Harvard Business School Press.; Nonaka et al. 2001Nonaka I, Konno N, Toyama R (2001) Emergence of “ba”. In: Nonaka I, Nishiguchi T. Knowledge emergence: social, technical, and evolutionary dimensions of knowledge creation. Oxford, New York: Oxford University Press. p. 13-29.; Nonaka and Takeuchi 2004Nonaka I, Takeuchi H (2004) Hitotsubashi on knowledge management. Singapore: John Wiley & Sons.; Grundstein 2008Grundstein M (2008) Assessing the enterprise’s knowledge management maturity level. Int J Knowl Learn 4(5):415-426. doi: 10.1504/IJKL.2008.02206
https://doi.org/10.1504/IJKL.2008.02206...
; Lloria 2008Lloria MB (2008) A review of the main approaches to knowledge management. Knowl Manag Res Pract 6(1):77-89. doi: 10.1057/palgrave.kmrp.8500164
https://doi.org/10.1057/palgrave.kmrp.85...
; Albers 2009Albers JA (2009) A practical approach to implementing knowledge management. Journal of Knowledge Management Practice 10(1):1-14.). An organization that does not understand the importance of knowledge nor manages or improves it, based on the environment demands in which it is inserted, may be faded to a condition of capabilities loss or stagnation.

Nonaka and Takeuchi (2004)Nonaka I, Takeuchi H (2004) Hitotsubashi on knowledge management. Singapore: John Wiley & Sons. explore the concepts of explicit and tacit knowledge and propose 4 modes of knowledge conversion in a process called “The Spiral of Knowledge”, namely: (1) Socialization; (2) Externalization; (3) Internalization; and (4) Combination.

The organizational environment must provide conditions and means for allowing knowledge to flow. Bock (1999)Bock F (1999) The intelligent approach to knowledge management: viewing KM in terms of content, culture, process, and infrastructure. Knowl Manag Rev 7:22-25. says that it is important to consider KM in terms of 4 integrated dimensions: content, culture, processes, and infrastructure. Content is related to the following question: what kind of knowledge is important to my organization? Prahalad and Hamel (1990)Prahalad CK, Hamel G (1990) The core competence of the corporation. Harvard Business Review; [accessed 2016 Jul 1]. http://www.expert2business.com/itson/Articles/CoreCompetencies.pdf
http://www.expert2business.com/itson/Art...
state that some knowledge, known as core competence, is the source for organizations’ technological success.

“Culture sets both the limits (constraints) and the direction of movement of behavior within the organization: culture dictates the acceptance of all organization change” (McNabb 2007McNabb DE (2007) Knowledge management in the public sector: a blueprint for innovation in government. Armonk: M.E. Sharpe., p. 113). Therefore, the organization’s cultural dimension is a major factor to KM success, so people and their beliefs may be responsible for the cycle of knowledge acceptance inside an organization.

Albers (2009)Albers JA (2009) A practical approach to implementing knowledge management. Journal of Knowledge Management Practice 10(1):1-14. proposed a practical approach to implement KM based on 5 basics steps:

  1. Select KM team.

  2. Establish KM strategy and business case.

  3. Perform knowledge assessment and audit.

  4. Perform information technology (IT) assessment.

  5. Develop project plan and measurement systems.

Fonseca (2011)Fonseca GA (2011) Métricas em gestão do conhecimento: modelo para avaliação do impacto de comunidades de prática em uma empresa desenvolvedora e fabricante de produtos complexos (Master’s thesis). São José dos Campos: Instituto Tecnológico de Aeronáutica. In portuguese., in a study about KM in an aeronautical company, pointed out that the KM system in that environment had low effectiveness. His findings have been confirmed by institutional characteristics like lack of cultural organization and low adherence to KM initiatives. These characteristics may be also present within the FT organization, where the high workload of FT workers may contribute to reinforce the tendency of low KM effectiveness.

FLIGHT TEST KNOWLEDGE MANAGEMENT

Kimberlin (2003)Kimberlin RD (2003) Flight testing of fixed-wing aircraft. Reston: American Institute of Aeronautics and Astronautics. states that the FT activity is dependent on efficient KM. The BAF Basic Doctrine Manual (DCA 1-1) defines the FT activity as “the action that consists in use air force resources to identify the flying qualities and the performance of aircrafts and systems” (Brasil 2012Brasil, Ministério da Defesa (2012) Comando da Aeronáutica. DCA 1-1: Doutrina Básica da Força Aérea Brasileira. Brasília: Ministério da Defesa., p. 57). This statement indicates the dynamic characteristic of the FT activities, because FT deals with new systems that accompany the airspace technology continuous evolution. The correct evaluation, via flight tests, of the new systems guarantees their proper work and ensures flight safety.

Dealing with the state-of-the-art technologies available, an FT organization must have a KM concern in order to keep its operational capabilities and to be able to process the market technology push.

There are research examples relating FT and KM. Gray (2005)Gray III WR (2005) Boundary-avoidance tracking: a new pilot tracking model. Proceedings of the 2005 AIAA Atmospheric Flight Mechanics Conference and Exhibit; San Francisco, USA. proposes a mathematical model to investigate and understand a FT technique called boundary-avoidance tracking, identifying the causes of dangerous flight conditions known as Pilot Induced Oscillation (PIO). Follador et al. (2009)Follador RC, Souza CE, Marto AG, Silva RGA, Góes LCS (2009) Comparison of in-flight measured and computed aeroelastic damping: modal identification procedures and modeling approaches. Paper presented at: IFASD 2009. Proccedings of the International Forum on Aeroelasticity and Structural Dynamics; Seattle, USA. analyse FT methods to evaluate aeroelastic structural vibrations using Operational Modal Analysis (OMA).

An example of KM applied to FT techniques is the aeronautical certification manuals, such as the Advisory Circulars (AC), from the Federal Aviation Administration (FAA). They suggest a great number of techniques that are recognized as a guide to conduct FT activities. The AC 25-7 — Flight Test Guide for Certification of Transport Category Airplanes (United States 2012United States, Federal Aviation Administration (2012) Advisory Circular AC25-7C: Flight Test Guide for Certification of Transport Category Airplanes. Washington: Federal Aviation Administration.) — indicates its purpose as: “This AC provides updated guidance for the flight test evaluation of transport category airplanes. These guidelines provide an acceptable means of demonstrating compliance with the pertinent regulations […]” (United States 2012United States, Federal Aviation Administration (2012) Advisory Circular AC25-7C: Flight Test Guide for Certification of Transport Category Airplanes. Washington: Federal Aviation Administration., p. 1).

In the AC 25-7, it is worth noticing that FT knowledge is constantly evolving in line with new technology capabilities, in order to provide compliance with regulations. The evolution of the FT techniques demand constant training of Human Resources to provide them with the required ability and understanding to deal with the new techniques. Another source for FT knowledge is the reports produced after each FT campaign. It can be learned from the reports the issues regarding the whole campaign, namely, motivation, applied resources FT techniques, and final results.

Although there is a huge amount of written material regarding FT, great part of the knowledge attained during FT campaigns is related to tacit knowledge, acquired during on-the-job learning, and must be shared with the organization through the process of “externalization” (Nonaka and Takeuchi 2004Nonaka I, Takeuchi H (2004) Hitotsubashi on knowledge management. Singapore: John Wiley & Sons.). This kind of knowledge is part of the FTO core competence, identified as the capability of performing FT campaigns (Follador and Trabasso 2015Follador RC, Trabasso LG (2015) Knowledge Management maturity level in a Brazilian Air Force flight test environment. Proceedings of the 2015 Portland International Conference on Management of Engineering and Technology (PICMET); Portland, USA.).

Another important issue regarding FT reports is related to its main part, the 7-part paragraph: “There are key features likely to be required in a complete flight test report: conditions, results, analysis, role relation, conclusions, recommendations and standards compliance” (Gratton, 2010Gratton GB (2010) Flight test reports. In: Blockley R, Shyy W, editors. Encyclopedia of aerospace engineering. Chichester: Wiley. p. 1-10., p. 1).

In the researcher’s judgment, the core part of the 7-part paragraph is the role relation or Mission Impact. This part deals with the impact of the tested system characteristics on the mission it is supposed to perform. The test team must joint the operational knowledge with the FT information obtained and predict if the mission is still possible to be accomplished or how it will be affected by the issues revealed by the FT. A lack on this operational knowledge may lead to a misinterpretation and a false FT result that may produce serious problems in the future system FT or even in the aircraft operational performance.

Follador and Trabasso (2015)Follador RC, Trabasso LG (2015) Knowledge Management maturity level in a Brazilian Air Force flight test environment. Proceedings of the 2015 Portland International Conference on Management of Engineering and Technology (PICMET); Portland, USA. also identified the following characteristics in the KM environment analyzed in their study:

  • Lack of infrastructure dedicated to KM.

  • Lack of KM specialist.

  • High turnover of trained staff.

  • Flying Test Course (CEV) and library are the main stocks of registered knowledge.

  • CEV and library not linked.

  • High workload of the FT teams, impairing them to conduct knowledge sharing.

  • Frequent occurrence of rework.

These findings, especially the 6th characteristic, emphasize that the operational knowledge may be lost because of the FTO high workload on performing FT campaigns; consequently, there is little or no time to maintain the FT pilots updated with the evolution of operational missions.

SYSTEMS DYNAMICS

SD is a methodology largely used for analyzing systemic behavior in organizational or social systems, by means of representing causal relations between its elements and by analyzing its evolution in time (Forrester 1971Forrester JW (1971) Counterintuitive behavior of social systems. Theor Decis 2(2):109-140. doi: 10.1007/BF00148991
https://doi.org/10.1007/BF00148991...
, 1994Forrester JW (1994) System dynamics, systems thinking, and soft OR. Syst Dynam Rev 10(2-3):245-256. doi: 10.1002/sdr.4260100211
https://doi.org/10.1002/sdr.4260100211...
, 1997Forrester JW (1997) Industrial dynamics. J Oper Res Soc 48(10):1037-1041.; Sterman 2002Sterman JD (2002) Systems dynamics modeling: tools for learning in a complex world. IEEE Eng Manag Rev 30(1):42-42. doi: 10.1109/EMR.2002.1022404
https://doi.org/10.1109/EMR.2002.1022404...
; Villela 2005Villela PR (2005) Introdução à dinâmica de sistemas. Juiz de Fora: Universidade Federal de Juiz de Fora.; Morecroft 2007Morecroft JDW (2007) Strategic modelling and business dynamics: a feedback systems approach. Chichester: John Wiley & Sons.; Figueiredo 2009Figueiredo JCB (2009) Estudo da difusão da tecnologia móvel celular no Brasil: uma abordagem com o uso de Dinâmica de Sistemas. Prod 19(1):230-245. doi: 10.1590/S0103-65132009000100015
https://doi.org/10.1590/S0103-6513200900...
; Ford 1999Ford AT (1999) Modeling the environment: an introduction to system dynamics — models of environmental systems. Washington: Island Press.; Amaral 2012Amaral JAA (2012) Desvendando sistemas; [accessed 2015 Mar 6]. http://issuu.com/profjoaoarantes/docs/desvendandosistemasebook
http://issuu.com/profjoaoarantes/docs/de...
). The awareness for SD is growing because of its unique capacity for representing the real world. It deals with complexity, non-linearity and feedback structures, inherent to social and physical systems. It is a methodology that provides better understanding of complex systems evolution (Forrester 1994Forrester JW (1994) System dynamics, systems thinking, and soft OR. Syst Dynam Rev 10(2-3):245-256. doi: 10.1002/sdr.4260100211
https://doi.org/10.1002/sdr.4260100211...
; Sterman 2002Sterman JD (2002) Systems dynamics modeling: tools for learning in a complex world. IEEE Eng Manag Rev 30(1):42-42. doi: 10.1109/EMR.2002.1022404
https://doi.org/10.1109/EMR.2002.1022404...
; Meadows and Wright 2008Meadows DH, Wright D (2008) Thinking in systems: a primer. White River Junction: Chelsea Green Publishing.).

SD response is usually represented by particular behavior and pattern like exponential growth and oscillations and by its direct relation with feedback loops characterized as reinforced, balanced, delayed balanced and their combination (Ford 1999Ford AT (1999) Modeling the environment: an introduction to system dynamics — models of environmental systems. Washington: Island Press.; Gonçalves 2009Gonçalves P (2009) Behavior modes, pathways and overall trajectories: eigenvector and eigenvalue analysis of dynamic systems. Syst Dynam Rev 25(1):35-62. doi: 10.2139/ssrn.1131392
https://doi.org/10.2139/ssrn.1131392...
).

Sterman (2002)Sterman JD (2002) Systems dynamics modeling: tools for learning in a complex world. IEEE Eng Manag Rev 30(1):42-42. doi: 10.1109/EMR.2002.1022404
https://doi.org/10.1109/EMR.2002.1022404...
proposes the iterative approach for SD modeling. Results of any step can yield insights that lead to revisions of the previous step, as depicted in Fig. 1. The first step of the SD modeling process is to understand the problem (Ford 1999Ford AT (1999) Modeling the environment: an introduction to system dynamics — models of environmental systems. Washington: Island Press.; Sterman 2002Sterman JD (2002) Systems dynamics modeling: tools for learning in a complex world. IEEE Eng Manag Rev 30(1):42-42. doi: 10.1109/EMR.2002.1022404
https://doi.org/10.1109/EMR.2002.1022404...
; Morecroft 2007Morecroft JDW (2007) Strategic modelling and business dynamics: a feedback systems approach. Chichester: John Wiley & Sons.).

Figure 1
Iterative SD modeling process (Sterman 2002Sterman JD (2002) Systems dynamics modeling: tools for learning in a complex world. IEEE Eng Manag Rev 30(1):42-42. doi: 10.1109/EMR.2002.1022404
https://doi.org/10.1109/EMR.2002.1022404...
).

Ford (1999)Ford AT (1999) Modeling the environment: an introduction to system dynamics — models of environmental systems. Washington: Island Press. proposes 8 steps for SD modeling, namely:

  1. Get acquainted with the system.

  2. Be specific about the dynamic problem.

  3. Construct the stock and flow diagram.

  4. Draw the Causal Loop Diagram (CLD).

  5. Estimate the parameters values.

  6. Run the model to get the reference mode.

  7. Conduct sensitivity analysis.

  8. Test the impact of policies.

Several authors studied the relation between qualitative and quantitative approaches to SD modeling (Ford 1999Ford AT (1999) Modeling the environment: an introduction to system dynamics — models of environmental systems. Washington: Island Press.; Wolstenholme 1999Wolstenholme EF (1999) Qualitative vs quantitative modelling: the evolving balance. J Oper Res Soc 50(4):422-428. doi: 10.2307/3010462
https://doi.org/10.2307/3010462...
; Coyle 2000Coyle RG (2000) Qualitative and quantitative modelling in system dynamics: some research questions. Syst Dynam Rev 16(3):225-244. doi: 10.1002/1099-1727(200023)16:3<225::AID-SDR195>3.0.CO;2-D
https://doi.org/10.1002/1099-1727(200023...
). These 2 approaches are complementary as seen in the 8-step method proposed by Ford (1999)Ford AT (1999) Modeling the environment: an introduction to system dynamics — models of environmental systems. Washington: Island Press.: the first 4 can be classified as qualitative whereas the remained 4 steps belong to quantitative approach to SD modeling.

One important aspect of Step 5 — Estimate the parameters values — is to choose the correct time horizon. Sterman (2002)Sterman JD (2002) Systems dynamics modeling: tools for learning in a complex world. IEEE Eng Manag Rev 30(1):42-42. doi: 10.1109/EMR.2002.1022404
https://doi.org/10.1109/EMR.2002.1022404...
says that it should extend far enough in history to show how the problem emerges and describes its symptoms. A common mistake at this step is to estimate a time horizon too short that does not allow for correctly estimating the length of delays in the system. “[…] A good rule of thumb is to set the time horizon several times as long as the longest time delays in the system…” (Sterman 2002Sterman JD (2002) Systems dynamics modeling: tools for learning in a complex world. IEEE Eng Manag Rev 30(1):42-42. doi: 10.1109/EMR.2002.1022404
https://doi.org/10.1109/EMR.2002.1022404...
, p. 119).

The Step 8 — Test the impact of policies — may be applied both in qualitative and quantitative SD modeling (Coyle 1996Coyle RG (1996) System dynamics modelling: a practical approach. Vol. 1. Boca Raton: CRC Press.). This may result in new policies to be applied to the model in order to achieve improvements in the system performance and to minimize the problem addressed (Morecroft 2007Morecroft JDW (2007) Strategic modelling and business dynamics: a feedback systems approach. Chichester: John Wiley & Sons.).

Meadows and Wright (2008)Meadows DH, Wright D (2008) Thinking in systems: a primer. White River Junction: Chelsea Green Publishing. identify 12 leverage points, as places to intervene in a system with new policies, in order to change the structure of systems to produce more of what is needed and less of that which is undesirable. Examples of the leverage points are:

  • Numbers: constants and parameters such as subsidies, taxes, and standards.

  • Buffers: the sizes of stabilizing stocks relative to their flows.

  • Delays: the lengths of time relative to the rates of system changes.

The literature presents several studies using SD as a tool for modeling subjects as: technology innovation (Swinerd and McNaught 2014Swinerd C, McNaught KR (2014) Simulating the diffusion of technological innovation with an integrated hybrid agent-based system dynamics model. J Simulat 8(3):231-240. doi: 10.1057/jos.2014.2
https://doi.org/10.1057/jos.2014.2...
), improvement of anemia control (McCarthy et al. 2014McCarthy JT, Hocum CL, Albright RC, Rogers J, Gallaher EJ, Steensma DP, Dingli D (2014) Biomedical system dynamics to improve anemia control with Darbepoetin Alfa in long-term hemodialysis patients. Mayo Clin Proc 89(1):87-94. doi: 10.1016/j.mayocp.2013.10.022
https://doi.org/10.1016/j.mayocp.2013.10...
), adult obesity trends (Fallah-Fini et al. 2014Fallah-Fini S, Rahmandad H, Huang TTK, Bures RM, Glass TA (2014) Modeling US adult obesity trends: a system dynamics model for estimating energy imbalance gap. Am J Publ Health 104(7):1230-1239. doi: 10.2105/AJPH.2014.301882
https://doi.org/10.2105/AJPH.2014.301882...
), infection screening among young women (Teng et al. 2015Teng Y, Kong N, Tu W (2015) Optimizing strategies for population-based chlamydia infection screening among young women: an age-structured system dynamics approach. BMC Publ Health 15(1):639. doi: 10.1186/s12889-015-1975-z
https://doi.org/10.1186/s12889-015-1975-...
), information sharing, psychological safety performance effects (Bendoly 2014Bendoly E (2014) System dynamics understanding in projects: information sharing, psychological safety, and performance effects. Prod Oper Manag 23(8):1352-1369. doi: 10.1111/poms.12024
https://doi.org/10.1111/poms.12024...
), and diffusion of technological innovation (Swinerd and McNaught 2014Swinerd C, McNaught KR (2014) Simulating the diffusion of technological innovation with an integrated hybrid agent-based system dynamics model. J Simulat 8(3):231-240. doi: 10.1057/jos.2014.2
https://doi.org/10.1057/jos.2014.2...
).

Regarding specifically researches on KM, the following topics are found: KM performance (Chen and Fong 2015Chen L, Fong PSW (2015) Evaluation of knowledge management performance: an organic approach. Inform Manag 52(4):431-453. doi: 10.1016/j.im.2015.01.005
https://doi.org/10.1016/j.im.2015.01.005...
), KM process in airlines (Zaim et al. 2013Zaim S, Bayyurt N, Tarim M, Zaim H, Guc Y (2013) System dynamics modeling of a knowledge management process: a case study in Turkish Airlines. Procedia - Social and Behavioral Sciences 99:545-552. doi: 10.1016/j.sbspro.2013.10.524
https://doi.org/10.1016/j.sbspro.2013.10...
), organizational IT investment strategy and market performance (Liao et al. 2015Liao YW, Wang YM, Wang YS, Tu YM (2015) Understanding the dynamics between organizational IT investment strategy and market performance: a system dynamics approach. Comput Ind 71:46-57. doi: 10.1016/j.compind.2015.02.006
https://doi.org/10.1016/j.compind.2015.0...
), analysis of technology districts’ evolution in a knowledge-based perspective (Dangelico et al. 2010Dangelico RM, Garavelli AC, Petruzzelli AM (2010) A system dynamics model to analyze technology districts’ evolution in a knowledge-based perspective. Technovation 30(2):142-153. doi: 10.1016/j.technovation.2009.09.006
https://doi.org/10.1016/j.technovation.2...
), and capacity planning (Špicar 2014Špicar R (2014) System dynamics archetypes in capacity planning. Procedia Engineering 69:1350-1355. doi: 10.1016/j.proeng.2014.03.128
https://doi.org/10.1016/j.proeng.2014.03...
).

Gonçalves (2011)Gonçalves P (2011) Balancing provision of relief and recovery with capacity building in humanitarian operations. Operations Management Research 4(1-2):39-50. doi: 10.1007/s12063-011-0045-7
https://doi.org/10.1007/s12063-011-0045-...
analyzed the balance between the provision of relief and recovery and the capacity building in humanitarian operations. This is carried out by modeling the performance of 2 polar resources allocation strategies: one focusing in relief and recovery efforts and the other on capacity building. The author reports a counterintuitive behavior from relief/recovery and capacity tradeoff that is characterized as capability trap.

Repenning and Sterman (2002)Repenning NP, Sterman JD (2002) Capability traps and self-confirming attribution errors in the dynamics of process improvement. Admin Sci Q 47(2):265-295. doi: 10.2307/3094806
https://doi.org/10.2307/3094806...
define capability trap as the phenomenon that arises when people’s efforts to achieve performance targets come at the expense of maintenance and learning, thereby eroding the health of the system. The SD model developed by Gonçalves (2011)Gonçalves P (2011) Balancing provision of relief and recovery with capacity building in humanitarian operations. Operations Management Research 4(1-2):39-50. doi: 10.1007/s12063-011-0045-7
https://doi.org/10.1007/s12063-011-0045-...
is presented in Fig. 2, where a causal loop diagram depicting the feedback processes for an organization allocating resources between providing aid and building capacity can build on the capability trap phenomenon.

Figure 2
Counterintuitive behavior from relief/recovery and capacity tradeoff (Gonçalves 2011Gonçalves P (2011) Balancing provision of relief and recovery with capacity building in humanitarian operations. Operations Management Research 4(1-2):39-50. doi: 10.1007/s12063-011-0045-7
https://doi.org/10.1007/s12063-011-0045-...
).

A similar condition reported by Gonçalves (2011)Gonçalves P (2011) Balancing provision of relief and recovery with capacity building in humanitarian operations. Operations Management Research 4(1-2):39-50. doi: 10.1007/s12063-011-0045-7
https://doi.org/10.1007/s12063-011-0045-...
was identified in the KM system for the FT environment addressed in the present paper. Follador and Trabasso (2015)Follador RC, Trabasso LG (2015) Knowledge Management maturity level in a Brazilian Air Force flight test environment. Proceedings of the 2015 Portland International Conference on Management of Engineering and Technology (PICMET); Portland, USA. also report the high workload as an obstacle for knowledge sharing between flight test teams, which may be characterized as a capability trap.

The searched literature showed the increased relevance of SD in the modeling of complex systems, but it did not address specifically the KM regarding the knowledge transferring problem in an FT environment. Thus the present study aims to identify a counterintuitive relation between the dedication of performing FT campaigns and the risk of losing the organization core competence using a SD modeling process. Then a course of actions is proposed as means to mitigate the risk of losing the FT core competence.

MODEL DESCRIPTION

The SD modeling process used is based on that proposed by Sterman (2002)Sterman JD (2002) Systems dynamics modeling: tools for learning in a complex world. IEEE Eng Manag Rev 30(1):42-42. doi: 10.1109/EMR.2002.1022404
https://doi.org/10.1109/EMR.2002.1022404...
and Morecroft (2007)Morecroft JDW (2007) Strategic modelling and business dynamics: a feedback systems approach. Chichester: John Wiley & Sons.. For this development it was chosen the methodology proposed by Sterman (2002)Sterman JD (2002) Systems dynamics modeling: tools for learning in a complex world. IEEE Eng Manag Rev 30(1):42-42. doi: 10.1109/EMR.2002.1022404
https://doi.org/10.1109/EMR.2002.1022404...
, following the 2nd path proposed by Morecroft (2007)Morecroft JDW (2007) Strategic modelling and business dynamics: a feedback systems approach. Chichester: John Wiley & Sons.:

  • Identification of the problem under study.

  • Identification of the dynamic response.

  • Conception of a map of the main sectors involved.

  • Model the system checking for flows and stocks.

The acquaintance with the KM system was achieved based on the results presented by Follador and Trabasso (2015)Follador RC, Trabasso LG (2015) Knowledge Management maturity level in a Brazilian Air Force flight test environment. Proceedings of the 2015 Portland International Conference on Management of Engineering and Technology (PICMET); Portland, USA. and Fonseca (2011)Fonseca GA (2011) Métricas em gestão do conhecimento: modelo para avaliação do impacto de comunidades de prática em uma empresa desenvolvedora e fabricante de produtos complexos (Master’s thesis). São José dos Campos: Instituto Tecnológico de Aeronáutica. In portuguese. about KM systems. The KM acquaintance in a flight test environment provided enough information to formulate the dynamic problem: there is a poor knowledge transferring inside FT knowledge management environment. This, in turn, implies rework and the loss of important FT knowledge achieved mostly during FT campaigns.

It was understood that a KM system may have a good initial knowledge transferring, because, to became an FT pilot or engineer, one must go through a capacitating course where the basic knowledge is provided. After this initial stage, the knowledge transferring opportunities tend to stabilize at a lower level along the time. This assumption of dynamic response is presented in Fig. 3. This curve corresponds to one of the fundamental modes of dynamic behavior, corresponding to a reinforced loop followed by a balanced loop plus another reinforced loop (Sterman 2002Sterman JD (2002) Systems dynamics modeling: tools for learning in a complex world. IEEE Eng Manag Rev 30(1):42-42. doi: 10.1109/EMR.2002.1022404
https://doi.org/10.1109/EMR.2002.1022404...
).

Figure 3
Dynamic response of knowledge transferring in a KM system.

The dynamic mode reflects the behavior of a crescent adhesion in the initial moments of a KM system responding to a reinforced positive loop, due to the value it may have inside the organization. Then, a temporal progression occurs and the adhesion behavior reaches the maximum value, influenced by a balanced loop. Finally, the dynamic mode directs the KM system behavior to a lower level, represented by the dashed line, caused by a reinforced negative loop, due to systemic issues in the FT organization that correspond to the problem addressed in this paper.

After the KM dynamic response identification, a map of the main sectors involved in the system was conceived based on the research on KM maturity level performed by Follador and Trabasso (2015)Follador RC, Trabasso LG (2015) Knowledge Management maturity level in a Brazilian Air Force flight test environment. Proceedings of the 2015 Portland International Conference on Management of Engineering and Technology (PICMET); Portland, USA.. This map involves 3 main areas that affect KM: culture/people, processes and technology/infrastructure, as it is presented in Fig. 4.

Figure 4
Map of the main sectors involved in the KM system.

For example, the CLD for process sector was constructed based on the research performed by Follador and Trabasso (2015)Follador RC, Trabasso LG (2015) Knowledge Management maturity level in a Brazilian Air Force flight test environment. Proceedings of the 2015 Portland International Conference on Management of Engineering and Technology (PICMET); Portland, USA. and Fonseca (2011)Fonseca GA (2011) Métricas em gestão do conhecimento: modelo para avaliação do impacto de comunidades de prática em uma empresa desenvolvedora e fabricante de produtos complexos (Master’s thesis). São José dos Campos: Instituto Tecnológico de Aeronáutica. In portuguese.. The CLD of KM process sector is presented in Fig. 5.

Figure 5
CLD of the KM process sector.

Once the CLDs for all KM sectors are constructed, they are grouped to construct the stock and flow diagram for the KM system model, depicted in Fig. 6.

Figure 6
Proposed stock and flow diagram for the KM system model.

To construct the KM model it was used the software Vensim® version 6.3 provided by Ventana Systems in an academic version. This software is an integrated framework for conceptualizing, building, simulating, analyzing, optimizing, and deploying models of complex dynamic systems.

The model was constructed by the identification of “stocks” (or levels) as {Organizational Knowledge} and “flows” (or rates), like [Knowledge use] and [Knowledge erase]. Influence variables where also identified and added to the model, such as <researching>, <contracting>, <capacitating>, and <on the job training>.

Considering the interactions among flows, stocks, and variables, it was possible to identify reinforced and balanced feedback loops represented by the symbols such as (Gonçalves 2009Gonçalves P (2009) Behavior modes, pathways and overall trajectories: eigenvector and eigenvalue analysis of dynamic systems. Syst Dynam Rev 25(1):35-62. doi: 10.2139/ssrn.1131392
https://doi.org/10.2139/ssrn.1131392...
).) and (),respectively. These loops provide the possibility of studying the causal relations in the KM system that are traduced into equations and into curves of behavior over time. Once the main stock-and-flow structures (or levels and rates of change) and feedback processes characterizing the system are captured, it is possible to translate them into a mathematical simulation model (

RESULTS AND DISCUSSION

In Fig. 6, the stock {Organizational Knowledge} participates in one loop involving [Knowledge transferring], [Knowledge use], and [Knowledge generation]. This loop deals with the knowledge generation effort of the organization. Several variables are relevant in this loop, such as <researching>, <contracting>, <capacitating>, and <on the job training>. In terms of FT, the variable <on the job training> bears singular importance, as it carries the experience exchanged during execution of FT campaigns or flight tests. Even the operational knowledge, as a basis to understand the mission impact, is transferred from pilot to pilot during flights or participates in operational campaigns.

Another important variable in the model is <knowledge use>. It participates in 3 feedback loops, namely, Knowledge generation (reinforced loop), Performance (reinforced loop), and Knowledge transferring (balanced loop).

These 3 loops interact among themselves and are influenced by a high Human Resources attrition rate, denoting 2 conflicting concerns to the FTO: (1) performing FT campaigns; and (2) transferring knowledge among the teams involved in FT campaigns execution. This conflict shows that, with a low number of FT teams in this organization and the stress to perform flight test campaigns continually required by the main customer (BAF), the KM activity and the organization knowledge may be jeopardized. This can be seen from Figs. 7 and 8, where the simulations response for <organizational knowledge> and <knowledge transferring> are presented.

Figure 7
<organizational knowledge> response simulation.
Figure 8
<knowledge transferring> response simulation.

The results represent a counterintuitive observation: the greater the effort to maintain the FT organization totally focused on performing FT campaigns, the greater the risk of losing its core competence and ability to continue fulfilling the customer’s needs in the future. Despite the effort to generate and transfer knowledge by the FTO, the additional workload influences the system and it may be prevalent over the other activities. Furthermore, in a medium to long term, it may threaten the knowledge transferring, characterizing a capability trap that may prevent the organization from sharing and continuously learning its core competence.

It is important to notice the great similarity with the curve presented and the dynamic hypothesis for knowledge transferring inside the FTO. This finding is important because it brings awareness of the importance to look for leverage points in the model to introduce new policies for providing a more stable knowledge transferring and a preservation of the organizational knowledge while attending the requirements of FT campaigns.

CONCLUSION

This paper has shown that it is feasible to construct the SD model to represent a KM system inside an FT environment, providing means for observing the existing feedback loops in the KM system and identifying a simulated response for knowledge transferring very similar to the dynamic hypothesis formulated.

The SD model has provided means to understand the main variables in the FT environment regarding KM and to observe how they influence the KM system. Also, it was possible to understand a counterintuitive aspect, regarding the necessity of performing FT campaigns and to preserve FT knowledge, where efforts to maintain the FT organization focused on performing FT campaigns may offer a risk of losing its core competence and the ability to continue fulfilling the customer’s needs in the future. This pattern characterizes the existence of a capability trap within the FT organization.

Further research will be addressed to improve the model where new policies will be proposed in order to change the structure of systems, looking for a way to provide a more stable knowledge transferring and a preservation of the organizational knowledge. Parameters of the SD model will be adjusted in order to run a sensitivity analysis and to test the impact of policies to change the system into a more appropriate behavior of knowledge transferring. The aim of this procedure is to ensure that the FT organization maintains its core competence without affecting its ultimate goals of providing FT campaigns according to the customer’s needs.

REFERENCES

  • Albers JA (2009) A practical approach to implementing knowledge management. Journal of Knowledge Management Practice 10(1):1-14.
  • Amaral JAA (2012) Desvendando sistemas; [accessed 2015 Mar 6]. http://issuu.com/profjoaoarantes/docs/desvendandosistemasebook
    » http://issuu.com/profjoaoarantes/docs/desvendandosistemasebook
  • Bendoly E (2014) System dynamics understanding in projects: information sharing, psychological safety, and performance effects. Prod Oper Manag 23(8):1352-1369. doi: 10.1111/poms.12024
    » https://doi.org/10.1111/poms.12024
  • Bock F (1999) The intelligent approach to knowledge management: viewing KM in terms of content, culture, process, and infrastructure. Knowl Manag Rev 7:22-25.
  • Brasil, Ministério da Defesa (2011) Comando da Aeronáutica. RICA 21-99: regimento interno do Instituto de Pesquisas e Ensaios em Voo. São José dos Campos: Ministério da Defesa.
  • Brasil, Ministério da Defesa (2012) Comando da Aeronáutica. DCA 1-1: Doutrina Básica da Força Aérea Brasileira. Brasília: Ministério da Defesa.
  • Chen L, Fong PSW (2015) Evaluation of knowledge management performance: an organic approach. Inform Manag 52(4):431-453. doi: 10.1016/j.im.2015.01.005
    » https://doi.org/10.1016/j.im.2015.01.005
  • Coyle RG (1996) System dynamics modelling: a practical approach. Vol. 1. Boca Raton: CRC Press.
  • Coyle RG (2000) Qualitative and quantitative modelling in system dynamics: some research questions. Syst Dynam Rev 16(3):225-244. doi: 10.1002/1099-1727(200023)16:3<225::AID-SDR195>3.0.CO;2-D
    » https://doi.org/10.1002/1099-1727(200023)16:3<225::AID-SDR195>3.0.CO;2-D
  • Dangelico RM, Garavelli AC, Petruzzelli AM (2010) A system dynamics model to analyze technology districts’ evolution in a knowledge-based perspective. Technovation 30(2):142-153. doi: 10.1016/j.technovation.2009.09.006
    » https://doi.org/10.1016/j.technovation.2009.09.006
  • Davenport TH, Prusak L (1998) Working knowledge: how organizations manage what they know. New York: Harvard Business School Press.
  • Fallah-Fini S, Rahmandad H, Huang TTK, Bures RM, Glass TA (2014) Modeling US adult obesity trends: a system dynamics model for estimating energy imbalance gap. Am J Publ Health 104(7):1230-1239. doi: 10.2105/AJPH.2014.301882
    » https://doi.org/10.2105/AJPH.2014.301882
  • Figueiredo JCB (2009) Estudo da difusão da tecnologia móvel celular no Brasil: uma abordagem com o uso de Dinâmica de Sistemas. Prod 19(1):230-245. doi: 10.1590/S0103-65132009000100015
    » https://doi.org/10.1590/S0103-65132009000100015
  • Follador RC, Souza CE, Marto AG, Silva RGA, Góes LCS (2009) Comparison of in-flight measured and computed aeroelastic damping: modal identification procedures and modeling approaches. Paper presented at: IFASD 2009. Proccedings of the International Forum on Aeroelasticity and Structural Dynamics; Seattle, USA.
  • Follador RC, Trabasso LG (2015) Knowledge Management maturity level in a Brazilian Air Force flight test environment. Proceedings of the 2015 Portland International Conference on Management of Engineering and Technology (PICMET); Portland, USA.
  • Fonseca GA (2011) Métricas em gestão do conhecimento: modelo para avaliação do impacto de comunidades de prática em uma empresa desenvolvedora e fabricante de produtos complexos (Master’s thesis). São José dos Campos: Instituto Tecnológico de Aeronáutica. In portuguese.
  • Ford AT (1999) Modeling the environment: an introduction to system dynamics — models of environmental systems. Washington: Island Press.
  • Forrester JW (1971) Counterintuitive behavior of social systems. Theor Decis 2(2):109-140. doi: 10.1007/BF00148991
    » https://doi.org/10.1007/BF00148991
  • Forrester JW (1994) System dynamics, systems thinking, and soft OR. Syst Dynam Rev 10(2-3):245-256. doi: 10.1002/sdr.4260100211
    » https://doi.org/10.1002/sdr.4260100211
  • Forrester JW (1997) Industrial dynamics. J Oper Res Soc 48(10):1037-1041.
  • Gonçalves P (2009) Behavior modes, pathways and overall trajectories: eigenvector and eigenvalue analysis of dynamic systems. Syst Dynam Rev 25(1):35-62. doi: 10.2139/ssrn.1131392
    » https://doi.org/10.2139/ssrn.1131392
  • Gonçalves P (2011) Balancing provision of relief and recovery with capacity building in humanitarian operations. Operations Management Research 4(1-2):39-50. doi: 10.1007/s12063-011-0045-7
    » https://doi.org/10.1007/s12063-011-0045-7
  • Gratton GB (2010) Flight test reports. In: Blockley R, Shyy W, editors. Encyclopedia of aerospace engineering. Chichester: Wiley. p. 1-10.
  • Gray III WR (2005) Boundary-avoidance tracking: a new pilot tracking model. Proceedings of the 2005 AIAA Atmospheric Flight Mechanics Conference and Exhibit; San Francisco, USA.
  • Grundstein M (2008) Assessing the enterprise’s knowledge management maturity level. Int J Knowl Learn 4(5):415-426. doi: 10.1504/IJKL.2008.02206
    » https://doi.org/10.1504/IJKL.2008.02206
  • Kimberlin RD (2003) Flight testing of fixed-wing aircraft. Reston: American Institute of Aeronautics and Astronautics.
  • Liao YW, Wang YM, Wang YS, Tu YM (2015) Understanding the dynamics between organizational IT investment strategy and market performance: a system dynamics approach. Comput Ind 71:46-57. doi: 10.1016/j.compind.2015.02.006
    » https://doi.org/10.1016/j.compind.2015.02.006
  • Lloria MB (2008) A review of the main approaches to knowledge management. Knowl Manag Res Pract 6(1):77-89. doi: 10.1057/palgrave.kmrp.8500164
    » https://doi.org/10.1057/palgrave.kmrp.8500164
  • McCarthy JT, Hocum CL, Albright RC, Rogers J, Gallaher EJ, Steensma DP, Dingli D (2014) Biomedical system dynamics to improve anemia control with Darbepoetin Alfa in long-term hemodialysis patients. Mayo Clin Proc 89(1):87-94. doi: 10.1016/j.mayocp.2013.10.022
    » https://doi.org/10.1016/j.mayocp.2013.10.022
  • McNabb DE (2007) Knowledge management in the public sector: a blueprint for innovation in government. Armonk: M.E. Sharpe.
  • Meadows DH, Wright D (2008) Thinking in systems: a primer. White River Junction: Chelsea Green Publishing.
  • Morecroft JDW (2007) Strategic modelling and business dynamics: a feedback systems approach. Chichester: John Wiley & Sons.
  • Nonaka I, Konno N, Toyama R (2001) Emergence of “ba”. In: Nonaka I, Nishiguchi T. Knowledge emergence: social, technical, and evolutionary dimensions of knowledge creation. Oxford, New York: Oxford University Press. p. 13-29.
  • Nonaka I, Takeuchi H (2004) Hitotsubashi on knowledge management. Singapore: John Wiley & Sons.
  • Prahalad CK, Hamel G (1990) The core competence of the corporation. Harvard Business Review; [accessed 2016 Jul 1]. http://www.expert2business.com/itson/Articles/CoreCompetencies.pdf
    » http://www.expert2business.com/itson/Articles/CoreCompetencies.pdf
  • Repenning NP, Sterman JD (2002) Capability traps and self-confirming attribution errors in the dynamics of process improvement. Admin Sci Q 47(2):265-295. doi: 10.2307/3094806
    » https://doi.org/10.2307/3094806
  • Špicar R (2014) System dynamics archetypes in capacity planning. Procedia Engineering 69:1350-1355. doi: 10.1016/j.proeng.2014.03.128
    » https://doi.org/10.1016/j.proeng.2014.03.128
  • Sterman JD (2002) Systems dynamics modeling: tools for learning in a complex world. IEEE Eng Manag Rev 30(1):42-42. doi: 10.1109/EMR.2002.1022404
    » https://doi.org/10.1109/EMR.2002.1022404
  • Swinerd C, McNaught KR (2014) Simulating the diffusion of technological innovation with an integrated hybrid agent-based system dynamics model. J Simulat 8(3):231-240. doi: 10.1057/jos.2014.2
    » https://doi.org/10.1057/jos.2014.2
  • Teng Y, Kong N, Tu W (2015) Optimizing strategies for population-based chlamydia infection screening among young women: an age-structured system dynamics approach. BMC Publ Health 15(1):639. doi: 10.1186/s12889-015-1975-z
    » https://doi.org/10.1186/s12889-015-1975-z
  • United States, Federal Aviation Administration (2012) Advisory Circular AC25-7C: Flight Test Guide for Certification of Transport Category Airplanes. Washington: Federal Aviation Administration.
  • Villela PR (2005) Introdução à dinâmica de sistemas. Juiz de Fora: Universidade Federal de Juiz de Fora.
  • Wolstenholme EF (1999) Qualitative vs quantitative modelling: the evolving balance. J Oper Res Soc 50(4):422-428. doi: 10.2307/3010462
    » https://doi.org/10.2307/3010462
  • Zaim S, Bayyurt N, Tarim M, Zaim H, Guc Y (2013) System dynamics modeling of a knowledge management process: a case study in Turkish Airlines. Procedia - Social and Behavioral Sciences 99:545-552. doi: 10.1016/j.sbspro.2013.10.524
    » https://doi.org/10.1016/j.sbspro.2013.10.524

Publication Dates

  • Publication in this collection
    Jul-Sep 2016

History

  • Received
    03 Nov 2015
  • Accepted
    12 June 2016
Departamento de Ciência e Tecnologia Aeroespacial Instituto de Aeronáutica e Espaço. Praça Marechal do Ar Eduardo Gomes, 50. Vila das Acácias, CEP: 12 228-901, tel (55) 12 99162 5609 - São José dos Campos - SP - Brazil
E-mail: submission.jatm@gmail.com