Acessibilidade / Reportar erro

SELF-EFFICACY AND SELF-AWARENESS IN SCIENTIFIC TRANSLATORS’ EDUCATION: A PRELIMINARY STUDY

Abstract

In this paper, we present the results of a preliminary study on the evolution of self-efficacy and self-awareness among scientific translation students throughout one semester using data collected for three academic years. The analysis was based on the two components of self-efficacy: the perception that students have of their own capabilities to perform specific activities related to scientific and technical translation and their actual capabilities to perform those activities. To assess the self-efficacy beliefs of students, we analyzed the evolution of the self-perception of students based on the results of two questionnaires, an initial assessment questionnaire on their translation habits and problems, and a final psychometric questionnaire on the perceived usefulness of the pedagogical method used and on their self-efficacy beliefs. To assess the actual capabilities of students, we analyzed the evolution of the number of errors in each translation assignment and of the academic scores of students. The comparative analysis of the diagnostic assessment questionnaire and the diagnostic assessment translation assignment revealed low self-awareness at the beginning of the semester, as evidenced by a poor correspondence between students’ perceptions and performance. In contrast, a high degree of correspondence was found between self-efficacy beliefs and academic performance at the end of the semester, which suggests that the implemented method helped students develop realistic self-efficacy beliefs.

Keywords
Self-efficacy; self-awareness; scientific translation; task performance; assessment

Introduction

The limited ability of students to anticipate translation problems, find the correct strategy to solve them, spot errors and mitigate or justify good decisions, often made routinely or unconsciously, is a major issue in translator education, insofar as these shortcomings will probably lead students to failure in selecting the appropriate strategies to produce a good translation. Often, students’ choice of translation strategies is affected by their motivation, cognition and beliefs. Haro Soler (2019b)Haro Soler, María del Mar. “Autoconfianza versus autoeficacia del traductor: propuesta terminológica y estado de la cuestión”. Cadernos de Tradução, 39(2), p. 204-226, 2019b. DOI: http://dx.doi.org/10.5007/2175-7968.2019v39n2p204
https://doi.org/10.5007/2175-7968.2019v3...
explored a number of concepts related to self-perception, like self-efficacy, which is composed of the capabilities of students to perform a specific activity (self-efficacy) and their self-perception of those capabilities (self-efficacy beliefs). When applied to translation, the author defined self-efficacy beliefs as the confidence or perception that a translator has on their self-efficacy or capabilities to translate.

Specifically, self-efficacy beliefs affect motivation, information processing and strategy selection, particularly when self-perception and self-performance do not match. For this reason, translator educators must be aware of the impact of self-efficacy on the prediction of competence (Bontempo & Napier, 2011Bontempo, Karen, & Napier, Jemina. “Evaluating Emotional Stability as a Predictor of Interpreter competence and Aptitude for Interpreting”. Interpreting, 34(1), p. 85-105, 2011. DOI: https://doi.org/10.1075/intp.13.1.06bon
https://doi.org/10.1075/intp.13.1.06bon...
), performance (Ayllón, Alsina & Colomer, 2019Ayllón, Sara; Alsina, Ángel & Colomer, Jordi. “Teachers’ involvement and students’ self-efficacy: Keys to achievement in higher education”. PLoS ONE, 14(5), p. 1-11, 2019. DOI: https://doi.org/10.1371/journal.pone.0216865
https://doi.org/10.1371/journal.pone.021...
; Kontinen, 2022Kontinen, Kalle. “Monitoring student self-efficacy in a translation company simulation: A multilevel model approach”. Trans-kom, 15(1), p. 1-25, 2022.) and motivation (Shaw, 2011Shaw, Sherry. “Cognitive and Motivational Contributors to Aptitude: A Study of Spoken and Signed Language Interpreting Students”. Interpreting, 13(1), p. 70-84, 2011.), in order to incorporate tasks that contribute to improving the translation-related knowledge of students and their confidence and efficacy (Araghian, Ghonsooly & Ghanizadeh, 2018Araghian, Roya; Ghonsooly, Behzad & Ghanizadeh, Afsaneh. “Investigating problem-solving strategies of translation trainees with high and low levels of self-efficacy”. Translation, Cognition and Behavior, 1(1), p. 74-97, 2018. DOI: https://doi.org/10.1075/tcb.00004.ara
https://doi.org/10.1075/tcb.00004.ara...
; Kontinen, 2022Kontinen, Kalle. “Monitoring student self-efficacy in a translation company simulation: A multilevel model approach”. Trans-kom, 15(1), p. 1-25, 2022.) and, consequently, the correspondence between their beliefs and their practices. Yet, introducing changes in the organization of a course requires measuring the self-efficacy of students (Bolaños-Medina & Núñez, 2018Bolaños-Medina, Alicia & Núñez, Juan. “A Preliminary Scale for Assessing Translators’ Self-Efficacy”. Across Languages and Cultures, 19(1). p. 53-78, 2018. DOI: http://dx.doi.org/10.1556/084.2018.19.1.3
https://doi.org/10.1556/084.2018.19.1.3...
) and identifying the most suitable practices to enhance their self-efficacy beliefs (Haro Soler, 2019bHaro Soler, María del Mar. “Autoconfianza versus autoeficacia del traductor: propuesta terminológica y estado de la cuestión”. Cadernos de Tradução, 39(2), p. 204-226, 2019b. DOI: http://dx.doi.org/10.5007/2175-7968.2019v39n2p204
https://doi.org/10.5007/2175-7968.2019v3...
). According to the literature, among these practices are experience, reflective practice and constructive feedback.

In general, expertise often leads to increased self-confidence and self-efficacy. In a study of the impact of different levels of task difficulty and expertise on self-efficacy judgements, Ho (2010)Ho, Hsin-Ning. The Relationship between Levels of Expertise, Task Difficulty, and Mental Effort Investment in Task Performance. Doctoral Thesis (Ph.D.). Faculty of the USC Rossier School of Education, University of South California, California, 2010. found a significant and positive relationship between expertise and perceived self-efficacy, i.e., subjects with more expertise showed high levels of self-efficacy and subjects with low level of expertise showed low levels of self-efficacy. On the contrary, task difficulty correlated negatively with perceived self-efficacy, whereas perceived self-efficacy correlated positively with task performance. Thus, increased task difficulty led to poorer self-efficacy and performance. This finding is in agreement with Bandura (1997)Bandura, Albert. Self-Efficacy: The Exercise of Control. New York: Freeman, 1997., who claimed that the judgement of personal efficacy depends also on the levels of task difficulty as perceived by the performer.

Yet, experience is not sufficient insofar as learners do not learn directly from experience, but from reflecting on experience (Schön, 1983Schön, Donald. The Reflective Practitioner. How Professionals Think in Action. New York: Basic Books, 1983.; Mezirow, 1990Mezirow, Jack. Fostering Critical Reflection in Adulthood: A Guide to Transformative and Emancipatory Learning, Malden: Wiley, 1990.; Brookfield, 1995Brookfield, Stephen. Becoming a Critically Reflective Teacher. London: Jossey-Bass, 1995.; Mezirow, 1996Mezirow, Jack. “Contemporary Paradigms of Learning”. Adult Education Quarterly, 46(3), p. 158-172, 1996. DOI: https://doi.org/10.1177/074171369604600303
https://doi.org/10.1177/0741713696046003...
). In translator education, there is now widespread acknowledgement of the need to promote self-reflection, as it leads to enhanced self-awareness and, hence, to increased self-efficacy (Atkinson & Creeze, 2014Atkinson, David & Creeze, Ineke. “Improving Psychological Skill in Trainee Interpreters”. International Journal of Interpreter Education, 6(1), p. 3-18, 2014.; Norberg, 2014Norberg, Ulf. “Fostering self-reflection in translation students. The value of guided commentaries”. Translation and Interpreting Studies, 9(1), p. 150-164, 2014. DOI: https://doi.org/10.1075/tis.9.1.08nor
https://doi.org/10.1075/tis.9.1.08nor...
; Krogstie & Krogstie, 2016Krogstie, Birgit & Krogstie, John. “Considering Self-Efficacy in Reflection”. In: Kravcik, Milos; Mikroyannidis, Alexander; Pammer, Viktoria; Prilla, Michael & Ullmann, Thomas (Eds.). Proceedings of the 6th Workshop on Awareness and Reflection in Technology Enhanced Learning. Lyon: CEUR, 2016. p. 59-65.; Haro Soler, 2019bHaro Soler, María del Mar. “Autoconfianza versus autoeficacia del traductor: propuesta terminológica y estado de la cuestión”. Cadernos de Tradução, 39(2), p. 204-226, 2019b. DOI: http://dx.doi.org/10.5007/2175-7968.2019v39n2p204
https://doi.org/10.5007/2175-7968.2019v3...
; Haro Soler, 2021Haro Soler, María del Mar. “How Can Translation Teachers Care for Their Students? A Case Study on Verbal Persuasion and Translation Students’ Self-Efficacy Beliefs”. New Voices in Translation Studies, 24(1), p. 46-71, 2021.). Krogstie & Krogstie (2016)Krogstie, Birgit & Krogstie, John. “Considering Self-Efficacy in Reflection”. In: Kravcik, Milos; Mikroyannidis, Alexander; Pammer, Viktoria; Prilla, Michael & Ullmann, Thomas (Eds.). Proceedings of the 6th Workshop on Awareness and Reflection in Technology Enhanced Learning. Lyon: CEUR, 2016. p. 59-65. studied the relationship between reflective learning and self-efficacy and found that, if appropriately supported, the reflective learning cycle can lead to increased self-efficacy. Yet, they also suggested that self-efficacy could suffer from the experience of not being able to bring about change or apply the outcome of reflection (Krogstie & Krogstie, 2016Krogstie, Birgit & Krogstie, John. “Considering Self-Efficacy in Reflection”. In: Kravcik, Milos; Mikroyannidis, Alexander; Pammer, Viktoria; Prilla, Michael & Ullmann, Thomas (Eds.). Proceedings of the 6th Workshop on Awareness and Reflection in Technology Enhanced Learning. Lyon: CEUR, 2016. p. 59-65.).

When reflecting on translation, students focus on constructing knowledge by searching for explanations, interpretations and predictions instead of focusing on finding the right answer (Pietrzak, 2019Pietrzak, Paulina. “Scaffolding Student Self-Reflection in Translator Training”. Translation and Interpreting Studies, 14(3), p. 416-436, 2019. DOI: https://doi.org/10.1075/tis.18029.pie
https://doi.org/10.1075/tis.18029.pie...
), thus activating learning, self-analysis, the ability to relate theoretical and practical knowledge and, eventually, the ability to identify and solve problems, which is essential in translation competence acquisition (Martínez Melis & Hurtado Albir, 2001Martínez Melis, Nicole & Hurtado Albir, Amparo. “Assessment in Translation Studies: Research Needs”. Meta: Journal Des Traducteurs, 46(2), p. 272-287, 2001. DOI: https://doi.org/10.7202/003624ar
https://doi.org/10.7202/003624ar...
; Presas, 2012Presas, Marisa. “Training Translators in the European Higher Education Area: A Model for Evaluating Learning Outcomes”. Interpreter and Translator Trainer, 6(2), p. 138-169, 2012. DOI: https://doi.org/10.1080/13556509.2012.10798834
https://doi.org/10.1080/13556509.2012.10...
; Angelone, 2013Angelone, Erik. “The Impact of Process Protocol Self-Analysis on Errors in the Translation Product”. Translation and Interpreting Studies, 8(2), p. 253-271, 2013. DOI: https://doi.org/10.1075/tis.8.2.07ang
https://doi.org/10.1075/tis.8.2.07ang...
; Massey, 2017Massey, Gary. “Translation Competence Development and Process-Oriented Pedagogy”. In: Ferreira, Aline & Schwieter, John (Eds.). The Handbook of Translation and Cognition. Malden: John Wiley and Sons, 2017. p. 496-518. DOI: https://doi.org/10.1002/9781119241485.ch27
https://doi.org/10.1002/9781119241485.ch...
; Rodríguez-Inés & Fox, 2018Rodríguez-Inés, Patricia & Fox, Olivia. “Reconciling Institutional and Professional Requirements in the Specialised Inverse Translation Class - A Case Study”. Meta: Journal Des Traducteurs, 63(1), p. 47-71, 2018. DOI: https://doi.org/10.7202/1050514ar
https://doi.org/10.7202/1050514ar...
; Núñez & Bolaños-Medina, 2018Núñez, Juan & Bolaños-Medina, Alicia. “Predictors of Problem-Solving in Translation: Implications for Translator Training”. Interpreter and Translator Trainer, 12(3), p. 282-298, 2018. DOI: https://doi.org/10.1080/1750399X.2017.1359762
https://doi.org/10.1080/1750399X.2017.13...
; Angelone, 2019Angelone, Erik. “Process-Oriented Assessment of Problems and Errors in Translation: Expanding Horizons through Screen Recording”. In Huertas-Barros, Elsa; Vandepitte, Sonia & Iglesias Fernández, Emilia (Eds.). Quality Assurance and Assessment Practices in Translation and Interpreting. Hershey: IGI Global, 2019. p. 179-198.; Galán-Mañas, 2019Galán-Mañas, Anabel. “Professional Portfolio in Translator Training: Professional Competence Development and Assessment”. Interpreter and Translator Trainer, 13(1), p. 44-63, 2019. DOI: https://doi.org/10.1080/1750399X.2018.1541295
https://doi.org/10.1080/1750399X.2018.15...
; PACTE, 2019PACTE. “Evolution of the Efficacy of the Translation Process in Translation Competence Acquisition”. Meta: Journal Des Traducteurs, 64(1), p. 242-265, 2019. DOI: https://doi.org/10.7202/1065336ar
https://doi.org/10.7202/1065336ar...
; Kovács & Harangus, 2019Kovács, Gabriella & Harangus, Katalin. “Translator Trainees’ Reading Literacy, Problem Solving, and Translation Skills: A Comparative Study”. Acta Universitatis Sapientiae Philologica, 11(3), p. 141-157, 2019. DOI: https://doi.org/10.2478/ausp-2019-0031
https://doi.org/10.2478/ausp-2019-0031...
). A variety of approaches have been used to implement reflective learning in translator education, particularly process-oriented pedagogical methods, such as think aloud protocols (TAPs), IPDR logging, retrospective verbalizations, questionnaires, interviews, changes tracked in a document, post-learning reports, keystroke logging, eye tracking or screen recordings (e.g. Gile, 2004Gile, Daniel. “Integrated Problem and Decision Reporting as a Translator Training Tool”. Journal of Specialised Translation, 2(1), p. 2-20, 2004.; Shreve, Angelone & Lacruz, 2014Shreve, Gregory; Angelone, Erik & Lacruz, Isabel. “Efficacy of Screen Recording in the Other-Revision of Translations: Episodic Memory and Event Models”. MonTI. Special Issue – Minding Translation, 1(1), p. 225-245, 2014. DOI: http://dx.doi.org/10.6035/MonTI.2014.ne1.7
https://doi.org/10.6035/MonTI.2014.ne1.7...
; Göpferich, 2013Göpferich, Susanne. “Translation Competence: Explaining Development and Stagnation from a Dynamic Systems Perspective”. Target. International Journal of Translation Studies, 2(51), p. 61-76, 2013. DOI: https://doi.org/10.1075/target.25.1.06goe
https://doi.org/10.1075/target.25.1.06go...
; Ehrensberger-Dow & Massey, 2013Ehrensberger-Dow, Maureen & Massey, Gary. “Indicators of Translation Competence: Translators’ Self-Concepts and the Translation of Titles”. Journal of Writing Research, 5(1), p. 103-131, 2013. DOI: https://doi.org/10.17239/jowr-2013.05.01.5
https://doi.org/10.17239/jowr-2013.05.01...
; Angelone, 2013Angelone, Erik. “The Impact of Process Protocol Self-Analysis on Errors in the Translation Product”. Translation and Interpreting Studies, 8(2), p. 253-271, 2013. DOI: https://doi.org/10.1075/tis.8.2.07ang
https://doi.org/10.1075/tis.8.2.07ang...
, 2015Angelone, Erik. “Optimizing Process-Oriented Translator Training Using Freeware and FOSS Screen Recording Applications”. In Sandrini, Peter & García González, Marta (Eds.). Translation and Openness. Innsbruck: Innsbruck University Press, 2015. p. 131-144.; Ferreira & Schwieter, 2017Ferreira, Aline & Schwieter, John. “Translation and Cognition”. In Ferreira, Aline & Schwieter, John (Eds.). The Handbook of Translation and Cognition. Malden: John Wiley and Sons, 2017. p. 1-17.; Shreve, Angelone & Lacruz, 2018Shreve, Gregory; Angelone, Erik & Lacruz, Isabel. “Are Expertise and Translation Competence the Same? Psychological Reality and the Theoretical Status of Competence”. In: Lacruz, Isabel & Jääskeläinen, Riitta (Eds.). Innovation and Expansion in Translation Process Research. Amsterdam: John Benjamins, 2018. p. 37-54.; Pietrzak, 2019Pietrzak, Paulina. “Scaffolding Student Self-Reflection in Translator Training”. Translation and Interpreting Studies, 14(3), p. 416-436, 2019. DOI: https://doi.org/10.1075/tis.18029.pie
https://doi.org/10.1075/tis.18029.pie...
). While simultaneous reflection may distort the translation process of students because of the extra effort required by self-reporting at the same time as they are translating, retrospective reflection can help minimize these problems and find a balance between the effort devoted to translating and the effort devoted to reflecting. Among the most common retrospective reflection methods are commented translations (Presas, 2012Presas, Marisa. “Training Translators in the European Higher Education Area: A Model for Evaluating Learning Outcomes”. Interpreter and Translator Trainer, 6(2), p. 138-169, 2012. DOI: https://doi.org/10.1080/13556509.2012.10798834
https://doi.org/10.1080/13556509.2012.10...
), written and oral reports on translation solutions (Rodríguez-Inés & Fox, 2018Rodríguez-Inés, Patricia & Fox, Olivia. “Reconciling Institutional and Professional Requirements in the Specialised Inverse Translation Class - A Case Study”. Meta: Journal Des Traducteurs, 63(1), p. 47-71, 2018. DOI: https://doi.org/10.7202/1050514ar
https://doi.org/10.7202/1050514ar...
) or reports on translations, self-assessment reports and revised versions of translations (Galán-Mañas, 2016Galán-Mañas, Anabel. “Learning Portfolio in Translator Training: The Tool of Choice for Competence Development and Assessment”. The Interpreter and Translator Trainer, 10(2), p. 161-182, 2016. DOI: https://doi.org/10.1080/1750399X.2015.1103108
https://doi.org/10.1080/1750399X.2015.11...
), which are in line with the methods used in this paper to enhance self-awareness and self-efficacy among scientific translation students.

In the field for specialized translation, Mellinger (2019)Mellinger, Christopher. “Metacognition and Self-Assessment in Specialized Translation Education: Task Awareness and Metacognitive Bundling”. Perspectives: Studies in Translation Theory and Practice, 27(4), p. 604-621, 2019. DOI: https://doi.org/10.1080/0907676X.2019.1566390
https://doi.org/10.1080/0907676X.2019.15...
explored the pedagogical usefulness of retrospective reflective essays for improving student performance in specialized translation. He combined product-based analysis of students’ translations with process-oriented reflections and found that students often exhibited limited global awareness of the process and reported translation problems related to medical terminology, neologisms and phraseology, but hardly reflected on the task. Interestingly, he found an increase in metacognitive behavior in only eight weeks and suggested that problem recognition and solution evaluation among specialized translation students can be developed as the result of coursework focused on increasing task awareness. Also, in the field of medical translation, Pietrzak (2019)Pietrzak, Paulina. “Scaffolding Student Self-Reflection in Translator Training”. Translation and Interpreting Studies, 14(3), p. 416-436, 2019. DOI: https://doi.org/10.1075/tis.18029.pie
https://doi.org/10.1075/tis.18029.pie...
combined prospective and retrospective reflection using pre-and post-translation questionnaires about students’ thoughts and assumptions related to the source text and concluded that students gained more awareness on the translation process and teachers gained more insight in students’ assumptions and concerns. Despite the benefits discussed in the above paragraphs, using these methodologies showed also some shortcomings or limitations. For instance, a potential problem of relying on the information provided by students in written reports can be an inclination to falsification, particularly when summative assessments are involved (Massey, 2017Massey, Gary. “Translation Competence Development and Process-Oriented Pedagogy”. In: Ferreira, Aline & Schwieter, John (Eds.). The Handbook of Translation and Cognition. Malden: John Wiley and Sons, 2017. p. 496-518. DOI: https://doi.org/10.1002/9781119241485.ch27
https://doi.org/10.1002/9781119241485.ch...
). Yet, when dealing with perception studies, relying on the information provided by students is essential.

Finally, reflective learning must be accompanied by constructive feedback, which helps students gain confidence in their abilities as translators (Atkinson, 2014Atkinson, David. “Developing Psychological Skill for the Global Language Industry: An Exploration of Approaches to Translator and Interpreter Training”. Translation Spaces, 3(1), p. 1-24, 2014. DOI: https://doi.org/10.1075/ts.3.01atk
https://doi.org/10.1075/ts.3.01atk...
; Atkinson & Creeze, 2014Atkinson, David & Creeze, Ineke. “Improving Psychological Skill in Trainee Interpreters”. International Journal of Interpreter Education, 6(1), p. 3-18, 2014.) and become aware of their strengths (Way, 2008Way, Catherine. “Systematic Assessment of Translator Competence: In Search of Achilles’ Heel”. In: Kearns, John (Ed.). Translator and Interpreter Training: Issues, Methods and Debates. London: Continuum, 2008. p. 88-103., 2009Way, Catherine. “Bringing Professional Practices into Translation Classrooms”. In: Kemble, Ian (Ed.). The Changing Face of Translation. Portsmouth: Portsmouth University Press, 2009. p. 131-142.). In this sense, Atkinson & Creeze (2014)Atkinson, David & Creeze, Ineke. “Improving Psychological Skill in Trainee Interpreters”. International Journal of Interpreter Education, 6(1), p. 3-18, 2014. proposed using self-reflection to help students develop realistic self-efficacy beliefs. In the field of specialized translation pedagogy, constructive feedback is particularly relevant for increasing self-confidence because students often feel less confident when exposed to the translation of specialized texts due to their lack of knowledge about the subject area (Le Poder, 2010Le Poder, Evelyn. “Introducción a la traducción jurídica”. In: Cifuentes, José Luis; Gómez González-Jover, Adelina; Lillo, Antonio & Yus Ramos, Francisco (Eds.). Los caminos de la lengua: Estudios en homenaje a Enrique Alcaraz Varó, Alicante: Servicio de Publicaciones de la Universidad de Alicante, 2010. p. 177-188.; Haro-Soler, 2021Haro Soler, María del Mar. “How Can Translation Teachers Care for Their Students? A Case Study on Verbal Persuasion and Translation Students’ Self-Efficacy Beliefs”. New Voices in Translation Studies, 24(1), p. 46-71, 2021.), which can yet be compensated by a good mastery of research skills (Bolaños-Medina, 2014Bolaños-Medina, Alicia. “Self-efficacy in Translation”. Translation and Interpreting Studies, 9(2). pp. 197-218, 2014. DOI: https://doi.org/10.1075/tis.9.2.03bol
https://doi.org/10.1075/tis.9.2.03bol...
). Nevertheless, as reported by Hjort-Pedersen & Faber (2009)Hjort-Pedersen, Mette & Faber, Dorris. “Uncertainty in the Cognitive Processing of a Legal Scenario: A Process Study of Student Translators”. Hermes: Journal of Language and Communication, 42(1), p. 189-209, 2009. DOI: https://doi.org/10.7146/hjlcb.v22i42.96852
https://doi.org/10.7146/hjlcb.v22i42.968...
for legal texts, students know that they need extensive knowledge but they find it difficult to recognize which are their information needs. Likewise, their lack of confidence and self-efficacy is related to their condition of non-experts as readers (Haro Soler, 2019aHaro Soler, María del Mar. “Autoeficacia del estudiantado en la formación en traducción jurídica: Un estudio exploratorio”. Opción, 89(2), p. 880-910, 2019a.) and writers of specialized texts (Hjort-Pedersen & Faber, 2009Hjort-Pedersen, Mette & Faber, Dorris. “Uncertainty in the Cognitive Processing of a Legal Scenario: A Process Study of Student Translators”. Hermes: Journal of Language and Communication, 42(1), p. 189-209, 2009. DOI: https://doi.org/10.7146/hjlcb.v22i42.96852
https://doi.org/10.7146/hjlcb.v22i42.968...
). Educators can positively influence self-efficacy-beliefs through realistic comments that correspond to the students’ real ability to translate (Haro-Soler, 2021Haro Soler, María del Mar. “How Can Translation Teachers Care for Their Students? A Case Study on Verbal Persuasion and Translation Students’ Self-Efficacy Beliefs”. New Voices in Translation Studies, 24(1), p. 46-71, 2021.).

Based on the literature review conducted, for the purposes of this paper we assume that expertise, constructive feedback and reflective practice help students enhance self-efficacy and self-awareness by contributing to the development of realistic self-efficacy beliefs. Specifically, boosting self-awareness helps students become more aware of their needs and their actual level of skill (Haro Soler, 2019bHaro Soler, María del Mar. “Autoconfianza versus autoeficacia del traductor: propuesta terminológica y estado de la cuestión”. Cadernos de Tradução, 39(2), p. 204-226, 2019b. DOI: http://dx.doi.org/10.5007/2175-7968.2019v39n2p204
https://doi.org/10.5007/2175-7968.2019v3...
), which in turn helps them activate the metacognitive strategies required to solve problems and reduce uncertainty (Araghian, Ghonsooly & Ghanizadeh, 2018Araghian, Roya; Ghonsooly, Behzad & Ghanizadeh, Afsaneh. “Investigating problem-solving strategies of translation trainees with high and low levels of self-efficacy”. Translation, Cognition and Behavior, 1(1), p. 74-97, 2018. DOI: https://doi.org/10.1075/tcb.00004.ara
https://doi.org/10.1075/tcb.00004.ara...
). As suggested above, when dealing with the translation of scientific and technical texts, reducing uncertainty and gaining confidence is particularly relevant. In agreement with De Young (2000)De Young, Raymond. “Expanding and Evaluating Motives for Environmentally Responsible Behavior”. Journal of Social Issues, 56(3), p. 509-526, 2000. DOI: http://dx.doi.org/10.1111/0022-4537.00181
https://doi.org/10.1111/0022-4537.00181...
, an efficient use of constructive feedback and reflective practice through assisted revision and self-reflection will help students experience an intrinsic satisfaction resulting from their own competence that will enhance their self-efficacy.

Aims and hypotheses

The aim of the current research is to analyze the evolution of self-awareness and self-efficacy from the beginning to the end of a semester based on the two components of self-efficacy: the perception that students have of their own capabilities to perform specific activities in the field of scientific and technical translation and their actual capabilities to perform those activities.

Based on our observations and on the literature on self-efficacy and reflective learning, we expect an initial deviation between students’ perceptions and students’ performance at the beginning of the semester. More specifically, it is our hypothesis that in the case of the translation of scientific and technical texts, students initially show low self-awareness of translation problems and errors and that assisted revision and reflective practice tasks help students 1) enhance their self-awareness of translation problems and errors and 2) improve their self-efficacy, in terms of both their actual performance as translators and their self-efficacy beliefs.

The results of this perception study based on a mixed-method approach will help us determine which aspects of the teaching and learning method used are perceived by students as the most contributing to their learning and, consequently, to find areas of improvement. Likewise, the results of this perception study will help us track progress of students’ performance and bring about actual change in the teaching and learning process.

Methodology of the study

The methodology used in this study followed a mixed-method approach that combined product-based analysis of students’ translations with process-oriented reflections, and included questionnaires, pre-translation analysis tasks, translations, revisions assisted by the educator and post-revision self-reports aimed at increasing metacognitive behavior and task awareness. The participants, materials and procedures used in this preliminary study are presented below.

Participants and setting

The study was conducted as part of a Scientific and Technical Translation module taught during the seventh semester of the four-year undergraduate program in Translation and Interpreting of the University of Vigo. The study covered three academic years, from 2018 to 2021, and all 76 students enrolled in the module took part in the research. The module is aimed at helping students acquire competence in the specificities of scientific and technical translation and writing. Because translation problems are closely associated with translation errors and with the use of strategies (Hurtado Albir, 2011Hurtado Albir, Amparo. Traducción y Traductología. Introducción a la Traductología. Madrid: Cátedra, 2011.), the pedagogical approach used in this module focuses on assisted revision and self-reflection (ARSR) to help students recognize problems, errors and strengths in their own translations, categorize them and evaluate the relevant solutions. Under this method, errors are understood as unsuccessful choices (Washbourne, 2015Washbourne, Kelly. “Learning to fail: unsuccessful translations as pedagogical resource”. Current Trends in Translation Teaching and Learning E, 2(1), p. 285-320, 2015.) leading to a translation that falls behind the professional standards; specifically, scientific writing errors are defined as solutions that deviate from scientific writing goals (Alley, 2018Alley, Michael. The Craft of Scientific Writing. London: Springer, 2018.). To bring unsuccessful translation into awareness as a learning opportunity, error identification is assisted by the instructor, who marks students’ translations using a color code in order to help students recognize their errors, categorize them and associate them to specific translation problems and strategies in order to enhance metacognitive bundling. After that, the students revise their texts using the appropriate resources and strategies, prepare a final version of their translations and write a self-report to justify their revision decisions and reflect on their learning. By improving their ability to identify and minimize problems and errors, categorize errors and improve the use of the appropriate resources and strategies, students are expected to enhance their self-awareness of translation problems and errors and their self-efficacy.

Procedures and materials

During the semester, students were asked to perform and deliver the tasks shown in Table 1, which included a diagnostic assessment questionnaire (DAQ), four translations, three revised translations (RT) with the corresponding self-reflection reports (SR) and a psychrometric questionnaire on the perceptions of students on different aspects of their performance as scientific and technical translators and their beliefs on the usefulness of the ASRS method. A detailed description of the materials is provided below.

Table 1
Tasks and materials analyzed in the study

Diagnostic assessment questionnaire

To assess students’ self-awareness and self-efficacy beliefs at the beginning of the semester, we used a diagnostic assessment questionnaire that included the following questions about their preliminary perceptions on some of their translation habits, problems and errors:

  1. Do you usually analyze the source text before translating it?

  2. Do you make planned documentary searches?

  3. Do you usually revise your translations before submitting them?

  4. Which types of problems do you usually find during the translation process?

  5. Which problems correspond specifically to the English-Spanish language pair?

  6. Can you easily spot your own errors?

Questions 1, 2, 3 and 6 were formulated as multiple-choice questions, with a box for observations, whereas questions 4 and 5 were open-ended questions. The questions related to translation habits were aimed at finding potential relationships between students’ problems/errors and some of their translation habits.

Translations and revised translations

To assess the actual performance of students, four translation assignments, labelled A0, A1, A2 and A3, were performed, delivered and assessed by the instructor during the semester. Table 2 summarizes the characteristics of each assignment.

Table 2
Characteristics of translation assignments

Assignment A0 was a conventional translation assignment, whereas assignments A1, A2 and A3 followed the stages devised in the assisted revision and self-reflection method (Figure 1, below), which included an initial translation, a self-reflection report and a revised translation of the same text. Assignment A2 was a group assignment, which was scheduled because of the impact of the collective self-efficacy on individual reflection (Krogstie & Krogstie 2016Krogstie, Birgit & Krogstie, John. “Considering Self-Efficacy in Reflection”. In: Kravcik, Milos; Mikroyannidis, Alexander; Pammer, Viktoria; Prilla, Michael & Ullmann, Thomas (Eds.). Proceedings of the 6th Workshop on Awareness and Reflection in Technology Enhanced Learning. Lyon: CEUR, 2016. p. 59-65.). All the tasks were assessed using a rubric with five performance levels: minimal (1), deficient (2), acceptable (3), strong (4) and standard (5).

Figure 1
Tasks included in translation assignments A1, A2 and A3

As in Chodkiewicz (2018)Chodkiewicz, Marta. “How Successful Are Undergraduate Students in Revising and Justifying Different Types of Translation Decisions in Response to Instructor Feedback?”. MiędzyOryginałem a Przekładem, 24(3), p. 53-73, 2018. DOI: https://doi.org/10.12797/MOaP.24.2018.42.04
https://doi.org/10.12797/MOaP.24.2018.42...
, students were not specifically trained in revision but had the opportunity to develop their revision skills by improving their translations. Versions 1 and 3 of the translations were assessed according to the criteria shown in Figure 2. As an aid to error detection and categorization, the particularly good solutions, understood as instances of avoidance of errors commonly observed among scientific translation students, and errors or inconsistencies of version 1 were marked by the instructor according to the color code shown in Figure 3.

Figure 2
Rubric used to assess translation assignments
Figure 3
Color code used to mark translations in assisted revision

Self-reflection reports

Assignments A1, A2 and A3 included a self-reflection report that comprised a contextualization and analysis of the text, a categorization of the errors marked in assisted revision, a justification for every error, the alternative solutions to errors and a justification for the particularly good solutions marked by the instructor. Students were asked to reflect on their translation actions and on the potential application of what they learnt to further translations.

The performance levels for the report were defined following a top-down approach by creating a conceptual framework for achievement, describing the intended achievement and defining one scale for each criterion, namely context, reflection and use of resources (Figure 4).

Figure 4
Rubric used to assess self-reflection reports

Psychrometric questionnaire

At the end of the semester, the students were asked to respond anonymously to a five-factor psychrometric questionnaire as a final assessment task. The questionnaire was not intended as a general scale of translators’ self-efficacy in the sense of Bolaños-Medina & Núñez (2018)Bolaños-Medina, Alicia & Núñez, Juan. “A Preliminary Scale for Assessing Translators’ Self-Efficacy”. Across Languages and Cultures, 19(1). p. 53-78, 2018. DOI: http://dx.doi.org/10.1556/084.2018.19.1.3
https://doi.org/10.1556/084.2018.19.1.3...
, but as a more specific questionnaire structured around the following five factors:

  • Factor 1: General self-efficacy statements;

  • Factor 2: Process-related statements;

  • Factor 3: Research abilities;

  • Factor 4: Usefulness of self-reflection;

  • Factor 5: Translation problems, errors and good solutions.

The questionnaire was aimed at assessing to what extent the participants felt more capable of performing specific tasks and to what extent self-reflection had helped them improve their self-awareness of translation problems and errors and their self-efficacy to perform specific tasks. The questionnaire comprised a total of 35 statements that students assessed using a five-point Likert scale ranging from “strongly disagree” to “completely agree”.

Data analysis

To quantify the degree of correspondence between initial self-perception and initial self-performance, we compared the responses to the diagnostic assessment questionnaire and the results of the diagnostic assessment translation, measured in terms of number and category of errors.

To measure the progress of students, two variables were considered: the number of errors marked in each translation by the educator and the scores of the three self-reflection reports for the three years considered. Descriptive statistics were used to analyse both variables, namely: mean number of translation errors marked by the instructor in version 1 of each translation and mean number of errors per type of error. To neutralize the effect of text length, the number of errors per 100 words was calculated for every type of error, translation assignment and year.

For the analysis of data pertaining to the self-reflection reports for assignments A1, A2 and A3, the scores for each criterion included in the rubric were homogenized by assigning an unweighted score to each performance level, from 1 to 5. The evolution of students’ performance was measured by calculating the mean and mode for the scores obtained for the three components during the three years, as well as the differences between the scores for A1 and A3.

Finally, a five-point Likert scale questionnaire was used to measure the perceptions of students with regard to the improvements in their performance as scientific translators throughout the semester. Respondents specified their level of agreement to the 29 statements contained in the questionnaire according to the following scale: (1) Strongly disagree; (2) Disagree; (3) Neither agree nor disagree; (4) Agree; (5) Strongly agree. To assess the evolution of self-awareness, the mean, mode and standard deviation for the answers was found and compared to the results of the analysis of the actual academic performance of students.

Results and discussion

In this section, we present and discuss the results of our study, divided into three blocks: diagnostic assessment, evolution of students’ performance and self-efficacy beliefs.

Diagnostic assessment

Diagnostic assessment questionnaire

The results of the diagnostic assessment questionnaire are presented below, organized into three categories: translation habits, perceived translation problems and revision and perceived translation errors.

a. Translation habits

According to the results of the questionnaire, 92% of students read the source text before translating it and 80% claim they make sure they understand the text. In contrast, 20% of students do not usually analyze the source text and only 5% of students analyze the source text in search of possible translation problems or difficulties, whereas most students analyze text type, function and audience.

As regards documentation habits, 50% of students never search for information related to the topic of the text or to the relevant phraseology in order to make informed decisions and almost 80% of students make unplanned searches while translating texts. Actually, only 43% of students search unknown words, terms or concepts before translating the text. These findings suggest a deficient preparation phase focused on isolated items and a limited global awareness of the process, in agreement with Mellinger (2019)Mellinger, Christopher. “Metacognition and Self-Assessment in Specialized Translation Education: Task Awareness and Metacognitive Bundling”. Perspectives: Studies in Translation Theory and Practice, 27(4), p. 604-621, 2019. DOI: https://doi.org/10.1080/0907676X.2019.1566390
https://doi.org/10.1080/0907676X.2019.15...
.

b. Perceived translation problems

The 18 categories of problems mentioned by the participants in the study were divided into two broad categories: problems related to predetermined aspects of source texts conceived as products (hereinafter called ‘product problems’), and problems related to the translation process or translation actions (hereinafter called ‘process problems’). Most students reported having both product and process problems. However, 40% of students showed no awareness of having process problems and 15% of students mentioned only broad categories of problems, such as language, culture or terminology, without relating the cited categories with any type of translation procedure, which could be indicative of a lack of metacognitive bundling and, consequently, of limited translation competence.

Figure 5
General categories of problems perceived by students

From among the 18 specific categories mentioned by the students, each student reported problems pertaining to only 1,7 categories on average, being 2 the mode for product problems and 1 for process problems, which could be due to low self-awareness or unrealistic self-efficacy beliefs.

Figure 6
Types of problems identified by students when translating

The most common product problem perceived by students was terminology, followed by cultural references. The high percentage of students who reported having terminological problems (54%) is in agreement with the findings of Mellinger (2019)Mellinger, Christopher. “Metacognition and Self-Assessment in Specialized Translation Education: Task Awareness and Metacognitive Bundling”. Perspectives: Studies in Translation Theory and Practice, 27(4), p. 604-621, 2019. DOI: https://doi.org/10.1080/0907676X.2019.1566390
https://doi.org/10.1080/0907676X.2019.15...
for medical translation and could be due to low self-confidence caused by the lack of expert knowledge, in line with Hjort-Pedersen & Faber (2009)Hjort-Pedersen, Mette & Faber, Dorris. “Uncertainty in the Cognitive Processing of a Legal Scenario: A Process Study of Student Translators”. Hermes: Journal of Language and Communication, 42(1), p. 189-209, 2009. DOI: https://doi.org/10.7146/hjlcb.v22i42.96852
https://doi.org/10.7146/hjlcb.v22i42.968...
and Haro-Soler (2019a)Haro Soler, María del Mar. “Autoeficacia del estudiantado en la formación en traducción jurídica: Un estudio exploratorio”. Opción, 89(2), p. 880-910, 2019a., but also to the poor documentation habits revealed by the responses to the questionnaire.

Mechanics and grammar were perceived as problems by 24% of students, and language in general was perceived as a problem by 14% of students. Interestingly, none of the students who declared having “language problems” responded affirmatively to the question related to the analysis of the linguistic characteristics of source texts. Despite being supposedly aware of having language problems, they do not analyze the text in search of potential language problems, which will probably lead them to making language errors. Accordingly, learning strategies must be developed to help them establish the relevant relationships between problems and strategies in order to reach metacognitive bundling and develop realistic self-efficacy beliefs.

As per process problems, the most common problem was finding equivalents, which is partially in agreement with the results for product problems; followed by decision-making, particularly about the selection of the most appropriate term. Actually, 25% of the students who declared having terminology-related problems affirmed having problems related to finding equivalents and decision-making, which suggests metacognitive activity in this small group of students. Yet, only 18% of students are aware of having research-related problems and 18% are aware of having difficulties in choosing the right term. In contrast, 51% of students did not mention any problems related with these processes, which could be indicative of insufficient awareness of their importance for successful strategy selection. Insufficient self-awareness can lead to these problems going unnoticed, and consequently, to wrong translation decisions.

Figure 7
Specific categories of problems perceived by students for the English-Spanish language pair

Our analysis of the specific problems mentioned by students for the English-Spanish language pair reveals a clear prevalence of mechanics and grammar, followed by calques, which is in agreement with a product-oriented education based on contrastive linguistics. Actually, process problems disappear for the English -Spanish pair. Interestingly, the percentage of students who perceive calques as a problem in this language pair multiplies by three as compared to calques perceived as a general translation problem, though not reaching even 25%. As compared to general translation problems, mechanics and grammar, calques and idiomaticity increase in relevance, while culture, terminology and general language problems sharply decrease.

c. Revision and perceived translation errors

When asked about their revision habits, 60% of students declared revising texts more than twice before submitting their translations (they allegedly revise content and style) whereas 40% declared performing only a stylistic editing of the draft version before submitting the translation. As regards the use of research resources during revision, 43% of the students declared using research resources during the revision, whereas 43% of the students declared carefully reading the text but not making queries. The percentage of students who only read the text is in agreement with the percentage of students who perform only a stylistic revision.

Despite the above revision habits, only 21% of students are sure of being able to spot and correct their own errors, while 52% detect errors only sometimes, and 19% feel they are able to spot their own errors but unable to correct them. Actually, almost 80% of students perceive they would be unable to successfully revise and correct their own translations. Because translation problems are closely associated with translation errors and the use of strategies (Hurtado Albir, 2011Hurtado Albir, Amparo. Traducción y Traductología. Introducción a la Traductología. Madrid: Cátedra, 2011.), error detection and categorization must be improved through reflective practice in order to improve awareness of problems and strategies.

Figure 8
Ability to spot and self-correct translation errors

In brief, the diagnostic assessment questionnaire revealed deficient metacognitive bundling mainly due to the difficulty to associate problems with procedures and to the weak preparation of the translation assignment, particularly in three areas: identification of potential problems, documentation and identification of appropriate translation procedures.

Diagnostic assessment translation assignment

To compare students’ self-efficacy beliefs with their actual performance at the beginning of the semester, we analyzed performance in terms of the number and category of errors in assignment A0, based on the six categories used to mark errors in assisted revision and on the assumption that errors are indicative of problems or difficulties.

Figure 9
Incidence of errors among students in assignment A0

As shown in Figure 9, the actual performance of students clearly deviates from their self-perceptions. From among the 6 specific categories shown in Figure 9, each student made errors pertaining to 4,87 categories on average, being 5 the mode, which clearly deviates from the 1,7 problem categories reported by students. Major errors comprised omissions and contresense, while accuracy comprised poor use of terminology and errors related with meaning deviations. Thus, as compared to the perceptions of students in regard to their ability to convey text meaning (only 7% of students were aware of having this problem), their actual problems in this key area for successful translation were much more serious. Actually, 100% of students made acccuracy errors, with 41% of students omitting information and 5% making contresense, which seriously affected the meaning of the translated text.

Deviations were also observed for mechanics and grammar and calques, which affected more than 95%os students, as compared to 50% and 25% of students, respectively, who were aware of having problems related to these categories. Scientific writing errors, also related to the proper use of language, were made by 100%, an expected result at the beginning of the semester.

Finally, deviations were observed even for the format category, which affected 36% of students, even though this type of error was not even mentioned in the diagnostic assessment questionnaire, which suggests a lack of awareness in this area. The impact of the categories accuracy, mechanics/grammar and calques, which show the largest deviations from students’ beliefs, is strong, insofar as these errors account for 63% of the total errors made by students.

The results suggest that students perceive a series of predetermined or fixed problems independent of the text to be translated but are not aware of other difficulties on the source text, mainly because of the type of analysis conducted and of poor revision habits, which lead them to making errors, particularly related to meaning, and is indicative of insufficient self-awareness and unrealistic self-efficacy beliefs. This could be explained by the predominant “product-oriented” approach in current translator education, which trains students to identify predetermined problems or “objective features” that can be recognized through a text analysis of the source and final texts, neglecting the problems related to their individual characteristics (Lachat Leal, 2003Lachat Leal, Cristina. Estrategias y problemas de traducción. Doctoral Thesis (Ph.D.). Facultad de Traducción e Interpretación, Universidad de Granada, Granada, 2003.) or to the procedures required to translate and revise. Likewise, the results reveal poor self-efficacy beliefs in terms of revision and error correction, with large uncertainty in their responses, which is indicative of insecurity and lack of self-confidence in their performance as revisers. Nevertheless, the perceptions of students in this area are more realistic and correspond better to their habits.

Evolution of students’ performance

To assess the actual performance of students, we analyzed the evolution of the number of errors in each translation assignment and the evolution of the academic scores of students.

Evolution of the number of errors

The evolution of the number of errors marked in the diagnostic translation and in version 1 of assignments A1, A2 and A3 was analyzed for the three study years.

Table 3
Evolution of number of errors in version 1 of assignments A0 to A3

The percentage of errors made by students in versions 1 of their translations showed a clear downward trend, with a decrease by 60% from the diagnostic assessment translation to version 1 of A3, which is an outstanding result for a 9-week period, particularly considering the increasing level of difficulty of the texts. By category, errors specifically related to scientific translation accounted for the majority of errors (71%) in the first versions of translations, an expected result at such an early time within the semester. Yet, these errors halved from diagnostic assessment to A3, which is an encouraging result. Calques experienced the most remarkable decrease (60%), which suggests a potential increase in students’ awareness, whereas format was the only category that remained stable throughout the semester.

As shown in Table 3, the means and standard deviations of the data largely varied among assignments. The large variability in the data for the first assignments could be indicative of different starting points for the participants, which progressively converged with the acquisition of the competences for the module. Actually, the value of standard deviation almost halved from A0 to A3. The lowest standard deviation corresponded to A2, which was a group assignment. The distribution of errors per type remained stable throughout the semester.

Overall, the progress of students as regards the number of errors made in the first versions of the translations was excellent, which suggests that assisted-revision and reflective practice actually helps students improve their ability to recognize problems and minimize errors, select and use the appropriate external resources, and provide solutions to problems. Following the analysis of the results for the number of errors, the results for the evolution of the rubric scores for the self-revision reports are presented in the next section.

Evolution of self-reflection report scores

Table 4 summarizes the scores for the three components of the self-reflection reports.

Table 4
Evolution of means and modes for self-reflection reports for A1 to A3

On average, none of the components obtained a mean score of strong or standard, although all the components reached the acceptable level in A3. Yet, the analysis of the modes for the three components reveals that the standard level was the most frequent score for reflection and use of resources, with 150% increase from A1. Actually, the evolution of mean scores from A1 to A3 was positive for all the criteria, with upgrades from deficient to acceptable in all the components and increases by 30-40% in all the mean scores. The performance of students improved most for A2, which was a group assignment, except for the contextualization item. Based on the results for the means of all the study years, cooperative learning apparently leads to an improvement in reflection, research tasks and translation revision, which is in agreement with the findings of Krogstie & Krogstie (2016)Krogstie, Birgit & Krogstie, John. “Considering Self-Efficacy in Reflection”. In: Kravcik, Milos; Mikroyannidis, Alexander; Pammer, Viktoria; Prilla, Michael & Ullmann, Thomas (Eds.). Proceedings of the 6th Workshop on Awareness and Reflection in Technology Enhanced Learning. Lyon: CEUR, 2016. p. 59-65. on the impact of the collective self-efficacy on individual reflection. A brief analysis of the evolution of the scores for each of the components of the self-report is presented.

Context: the ability of students to contextualize the text and anticipate translation problems improved steadily. In A1, there was no evidence of problem anticipation in self-reflection reports, whereas in A2 and A3, some translation problems were anticipated as a result of the analysis of the context of situation, which was correctly applied to the translation.

Reflection: the results for the self-reflection component of the report were very good,with a peak increase of 1,02 points in A2, the group assignment. Most students drew some conclusions from self-reflection, correctly identified the sources of errors or good solutions, and justified the solutions proposed. Yet, at this level, no suggestions were made for future applications of the conclusions to other translations, which could be detrimental to self-efficacy, as claimed by Krogstie & Krogstie (2016)Krogstie, Birgit & Krogstie, John. “Considering Self-Efficacy in Reflection”. In: Kravcik, Milos; Mikroyannidis, Alexander; Pammer, Viktoria; Prilla, Michael & Ullmann, Thomas (Eds.). Proceedings of the 6th Workshop on Awareness and Reflection in Technology Enhanced Learning. Lyon: CEUR, 2016. p. 59-65..

Use of resources: the best evolution corresponded to the use of resources. Actually, 33% of students reached the standard level and 16% reached the strong level in A3, in contrast with 7% and 13%, respectively, in A1. In practice, 57% of students systematically used appropriate resources and were able to cite them correctly, and 33% of students were able to select and use highly relevant resources in an efficient manner. Yet, almost 20% of students did not use any resources for justifying their errors or good solutions and based their reflections mostly on classroom comments.

In general, the scores for all the components of the method showed a good evolution, with reflection and use of resources contributing most to the improvement of students’ performance.

Self-awareness and self-efficacy beliefs

Table 5 summarizes the results of the psychrometric questionnaire, which were analyzed based on the mean, mode and standard deviation for each statement. The results of the questionnaire were compared with the evolution of the actual performance of students to verify whether students developed realistic beliefs.

Table 5
Results of the psychrometric questionnaire

The results obtained from the psychrometric questionnaire, with a mean of 4 for all the factors considered as a whole, suggest that students consider that their abilities to perform the tasks required to effectively translate scientific and technical texts and to self-report have improved, which is in agreement with the good results obtained for actual performance. Such a correspondence of results is indicative of improved general self-awareness.

For general efficacy statements, the poorest score corresponded to students’ beliefs about translation efficacy (3,71), understood as the relation between solution acceptability and the time spent in the process (PACTE, 2019PACTE. “Evolution of the Efficacy of the Translation Process in Translation Competence Acquisition”. Meta: Journal Des Traducteurs, 64(1), p. 242-265, 2019. DOI: https://doi.org/10.7202/1065336ar
https://doi.org/10.7202/1065336ar...
). In this case, 65% were sure or very sure of having improved their efficacy whereas 35% of students were not quite sure. Actually, this perception was confirmed by their responses to process-related statements, specifically to the questions related to the time devoted to the different translation stages, which suggest that students generally tend to devote more time to every stage in the translation process by the end of the semester, but are not capable of reaching a good distribution of time. For process-related statements, the best results corresponded to concurrent reflection, aimed at making appropriate decisions, and to awareness of the appropriate translation strategies (4,33), which apparently confirms the beneficial effects of reflective practice and constructive feedback on self-efficacy and learning found by authors such as Atkinson (2014)Atkinson, David & Creeze, Ineke. “Improving Psychological Skill in Trainee Interpreters”. International Journal of Interpreter Education, 6(1), p. 3-18, 2014., Atkinson & Creeze (2014)Atkinson, David & Creeze, Ineke. “Improving Psychological Skill in Trainee Interpreters”. International Journal of Interpreter Education, 6(1), p. 3-18, 2014., Krogstie & Krogstie (2016)Krogstie, Birgit & Krogstie, John. “Considering Self-Efficacy in Reflection”. In: Kravcik, Milos; Mikroyannidis, Alexander; Pammer, Viktoria; Prilla, Michael & Ullmann, Thomas (Eds.). Proceedings of the 6th Workshop on Awareness and Reflection in Technology Enhanced Learning. Lyon: CEUR, 2016. p. 59-65. or Haro Soler (2019b)Haro Soler, María del Mar. “Autoconfianza versus autoeficacia del traductor: propuesta terminológica y estado de la cuestión”. Cadernos de Tradução, 39(2), p. 204-226, 2019b. DOI: http://dx.doi.org/10.5007/2175-7968.2019v39n2p204
https://doi.org/10.5007/2175-7968.2019v3...
.

The highest mean score was observed for Factor 3, related to the research abilities of students. Students perceived that they were more efficacious in all the items related to the documentation skills for specialized translation and felt that they used research resources efficiently. The agreement between the results for self-efficacy beliefs in this area and the actual performance of students suggests that the research tasks included in the pedagogical method used contributed to improving self-awareness. Such correspondence becomes even more significant given the increase in the difficulty of the source text for A3, which was more complex in terms of text readability and of the extralinguistic knowledge required to correctly understand the text.

The responses to the questions about the usefulness of the self-report showed larger variabilities, as suggested by the higher standard deviation values. In this case, the increase in the variability of responses was due to a larger occurrence of extreme scores. Specifically, highly variable values were found for items 18 and 20, related to the usefulness of the self-reflection report to improve the translation process and to relate theory and practice. Thus, 15% of students considered that the self-revision report did not help them improve their translation process and 40% of students found that the effort required to perform the report was excessive as compared to their learning. These results suggest the need to incorporate some measures to help less confident students improve their performance. In contrast, 75% of students perceived that self-reflection helped them improve their translations and 80% believed that the self-reflection report made them more aware of what they learned and why they made errors. Finally, 70% of students claimed that being aware of their good decisions enhanced their self-confidence and 90% of students believed that they made fewer errors and that color coding helped them identify and categorize errors, which is in agreement with their actual performance.

Finally, the questionnaire included an open-ended question about the types of error, which revealed that students considered that they committed fewer errors of the following types: errors related to the goals of scientific writing (45%), accuracy errors (21%), grammar errors (14%), calques (9,5%) and major errors (9,5%), which also corresponds to a great extent to their actual performance. These results support the findings reported by Mellinger (2019)Mellinger, Christopher. “Metacognition and Self-Assessment in Specialized Translation Education: Task Awareness and Metacognitive Bundling”. Perspectives: Studies in Translation Theory and Practice, 27(4), p. 604-621, 2019. DOI: https://doi.org/10.1080/0907676X.2019.1566390
https://doi.org/10.1080/0907676X.2019.15...
for medical translation, according to whom problem recognition and solution evaluation can be developed by designing tasks that increase self-awareness.

Conclusions

The results of this preliminary study suggest that, overall, the assisted revision and self-reflection method implemented in one module of scientific and technical translation during three academic years has helped students enhance the two components of self-efficacy: their actual performance as scientific and technical translators and their self-efficacy beliefs. The improved correspondence between both components by the end of the semester as compared to the poor correspondence found at the beginning of the semester suggests that assisted revision and reflective practice have enhanced the awareness of students of their own problems and errors and have helped them develop realistic self-efficacy beliefs. Actually, a strong relationship was found between the scores observed for self-reflection reports and the perception of students on their ability to reflect on errors and good decisions and to justify their translation decisions. This is particularly true for the perception of the decrease in the number of errors related to scientific writing goals and the use of resources for specialized translation, which suggests a stronger self-awareness of the importance of the mastery of scientific writing and research skills to compensate for the lack of subject knowledge and limited experience in scientific translation or writing. Actually, in self-reflection reports, most of the reflections aimed at future translations were related to resource use.

Despite these results for the efficacy of the assisted revision and self-reflection method in helping students identify and minimize problems and errors, categorize errors, improve the use of resources, identify their strengths and justify errors and good solutions, some adjustments are needed to correct the detected drawbacks, namely the strong effort required to perform the tasks and the difficulties in transforming the good results of self-reflection into an efficacious translation process. The first drawback could be tackled by introducing more group work, which has actually produced the best results and could relief some of the individual burden of the assignments. The second drawback requires a deeper analysis in order to fully understand the causes for these difficulties.

The results for the usefulness of color coding suggest the need for a more detailed analysis of this factor and of its role in the increased awareness of students of their own problems and errors and enhanced self-efficacy. An experimental study has been designed and is currently under way to verify the relevance of color coding in the pedagogical method used.

References

  • Alley, Michael. The Craft of Scientific Writing London: Springer, 2018.
  • Angelone, Erik. “The Impact of Process Protocol Self-Analysis on Errors in the Translation Product”. Translation and Interpreting Studies, 8(2), p. 253-271, 2013. DOI: https://doi.org/10.1075/tis.8.2.07ang
    » https://doi.org/10.1075/tis.8.2.07ang
  • Angelone, Erik. “Optimizing Process-Oriented Translator Training Using Freeware and FOSS Screen Recording Applications”. In Sandrini, Peter & García González, Marta (Eds.). Translation and Openness Innsbruck: Innsbruck University Press, 2015. p. 131-144.
  • Angelone, Erik. “Process-Oriented Assessment of Problems and Errors in Translation: Expanding Horizons through Screen Recording”. In Huertas-Barros, Elsa; Vandepitte, Sonia & Iglesias Fernández, Emilia (Eds.). Quality Assurance and Assessment Practices in Translation and Interpreting Hershey: IGI Global, 2019. p. 179-198.
  • Araghian, Roya; Ghonsooly, Behzad & Ghanizadeh, Afsaneh. “Investigating problem-solving strategies of translation trainees with high and low levels of self-efficacy”. Translation, Cognition and Behavior, 1(1), p. 74-97, 2018. DOI: https://doi.org/10.1075/tcb.00004.ara
    » https://doi.org/10.1075/tcb.00004.ara
  • Atkinson, David. “Developing Psychological Skill for the Global Language Industry: An Exploration of Approaches to Translator and Interpreter Training”. Translation Spaces, 3(1), p. 1-24, 2014. DOI: https://doi.org/10.1075/ts.3.01atk
    » https://doi.org/10.1075/ts.3.01atk
  • Atkinson, David & Creeze, Ineke. “Improving Psychological Skill in Trainee Interpreters”. International Journal of Interpreter Education, 6(1), p. 3-18, 2014.
  • Ayllón, Sara; Alsina, Ángel & Colomer, Jordi. “Teachers’ involvement and students’ self-efficacy: Keys to achievement in higher education”. PLoS ONE, 14(5), p. 1-11, 2019. DOI: https://doi.org/10.1371/journal.pone.0216865
    » https://doi.org/10.1371/journal.pone.0216865
  • Bandura, Albert. Self-Efficacy: The Exercise of Control New York: Freeman, 1997.
  • Bolaños-Medina, Alicia. “Self-efficacy in Translation”. Translation and Interpreting Studies, 9(2). pp. 197-218, 2014. DOI: https://doi.org/10.1075/tis.9.2.03bol
    » https://doi.org/10.1075/tis.9.2.03bol
  • Bolaños-Medina, Alicia & Núñez, Juan. “A Preliminary Scale for Assessing Translators’ Self-Efficacy”. Across Languages and Cultures, 19(1). p. 53-78, 2018. DOI: http://dx.doi.org/10.1556/084.2018.19.1.3
    » https://doi.org/10.1556/084.2018.19.1.3
  • Bontempo, Karen, & Napier, Jemina. “Evaluating Emotional Stability as a Predictor of Interpreter competence and Aptitude for Interpreting”. Interpreting, 34(1), p. 85-105, 2011. DOI: https://doi.org/10.1075/intp.13.1.06bon
    » https://doi.org/10.1075/intp.13.1.06bon
  • Brookfield, Stephen. Becoming a Critically Reflective Teacher London: Jossey-Bass, 1995.
  • Chodkiewicz, Marta. “How Successful Are Undergraduate Students in Revising and Justifying Different Types of Translation Decisions in Response to Instructor Feedback?”. MiędzyOryginałem a Przekładem, 24(3), p. 53-73, 2018. DOI: https://doi.org/10.12797/MOaP.24.2018.42.04
    » https://doi.org/10.12797/MOaP.24.2018.42.04
  • De Young, Raymond. “Expanding and Evaluating Motives for Environmentally Responsible Behavior”. Journal of Social Issues, 56(3), p. 509-526, 2000. DOI: http://dx.doi.org/10.1111/0022-4537.00181
    » https://doi.org/10.1111/0022-4537.00181
  • Ehrensberger-Dow, Maureen & Massey, Gary. “Indicators of Translation Competence: Translators’ Self-Concepts and the Translation of Titles”. Journal of Writing Research, 5(1), p. 103-131, 2013. DOI: https://doi.org/10.17239/jowr-2013.05.01.5
    » https://doi.org/10.17239/jowr-2013.05.01.5
  • Ferreira, Aline & Schwieter, John. “Translation and Cognition”. In Ferreira, Aline & Schwieter, John (Eds.). The Handbook of Translation and Cognition Malden: John Wiley and Sons, 2017. p. 1-17.
  • Galán-Mañas, Anabel. “Learning Portfolio in Translator Training: The Tool of Choice for Competence Development and Assessment”. The Interpreter and Translator Trainer, 10(2), p. 161-182, 2016. DOI: https://doi.org/10.1080/1750399X.2015.1103108
    » https://doi.org/10.1080/1750399X.2015.1103108
  • Galán-Mañas, Anabel. “Professional Portfolio in Translator Training: Professional Competence Development and Assessment”. Interpreter and Translator Trainer, 13(1), p. 44-63, 2019. DOI: https://doi.org/10.1080/1750399X.2018.1541295
    » https://doi.org/10.1080/1750399X.2018.1541295
  • Gile, Daniel. “Integrated Problem and Decision Reporting as a Translator Training Tool”. Journal of Specialised Translation, 2(1), p. 2-20, 2004.
  • Göpferich, Susanne. “Translation Competence: Explaining Development and Stagnation from a Dynamic Systems Perspective”. Target. International Journal of Translation Studies, 2(51), p. 61-76, 2013. DOI: https://doi.org/10.1075/target.25.1.06goe
    » https://doi.org/10.1075/target.25.1.06goe
  • Haro Soler, María del Mar. “Autoeficacia del estudiantado en la formación en traducción jurídica: Un estudio exploratorio”. Opción, 89(2), p. 880-910, 2019a.
  • Haro Soler, María del Mar. “Autoconfianza versus autoeficacia del traductor: propuesta terminológica y estado de la cuestión”. Cadernos de Tradução, 39(2), p. 204-226, 2019b. DOI: http://dx.doi.org/10.5007/2175-7968.2019v39n2p204
    » https://doi.org/10.5007/2175-7968.2019v39n2p204
  • Haro Soler, María del Mar. “How Can Translation Teachers Care for Their Students? A Case Study on Verbal Persuasion and Translation Students’ Self-Efficacy Beliefs”. New Voices in Translation Studies, 24(1), p. 46-71, 2021.
  • Hjort-Pedersen, Mette & Faber, Dorris. “Uncertainty in the Cognitive Processing of a Legal Scenario: A Process Study of Student Translators”. Hermes: Journal of Language and Communication, 42(1), p. 189-209, 2009. DOI: https://doi.org/10.7146/hjlcb.v22i42.96852
    » https://doi.org/10.7146/hjlcb.v22i42.96852
  • Ho, Hsin-Ning. The Relationship between Levels of Expertise, Task Difficulty, and Mental Effort Investment in Task Performance Doctoral Thesis (Ph.D.). Faculty of the USC Rossier School of Education, University of South California, California, 2010.
  • Hurtado Albir, Amparo. Traducción y Traductología. Introducción a la Traductología Madrid: Cátedra, 2011.
  • Kontinen, Kalle. “Monitoring student self-efficacy in a translation company simulation: A multilevel model approach”. Trans-kom, 15(1), p. 1-25, 2022.
  • Kovács, Gabriella & Harangus, Katalin. “Translator Trainees’ Reading Literacy, Problem Solving, and Translation Skills: A Comparative Study”. Acta Universitatis Sapientiae Philologica, 11(3), p. 141-157, 2019. DOI: https://doi.org/10.2478/ausp-2019-0031
    » https://doi.org/10.2478/ausp-2019-0031
  • Krogstie, Birgit & Krogstie, John. “Considering Self-Efficacy in Reflection”. In: Kravcik, Milos; Mikroyannidis, Alexander; Pammer, Viktoria; Prilla, Michael & Ullmann, Thomas (Eds.). Proceedings of the 6th Workshop on Awareness and Reflection in Technology Enhanced Learning Lyon: CEUR, 2016. p. 59-65.
  • Lachat Leal, Cristina. Estrategias y problemas de traducción Doctoral Thesis (Ph.D.). Facultad de Traducción e Interpretación, Universidad de Granada, Granada, 2003.
  • Le Poder, Evelyn. “Introducción a la traducción jurídica”. In: Cifuentes, José Luis; Gómez González-Jover, Adelina; Lillo, Antonio & Yus Ramos, Francisco (Eds.). Los caminos de la lengua: Estudios en homenaje a Enrique Alcaraz Varó, Alicante: Servicio de Publicaciones de la Universidad de Alicante, 2010. p. 177-188.
  • Martínez Melis, Nicole & Hurtado Albir, Amparo. “Assessment in Translation Studies: Research Needs”. Meta: Journal Des Traducteurs, 46(2), p. 272-287, 2001. DOI: https://doi.org/10.7202/003624ar
    » https://doi.org/10.7202/003624ar
  • Massey, Gary. “Translation Competence Development and Process-Oriented Pedagogy”. In: Ferreira, Aline & Schwieter, John (Eds.). The Handbook of Translation and Cognition Malden: John Wiley and Sons, 2017. p. 496-518. DOI: https://doi.org/10.1002/9781119241485.ch27
    » https://doi.org/10.1002/9781119241485.ch27
  • Mellinger, Christopher. “Metacognition and Self-Assessment in Specialized Translation Education: Task Awareness and Metacognitive Bundling”. Perspectives: Studies in Translation Theory and Practice, 27(4), p. 604-621, 2019. DOI: https://doi.org/10.1080/0907676X.2019.1566390
    » https://doi.org/10.1080/0907676X.2019.1566390
  • Mezirow, Jack. Fostering Critical Reflection in Adulthood: A Guide to Transformative and Emancipatory Learning, Malden: Wiley, 1990.
  • Mezirow, Jack. “Contemporary Paradigms of Learning”. Adult Education Quarterly, 46(3), p. 158-172, 1996. DOI: https://doi.org/10.1177/074171369604600303
    » https://doi.org/10.1177/074171369604600303
  • Norberg, Ulf. “Fostering self-reflection in translation students. The value of guided commentaries”. Translation and Interpreting Studies, 9(1), p. 150-164, 2014. DOI: https://doi.org/10.1075/tis.9.1.08nor
    » https://doi.org/10.1075/tis.9.1.08nor
  • Núñez, Juan & Bolaños-Medina, Alicia. “Predictors of Problem-Solving in Translation: Implications for Translator Training”. Interpreter and Translator Trainer, 12(3), p. 282-298, 2018. DOI: https://doi.org/10.1080/1750399X.2017.1359762
    » https://doi.org/10.1080/1750399X.2017.1359762
  • PACTE. “Evolution of the Efficacy of the Translation Process in Translation Competence Acquisition”. Meta: Journal Des Traducteurs, 64(1), p. 242-265, 2019. DOI: https://doi.org/10.7202/1065336ar
    » https://doi.org/10.7202/1065336ar
  • Pietrzak, Paulina. “Scaffolding Student Self-Reflection in Translator Training”. Translation and Interpreting Studies, 14(3), p. 416-436, 2019. DOI: https://doi.org/10.1075/tis.18029.pie
    » https://doi.org/10.1075/tis.18029.pie
  • Presas, Marisa. “Training Translators in the European Higher Education Area: A Model for Evaluating Learning Outcomes”. Interpreter and Translator Trainer, 6(2), p. 138-169, 2012. DOI: https://doi.org/10.1080/13556509.2012.10798834
    » https://doi.org/10.1080/13556509.2012.10798834
  • Rodríguez-Inés, Patricia & Fox, Olivia. “Reconciling Institutional and Professional Requirements in the Specialised Inverse Translation Class - A Case Study”. Meta: Journal Des Traducteurs, 63(1), p. 47-71, 2018. DOI: https://doi.org/10.7202/1050514ar
    » https://doi.org/10.7202/1050514ar
  • Shaw, Sherry. “Cognitive and Motivational Contributors to Aptitude: A Study of Spoken and Signed Language Interpreting Students”. Interpreting, 13(1), p. 70-84, 2011.
  • Schön, Donald. The Reflective Practitioner. How Professionals Think in Action New York: Basic Books, 1983.
  • Shreve, Gregory; Angelone, Erik & Lacruz, Isabel. “Efficacy of Screen Recording in the Other-Revision of Translations: Episodic Memory and Event Models”. MonTI. Special Issue – Minding Translation, 1(1), p. 225-245, 2014. DOI: http://dx.doi.org/10.6035/MonTI.2014.ne1.7
    » https://doi.org/10.6035/MonTI.2014.ne1.7
  • Shreve, Gregory; Angelone, Erik & Lacruz, Isabel. “Are Expertise and Translation Competence the Same? Psychological Reality and the Theoretical Status of Competence”. In: Lacruz, Isabel & Jääskeläinen, Riitta (Eds.). Innovation and Expansion in Translation Process Research Amsterdam: John Benjamins, 2018. p. 37-54.
  • Washbourne, Kelly. “Learning to fail: unsuccessful translations as pedagogical resource”. Current Trends in Translation Teaching and Learning E, 2(1), p. 285-320, 2015.
  • Way, Catherine. “Systematic Assessment of Translator Competence: In Search of Achilles’ Heel”. In: Kearns, John (Ed.). Translator and Interpreter Training: Issues, Methods and Debates London: Continuum, 2008. p. 88-103.
  • Way, Catherine. “Bringing Professional Practices into Translation Classrooms”. In: Kemble, Ian (Ed.). The Changing Face of Translation Portsmouth: Portsmouth University Press, 2009. p. 131-142.

Publication Dates

  • Publication in this collection
    04 Dec 2023
  • Date of issue
    2023

History

  • Received
    13 Jan 2023
  • Accepted
    07 June 2023
  • Published
    Aug 2023
Universidade Federal de Santa Catarina Campus da Universidade Federal de Santa Catarina/Centro de Comunicação e Expressão/Prédio B/Sala 301 - Florianópolis - SC - Brazil
E-mail: suporte.cadernostraducao@contato.ufsc.br