Joint online distance learning to complement postgraduate pathology training in preparation for national board examinations =========================================================================================================================== * Bas de Leng * Laura Helle * Otto Jokelainen * Mikko Kainulainen * Pauliina Kronqvist * Christian Mol * Friedrich Pawelka * Vesa-Matti Pohjanen * Koen Vincken ## Abstract **Aims** To meet the flexible learning needs of pathology residents preparing for national board examinations, a joint distance learning approach was developed using both asynchronous and synchronous activities with whole slide images, drawing on empirical educational research on online distance learning. **Methods** In a case study of an implementation of the designed joint distance learning approach with a geographically dispersed group of pathology residents in Finland, the participants’ perceptions were measured with a 12-item questionnaire covering the value of the learning opportunity, the quality of the sociocognitive processes and their emotional engagement and social cohesion. Communication during the online session was also recorded and analysed to provide objectivity to the self-report data. **Results** The effectiveness of joint online learning for knowledge acquisition and preparation for national board examinations was highly rated. However, despite strong emotional engagement during synchronous activities, participants reported minimal interpersonal interaction, which was also reflected in the recordings of the online session. **Conclusion** Using a technology integration framework and guided by the principles of self-determination theory, joint distance learning is emerging as a beneficial addition to postgraduate pathology programmes in preparation for national examinations. However, to realise the full potential of interpersonal interaction, participants should be prepared for an appropriate mindset. * education, medical * computer-aided design * education #### WHAT IS ALREADY KNOWN ON THIS TOPIC * Although organising multi-institutional teaching activities digitally and remotely seems a logical option for postgraduate medical education, it is still underused. * The evaluation of the online distance learning formats by the staff and the trainees shows a very mixed picture. #### WHAT THIS STUDY ADDS * Using a technology integration framework and guided by the principles of self-determination theory, joint online learning opportunities are highly valued by residents in preparation for national board examinations. * To realise the full potential of interpersonal dynamics in joint online learning opportunities, participants need to cultivate a mindset conducive to meaningful interaction. #### HOW THIS STUDY MIGHT AFFECT RESEARCH, PRACTICE OR POLICY * In order to determine whether joint multi-institutional online learning approaches are a serious option for national pathology societies to incorporate as a regular part of their residency programmes, further experimental studies and qualitative studies on the promotion of appropriate attitudes to online interpersonal interaction are needed. ## Introduction It is often a challenge for individual postgraduate pathology training institutions to provide each resident with the optimal learning experiences necessary to pass the examinations for board certification. In some countries, such as Finland, the board examinations are national, but similar challenges apply to institutional or international examinations. Although several pathology curricula have been described in the literature, particularly in the USA, and the Accreditation Council for Graduate Medical Education has established overarching guidelines for pathology residency training, there remains a wide variety of curricula in different institutions.1 2 In essence, pathology residency training has remained more of an apprenticeship than a curriculum, with the inherent limitation of knowledge gaps that can vary significantly between training programmes.1 In addition, it is difficult for any single postgraduate medical education (PGME) programme to cover the rapid and ever-evolving technical developments in pathology diagnostics, where, for example, laboratories need to adopt digital pathology for their diagnostics3 and the number of biomarkers available to a pathologist is increasing every day. In PGME, on the other hand, the residency and fellowship programmes often have common core requirements that make joint teaching a viable option in terms of content. Since 2023, the common core requirements in pathology training in Finland have been defined as entrustable professional activities (EPAs). These EPAs include the ability to perform a medical autopsy, to chair a multidisciplinary meeting, the general ability to examine surgical resection specimens, to perform frozen section procedures and specified skills and knowledge in all major subfields of surgical pathology. However, co-organised, face-to-face extra-institutional teaching activities—such as educational pathology conferences, visiting lectureships or resident study groups—often do not fit into everyone’s schedule, are time consuming and expensive to attend or organise. Organising such collaborative teaching activities digitally and remotely therefore seems a logical option, especially for distant institutions. It offers young professionals with a full time job and busy social lives, the flexibility of avoiding travel and tuning in from distributed clinical sites or from home, making a valuable contribution to a better work-life balance. An important prerequisite for such computer-mediated solutions is the availability of online teaching materials and familiarity with their use. As virtual microscopy, that is, computer-based digital slide viewers, has been used in pathology education and certification examinations for many years,2 this seems to be a minor issue for pathology education. Nevertheless, prior to the COVID-19 pandemic, the use of digital pathology and whole slide imaging (WSI) as an educational tool for distance teaching remained underused.4 During the social distancing measures in response to the COVID-19 pandemic, however, distance learning opportunities for pathology residents outside of their daily practice received a huge boost. A recent literature review by Hassell *et al*5 gives a nice overview with lists of the many online resources such as cases, atlases and other websites for all stages of pathology education. However, to the best of our knowledge, an organised combination of asynchronous and synchronous online activities has not been described in the literature for the PGME context. During the COVID-19 pandemic, there was no choice but to work and study remotely. However, now that conditions have returned to normal and the choice between face-to-face and online distance learning has been restored, it is interesting to explore how the compulsory move to distance learning during the pandemic has affected current attitudes towards this option for teaching pathology residents. The studies described in the literature present a mixed and conflicting picture in this regard. An online survey of pathology trainees,5 programme directors and faculty assessing the use of and response to various digital pathology modalities before and after COVID-19 revealed a perception—held fairly equally by the majority of faculty and trainees—that the move to online modalities had led to a reduction in the quality and effectiveness of pathology teaching and learning. However, a review of 51 papers on remote not workplace-based learning in PGME, in response to COVID-19, found that learners were largely satisfied with online learning and reported mostly positive responses.6 The latter Best Evidence Medical Education (BEME) systematic review also provides some guidance for educators seeking to optimise learning in their postpandemic practice, stating that future online distance education would benefit from: (a) considering technology integration frameworks, (b) leveraging collaborations and (c) underpinning their developments with learning theories. In response to the aforementioned need for flexible and easily accessible supplementary learning opportunities for pathology residents, and in line with the recommendations of the BEME guide,6 we developed and piloted in a multi-institutional collaboration, using the PICRAT framework and underpinned by self-determination theory (SDT)7—an online learning opportunity to prepare pathology residents for a national board examination. After the pilot, we assessed the residents' perceptions of the value of the learning opportunity, the quality of the social-cognitive processes during the joint online debriefing, and finally their emotional engagement and social cohesion during this debriefing. ## Methods ### Collaboration, educational theory and technology integration framework We brought together the five university hospitals with PGME pathology programmes in Finland (Helsinki, Kuopio, Oulu, Tampere and Turku), which are geographically far apart, in an online multi-institutional collaboration. As SDT states that autonomy, competence and relatedness are the three basic cognitive needs that are essential for building intrinsic motivation to learn7 and have also been shown to be useful for distance histopathology education,8 we addressed these needs to stimulate residents’ engagement in a joint online distance learning activity to prepare for their national board exam. Autonomy (feeling that one is the source of one’s own behaviour) was particularly addressed in the preparatory asynchronous work, which could be completed independently, at one’s own pace, regardless of time or place. Competence (feeling effective in one’s actions) and relatedness (feeling connected to others) on the other hand were particularly addressed in the synchronous debriefing session, where peers from different institutions met online and were supported by two experienced pathologists who had a good idea of the residents’ level of knowledge from the products of their preparatory work. As a framework for technology integration, we used the PICRAT framework,9 which was also used in the systematic review by Khamees *et al*.6 It is designed to explore the extent to which teachers have integrated technology and facilitated learner engagement in online learning implementations. In doing so, the PICRAT framework can also provide us insights into how to improve teaching and increase learner involvement in online distance learning developments. PIC in the PICRAT framework stands for passive, interactive and creative and describes a learner’s relationship to technology. It refers in part to the Interactive, Creative, Active, Passive (ICAP) framework,10 which assumes that different kinds of cognitive engagement bring about different levels of understanding. Passive engagement (P) would produce knowledge that can be recalled verbatim. Active engagement (A) would produce a body of knowledge that can be applied to similar contexts, whereas constructive or creative engagement (C) would result in knowledge that can be applied to a novel context. Finally, interactive student engagement (I) would result in a knowledge base that allows partners to invent new ideas. RAT in PICRAT framework stands for replaces, amplifies or transforms and describes a teacher’s use of technology. In amplifying, the use of technology goes beyond replacement, because it enables the learner to achieve their learning outcomes more effectively and/or efficiently. In transforming, technology enables learning outcomes that would not have been possible without it. During the development and implementation of the online distance learning opportunity for pathology residents, we sought to fulfil especially the creative, interactive, amplifying and transforming factors of the PICRAT framework. ### Procedure The online learning opportunity consisted of two phases: asynchronous individual work followed by synchronous group work (figure 1). The individual work required residents to view eight short clinical vignettes with WSI tissue samples and to answer accompanying questions. In terms of PIC classification, the residents’ engagement with the technology was *creative*, as they had to submit their answers to a variety of question types (free text, multiple choice, marker and long list) in an online assessment programme that allows visualisation and manipulation of large WSIs (VQuest; [http://vquest.eu/](http://vquest.eu/)). ![Figure 1](http://jcp.bmj.com/https://jcptest-stage.highwire.org/content/jclinpath/early/2024/03/08/jcp-2023-209311/F1.medium.gif) [Figure 1](http://jcp.bmj.com/content/early/2024/03/08/jcp-2023-209311/F1) Figure 1 Overview learning opportunity (note: the figure is a compilation of images from [https://commons.wikimedia.org/](https://commons.wikimedia.org/) with source: CIA, The World Factbook, 2004 and screenshots from our software programs). In a subsequent joint debriefing session, the collected responses from the preparatory work were displayed in a shared learning dashboard11 and discussed in a video conference (Zoom meeting) moderated by two pathology teachers. This made the residents’ relationship with the technology also *interactive*. The teachers’ use of technology was for both the individual preparatory assignment and the group debriefing in part *amplifying* and *transforming*. Free text and multiple choice questions can be implemented on paper, but with used technology the collection, aggregation and reporting of responses can be enhanced and done in real time. Moreover, for marker questions, where the answers are placed inside the WSI and can then be displayed in a hotspot diagram, the used technology is essential. The asynchronous individual work on eight cases in VQuest is been done in the last 3 weeks of December 2022. The synchronous moderated joint debriefing using Zoom and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses learning dashboard was scheduled for the second week of January 2023. Each of the moderating pathology teachers developed four cases from their practice, one using only text-based questions (multiple choice, long menu and open text) and the other using a combination of text-based and marker questions (marker placed within the WSI). Neither residents nor teachers needed to instal any special software as everything could be accessed through a standard browser. To ensure a degree of anonymity during the Zoom debriefing, participants were given login names that only revealed their university hospital and year of training; as the Zoom session was also recorded, the webcams were disabled for participants. In contrast, the two pathology teachers who moderated the debriefing and the two persons who technically supported the session were visible via their webcam. ### Measures Residents’ perceptions of both asynchronous individual preparation and synchronous joint online debriefing were assessed using a questionnaire with 12 statements to be answered on a 7-point Likert scale (table 1). Each of the aspects: learning value (items 1–4), quality of sociocognitive processes (items 5–8), emotional engagement and social cohesion (items 9–12) were covered by four items. View this table: [Table 1](http://jcp.bmj.com/content/early/2024/03/08/jcp-2023-209311/T1) Table 1 Residents’ perceptions of the supplementary learning opportunity The four items for the quality of sociocognitive processes (eg, discussion) were selected from the ‘Heedful Interrelating in Collaborative Educational Settings’ scale,12 a 6-item questionnaire that measures participants’ perceptions of the quality of interactions during collaborative educational tasks. For emotional engagement, items from ‘emotional engagement’ questionnaire by Dao and Sato13 were used. ### Data collection and analysis Residents who were able to participate in both parts of the learning opportunity were asked to complete an online questionnaire (LimeSurvey) anonymously, immediately after the joint online debriefing. Means and SD per item were calculated for these responses. Participants’ verbal and chat activity during the Zoom session was also recorded in order to have a means of objectifying self-reports of online discourse.ob ## Results Sixteen pathology residents participated in the asynchronous individual work, while eight of them also participated in the subsequent joint online debriefing session. The latter eight came from four different Finnish university hospitals, ranged from the first to the third year of their residency training; all responded to the online questionnaire. Table 1 shows the residents’ scores on the questionnaire that assessed the following aspects of the learning opportunity: learning value (items 1–4), quality of sociocognitive processes (items 5–8), emotional engagement and social cohesion (items 9–12). The mean scores for the learning value of both parts were all above 5 on the 7-point Likert scale. The scores for emotional engagement and social cohesion were all around 5, but three of the four scores for the quality of sociocognitive processes were well below 3.5. ## Discussion and conclusion Although online collaborative teaching seems to be a logical option for additional learning opportunities in pathology PGME programmes, this option remained underused prior to the COVID-19 pandemic,4 and even after the pandemic the appreciation of this option shows a mixed picture in the literature. In contrast to the PGME context, the use of a combination of asynchronous and synchronous learning opportunities during the COVID-19 pandemic has been described in the literature for undergraduate and graduate pathology teaching14–18 (table 2). What is unique about the use of this combination in the study described here is that the individual performances in the preceding asynchronous activities were archived with digital slides so that they could later be discussed in detail in the group during the synchronous activities. View this table: [Table 2](http://jcp.bmj.com/content/early/2024/03/08/jcp-2023-209311/T2) Table 2 Joint online distance learning during the COVID-19 pandemic for different stages of pathology education As the characteristics of online distance learning programmes are important for their evaluation, we designed and implemented a joint online learning activity following the recommendations of the BEME guide,6 using the PICRAT framework as the technology integration framework and SDT as the learning theory. This case study evaluated the implementation of this joint online learning approach for a distributed group of pathology residents preparing for a national board examination. The results indicated that the residents highly valued the joint online learning opportunity in terms of knowledge acquisition and preparation for their national examination. This was confirmed by the significant positive responses to the open questions, with residents regularly asking for more such teaching opportunities. However, although they were highly emotionally engaged in the 2-hour synchronous activity, they perceived little interpersonal interaction. This was confirmed by the analysis of the screen-recordings and chat-recordings of the session, in which there was little to no interaction—apart from some verbal discussion between the two teachers and a few chat messages. This is a pity because such interpersonal interaction has the potential to engage residents deeply, making their thinking visible and providing an important opportunity to deepen knowledge through argumentation and to discuss misconceptions.19 Well-known inhibitors of interaction, such as disinterest or anxiety,20 do not seem to play a role here. Both teachers also regularly encouraged active participation from residents with questions, so it seems that the prerequisite that participants enter the online session with a mindset, in which the aim is to grow in knowledge together through constructive interpersonal interaction,21 is missing. As the pilot project took place entirely in a Finnish context, cultural factors may also have played a role. For example, a cross-cultural comparison study of asynchronous online collaboration showed differences in the behaviour of Finnish, American and Korean participants.22 It may not have helped that the participants did not know each other and the webcam was turned off for privacy reasons. In addition, the online session was advertised as a debriefing session, which may have led to the expectation that teachers would mainly discuss the cases covered. Despite the obvious limitation of having relatively few participants and a specific geographical context, it is safe to conclude that joint online distance learning based on a technology integration framework and on principles of SDT are a welcome and instructive addition to PGME pathology programmes. However, in order to take advantage of the valuable role of interpersonal interaction for learning, participants should be prepared for an appropriate mindset. For small groups of learners who have never met in person, short icebreaker activities, such as sharing personal photos of hobbies or pets that are being discussed, can facilitate social interaction in general.15 In addition, separate targeted introductions could also help to raise awareness of the effectiveness of collaborative learning and the importance of having the right mindset for it. One might consider knowledge about how individual performance goals are related to the regulation of learning in groups.23 In order to determine whether the joint multi-institutional online learning approach described in this study is a serious option for national pathology societies to incorporate as a regular part of their residency programmes, future research on the approach with larger numbers and in different geographical contexts would be welcome. ## Data availability statement Data are available on reasonable request. ## Ethics statements ### Patient consent for publication Not applicable. ### Ethics approval The telephone inquiries to the ethics committees of the Universities of Münster and Turku confirmed that exemptions are granted for these non-biomedical studies when written informed consent was obtained from all individual participants in the study. ## Footnotes * Handling editor Runjan Chetty. * Contributors BdL: guarantor, conceptualisation, methodology, investigation, project administration, writing—original, review and editing. OJ and V-MP: validation, review and editing. Others: validation and resources. * Funding The study was funded by the European Union ERASMUS+ grant programme under grant number 2020-1-DE01-KA226-HE-005813. * Map disclaimer The depiction of boundaries on this map does not imply the expression of any opinion whatsoever on the part of BMJ (or any member of its group) concerning the legal status of any country, territory, jurisdiction or area or of its authorities. This map is provided without any warranty of any kind, either express or implied. * Competing interests None declared. * Provenance and peer review Not commissioned; externally peer reviewed. [http://creativecommons.org/licenses/by-nc/4.0/](http://creativecommons.org/licenses/by-nc/4.0/) This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: [http://creativecommons.org/licenses/by-nc/4.0/](http://creativecommons.org/licenses/by-nc/4.0/). ## References 1. Katsakhyan L, Preciado C, Baloch ZW. Pathology residency curricula a systematic review of novel educational ventures in the published literature. Am J Clin Pathol 2022;158:331–7. [doi:10.1093/ajcp/aqac069](http://dx.doi.org/10.1093/ajcp/aqac069) 2. Wake LM, Allison DB, Ware AD, et al. Pathology residency program special expertise tracks meet the needs of an evolving field. Acad Pathol 2021;8:23742895211037034. [doi:10.1177/23742895211037034](http://dx.doi.org/10.1177/23742895211037034) 3. Van Es SL. Digital pathology: semper ad meliora. Pathology 2019;51:1–10. [doi:10.1016/j.pathol.2018.10.011](http://dx.doi.org/10.1016/j.pathol.2018.10.011) [PubMed](http://jcp.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fjclinpath%2Fearly%2F2024%2F03%2F08%2Fjcp-2023-209311.atom) 4. Evans AJ, Depeiza N, Allen S-G, et al. Use of whole slide imaging (WSI) for distance teaching. J Clin Pathol 2021;74:425–8. [doi:10.1136/jclinpath-2020-206763](http://dx.doi.org/10.1136/jclinpath-2020-206763) [Abstract/FREE Full Text](http://jcp.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToiamNsaW5wYXRoIjtzOjU6InJlc2lkIjtzOjg6Ijc0LzcvNDI1IjtzOjQ6ImF0b20iO3M6NDg6Ii9qY2xpbnBhdGgvZWFybHkvMjAyNC8wMy8wOC9qY3AtMjAyMy0yMDkzMTEuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 5. Hassell LA, Peterson J, Pantanowitz L. Pushed across the digital divide: COVID-19 accelerated pathology training onto a new digital learning curve. Acad Pathol 2021;8:2374289521994240. [doi:10.1177/2374289521994240](http://dx.doi.org/10.1177/2374289521994240) 6. Khamees D, Peterson W, Patricio M, et al. Remote learning developments in postgraduate medical education in response to the COVID-19 pandemic - a BEME systematic review: BEME guide No.71. Med Teach 2022;44:466–85. [doi:10.1080/0142159X.2022.2040732](http://dx.doi.org/10.1080/0142159X.2022.2040732) 7. Ryan RM, Deci EL. Self-determination theory: basic psychological needs in motivation, development, and wellness. Guilford publications, 2017. 8. Uraiby H, Grafton-Clarke C, Gordon M, et al. Fostering intrinsic motivation in remote undergraduate histopathology education. J Clin Pathol 2022;75:837–43. [doi:10.1136/jclinpath-2021-207640](http://dx.doi.org/10.1136/jclinpath-2021-207640) [Abstract/FREE Full Text](http://jcp.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToiamNsaW5wYXRoIjtzOjU6InJlc2lkIjtzOjk6Ijc1LzEyLzgzNyI7czo0OiJhdG9tIjtzOjQ4OiIvamNsaW5wYXRoL2Vhcmx5LzIwMjQvMDMvMDgvamNwLTIwMjMtMjA5MzExLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 9. Kimmons R, Graham CR, West RE. The PICRAT model for technology integration in teacher preparation. Contemporary Issues in Technology and Teacher Education 2020;20. Available: [https://citejournal.org/volume-20/issue-1-20/general/the-picrat-model-for-technology-integration-in-teacher-preparation](https://citejournal.org/volume-20/issue-1-20/general/the-picrat-model-for-technology-integration-in-teacher-preparation) 10. Chi MTH. Active-constructive-interactive: a conceptual framework for differentiating learning activities. Top Cogn Sci 2009;1:73–105. [doi:10.1111/j.1756-8765.2008.01005.x](http://dx.doi.org/10.1111/j.1756-8765.2008.01005.x) [CrossRef](http://jcp.bmj.com/lookup/external-ref?access_num=10.1111/j.1756-8765.2008.01005.x&link_type=DOI) 11. De Leng B, Pawelka F. The use of learning Dashboards to support complex in-class pedagogical scenarios in medical training: how do they influence students’ cognitive engagement? RPTEL 2020;15:14–31. [doi:10.1186/s41039-020-00135-7](http://dx.doi.org/10.1186/s41039-020-00135-7) 12. Daniel SR, Jordan ME. Measuring heedful interrelating in collaborative educational settings. Int J Sch Educ Psychol 2015;3:25–36. [doi:10.1080/21683603.2014.909342](http://dx.doi.org/10.1080/21683603.2014.909342) 13. Dao P, Sato M. Exploring fluctuations in the relationship between learners' positive emotional engagement and their interactional behaviours. Lang Teach Res 2021;25:972–94. [doi:10.1177/13621688211044238](http://dx.doi.org/10.1177/13621688211044238) 14. Balakrishnan R, Singh K, Harigopal M, et al. A novel “Google Classroom”-based pathology education tool for trainees during the COVID-19 pandemic: impactful learning while social distancing. Arch Pathol Lab Med 2020;144:1445b–1447. [doi:10.5858/arpa.2020-0476-LE](http://dx.doi.org/10.5858/arpa.2020-0476-LE) 15. Sundling K, Kraft A. Cytopathology in focus: virtual education in cytology: pandemic silver lining. Available: [https://www.captodayonline.com/cytopathology-in-focus-virtual-education-in-cytology-pandemic-silver-lining/](https://www.captodayonline.com/cytopathology-in-focus-virtual-education-in-cytology-pandemic-silver-lining/) [Accessed 02 Jan 2024]. 16. Parker EU, Chang O, Koch L. Remote anatomic pathology medical student education in Washington state: an early COVID-19 experience. Am J Clin Pathol 2020;154:585–91. [doi:10.1093/ajcp/aqaa154](http://dx.doi.org/10.1093/ajcp/aqaa154) 17. Samueli B, Sror N, Jotkowitz A, et al. Remote pathology education during the COVID-19 era: crisis converted to opportunity. Ann Diagn Pathol 2020;49:151612. [doi:10.1016/j.anndiagpath.2020.151612](http://dx.doi.org/10.1016/j.anndiagpath.2020.151612) [CrossRef](http://jcp.bmj.com/lookup/external-ref?access_num=10.1016/j.anndiagpath.2020.151612&link_type=DOI) [PubMed](http://jcp.bmj.com/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fjclinpath%2Fearly%2F2024%2F03%2F08%2Fjcp-2023-209311.atom) 18. Sharma R, King TS, Hanson ER, et al. Medical histopathology laboratories: remote teaching in response to COVID-19 pandemic. Acad Pathol 2021;8:2374289521998049. [doi:10.1177/2374289521998049](http://dx.doi.org/10.1177/2374289521998049) 19. Leitão S. The potential of argument in knowledge building. Hum Dev 2000;43:332–60. [doi:10.1159/000022695](http://dx.doi.org/10.1159/000022695) [CrossRef](http://jcp.bmj.com/lookup/external-ref?access_num=10.1159/000022695&link_type=DOI) 20. Van den Bossche P, Gijselaers WH, Segers M, et al. Social and cognitive factors driving teamwork in collaborative learning environments - team learning beliefs and behaviors. Small Group Res 2006;37:490–521. [doi:10.1177/1046496406292938](http://dx.doi.org/10.1177/1046496406292938) [CrossRef](http://jcp.bmj.com/lookup/external-ref?access_num=10.1177/1046496406292938&link_type=DOI) [Web of Science](http://jcp.bmj.com/lookup/external-ref?access_num=000240424600004&link_type=ISI) 21. Kuhn D, Zillmer N, Crowell A, et al. Developing norms of argumentation: metacognitive, epistemological, and social dimensions of developing argumentive competence. Cogn Instr 2013;31:456–96. [doi:10.1080/07370008.2013.830618](http://dx.doi.org/10.1080/07370008.2013.830618) 22. Kim K-J, Bonk CJ. Cross-cultural comparisons of online collaboration. J Comput Mediat Commun 2002;8. [doi:10.1111/j.1083-6101.2002.tb00163.x](http://dx.doi.org/10.1111/j.1083-6101.2002.tb00163.x) 23. Greisel M, Melzner N, Kollar I, et al. How are achievement goals associated with self-, co-, and socially shared regulation in collaborative learning? Educ Psychol 2023;43:384–402. [doi:10.1080/01443410.2023.2211751](http://dx.doi.org/10.1080/01443410.2023.2211751)