Less May Be More! A Randomized Control Trial Investigating Virtual Clinical Simulations versus Face-to-face High Fidelity Simulations

Description and Goals: The goal of this research study presentation is to provide high school, college and university educators with new evidence suggesting that virtual clinical simulations (VCS) may be just as effective as high-cost, high fidelity, face-to-face (F2F) clinical simulations in regards to student learning outcomes. The virtual clinical simulation platform will be highlighted encouraging active engagement of participants. The presentation will include the research questions, methodology, results, and a discussion of the findings. Context The foundation for achieving competent, ethical, and safe nursing practice is considered to be clinical practices experiences (Diem et al., 2005). There are increasing challenges with planning quality, relevant clinical learning experiences for students, including increased student admissions, health care institution mergers creating fewer clinical placement areas, alternate models of care, and increased competition for health care placements (Foronda et al., 2013b; Hayden, 2010). To mitigate these challenges educators need to devise creative educational strategies to promote development of sound student clinical practice and clinical judgement. One such strategy described in the literature is the use of clinical simulation. Simulation is defined as learning that amplifies, mimics, or replaces real-life clinical situations (McAllister et al., 2013). Although there are many types of simulation, the focus of this RCT was on VCS and F2F high-fidelity clinical simulations. A combination of computer multimedia is utilized with VCS “with a central video or virtual world to produce interactive learning activities mediated by the learner” (Cant & Cooper, 2014, p. 1435). VCS may be a beneficial learning activity to more closely align theory with practice (Foronda et al., 2013a; Killion et al., 2011). Although the beneficial effects of medium and high fidelity simulation for students is cited in previous research (Hampson & Contrell, 2014; Ko & Kim, 2014; Kim-Godwin et al., 2013; Lewis & Ciak, 2011; Veltri et al., 2014), little information is available regarding the effects of VCS. Disadvantages of F2f clinical simulation cited in the literature include high financial, space, and human resource costs (Nagle et al., 2008). Recent literature of the use of VCS in nursing education is sparse. Examples include leadership styles (Foronda et al., 2014), disaster training (Farra et al., 2015; Ulrich et al., 2014), medication administration (Vottero, 2014), and transformative learning (Kleinheksel, 2014). However, research of effectiveness of VCS for undergraduate nursing education is limited, due in part to lack of comparative or control groups, and use of small samples. VCS may be more popular with 21st century students as they are known to positively interact with new technologies that are being used in teaching and learning (Montenery et al., 2013). Research Question Are there differences in the effectiveness of two methods of clinical simulation (virtual and face-to-face) in relation to student knowledge, self-confidence, and anxiety, for two maternal-newborn clinical scenarios (preeclampsia and Group B Streptococcus [GBS]) in third year undergraduate nursing students. Methods Research design: A randomized experimental pretest-post-test research design was used to evaluate the effectiveness of two simulations, VCS (vSim® for Nursing co-developed by Laedral and Wolters Kluwer Health from Lippincott) and a F2F high fidelity manikin clinical simulation. Setting: The research took place in a university in Eastern Canada. The setting for the VCS were two similar rooms, with a computer and a 42” projector screen and a research assistant in attendance. The Clinical Learning and Simulation Centre was the setting for all students completing the F2F high fidelity manikin simulation achieving constancy of environmental conditions. Participants: Third year undergraduate Bachelor of Science in Nursing students (N=56). Measures: Quantitative data collection instruments included pre/post-test knowledge, application and critical thinking tests, and the Nursing Anxiety and Self-Confidence with Clinical Decision Making Scale (NASC-CDM) (White, 2011). Qualitative data was collected using the Clinical Simulation Completion Questionnaire. Procedures: Following ethical approval (REB# 2014-3336), students were introduced to the study during a scheduled class, provided with an information sheet and consent form. Students were aware that their decision to participate would in no manner affect their course grade. Once consent was obtained, students were randomized to one of two groups, and then further randomized to one of 21 student dyads for completion of the clinical simulations. The experimental variable was the VCS and the control variable was F2F high fidelity simulation. The two simulation modalities were congruent in student learning objectives, complexity, cues and the debriefing pattern. Group 1 received the experimental variable for scenario one and the control variable for scenario two whereas Group 2 received the experimental variable for scenario two and the control variable for scenario one. Data was collected before and after each scenario, and at the completion of both scenario simulations. Results SPSS 22 for Windows was used to analyze the data. Baseline characteristics were assess by direct comparison and differences in student learning outcomes were assessed by independent sample t-tests. Qualitative data was analyzed using content analysis. Fifty-six of an eligible 84 students consented to participate in the study. The mean age of participants was 25 years (range: 20 to 44) with the majority being female (84%), and no previous university degree (81%). An independent samples t-test revealed no significant difference in scores for F2F (M = 4.80, SD = 1.19) and virtual (M = 4.12, SD = 1.54); t (48) = 1.75, p = .09, two-tailed) simulations for scenario one and F2F (M = 6.82, SD = 1.25) and VCS (M = 6.40, SD = 1.73); t (51) = 1.02, p = .31, two-tailed) for scenario two. There were no differences related to student self-confidence ((t = 1.93; p = .059) however student anxiety levels were significantly higher for the VCS group (M = 73.26) as compared to the F2F group (M= 57.75). Students reported that they preferred the F2F over the VCS and 61% of participants indicated that they were technically or highly technically competent. Discussion of Findings This study found no significant differences in student learning outcomes in VCS versus F2F high-fidelity clinical simulations. F2F high-fidelity simulations have been cited to be costly related to financial, faculty and equipment resources (Harder, 2010; Nagle et al., 2008) whereas VCS is less costly and can engage students repeatedly in a safe, reproducible and accessible environment. Contrary to the literature, we found that students reported a preference for the F2F simulation. When considering this incongruity, we noted that almost half of the students indicated their reason for not liking the VCS was related to technological issues, i.e., “online program was slow”, “didn’t know where to find things”. In hindsight, the design should have included a pre-study orientation to the VCS platform to ensure that students would not be focused on learning the software while trying to complete the simulation. Our finding of no statistically significant differences in student learning outcomes between the two types of simulations has implications for program planning, resource allocation and continued clinical simulation development. A thorough cost analysis of VCS versus F2F high-fidelity manikin simulation needs to be considered prior to planning and implementing clinical simulations, particularly important in this era of cost containment. In relation to student self-confidence, no self-reported differences indicates that both simulation modalities are effective in maintaining student self-confidence in clinical practice scenarios. Similar findings were reported by others’ in relation to clinical simulations (Fisher & King, 2013; Heinrichs et al., 2008; Leigh, 2008). Differences were found in students’ anxiety levels and were higher when completing the VCS as compared to the F2F simulation. We question whether the increased anxiety arose from the technology surrounding the VCS, and not the simulation itself? On the other hand, students may have been more comfortable in the F2F simulation as the majority of participants would have had prior exposure to the Simulation Centre earlier in their education. Several studies have investigated student anxiety during simulations (Beischel, 2013; Cheung & Au, 2011; Gore et al., 2011; Megel et al., 2012). Anxiety reducing strategies should be planned and implemented prior to any clinical simulation experience. Limitations and Recommendations for Future Research Limitations include the threat of testing, small sample size, and lack of an orientation session pre-study to the virtual clinical simulation platform. Future research includes repeating this RCT with larger sample sizes and conducting a thorough cost-benefit analysis of VSC verses F2F high-fidelity simulations. Conclusion With no differences in student learning outcomes, VCS have the potential to enhance clinical practicum preparation and is a promising educational learning activity. VCS incorporates learning principles of constructivism, enables self-directed learning, and ‘cybergogy’, in a realistic clinical practice setting, while facilitating student learning and self-confidence. It is unknown what the best level of anxiety is to augment student learning in simulation therefore educators should attempt to moderate anxiety levels during simulations to enhance learning. References Beischel, K.P. (2013). Variables affecting learning in a simulation experience: A mixed methods study. Western Journal of Nursing Research, 35(2), 226-247. doi: 10.1177/0193945911408444 Cant, R., & Cooper, S. (2014). Simulation in the Internet age: The place of web-based simulation in nursing education. An integrative review. Nurse Education Today, 34(12), 1435-42. doi: 10.1016/j.nedt.2014.08.001 Cheung, R.Y., & Au, T.K. (2011). Nursing students’ anxiety and clinical performance. Journal of Nursing Education, 50(5), 286-289. doi: 10.3928/01484834-20110131-08 Diem, E., Cragg, B., Moreau, D., Lauzon, S., Blais, J., McBride, W., & Idriss, D. (2005). Report of Canadian Nursing Advisory Committee on Educational Preparation – Clinical Placements. Ottawa, ON: Canadian Nurses Association. Retrieved from http://www.cnaaiic.ca/CNA/documents/pdf/publications/Clinical_Placements_e.pdf Farra, S., Miller, E., & Hodgson, E. (2015). Virtual reality disaster training: Translation to practice. Nurse Education in Practice, 15(1), 53-7. doi:10.1016/j.nepr.2013.08.017 Fisher, D., & King, L. (2013). An integrative literature review on preparing nursing students through simulation to recognize and respond to the deteriorating patient. Journal of Advanced Nursing, 69(11), 2375-2388. doi: 10.1111/jan.12174 Foronda, C., Budhathoki, C., & Salani, D. (2014). Use of multiuser, high-fidelity virtual simulation to teach leadership styles to nursing students. Nurse Educator, 39(5), 209-11. Foronda, C., Godsall, L., & Trybulski, J. (2013a). Virtual clinical simulation: The state of the science. Clinical Simulation in Nursing, 9(8), e279–e286. doi: http://dx.doi.org/10.1016/j.ecns.2012.05.005 Foronda, C., Liu, S., & Bauman, E. (2013b). Evaluation of simulation in undergraduate nurse education: An integrative review. Clinical Simulation in Nursing, 9, e409–e416. doi: http://dx.doi.org/10.1016/j.ecns.2012.11.003 Gore, T., Hunt, C., Parker, F., & Raines, K. (2011). The effects of simulated clinical experiences on anxiety: Nursing student' perspectives. Clinical Simulation in Nursing, 7(5), e175–e180. doi: http://dx.doi.org.ezproxy.library.dal.ca/10.1016/j.ecns.2010.02.001 Hampson, S., & Cantrell, S. (2014). Does the use of standardized patients in maternal-newborn simulation increase student confidence prior to entering the clinical setting? JOGNN, 43(S1), S48. doi: 10.1111/1552-6909.12431 Harder, B.N. (2010). Use of simulation in teaching and learning in health sciences: A systematic review. Journal of Nurse Education, 49(1), 23-28. doi: 10.3928/01484834-20090828-08 Hayden, J. (2010). Use of simulation in nursing education. National survey results. Journal of Nursing Regulation, 1(3), 52-57. Hayden, J., Smiley, R., Alexander, M., Kardong-Edgren, S., & Jeffries, P. (2014). The NCSBN national simulation study: A longitudinal, randomized, controlled study replacing clinical hours with simulation in prelicensure nursing education. Journal of Nursing Regulation, 5(2), 2-39. doi: 10.1016/j.ecns.2012.07.070 Heinrichs, P., Youngblood, P., Harter, P.M., & Parvati, D. (2008). Simulation for team training and assessment: Case studies on online training with virtual worlds. World Journal of Surgery, 32, 161-170. doi: 10.1007/s00268-007-9354-2 Killion, C., Reilly, J., & Gallagher-Lepak, S. (2011). Becoming an ‘‘onliner’’: Students’ perceptions of moving from traditional to virtual learning. Online Journal of Nursing Informatics, 15(1). Retrieved from http://ojni.org/issues/?p=139 10p Kim-Godwin, Y.S., Livsey, K.R., Ezzell, D., Highsmith, C., Winslow, H., & Aikman, A. (2013). Students like peer evaluation during home visit simulation experiences. Clinical Simulation in Nursing, 9(11), e535-e542. doi: http://dx.doi.org/10.1016/j.ecns.2012.06.002 Kleinheksel, A.J. (2014).Transformative learning through virtual patient simulations: Predicting critical student reflections. Clinical Simulation in Nursing, 10(6), e301–e308. doi: 10.1016/j.ecns.2014.02.001 Ko, E., & Kim, H. (2014). Effects of multi-mode simulation learning on nursing students’ critical thinking disposition, problem solving process and clinical competence. Korean Journal of Adult Learning, 26(1), 107-116. Leigh, G.T. (2008). High-fidelity patient simulation and nursing students' self-efficacy: A review of the literature. International Journal of Nursing Education Scholarship, 5(art. 37). doi: 10.2202/1548-923X.1613 Lewis, D.Y. & Ciak, A.D. (2011). The impact of a simulation lab experience for nursing students. Nurse Education Perspectives, 32(4), 256-8. McAllister, M., Levett-Jones, T., Downer, T., Harrison, P., Harvey, T., Reid-Searl, K… & Calleja, P. (2013). Snapshots of simulation: Creative strategies used by Australian educators to enhance simulation learning experiences for nursing students. Nursing Education in Practice, 13. doi: S1471-5953(13)00095-4. 10.1016/j.nepr.2013.04.010 Megel, M.E., Black, J., Clark, L., Carstens, P., Jenkins, L.D., Promes, J…Goodman, T. (2012). Effect of high-fidelity simulation on pediatric nursing students’ anxiety. Clinical Simulation in Nursing, 8(9), e419-428. doi:10.1016/j.ecns.2011.03.006 Montenery, S., Walker, M., Sorensen, E., Thompson, R., Kirklin, D., White, R., & Ross, C. (2013). Millennial generation student nurses' perceptions of the impact of multiple technologies on learning. Nursing Education Perspectives, 34(6), 405-409. Nagle, B., McHale, M., Alexander, G., & French, B. (2008). Incorporating scenario-based simulation into a hospital nursing education program. Journal of Continuing Education, 40, 18-25. Ulrich, D., Farra, S., Smith, S., & Hodgson, E. (2014). The student experience using virtual reality simulation to teach decontamination. Clinical Simulation in Nursing, 10(11), 546-53. doi: http://dx.doi.org/10.1016/j.ecns.2014.08.003 Veltri, L., Rowe, J., Bell, K., Arwood, E., & Kindler, L. (2014). The maternal-newborn assessment study: Can simulation replicate the clinical learning experience in undergraduate nursing education? JOGNN, 43(S1), S84. doi: 10.1111/1552-6909.12442 Vottero, B. (2014). Proof of concept: Virtual reality simulation of a Pyxis machine for medication administration. Clinical Simulation in Nursing, 10(6), e325-31. doi: http://dx.doi.org/10.1016/j.ecns.2014.03.001 White, K. (2011). The development and validation of a tool to measure self-confidence and anxiety in nursing students while making clinical decisions. UNLV Theses/Dissertations/ Professional Papers/Capstones. Paper 1384. Retrieved from http://digitalscholarship.unlv.edu/thesesdissertations