Using a Mixed-Methods Approach to Understand What Students Expect From Their Online Education: Why it Matters

Audience Level: 
All
Session Time Slot(s): 
Institutional Level: 
Higher Ed
Special Session: 
Research
Abstract: 

Using a SERVQUAL tool modified for the online learning environment, we conducted mixed-methods study to explore student expectations of online education, student perceived service, gaps in service quality, and faculty perceptions of student expectations. We present the results, research methods for replication, and why gathering this type of data matters.

Extended Abstract: 

Discrepancies between student expectations of online education and their perceptions of actual program experiences can lead to negative outcomes such as decreased student satisfaction, increased attrition, and student reluctance to recommend a program to others.  The gap model of service quality, a customer-satisfaction framework, identifies five potential gaps that must be evaluated so that corrective actions and process improvements can be implemented to improve customer-perceived satisfaction (Berry, Zeithaml, & Parasuraman, 1990).

This framework was used to evaluate an online Registered Nurse (RN) to Bachelor of Science in Nursing (BSN) program located in the Midwest of the United States. The RN student population has unique needs and face barriers such as competing priorities, work schedules, family obligations, time constraints, past negative educational experiences, and limited funds (Altman, 2011; Duffy et al., 2014).  To better meet the needs of these students for flexibility, of the 747 RN to BSN programs in the U.S., more than 400 were offered at least partially online (AACN, 2017). Yet, little research has been completed regarding the expectations these adult learners have of online education. Even less attention has been directed towards evaluating how student expectations compare to their perceptions of the actual online education services received.  

Gaps 1 and 5 of the gap model of service quality were targeted for this study. Gap 1, the knowledge gap,  measures the difference between student expectations of service and faculty perceptions of what students expectations. This gap occurs when discrepancies arise between what faculty perceive  student expect and what students actually expect. Gap 5, the customer gap, measures the difference between student expectations of service and their perceived actual service. This gap occurs when the student’s actual experiences to do meet their expectations (Parasuraman, Zeithaml, & Berry, 1985).  Gaps found in both of these areas can influence student perceptions of program quality.

A mixed-methods study was conducted to explore student expectations, student perceived service, gaps in service quality, and faculty perceptions of student expectations.

The research questions for this study were as follows:

1. What expectations do RN students have of their online education experience?

2.  What perceptions do RN students have of their actual online education experiences?

3. What gaps exist between student expectations and perceptions in the areas of empathy, assurance, responsiveness, reliability, website content, and e-learning quality.

4. What do faculty perceive students expect from their online education experience?

5.  Is there a gap between faculty perceptions of student expectations and students’ reported expectations?

Following institutional review board approval, students and faculty participants were recruited via university email. A SERVQUAL tool modified by Udo, Bagchi, and Kirs (2011) to fit the online learning environment was used for the collection of quantitative data. Qualitative data were collected during student and faculty interviews using semi-structured questions. Survey participants included 54 active students. Fifteen students and five faculty participated in the qualitative interviews.

Quantitative analysis revealed gaps in all dimensions. The expectation-perception gap was greatest for responsiveness (-0.506) and least for website content (-0.156).  Other gaps included assurance (-0.287), reliability (-0.364), e-learning quality (-0.389), and empathy (-0.423). Student responses to three single-item survey questions on a scale of 1=very poor to 7=excellent were as follows: Your perception of the program’s overall instruction quality (Mean 6.07, SD .843);  Would you recommend this RN to BSN program to someone else (Mean 5.93, SD, 1.21); I would say that I am satisfied with the RN to BSN program (Mean 5.87, SD 1.25). Significant correlations between the 6 dimensions and student reports of satisfaction and quality were revealed.

Qualitative analysis revealed three common themes between students and faculty including: workload, coursework, and flexibility.  Agreements were found in the areas of workload and coursework and a gap was found in the area of flexibility. Faculty introduced an additional theme of availability and students introduced an additional theme of support.

Discrepancies between student expectations and experiences as well as faculty’s perceptions of their expectations, do impact students’ perceptions of overall online program quality. In the online environment especially, eliciting student feedback regarding their experiences is essential. The results of this study were used to inform faculty practices as well as decisions related to a recent curricular revision. The study of student expectations and perceptions assists in locating areas of performance where improvements are needed, or areas where resources could be better utilized.

Educators and administrators are rightly concerned with delivering quality online education that students find satisfying. As leaders of educational institutions strive to remain viable in a rapidly changing world, adopting a student-as-customer focus aids in meeting student needs more effectively (Mark, 2013). The gap model of service quality has been recognized widely in the quality literature and is useful in higher education evaluation. In this discovery session, participants will learn the process of conducting a gap analysis using the modified SERVQUAL tool, which measures student expectations and perceptions of six quality dimension: empathy (faculty’s ability to provide caring and individualized attention), assurance (faculty’s knowledge, courtesy and ability to convey trust and confidence), responsiveness (faculty’s willingness to help students and provide prompt service), reliability (faculty’s ability to perform promised services dependably and accurately), website content (layout, visual effect and appeal, graphics use, presence of multimedia, and information quality), and e-learning quality (quality and clarity of instruction, information currency, and website feature functionality).  Participants of this discovery session will review the data and its implications for our program, learn how to replicate this study and tailor it to their online student populations, as well as why obtaining this type of information on their specific student population matters. Participants will receive handouts including the student questionnaire and qualitative semi-structured interview questions for both students and faculty.

 

Altmann, T. K. (2011). Registered nurses returning to school for a bachelor’s degree in nursing: Issues emerging from a meta-analysis of the research. Contemporary Nurse, 39(2), 256–272. doi:10.5172/conu.2011.39.2.256

American Association of Colleges of Nursing (AACN).  Fact sheet: The impact of education on nursing practice. 2017. http://www.aacnnursing.org/Portals/42/News/Factsheets/Education-Impact-Fact-Sheet.pdf.

Berry, L. L., Zeithaml, V. A., & Parasuraman, A. (1990). Five imperatives for improving service quality. MIT Sloan Management Review, 31(4), 29.

Duffy, M. T., Friesen, M. A., Speroni, K. G., Swengros, D., Shanks, L. A., Waiter, P. A., & Sheridan, M. J. (2014). BSN completion barriers, challenges, incentives, and strategies. The Journal of Nursing Administration, 44(4), 232–236. doi:10.1097/NNA.0000000000000054

Mark, E. (2013). Student satisfaction and the customer focus in higher education. Journal of Higher Education Policy and Management, 35(1), 2–10. doi:10.1080/1360080X.2012.727703

Parasuraman, A., Zeithaml, V. A., & Berry, L. L. (1985). A conceptual model of service quality and its implications for future research. Journal of Marketing, 49(4), 41–50. doi:10.2307/1251430

Udo, G. J., Bagchi, K. K., & Kirs, P. J. (2011). Using SERVQUAL to assess the quality of e-learning experience. Computers in Human Behavior, 27(3), 1272–1283. doi:10.1016/j.chb.2011.01.009

Position: 
15
Conference Session: 
Concurrent Session 3
Conference Track: 
Research
Session Type: 
Discovery Session
Intended Audience: 
Administrators
Design Thinkers
Faculty
Instructional Support
Researchers