Gauging Online Course Quality in Large Institutions: Preparing for Scale

Audience Level: 
All
Session Time Slot(s): 
Institutional Level: 
Higher Ed
Abstract: 

Presenters will describe their experiences of implementing an online course review process at a large university in the United States. Institutional scale, infrastructure, university culture, communication, and technological resources emerged as critical factors. Open resources, as well as lessons learned, will be shared.

Extended Abstract: 

The purpose of this session is to share how a team of Instructional Designers at the University of Central Florida designed, developed, and implemented a review process for online courses, while preparing for institutional scale.

By participating in this interactive session, attendees will be able to:

  • Identify factors that impact the implementation of an online course review process, particularly in a large university context

  • Articulate strategies that are effective with skeptical faculty

  • Relate presenters’ experiences to their own university contexts

  • Adopt or adapt the open resources that will be shared (namely, the items used in the “Quality Course Check” and “High Quality Course Check”)

Outline of Session

  1. A brief description of the history of online course “quality” at UCF

  2. A look into how university and state factors led us to create an (optional) online course review process

  3. An examination of how our unique university culture impacted our selection of standards and procedures to assess “quality”

  4. A rich description of our scalable course review process, which is “stackable” in nature (for instance, courses can be rated as “Quality” and, if desired, be further assessed for “High Quality”) and aligned with our professional development and awards. The review is facilitated between the Instructional Designer and instructor; this relationship will be highlighted.

  5. An exploration of how the team leveraged technology to help purposefully recruit instructors

  6. An overview of our communication plan and strategy with instructors (who were not financially incentivized to participate). We quickly found that instructors had concerns about being evaluated for “quality”. Emphasizing design rather than teaching, and emphasizing learner success were helpful in promoting participation.

  7. A preview of the roadmap of ideas ahead, such as automation of recruiting instructors, badging, and using open source platforms such as OSCQR

Participants who are currently implementing or interested in starting any online course review process should benefit from this interactive session. Given that attendees will likely be considering or engaging in course reviews at their institutions, we will engage them in an activity which asks them to gauge factors that both facilitate and impede the promotion of the course review process at their institutions. Then participants will have a conversation with their groups or partners about ways to amplify the facilitative factors or influencing the impeding factors for effective promotion of their course review process. Finally, participants will have the opportunity to freely download our two online course quality review instruments.

Position: 
8
Conference Session: 
Concurrent Session 5
Session Type: 
Discovery Session