Tip:
Highlight text to annotate it
X
The Process of a QM-Recognized Review Quality Matters (QM) is based on continuous
improvement. All courses submitted for review are expected to meet standards, if not after
the initial review, then after amendment. The peer review process is collegial and based
on respect. The review is about the course not the faculty member.
An official QM review can either managed by QM or the subscribing institution. A QM managed
review begins with the Institutional Representative (IR) submitting a Course Review Application
(CRA) in the Course Review Management System (CRMS). A subscriber managed QM review also
uses the CRMS but since it is not managed by QM the IR doesn’t complete a CRA but
instead contacts the Master Reviewer to begin the process. Both types of reviews follow
the same process with but if the subscriber is managing the review they chose the review
team and determine the stipend. The QM core review team consists of 3 members
all with certified QM training: * Master Reviewer (MR) who serves as the team
chair * Peer Reviewer (PR)
* Subject Matter Expert (SME) The expanded team includes:
* QM review coordinator, who can be used for questions and general administrative support
* Faculty Developer (FD), who can be contacted for questions about the course
* IR who serves as a liaison with both QM and the FD
Instructor Worksheet In the next step in the review process the
FD completes the Instructor Worksheet (IW) in the CRMS. The IW contains a wealth of information
that should be carefully studied by the review team before and again during the review process.
If course level and module level objectives are not stated in measurable terms they must
be modified before the review begins. If the course level objectives are not measurable
and set by the institution so they cannot be changed QM mandates that specific suggestions
be made for improvement. In this case a reviewer will score the standard as met. The module
level objectives must be stated in measurable terms for the standard to be met.
Pre-Review Conference Call The MR schedules a pre-review conference call
that includes the core review team the FD. This pre-review call is required for the MR
and the FD and highly encouraged for the PR and the SME. It is the MR’s role to debrief
any of the review team who misses this call. The MR consults the Pre-Review Conference
Agenda Template prior to conference call to make sure all documents are in order and to
guide the conversation during the call so all important points are covered. A time frame
for the completion of the review is mutually agreed upon, and usually is about 3 weeks
long. The FD is excused from the last part of the conference call when the MR reminds
the review team of review details and responsibilities. Course Review
The review team then begins the course review using the CRMS. The MR can see the progress
in the CRMS as the team works through the review. If reviewers have questions about
the course or the QM rubric they consult with the MR. The MR serves as the main point of
contact with the IR, FD and QM if needed during the review. Melissa Poole at QM is the expert
if questions arise. If 1 or 2 essential standards are not met, and perhaps can be amended within
the 3 week course review time frame the MR will contact the FD to see if they are able
and willing to make the adjustments to the course during the time frame of the initial
review. When the team has finished the review the MR carefully looks through the PR and
SME’s comments. If appropriate the MR will ask them to expand or clarify their comments.
A reviewer can change their scores if they want too before the report is finalized. A
post review conference call is optional if the course meets standards on initial review
and mandatory if it does not. The MR then submits the final report in the CRMS after
the post review conference call. Met Standards on initial review
When the MR submits the final report it automatically notifies the FD with the review outcome and
provides an online Faculty Response Form. All reviewers, the FD and the IR are also
asked to take a post review survey. Did not met standards on initial review
When the final report is submitted to the CRMS it automatically notifies the FD with
the review outcome and provides an online Faculty Response Form which must be completed
within 2 weeks. All reviewers, the FD and the IR are also asked to take a post review
survey. When the Faculty Response Form is submitted it will generates a Course Amendment
form in the CRMS. The FD gets access to the complete review report with specific comments
and suggestions about changes that need to made to meet QM standards and get QM recognition.
When the FD completes the adjustments to the Course Amendment form, only the MR reviews
the course to make sure it now meets standards, if it still does not meet standards the FD
makes changes again. This must be completed within the larger 20 week window for the review;
typically this gives the FD 16 weeks to complete the modifications. When the course does meet
standards the MR approves the course amendment form which automatically generates an email
with the results of the review. References-
Course Review Policies and Processes Quality Matters Rubric Workbook for Higher
Education 2011-2013 Edition Team Calendar for QM Managed Reviews
Team Chair Roles and Responsibilities