Course Quality

Quality Matters and Course Video: Turning Lectures Into Evidence

A Quality Matters review asks for alignment. Learning objectives have to be measurable, assessment has to match them, materials have to support them, and learner activity has to produce interaction that a reviewer can see. Recorded lectures normally sit outside all four, listed as materials and nothing more.

Adding an engagement layer moves video from the materials column into the assessment and interaction columns. The same recording carries graded questions tied to an objective, a discussion thread anchored to the moment it belongs to, and a participation record per learner.

Learn more: aligning video with the standards a reviewer checks
Quality Matters and Video

Alignment Is the Whole Game

The QM rubric is built around alignment: objectives, assessment, materials, activities and technology all pointing at the same outcome. Course reviews rarely fail because a component is missing. They fail because the components do not connect, and video is the usual disconnection point, present in the course and absent from the evidence.

Why does video weaken alignment?

Because a lecture normally arrives as an untethered resource. It supports an objective in the designer's head, but nothing in the course records whether a student engaged with it or learned from it. A reviewer sees a link and a duration, which supports the materials standard and nothing else.

How does an engagement layer change that?

By attaching the objective to the timeline. An in-video quiz written against a specific objective produces a graded result linked to the moment the concept is taught. Reflection points turn passive watching into a recorded activity. Timestamped discussion gives learner-to-learner interaction that a reviewer can inspect rather than infer.

What about measurable objectives?

Measurability is where video usually helps least and could help most. Attention and comprehension analytics report which segments a cohort rewatched, skipped or misunderstood, so a designer can point at evidence when revising an objective rather than relying on end-of-term impressions. Lumo AI drafts questions scaffolded across Bloom's taxonomy, which makes it easier to write assessment at the cognitive level the objective actually claims.

Does this help with accessibility standards too?

QM asks that course materials and tools be accessible, which overlaps with the obligations described on ADA Title II and course video. Annoto's interface meets WCAG 2.1 AA, and timestamped notes and transcripts support learners who cannot follow a lecture at pace. See the accessibility statement.

How does this relate to RSI?

The two overlap without being the same. QM is a voluntary quality standard applied through peer review, and RSI is a federal requirement tied to Title IV eligibility. Both want documented, instructor-initiated interaction, so course video instrumented once tends to serve both files.

Where should a course design team start?

Take one course heading into review and pick the three lectures that carry the most weight against its objectives. Write two questions per lecture mapped to a stated objective, add one discussion prompt, and run a term. What comes back is alignment evidence in the rubric's own vocabulary.

What belongs in the evidence packet a review team reads?

Build the packet out of exports the course produces rather than a narrative written after the fact. From Annoto analytics a coordinator can pull completion per lecture, question scores grouped by the objective each question names, discussion threads with timestamps and authors intact, peer review activity, and comprehension by segment, taken out by CSV or the REST API. Where the course runs over LTI 1.3, graded activity syncs into the LMS gradebook, so the numbers in the packet match the system of record instead of sitting in a side tool. Add the question bank itself and a one-page map from each stated objective to the activities that assess it.

How do you align a video activity to an objective a reviewer can find?

Name the objective in the activity. A question written as “identify the three failure modes” is checkable against an objective phrased the same way; a question written as “what did the lecture say” is not. Place each in-video question at the moment the concept is taught rather than at the end, so alignment is visible on the timeline instead of inferred from a syllabus. Lumo AI drafts at the cognitive level the objective claims, and the wording can then be edited back to the objective’s own verbs. For objectives that ask a student to demonstrate something, a video assignment with a rubric carries what a multiple-choice item cannot.

What do reviewers usually ask about a recorded lecture?

Three questions recur. Is the lecture required or optional, and how would a student know? A graded activity on the timeline answers that in the course rather than the review file. Where is the instructor during an asynchronous week? Timeline discussion shows instructor prompts and replies attached to specific moments, dated and visible to the cohort. And what does a learner who is lost do next? Notes with AI recaps, transcripts and peer answers sit on the same timeline, so the path forward is documented rather than assumed. Answer these three inside the course and the standards are demonstrated, not asserted.

Rubric Alignment

What reviewers look for, and what the video can show

Quality Matters is a peer review process rather than a checklist a vendor can satisfy. These are the places instrumented video contributes evidence.

What the review examines
Annoto
The evidence it contributes
Assessment measures stated objectives
Graded in-video questions mapped to an objective
Materials support the objectives
Lectures carry activity rather than sitting as links
Activities promote active learning
Reflection points, polls and in-video questions
Learner-to-learner interaction
Timestamped cohort discussion and peer review
Learner-to-instructor interaction
Instructor prompts and replies on the timeline
Timely feedback on performance
Instant quiz feedback, graded video assignments
Accessible course tools
Interface at WCAG 2.1 AA

Quality Matters is an independent organisation, and Annoto is not affiliated with or endorsed by it. Course certification is decided by QM peer reviewers on the current rubric.

Preparing A Course

One course, one term, three lectures

Enough to produce alignment evidence without redesigning the syllabus.

1
Pick the lectures that carry objectives

Choose the three recordings doing the most work against the course's stated outcomes.

2
Write questions against the objective

Two graded questions and one discussion prompt per lecture, each mapped to an objective by name.

3
Bring the data to the review

Completion, scores per objective, discussion activity and comprehension by segment, exported for the review file.

FAQ

Quality Matters and Course Video, Answered

Does using Annoto make a course QM certified?
No. Quality Matters certification comes from peer reviewers assessing a course against the current rubric, and no tool can deliver it. What an engagement layer does is produce evidence for the standards where video normally contributes nothing, particularly assessment alignment, active learning and learner interaction.
Why do recorded lectures weaken a QM review?
Because they usually appear as materials and nowhere else. The lecture supports an objective in the designer's intent, but the course produces no record that a student engaged with it or learned from it, so the alignment a reviewer is looking for cannot be demonstrated.
How do we map questions to objectives?
Write each in-video question against a stated objective and name it in the question. Lumo AI drafts questions scaffolded across Bloom's taxonomy, which makes it easier to assess at the cognitive level the objective claims rather than defaulting to recall.
Does this overlap with RSI compliance?
It does. Quality Matters is a voluntary quality standard applied by peer review, while RSI is a federal requirement tied to Title IV eligibility. Both want documented, instructor-initiated interaction, so instrumenting video once tends to serve both.
What can we hand to a reviewer?
Completion and scores per objective, discussion threads with timestamps and authors, peer review activity, and comprehension by video segment. It exports by CSV or through the REST API. See Analytics and Analytics Export.
Related

Course quality, compliance and the evidence behind both

The standards that arrive together, and the features that answer them.

Bring A Course Heading Into Review

Twenty minutes with your instructional design team. We will map one lecture to its objectives and show you the evidence it produces.

Book A Demo