Lecture Capture - Analytics guide

This guide provides an overview of the Lecture Capture systems' Analytics section, as well as best practice for viewing and using the information provided.

The new Lecture Capture experience includes a number of new features and more that will be progressively released throughout 2018. Students are able to view and interact with pre-loaded presentation slides during the live lecture, flag points of confusion, and interact with embedded activities. The updated analytics section in Echo360 takes into account the many new ways students can interact with content.

This guide provides an overview of the Lecture Capture systems' Analytics section, as well as best practice for viewing and using the information provided. Echo360 also provide detailed information regarding analytics: Echo360 guide: Understanding Course and Student Analytics.

Accessing the Analytics Page

To access analytics for your subject, navigate to the Analytics tab within the Echo360 classroom for your subject.

Analytics tab in Course page
Analytics tab in Course page

Classes

Once you have selected the Analytics tab, you will be presented with the Classes page. The Classes page provides an overview of analytics for the selected subject. By default, this section will show analytics for the whole subject (shown as "All Classes").

The timeline shows the Engagement Score and its components for each class based on the date of the recording. You can select the legend to highlight a particular metric or hide a metric by clicking in the coloured circle. Hovering over the graph will reveal raw data.

Timeline graph for a single recording
Timeline graph for a single recording

The Least Engaged Student table below the timeline provides a list of students with the lowest Engagement Score. Select the See All section to be taken to the Students analytics page.

The Confusing Content table provides a summary of content that students have flagged as confusing using the Confusion Flag feature. Further information on the Confusion Flag function can be found in the Echo360 - Extended Guide - Staff.

It is also possible to drill down to the individual lecture by selecting it from the drop down menu at the top of the page. The timeline now shows a 10 minute window at 30-second increments of the views, questions, confusion points and notes word count for that class. If presentation slides have been uploaded you can switch between video and presentation views using the drop down above the timeline.

Details of student engagement for a single recording
Details of student engagement for a single recording

Students

The Students page provides usage and participation statistics for each student and displays analytics for the whole subject ("All Classes") by default. To see analytics for an individual lecture, click the drop down menu and select the desired lecture.

The table is searchable using the search dialog at the top of the page. Each column can also be used to sort the table by clicking on the heading.

When looking at an individual class, a drop down is available at the top right to display metrics for video, presentation or all content. Note that the number of video views and the percentage of video viewed is only available through the video option.

Adjustment of the Engagement Score metric
Adjustment of the Engagement Score metric

Engagement

The Lecture Capture system refers to Engagement throughout the analytics section, and also the wider system. The Engagement Score is a combination of 6 different metrics, which can be weighted to suit your own reporting preferences. A summary of the different metrics is provided below:

Attendance measures if the student was active in the Echo360 "classroom" during the scheduled recording time. Note that this is not physical attendance and should not be used as an attendance measure.
Video Views counts the number of times a student viewed a recording. Where this value appears for all classes it is a cumulative value.
Presentation views counts the number of times a student viewed the presentation slides. This requires the presentation slides to be uploaded to the classroom.
Q&A counts participation in the Question and Answer feature. This requires the Q&A feature to be turned on.
Notes counts the number of words taken in notes.
Activities counts the participation in classroom activities (e.g., in-class polls and quizzes). This requires classroom activities to be added and used within the Lecture Capture system.

Engagement Score Metric Weightings

The Engagement Score Metric Weightings allows you to adjust the weighting of the Engagement Score in your subject by  sliding each metric to a particular % level. Changes applied here will be made on your selected subject only. Any further changes will also need to be made on all other subjects. Note that this change will also impact other staff viewing the analytics for this subject.

For further information on the engagement score and how it can be interpreted, view the information found in the Echo360 guide: Engagement and Analytics Metrics Defined.

Metric Correlation Graph

The Engagement section also provides the ability to upload external grades to the Lecture Capture system. The purpose of this is to view the correlation between the Engagement Score and external grades. This function is not currently supported.

Export & Gradebook

Export

All of the analytics available to instructors within the Lecture Capture system can also be downloaded as a CSV file via the analytics export function. To access this section, in your desired course, select the Analytics tab and then select the Export & Gradebook menu on the right hand menu bar.

Export analytics to CSV reports
Adjustment of the Engagement Score metric

The below reports are currently available for export:

Activity Participation (%) Provides a percentage of participation based on total activities for each student at each lecture.
Activity Participation (Raw #) Provides the number of activities that the student has participated in for each lecture.
Activity Score (%) Provides a percentage score which represents correct answers to activities for each student at each lecture.
Activity Score (Raw #) Provides the activity score as a number, for each student in each lecture.
Attendance Provides an attendance count for each student at each lecture. The student is considered to have attended a class if they are actively using the system during the scheduled recording time.
Engagement Provides an Engagement score for each lecture per student. For more information on the engagement score, see the 'What is Engagement?' section below.
Notes word count Provides a word count for the Note taking function on each recording for each student.
Presentation Views Provides a count of presentation views for each lecture for each student. This report requires that individual presentation slides are uploaded for each lecture.
Questions Provides a count of questions for each lecture for each student. This report requires the Q&A feature to be active.
Video Views Provides a count of video views for each lecture for each student.

Gradebook

The Gradebook function provides the ability to export some metrics back to the LMS. This function is not currently supported.

This guide was last updated 29 Aug 2018.
Report any errors or omissions in this guide to lms-guides@lists.unimelb.edu.au

Print this guide

The LMS is a learning technology service provided by Learning Environments