How can we help?

My Cases

Definitions of Analytics Data Metrics
Last Updated: Apr 29, 2019 10:10AM EDT

This article applies to:  Echo360 Instructors

The data being provided to instructors through the course Analytics page has been updated to be more accurate and more granular than before. Echo360 now provides MORE metrics and has slightly redefined some of the existing data points, again to be more accurate with the information.

Each of the metrics available are defined in detail below. Some appear in the interface, and additional fields are provided in the CSV Exports available from both the Classes and Students tabs. All fields are defined on this page, with those shown in the interface listed first.

Metrics Shown On the Analytics Page Grids

The metrics defined below appear in the Echo360 interface, in the data grids shown on the Classes tab or the Students tab on the course Analytics page. ALL of the below metrics also appear in the CSV Exports of either Classes or Students data, or in many cases, both.

TOTAL ENGAGEMENT - This score is a cumulative total of all of the "countable" data points. This includes: Video Views, Slide Deck Views, Polling Responses, Q&A Entries, Note Events, and Confusion markers. 

  • If viewing the Classes tab the Total Engagement score for each class is a sum of all of these counts for all students who have engaged with this class.
  • If viewing the Students tab, the Total Engagement score is a sum of these counts for each student, either for All Classes in the course or for a specific class, if one is selected.

WEIGHTED ENGAGEMENT (%) - Appears on the Students tab. This is the metric previously called Engagement. It provides an "engagement percentage" for each student based on the "weight" or importance given to each metric. Instructors can set their own metric weighting, so that this Weighted Engagement score accurately reflects student interaction with the course and class materials as is important to YOU.

For example, if it is most important that students view each class video and/or slide deck, you should increase the weight of the Video View and Presentation View metrics, so that the students who do view the videos and slide decks most often are given higher weighted engagement scores. Or if participation in class discussions is most important to you, raise the weight of the Q&A metric.

The difference between Weighted Engagement and Total Engagement is that Weighted Engagement is a calculated percentage customizable to YOUR priorities; Total Engagement shows total student interaction, without preference to any particular item.

ATTENDANCE (%) - Attendance itself is a binary metric; either the student entered the online classroom during class time or they did not. In truth, there is some leeway given for attendance. A student can enter the classroom anytime from 45 minutes prior to the beginning of class up to 5 minutes before the end of class to get credit for attendance.
If a class does not have a date or time, Attendance is determined by whether or not the student interacted with anything in the classroom at any time (viewed the video or slide deck, posted a Q&A entry, or took notes). 

For each class/each student, this metric is either 0% or 100%.

  • If viewing the Classes tab, the percentage shown is the percentage of enrolled students who attended (have 100% attendance for) that class.
  • If viewing the Students tab, the percentage shown is the percentage of all classes this student has attended (for which they show 100% attendance).
  • If viewing the Students tab and you have selected a particular class, the percentage shown is either 0% or 100% for each student.

VIDEO VIEWS - The number of times students have viewed a video. Strictly speaking this is the number of times the student ENTERED the classroom and clicked Play. Clicking pause/play repeatedly without exiting the classroom does not generate additional "views". 

  • If viewing the Classes tab, this is the total number of times the video in the class was viewed by students in the section.
  • If viewing the Students tab, this is the number of times each listed student viewed videos in the section, either for all classes or for a particular class if one is selected.

SLIDE DECK VIEWS - The number of times students viewed a slide deck. Strictly speaking this is the number of times the student ENTERED the classroom and paged through at least one slide.

  • If viewing the Classes tab, this is the total number of times the slide deck in the class was viewed by students in the section.
  • If viewing the Students tab, this is the number of times each listed student viewed slide decks in the section, either for all classes or for a particular class if one is selected.

POLLING RESPONSES - Appears on the Classes tab. The total number of student responses given to polling questions in each class.

POLLING PARTICIPATION (%) - Appears on the Students tab. Percentage of the polling questions each student responded to in the section, either for all classes or for a particular class if one is selected.

NOTE: Participation % is not negatively affected if the question is NOT answered by ANY students; this accommodates a situation where the instructor may not have gotten through all of the polling questions in a class. Only polling questions where at least one student has submitted an answer are counted for participation.

POLLING CORRECT (%) - Appears on the Students tab. Percentage of the polling questions each student answered correctly in the section, either for all classes or for a particular class if one is selected. 

ONLY applies to those slides where a correct answer is possible. Polling slides that cannot or do not have correct answers indicated are not included in the percentage correct calculation (e.g., short answer questions or multiple choice/ordered list questions that do not have a correct answer marked).

NOTE EVENTS - Note Events are distinct note entries. They typically include a time stamp or slide stamp to indicate what was showing in the classroom when the note was taken (notes taken during Live classes do not have timestamps). Each note event includes typed words separated by the student pressing Enter. The Note Events count is the total number of distinct notes (separated by Enter) students have taken.

  • If viewing the Classes tab, this is the total number of notes taken for each class by all students in the section.
  • If viewing the Students tab, this is the total number of notes taken by each student, either for all classes or for a particular class if one is selected.

Q&A EVENTS - Q&A Events are either a Question or a Response to a question posted for classes. These can be posted in the Discussion panel in a classroom or in the Q&A Tab with a target class selected. Each question and response is counted separately. 

  • If viewing the Classes tab, this is the total number of Questions and Responses entered for each class by all users in the section (includes only Student Q&A entries).  
  • If viewing the Students tab, this is the total number of Questions/Responses entered by each student, either for all classes or for a particular class if one is selected. Does not include Q&A that is not associated with a class (entered into the General category in the Q&A tab). 

CONFUSION FLAGS - Confusion Flags are instances where a student clicks the Confusion Flag icon in a classroom, then (if necessary) identifies either the video scene or the slide as confusing (or both, but the flag must be clicked twice). The Confusion Flags count is the number of times students have marked an item as confusing.  

  • If viewing the Classes tab, this is the total number of Confusion Flags marked for each class by all students in the section.
  • If viewing the Students tab, this is the total number of Confusion Flags marked by each student, either for all classes or for a particular class if one is selected.

Metrics Provided in the CSV Exports

In addition to the metrics listed above, Exporting the Classes grid or the Students grid to a CSV file will provide additional data fields, as described below. Note that while the field name may be the same for both exports, the definition may differ slightly for Classes vs. Students.

Data Exported for Classes CSV Export

All of the above Interface-shown fields appear in the Classes CSV Export, as well as the following data fields for each listed class:                                                                        

VIDEO VIEWED % - Percentage of this class' video that has been viewed, averaged across all students in the section. 

SLIDES VIEWED %  - Percentage of this class' slide deck that has been viewed, averaged across all students in the section.  (Calculation: slides viewed ([total number of slides x number of enrolled students])

POLLING QUESTION COUNT - Total count of polling questions included in this class' slide deck. See Note.

NOTE: Polling Question Count does NOT include any question that has not been answered by ANY students; this accommodates a situation where the instructor may not have gotten through all of the polling questions in a class. Only polling questions where at least one student has submitted an answer are counted, specifically with reference to Polling Participation % calculations.

POLLING RESPONSES - Total count of polling responses given to the questions in this class' slide deck. 

POLL RESPONSE CORRECT COUNT - Total count of correct responses given for the class' polling slides by students in the section. Only includes responses to slides where a correct answer is/can be identified.

POLLING PARTICIPATION % - Percentage of total possible responses actually given for polling questions by students in the section. Calculation: Total responses given for the class / (total poll questions asked * students enrolled in section).

POLLING CORRECT % - Percentage of total possible correct responses given to polling questions (that have a correct answer identified) by students in the section. Calculation: Total response correct count / (total poll questions that have a potential correct answer * students enrolled in section)
 

Data Exported for Students CSV Export

All of the Interface-shown fields defined at the top of this article also appear in the Students CSV Export, as well as the following data fields for each student.

SOME of the below metrics appear in the Students Export for All Classes, and SOME only appear if a specific class is selected prior to export. 

VIEW DURATION - Appears only for single class exports. How long, in minutes the student spent viewing the video in this class. Along with Capture Duration determines Video Viewed percentage. 

NOTE: The View Duration may be higher than the Capture duration if the student views the video multiple times.

CAPTURE DURATION - Appears only for single class exports. The length of the video in this class, in minutes. 

VIDEO VIEWED % - Percentage of class video(s) viewed by this student. Only classes that contain video media are included in the calculations.

  • If exported for a SINGLE class, this is the total percentage of the video in that class that has been viewed by this student. 
  • If exported for ALL classes, this is the total percentage of video views by this student, averaged across the classes in the section. 

SLIDES VIEWED - Appears only for single class exports. The number of slides in this class' deck this student has viewed that are NOT polling questions. Along with Total Slides in Deck, determines Slides Viewed percentage.

TOTAL SLIDES IN DECK  - Appears only for single class exports. Total number of slides in this class' deck that are NOT polling questions.

SLIDE VIEWED %  - Percentage of slide deck(s) viewed, not including polling question slides. If the slide deck contains only polling question slides, there is no slide view data to provide. Use the Polling participation and response count data instead.

  • If exported for a SINGLE class, this is the total percentage of the slides in this class' deck that this student viewed that are NOT polling questions. 
  • If exported for ALL classes, this is the total percentage of slide deck views by this student of NON-polling questions, averaged across the classes in the section. 

POLLING QUESTION COUNT - Total number of polling questions. See note immediately below.

  • If exported for a SINGLE class, this is the total number of polling questions in this class. 
  • If exported for ALL classes, this is the total number of polling questions across all all classes.

NOTE: Polling Question Count does NOT include any question that has not been answered by ANY students; this accommodates a situation where the instructor may not have gotten through all of the polling questions in a class. Only polling questions where at least one student has submitted an answer are counted, specifically with reference to Polling Participation % calculations.

POLLING RESPONSES  - Count of polling responses by student. Along with Poll Question Count, determines Participation percentage

  • If exported for a SINGLE class, this is the number of polling questions in this class that this student submitted a response to.
  • If exported for ALL classes, this is the total number of polling questions across all classes that this student submitted a response to.

POLL RESPONSES CORRECT COUNT  - Count of polling questions that were answered correctly by this student (does not include questions with no correct answer).

  • If exported for a SINGLE class, this is the number of polling questions in this class that this student submitted a CORRECT response to.
  • If exported for ALL classes, this is the total number of polling questions across all classes that this student submitted CORRECT a response to.

POLL RESPONSES INCORRECT COUNT  - Count of polling responses that were answered incorrectly or not answered at all by this student (does not include questions with no correct answer).

  • If exported for a SINGLE class, this is the number of polling questions in this class that this student submitted a INCORRECT response to (or did not submit a response).
  • If exported for ALL classes, this is the total number of polling questions across all classes that this student submitted INCORRECT a response to (or did not submit a response).

POLLING PARTICIPATION % - Percentage of total possible responses actually given to polling questions by this student.  Calculation: Total responses given by the student / Total number of polling questions.

  • If exported for a SINGLE class, this is the percentage of polling questions in this class that this student submitted ANY response to.
  • If exported for ALL classes, this is the percentage of polling questions across all classes that this student submitted ANY response to.

POLLING CORRECT % - Percentage of total possible correct responses given to polling questions by this student (applies only to slides that have a correct answer identified). Calculation: Total CORRECT responses given  / Total number of polling questions where a correct answer is/can be identified.

  • If exported for a SINGLE class, this is the percentage of polling questions in this class that this student submitted a CORRECT response to.
  • If exported for ALL classes, this is the percentage of polling questions across all classes that this student submitted a CORRECT response to.

 
c9f5f1d87ac29bd0c146e9565da3c739@echo360.desk-mail.com
https://cdn.desk.com/
false
desk
Loading
seconds ago
a minute ago
minutes ago
an hour ago
hours ago
a day ago
days ago
about
false
Invalid characters found
/customer/en/portal/articles/autocomplete?b_id=16610