The Question tab of the Instructor Report provides detailed information for each question on the exam. Quickly assess how learners performed on the exam and understand if the exam achieved the intended goal.
Instructors can also access the Exam Report in one of the following ways:
- Click on the Exam name from My Reports.
- Click on the View Results action for an exam in My Reports.
- Click the Results button from the Course > Exams section for a completed exam.
- Click on the Exam name from the Course > Results > Results section.
- Click on the Results action for an exam in Course > Results > Results section.
- Click on the Exam status from the Course > Results > Scores section (in the column heading).
The Exam Report is defaulted to the Summary tab. Click the Questions tab to see detailed information for each question in the exam. The Questions tab is divided into two sections, each of which is covered in more detail below.
Course / Exam Information
In this section, you will find key information about the exam. On the left, the course name and instructor name are displayed. On the right, you will see the total number of learners assigned to the exam, along with the exam’s Start and End Dates / Times. If the exam has an overall time limit, it appears here; no time limit is shown for untimed exams or those timed per question. This area also shows the scoring type (Highest Score, Average Score, or Last Attempt) and the number of attempts for exams that allow more than one attempt.
Questions
Questions appear in the table by default in the same order as they were presented on the original test linked to the exam. The table can be sorted by any column by clicking on the sort arrows in the column heading. Each question is shown on its own row, which is collapsed by default for easier navigation. From this page, you can also download the report in CSV or PDF format.
Use this report to review an exam with learners while hiding any details you prefer not to share. The Report Display Options can be adjusted for each report individually or set as a default for future use.
• Show Question Content - Turns on the display of the question, answer choices and correct answer(s) if applicable, Edit Score button, and Response Frequency in the Instructor Report. • Show Correct Answers - Shows the answer choices and correct answer(s) if applicable for each question on the expanded row in the Instructor Report. • Show Rationale - Displays the explanation or reasoning for each answer on the question's expanded row. • Show Instructor Annotations - Shows any instructor notes or comments on the question's expanded row. • Show Performance Metrics - Adds performance statistics (such as scores or averages) to the Instructor Report.
The information provided as column headers stays the same whether the question is collasped or not. What is displayed for the question's row depends on whether it is collapsed or expanded.
- Question Number
- Question Type
- Question Name
- Avg. Pts
- Avg. Time
- Skipped
- Point Biserial
- Difficulty Factor
- Discrimination Index
- Response Frequency
- Scoring - Type
- Scoring - Possible Points
- Roster Performance - Correct
- Roster Performance - Answered
- Roster Performance - Avg Time
- Time Limit
- Instructor Annotation
Question Table Columns
Question Number
The question number corresponds to the order in which the questions were listed in the test linked to the exam. It lists the original order of the questions, regardless of whether they were randomized for learners.
Question Type
A tooltip describing the question type and an accompanying icon are displayed.
Question Name
The question name is shown. The expanded question card displays the entire question, answer options, the correct answer(s), and the Edit Score button.
Avg. Pts
Avg. Points displays the sum of the points scored by each learner divided by the total number of learners who submitted an attempt. If a learner misses the exam (did not submit an attempt), they are not included in the calculation. This information is hidden if Show Performance Metrics is turned off in the report settings.
Avg. Time
Avg. Time displays the sum of the time each learner spends on each question divided by the number of learners. If a learner misses the exam (did not submit an attempt), they are not included in the calculation. This information is hidden if Show Performance Metrics is turned off in the report settings.
Skipped
Skipped identifies the number of learners who did not submit an answer for the question, i.e., the question was in the unanswered state when the attempt was submitted. If a learner misses the exam (did not submit an attempt), they are not included in the calculation. This information is hidden if Show Performance Metrics is turned off in the report settings.
Point Biserial
Point Biserial (PB) is a statistic that shows how well a question separates high- and low-performing learners. It is always a number between –1.00 and 1.00. If the PB cannot be calculated—such as when everyone skips the question or everyone answers the same way—it will display as --. This information is hidden if Show Performance Metrics is turned off in the report settings.
This metric is calculated using the following formula:
$$PB=\frac{M_1M_2}{s_n}\sqrt{pq}$$
where:
- \(M_1\) is the average attempt score for learners who answered the question correctly
- \(M_2\) is the average attempt score for learners who answered the question incorrectly
- \(s_n\) is the standard deviation of the exam scores
- \(p\) is the proportion of correct answers to the question
- \(q\) is the proportion of incorrect answers to the question
A high positive PB means top scorers usually answer correctly. A value near zero means all learners are about equally likely to get it right. A negative PB means lower scorers tend to answer correctly more often.
Difficulty Factor
Difficulty Factor (DF) shows how challenging a question was for learners who took the exam. It is always a number between 0.00 and 1.00, matching the percentage of learners who answered the question correctly. A higher DF means the question was easier, while a lower DF means it was harder. If the DF cannot be calculated—such as when everyone skips the question—it will display as --. This information is hidden if Show Performance Metrics is turned off in the report settings.
This metric is calculated using the following formula:
$$DF=\frac{C}{T}$$
where:
- \(C\) is the number of correct and partially correct responses
- \(T\) is the total number of responses
Discrimination Index
Discrimination Index (DI) shows how well a question tells apart high- and low-performing learners. It is always a number between –1.00 and 1.00, based on the scores of only the top and bottom 25% of learners. If the DI cannot be calculated—such as when all learners skip the question—it will display as --. This information is hidden if Show Performance Metrics is turned off in the report settings.
This metric is calculated using the following formula:
$$DI=\frac{\frac{C_T}{n_T}-\frac{C_B}{n_B}}{n_T}$$
where:
- \(C_T\) is the number of attempts in the top 25% of exam scores where the question was answered correctly
- \(C_B\) is the number of attempts in the bottom 25% of exam scores where the question was answered correctly
- \(n_T\) is the number of attempts in the top 25% of exam scores
- \(n_B\) is the number of attempts in the bottom 25% of exam scores
A high positive DI means top scorers usually get the question right. A value near zero means everyone is about equally likely to answer correctly. A negative DI means lower scorers tend to get it right more often.
Expanded Question Information
Response Frequency
Response Frequency shows how many learners chose each answer option for a question. This information is hidden if Show Performance Metrics is turned off in the report settings. Response frequency is available for the following question types:
- Bowtie
- Fill in the Blank (Drop-Down mode)
- Highlight
- Modified True / False
- Multiple Choice
- Multiple Select
- True / False
Scoring - Type
There are various scoring types, depending on the type of question:
- All or Nothing (All / None) - Learners either get the question correct and receive all points or incorrect and receive no points. Questions with multiple parts must have all parts answered correctly. All or Nothing awards no partial points.
- 0 / 1 Partial - Learners will receive partial credit based on their response to the question. Items answered correctly will score points based on the instructor's points setting, and items answered incorrectly will score no points.
- + / - Partial - Learners will receive partial credit based on their response to the question. Items answered correctly will score points based on the instructor's points setting, and items answered incorrectly will lose points. Questions cannot score less than zero points.
- Rationale - The Rational scoring type applies to fill in the blank and drag and drop questions only when there is more than one blank for the learner to complete. If the learner answers the first blank incorrectly, they are not eligible to receive points for the question, regardless of how they answer any subsequent items. If the learner answers the first blank correctly, they will receive points for subsequent items answered correctly based on the instructor's points setting. Items answered incorrectly will score no points.
Refer to each of the different question types for more scoring information.
Scoring - Possible Points
This is the number of possible points configured for the question.
Correct
This identifies the number of learners who have answered the question correctly or partially correctly (scored more than zero points). This information is hidden if Show Performance Metrics is turned off in the report settings.
Answered
Answered identifies the number of learners who answered the question. This information is hidden if Show Performance Metrics is turned off in the report settings.
Time Limit
A Time Limit will only appear if the questions are timed. This information is hidden if Show Performance Metrics is turned off in the report settings.
Instructor Annotations
Instructor Annotation will only appear if the question has that field populated from the Feedback and Rationale tab and Show Instructor Annotation has been turned on. This setting will also apply to the report's PDF download.