Akindi provides Instructors with various reports for each assessment, including:
Easiest and Hardest Question
Full Responses breakdown
Easiest and Hardest Question
We calculate the easiest and hardest questions by identifying the average of each question. This data can be valuable in helping to understand which concepts the class understands fully and which concepts the class needs to review. This can be found in the ‘Overview’ tab of the results analysis.
GIF: Easiest and most difficult question breakdowns.
The grade distribution can be found in the 'Graphs' tab of the Results Analysis.
Image: Grade distribution breakdown
In the ‘Graphs’ tab of the Results Analysis, you can find the Answer Breakdown. The overview graph shows the percentage of correct and incorrect answers. Clicking on any one of the bars, reveals the answer breakdown.
If you have multiple versions of a test, you’ll have to choose a version in the top left drop-down menu to see the question breakdown.
GIF: Filter results using Section and Version dropdown menu
Full Responses Breakdown
In the 'Responses' tab of the Results Analysis, you can view a comprehensive breakdown of each student's test.
Image: Responses tab.
Discriminatory Score and Point Biserial
Akindi uses the point-biserial correlation coefficient (rpb) to calculate a discriminatory score for each question in your assessment, and for your assessment as a whole.
Image: Point biserial breakdown.
The discriminatory score shows the correlation between correctly answering each question and performing well on the assessment as a whole; in other words, it shows how well each question discriminates between students who did well on the assessment and students who did poorly.
Akindi considers questions with a discriminatory score above 0.20 to be well-constructed: high-performing students generally answer them correctly, and low-performing students generally answer them incorrectly. Give yourself a pat on the back for these questions: they are probably doing a good job of accurately assessing your students.
Questions with a discriminatory score between 0.00 and 0.20 are considered candidates for improvement: high and low performing students answer correctly with approximately the same frequency. It might be worth double checking these questions to see whether they could be clarified, or ambiguity could be removed.
Questions with a discriminatory score below 0.00 are considered problematic: the highest performing students are getting them wrong and the lowest performing students are getting them right! It is definitely worth reviewing these questions to see if they can be clarified, or (more frequently) the answer key was entered incorrectly (Akindi will even tell you which of the "incorrect" answers were chosen most frequently).
GIF: Best constructed questions and questions which could be improved breakdown.
The assessment's overall discriminatory score is the average score of the questions in the assignment, excluding questions with a weight of 0.
When calculating the discriminatory score, questions weights are not considered except for zero-weighted questions which are not considered when calculating the overall assessment discriminatory score. More specifically, the per-question rpb is calculated with respect to each student's overall test score assuming each question has a weight of either 0 (if the question's actual weight is 0) or 1 (if the question's actual weight is non-zero). The overall score is the arithmetic mean of the per-question score, excluding questions with a weight of zero.