Prompting for a confidence level is a very important part of our algorithm.

First, from a practical point of view, the confidence prompt allows learners to confirm their choice. If answers were auto-submitted immediately on selection, there would be a high number of erroneous submissions — especially when answering on a mobile device.

It is natural for learners to feel some discomfort having to specify their confidence level. This is actually an important part of having them "place a mental bet" on their answer and will engage them more deeply and drive better retention.

Learners will respond automatically to questions they have high confidence in but, for questions that they are less confident in, we’ll be able to measure the delay in responding and examine their "certainty" — whether they change their answer before submitting.

These signals that we capture and measure, among others, are used to assess each learner’s mastery. We want to understand the likelihood that each learner is guessing or really knows the answer.