lesson
20 min

Iterate on Evidence

Rank what you found by severity, fix the worst problems first, and test again.

What you will learn in this lesson

You will turn test notes into a ranked fix list. Then you will improve your prototype and test again.

List every problem

Go through your notes from all tests. Write each problem as one line. Note how many testers hit it.

  • "4 of 5 did not see the 'What to bring' button."
  • "2 of 5 thought 'Proof of residency' meant a passport."
  • "1 of 5 wanted the hours on the first screen."

Rank by severity

Severity means how bad a problem is. Use three levels:

LevelMeaningExample
HighPeople can't finish the task, or they could be harmedCan't find what papers to bring. Data shared without consent.
MediumPeople finish, but with trouble or errorsConfused by a label, but figured it out
LowSmall annoyanceWanted the hours higher up the page

Fix every high item. Fix medium items if you can. Note low items for later.

Accessibility problems that block people are always high. A form a screen-reader user can't finish is a task failure, not a style note.

Change, then test again

Make your fixes. Then test with two or three new people. Did the high problems go away? Did the fixes create new problems? This loop of test, fix, and test again is called iteration.

Judgment check: what you won't fix

You can't fix everything. Say what you left out and why. That honesty is a strength in a case study. It shows you made choices on purpose.

Module 6 check

Quiz: Module 6 quiz: Test and include

  1. 01During a test, the tester asks, 'What do I do now?' What should you say?

    Choose one.

  2. 02What does the P in POUR stand for?

    Choose one.

  3. 03An error shows only as red text. What is the problem?

    Choose one.

  4. 044 of 5 testers could not find the papers list. What severity is this?

    Choose one.

  5. 05Testing a prototype with a 14-year-old needs which steps? Choose all that apply.

    Choose all that apply.