| ECT/HCI 441 Grading Criteria for Usability Testing |
| Greeter | Puts user at ease: | 1. |
2 |
| 2. |
2 |
||
| 3. |
2 |
||
| 4. |
2 |
||
| In a written document, greeter explains |
1 |
||
| the purpose of the test |
2 |
||
| explains user’s contribution / empowers user (3 ways) 1. | 2 | ||
| 2. |
2 |
||
| 3. | 2 | ||
| explains how user should interact with prototype |
4 |
||
| encourages user to "think aloud" |
2 |
||
| offers Informed Consent document. Waits while user reads and signs. |
2 |
||
| Facilitator | gives users tasks to perform, one task per card |
1 |
|
| encourages user to express thoughts |
3 |
||
| allows user to struggle without offering help too quickly |
4 |
||
| makes sure that tests finish on time |
4 |
||
| maintains a neutral demeanor at all times |
3 |
||
| concludes test scenario in a neutral manner |
2
|
||
| Computer | correctly responds to user input |
3 |
|
| responds to user input in a timely manner |
3 |
||
| maintains a neutral demeanor at all times. Does not speak during test. |
3 |
||
| Observer | stands out of line of direct sight of user |
2 |
|
| positions self to see the user’s hands, face and screen |
2 |
||
| takes notes, one per card |
2 |
||
| takes notes quietly |
2 |
||
| maintains neutral demeanor at all times. Does not speak during test. |
2 |
||
| Conclusion | Thank user for participating (all team members can do this) |
3 |
|
| General | Test team arrives on time and sets up quickly |
5 |
|
| Finished within scheduled time without prompting from instructor |
2 |
||
| Consent Form is clearly written and includes |
|
||
| A statement of confidentiality |
1 |
||
| "I have freely volunteered to participate" |
1 |
||
| statement of purpose |
1 |
||
| statement of benefit and any risk |
1 |
||
| user has the opportunity to ask questions |
1 |
||
| user may withdraw consent and discontinue participation at any time without penalty |
1 |
||
| "I am at least 18 years of age." |
1 |
||
| contact information of tester; tester’s supervisor |
1 |
||
| "My signature below affirms all of the above prior to participation" |
1 |
||
| Pretest Questionnaire includes | |||
| a method to determine if person is part of target user group |
4
|
||
| Posttest Questionnaire includes | |||
| a method to determine preference measures |
4
|
||
| Task list | clearly stated/phrased but without cues |
2 |
|
| include real data, motivation | 2 | ||
| poses tasks, not instructions | 2 | ||
| tests usability goals mentioned in homework 1 | 5 | ||
| Appropriate tasks for each user group |
2 |
||
| Team Total (out of 100) | |||
| Overall score (75% team total + 25% Prototype) | |||