Tester checklists
A testing round works through these suites — one per area of the
product, with one annotation suite per data type. Every step has a
stable id (like OB-01, AN-NER-07), an action, and what you
should see.
Work these steps on the in-app checklist — account menu → My testing checklist — where every Pass / Fail / Skip is recorded the moment you press it, and Fail files the report for you. This page (and its PDF) is the same list for reading, printing, or working offline; if you used paper, transfer your ticks into the app afterwards.
New to structured testing? Read the Testing guide first — it explains steps, the result statuses, how to report a bug, and how the round is run.
Who does which suites
Each tester has a playlist. Pick yours in the app's checklist page ("I am …") and it shows only your suites.
tester1 — Organisation owner / admin
Accounts: tester1 / tester1b (see accounts/testers.yml). Work through the linked sections in order; each section's steps have their own IDs and Report links.
| Suite | Sections |
|---|---|
| 01-onboarding-auth | A–E |
| 05-organization-platform | A, B, D, E |
| 04-project-management | A–E |
| 07-ui-design | all |
| 13-docs | all |
When you finish a suite, update your row in the tracking board (status + pass/total).
tester2 — Project manager
Accounts: tester2 / tester2b (see accounts/testers.yml). Work through the linked sections in order; each section's steps have their own IDs and Report links.
| Suite | Sections |
|---|---|
| 04-project-management | all |
| 03-review-quality | C, D, E |
| 02-annotation-* (every one) | Setup + Export sections of every type |
| 07-ui-design | all |
| 14-performance | all |
When you finish a suite, update your row in the tracking board (status + pass/total).
tester3 — Annotator
Accounts: tester3 / tester3b (see accounts/testers.yml). Work through the linked sections in order; each section's steps have their own IDs and Report links.
| Suite | Sections |
|---|---|
| 01-onboarding-auth | A–C |
| 02-annotation-* (every one) | Label + Regions toolbar sections of EVERY type |
| 03-review-quality | B (dispute side) |
| 08-accessibility | Keyboard only |
| 12-localization | all |
When you finish a suite, update your row in the tracking board (status + pass/total).
tester4 — Reviewer
Accounts: tester4 / tester4b (see accounts/testers.yml). Work through the linked sections in order; each section's steps have their own IDs and Report links.
| Suite | Sections |
|---|---|
| 03-review-quality | A, B |
| 02-annotation-* (every one) | Review round-trip section of every type |
| 06-speech-sign-language | D |
When you finish a suite, update your row in the tracking board (status + pass/total).
tester5 — Speech / sign contributor
Accounts: tester5 (see accounts/testers.yml). Work through the linked sections in order; each section's steps have their own IDs and Report links.
| Suite | Sections |
|---|---|
| 06-speech-sign-language | all |
| 02-annotation-auds | all |
| 02-annotation-asr | all |
| 09-mobile | recording steps |
When you finish a suite, update your row in the tracking board (status + pass/total).
tester6 — Desktop app
Accounts: tester6 (see accounts/testers.yml). Work through the linked sections in order; each section's steps have their own IDs and Report links.
| Suite | Sections |
|---|---|
| 10-desktop-offline | all |
| 02-annotation-cls | Label section, offline |
| 07-ui-design | Responsive |
When you finish a suite, update your row in the tracking board (status + pass/total).
tester7 — Phone app
Accounts: tester7 (see accounts/testers.yml). Work through the linked sections in order; each section's steps have their own IDs and Report links.
| Suite | Sections |
|---|---|
| 09-mobile | all |
| 02-annotation-cls | Mobile section |
| 02-annotation-bbox | Mobile section |
| 08-accessibility | Touch |
When you finish a suite, update your row in the tracking board (status + pass/total).
tester8 — Security and accessibility
Accounts: tester8 (see accounts/testers.yml). Work through the linked sections in order; each section's steps have their own IDs and Report links.
| Suite | Sections |
|---|---|
| 11-security-privacy | all |
| 08-accessibility | all |
| 07-ui-design | all |
When you finish a suite, update your row in the tracking board (status + pass/total).
All suites
Coordinators watch progress live under Platform → Testing — the suite-by-tester matrix fills in as testers press Pass / Fail / Skip, and failed steps link straight to their filed issues.