Project management
Work these steps on the in-app checklist β account menu β My testing checklist β where every Pass / Fail / Skip is recorded the moment you press it, and Fail files the report for you. This page (and its PDF) is the same list for reading, printing, or working offline; if you used paper, transfer your ticks into the app afterwards.
Creating and running a project end to end. Do this as tester2 (manager).
Each step: Do this, then check You should see.
A. Createβ
-
PM-01 Create a project from the template gallery. You should see: every template you can pick actually works; no greyed 'Enterprise' templates are shown.
-
PM-02 Create a project with the name '1'. You should see: validation rejects a one-character / digit-only name with a clear message.
-
PM-03 Save a labeling config with an error (unclosed tag). You should see: a precise error under the editor; the preview does not crash.
-
PM-04 Import the fixture JSON, then import a CSV with different column names. You should see: the import mapping step lets you map columns to the config variables; the preview shows real rows.
B. Dashboardβ
-
PM-05 Open the dashboard as the manager. You should see: progress card + 'Needs attention' side by side; setup chips (Configure, Import, Invite, Publish) beside the settings search; no card for finished setup steps.
-
PM-06 Resize to a phone width. You should see: setup chips become a 2Γ2 grid; attention pills are 2 per row; the title truncates with an ellipsis.
-
PM-07 Type 'annotators per task' in the settings search. You should see: a direct link to that setting opens the right tab and scrolls to it.
C. Membersβ
-
PM-08 Add tester3 as annotator and tester4 as reviewer; remove and re-add one. You should see: roles show in the list; removed members lose access immediately (check as them).
-
PM-09 Pause an annotator. You should see: they see a clear notice and cannot label; unpause restores.
D. Settingsβ
-
PM-10 Change 'annotators per task' to 2 and 'show skip button' off. You should see: the label stream behaves accordingly (no Skip; tasks close after 2 annotations).
-
PM-11 Turn on 'Allow on mobile'. You should see: the project appears in the phone app within a minute.
-
PM-12 Set a dataset license and consent text. You should see: the consent shows to annotators before they start; exports include LICENSE.txt and the data card.
E. Archive / publishβ
-
PM-13 Pause (unpublish) the project. You should see: annotators lose access; managers keep it; the card shows Resume.
-
PM-14 Danger Zone β Archive Project. You should see: you land on Projects; the project is only under the Archived filter; the dashboard shows an Archived pill and Restore; labeling refuses with a clear message.
-
PM-15 Restore it. You should see: everything is back exactly as before.
F. Webhooksβ
-
PM-16 Add a webhook to a request-bin URL with a signing secret; submit an annotation. You should see: the bin receives JSON with X-AfriAnnotate-Event, -Timestamp and -Signature; 'Recent deliveries' lists it as Delivered.
-
PM-17 Point the webhook at an unreachable URL and submit again. You should see: 'Recent deliveries' shows Failed with 3 attempts; the org owner gets one email, not several.
G. Exportβ
- PM-18 Export β Preview β switch formats; Choose fields; Export. You should see: covered in each annotation suite β confirm here for the project you built.