Review challenge submissions
When hackers submit to a challenge, their submissions can be reviewed and
approved or rejected. This guide covers the review workflow. Open submissions at
https://core.mlhtools.com/resources/challenge_submissions.
Submission statuses
A challenge submission moves through these statuses:
- Draft: started but not yet submitted.
- Submitted: submitted and awaiting review. These are the unreviewed submissions.
- Manual approved: approved by a reviewer.
- Bulk approved: approved as part of a bulk action.
- Auto approved: approved automatically on submission (when the challenge allows it).
- Rejected: not accepted; a rejection reason can be recorded.
- Withdrawn: withdrawn (a withdraw reason is recorded).
The dashboard shows a count of total submissions and a count of unreviewed (submitted) submissions.
Review a single submission
- In Avo, open the Challenge Submissions resource (or open a challenge and view its submissions).
- On a submission, run the Review action.
- The review shows the submission's project URL, description, and screenshots.
- Choose Approve or Reject. If you reject, you can add a rejection reason.
- Confirm. Approving sets the submission to manual approved; rejecting sets it to rejected.
Approve many at once
Select multiple submitted submissions and run the Bulk Approve action to approve them together (each becomes bulk approved).
Useful fields
- Winner: mark a submission as a challenge winner.
- Status: the current review status.
- Rejection reason / Withdraw reason: recorded when a submission is rejected or withdrawn.