Skip to main content

Review challenge submissions

When hackers submit to a challenge, their submissions can be reviewed and approved or rejected. This guide covers the review workflow. Open submissions at https://core.mlhtools.com/resources/challenge_submissions.

Submission statuses

A challenge submission moves through these statuses:

  • Draft: started but not yet submitted.
  • Submitted: submitted and awaiting review. These are the unreviewed submissions.
  • Manual approved: approved by a reviewer.
  • Bulk approved: approved as part of a bulk action.
  • Auto approved: approved automatically on submission (when the challenge allows it).
  • Rejected: not accepted; a rejection reason can be recorded.
  • Withdrawn: withdrawn (a withdraw reason is recorded).

The dashboard shows a count of total submissions and a count of unreviewed (submitted) submissions.

Review a single submission

  1. In Avo, open the Challenge Submissions resource (or open a challenge and view its submissions).
  2. On a submission, run the Review action.
  3. The review shows the submission's project URL, description, and screenshots.
  4. Choose Approve or Reject. If you reject, you can add a rejection reason.
  5. Confirm. Approving sets the submission to manual approved; rejecting sets it to rejected.

Approve many at once

Select multiple submitted submissions and run the Bulk Approve action to approve them together (each becomes bulk approved).

Useful fields

  • Winner: mark a submission as a challenge winner.
  • Status: the current review status.
  • Rejection reason / Withdraw reason: recorded when a submission is rejected or withdrawn.