Wishlist

This is Bernard's random wishlist/TODO list - it is more a collection of thoughts than any concrete plans.

Scoring

• A flexible ScoreType which handles batching well.
• turn score parameters into a text-area (before ultimately giving it an actual UI)
• Related to a better UI for the above, assign and show names for test cases
• Ability to weight questions globally?
• Fix needing to restart ScoringService after adding tasks, test data or modifying scoring parameters.

UI

• More detail in the logs and contest overview about what submissions are for (i.e. also show which user and task).
• Fix scoreboard UI glitch when subchanges for fractional scores are sent (32.31 becomes 32.3100000001, etc).

Queue management

• Make queue fairer amongst contestants.
• Ability to take something out of the queue from the website, and/or demote its priority.

Misc

• Ability to have a many-to-many relationship between contests and tasks. (i.e. reuse the same task for multiple contests)
• Ability to specifying system-local exclusions for sandboxed compilation/evaluation/etc, including specific paths and system calls to permit.
• New sandboxing approach based on namespaces ... more liberal but less error-prone. WIP.

Testing

• More line coverage from the test suite.
• A fuzz tester that makes semi-random garbage web requests.
• A database consistency checker. This would check things like:
• scoring parameters are correct
• task type parameters are correct
• Finish command-line submitter to poll for results and better detect and handle errors.
• Also write a command-line submitter that doesn't require CWS.
• Security audit
• Unicode audit