Test Harness

From ICPC-Contest Control Standard
Revision as of 02:57, 20 February 2011 by Douglas Lane (talk | contribs) (Initial entry 5 sections)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigationJump to search

A Test Harness is an automated testing framework.

This article contains information about the input, output and tests for systems implementing the CCS

Testing Configuration Changes

Description Input Compare to
Test initial configuration values Load Problem format file Event Feed
Description Input Compare to
Test change configuration values Load Problem format file Event Feed

Testing Run Submissions

Description Input Compare to
Test run submission Scriptable Submissions runs Event Feed
Test run judgement Scriptable Submissions runs Event Feed

Testing Clarifications

Description Input Compare to
Test clar submission Scriptable Submissions clars Event Feed
Test clar answered Scriptable Submissions clars Event Feed
Comment: There is currently no CCS-defined way to automatically answer a clarification Douglas Lane 03:57, 20 February 2011 (CET)

Testing Standings

Description Input Compare to
Test standings change Scriptable Submissions runs scoreboard.tsv

Testing Notifications

Description Input Compare to
Test notification sent Scriptable Submissions runs Not defined
Comment: There is no CCS-defined data within the Event Feed for notifications Douglas Lane 03:57, 20 February 2011 (CET)