AutoMark: Format for Marking Scripts

Sample Script

<markingguide>
   <tries>100</tries>
   <question>
      <compile>rm *.class; javac Question1.java 2&gt;&amp;1</compile>
      <run>java Question1 &gt; testoutput.out &lt; testinput.in 2&gt;&amp;1</run>
      <check>
         <file1>testoutput.test</file1>
         <file2>testoutput.out</file2>
      </check>
      <marks>100</marks>
      <trial>
         <file name="testinput.in">
1 2 3 4 5 6 7 8 9
         </file>
         <file name="testoutput.test">
1 2 3
4 5 6
7 8 9
         </file>
      </trial>
      <trial>
         <fixedfile name="testinput.in.2" targetfilename="testinput.in"/>
         <file name="testoutput.test">
0 0 0
0 111 0
0 0 0
         </file>
      </trial>
   </question>
</markingguide>

Fields

Field	Attributes	Description	Repeatable	Mandatory
markingguide		containing the whole assignment		M
markingguide/tries		number of submissions allowed
markingguide/question		for each question	R
question/fixedfile, trial/fixedfile	name, targetfilename	copies named file to program directory before compilation or before each trial. can appear within question or within trial. if targetfilename is specified, file is renamed to this when it is copied.	R
question/compile, trial/compile		command to compile program	R
question/run, trial/run		command to execute program	R
question/check, trial/check	printCheck (optional)	specify which 2 files are to be compared in each trial. printCheck=0 will not print actual and expected output/input
question/checkScript, trial/checkScript		specify the name of the checking script. this script will be invoked for every trial and should output a mark [0-100] in trialscore.dat. any output to stdout will appear in the report
check/file1		name of expected output file		M
check/file2		name of output file produced by program		M
question/marks, trial/marks		marks for question or trial. can appear within question or trial. defaults to 100. if no marks are specified, all trials are equal and all questions are equal - for a scaled total of 100.
question/trial		specification of input/output for each test case	R
trial/file	name	stores data into the file with specified name before the trial is conducted	R
question/maximumCPU, trial/maximumCPU		specifies maximum number of seconds of execution time (default: 30s)
question/maximumMemory, trial/maximumMemory		specifies maximum amount of memory usable (default: 10MB)
question/maximumFile, trial/maximumFile		specifies maximum size of each file created by the program (default: 1MB)

Notes

the scripts gets runs from top to bottom and files are not erased unless this is done explicitly (until after the marking is over)
as this is XML: all less-thans must be "<" all greater-thans must be ">"; and all ampersands must be "&"
> testoutput.out redirects output to the file testoutput.out
< testinput.in redirects input from the file testinput.in
2>&1 sends all error output to standard output as well - this must appear after output redirection

the typical run/compile commands are as follows:

java compile:

rm *.class; javac Question1.java 2&gt;&amp;1

java run:

java Question1 &gt; testoutput.out &lt; testinput.in 2&gt;&amp;1

javadoc compile:
```
rm -fR docs
```

javadoc run:

javadoc -private -author -version -d docs *.java 2&gt;&amp;1 ; grep -v 'Generated by javadoc' docs/Teacher.html &gt; docs/TeacherX.html 2>&1 ; grep -v 'Generated by javadoc' docs/TeachingAssistant.html &gt; docs/TeachingAssistantX.html 2&gt;&amp;1

python run:

/usr/local/bin/python tut1q1.py &gt; testoutput.out &lt; testinput.in 2&gt;&amp;1

hussein, 2 september 2009