Contest Results, final round

Teams in competition

152 Survivors: Wheeler's Wacky Search in ocaml (117)
[b8] clan: runme in ocaml (140)
BlobMakers: ElegantBlob in c (177) [ElegantBlob in c (166)]
Dylan Hackers: Beam Search in dylan (237), Dylan Hackers in dylan (249)
Eeniac: ReMarkToo in c++ (186) [ReMarkToo in c++ (153)]
Exo-Plugarite Zulanga: mltong in sml (208)
Funktion im Kopf der Mensch: trender in ocaml (238) [trender in ocaml (257)]
Haskell Carrots: LALR(5000000) in haskell (121)
HeavyMetal: [Exhaustion in mercury (263)]
judges: [Planar in ocaml (260)]
Masch Tech: [MT_SML in c (254)]
Tycon Mismatch: (\x.x) in sml (167)

Results

Results are presented in the following table. There is one row per program and one column per input. Lightning entries are emphasized and the rows non-competing programs have a darker background.

One cell gives the result of a given program on a given input.

When the program passes the test, the cell shows the improvement on size (and rank) and the wall-clock running time. In case no compression is acheived (cat behavior), the cell has a yellow background.
The program may not pass the test for various reasons. In all cases the program is eliminated.
- Output is not equivalent to input. Then, the cell shows ``Bug'' and includes three pointers, to validator output, program standard output and program standard error.
- The program does not terminate before the end of allotted time. Then, the cell shows ``Timeout''.
- The program produces an output bigger than its input. Then the cell backgroud is orange.
Programs that failed once according to the above rules are eliminated. We did not test eliminated programs any further. As a consequence, some cells are empty.

	icfp2000		exhaustive		validate-big		validate-small		the-random-returns		hevea		suite		hand-again		fractal-big
	64936	10 min	1269376	30 min	134881	15 min	97483	15 min	11385	15 min	2639342	60 min	28814	60 min	4392	60 min	925869	60 min
117	6485 (8)	555.15	1002845 (4)	1755.54	48636 (10)	855.19	11529 (9)	855.22	5057 (8)	855.14	787 (10)	3559.43	6755 (8)	3555.03	585 (9)	3555.15	748603 (7)	3555.53
121	7121 (2)	590.06	1016633 (1)	1790.78	53846 (1)	890.07	16448 (1)	890.07	5683 (4)	890.04	1176371 (1)	3590.23	7208 (1)	3590.07	942 (2)	3593.27	761837 (3)	3590.11
140	6835 (5)	1.81	1007040 (3)	257.16	51389 (4)	5.44	15343 (2)	4.94	5847 (2)	0.48	1172884 (4)	55.32	6890 (6)	0.93	762 (5)	0.54	733383 (7)	18.76
153	6401 (8)	0.11	981050 (8)	0.50	49191 (7)	0.18	11793 (8)	0.17	4967 (8)	0.14	1172902 (2)	1.65	7091 (4)	0.06	866 (3)	0.09	756809 (4)	0.25
166	6924 (3)	0.14	1007111 (2)	3.86	51682 (3)	0.29	14448 (3)	0.27	4908 (9)	0.10	1172902 (2)	2.50	6964 (5)	0.12	783 (4)	0.11	723369 (8)	1.29
167	6863 (4)	25.36	929716 (9)	1546.09	50033 (6)	299.27	13306 (4)	193.82	5120 (7)	0.18	1122944 (8)	59.37	6657 (8)	1.19	710 (7)	0.13	633975 (9)	27.09
177	6924 (3)	0.14	1007111 (2)	3.85	51682 (3)	0.30	14448 (3)	0.27	4908 (9)	0.11	1172902 (2)	2.54	6964 (5)	0.15	783 (4)	0.09	723369 (8)	1.30
186	6401 (8)	0.10	981050 (8)	0.39	49191 (7)	0.12	11793 (8)	0.11	4967 (8)	0.09	1172902 (2)	1.72	7100 (3)	0.09	866 (3)	0.10	756809 (4)	0.36
208	6077 (9)	5.27	1001935 (4)	5.66	48989 (9)	9.36	12815 (7)	5.29	5766 (3)	5.21	967788 (9)	19.60	5433 (9)	5.16	754 (6)	5.25	769436 (2)	13.52
237	6691 (7)	126.31	999525 (5)	1770.91	50128 (5)	388.14	12853 (6)	365.17	5205 (6)	57.79	1150299 (6)	3399.63	7014 (4)	69.81	543 (9)	15.69	756672 (5)	2665.22
238	6828 (6)	6.01	995140 (7)	1793.07	49030 (8)	183.43	13054 (5)	65.91	5426 (5)	0.33	1147436 (7)	242.13	6863 (7)	6.55	666 (8)	0.20	751305 (6)	3593.02
249	7711 (1)	85.28	999525 (5)	1770.45	53610 (2)	248.10	10348 (9)	125.35	5869 (1)	42.78	1155514 (5)	2091.47	7157 (2)	49.58	958 (1)	12.28	770855 (1)	2427.15
254	6719 (7)	0.13	1009431 (2)	0.63	49599 (7)	0.20	12617 (8)	0.18	5363 (6)	0.10	1145672 (8)	0.91	6522 (9)	0.12	708 (8)	0.10	750066 (7)	0.92
257	6828 (6)	4.36	995140 (7)	1322.61	49030 (8)	124.18	13054 (5)	48.42	5426 (5)	0.36	1147436 (7)	171.97	6863 (7)	4.36	666 (8)	0.27	751305 (6)	3590.53
260	6723 (7)	0.38	991514 (8)	4.40	49629 (7)	1.36	12231 (8)	0.90	4987 (8)	0.86	1172930 (2)	7.11	6975 (5)	0.15	614 (9)	0.20	749133 (7)	2.78
263	6613 (8)	594.12	1002493 (4)	1794.13	48483 (10)	894.12	12327 (8)	894.11	5789 (3)	894.11	Bug, Out, Err		5459 (9)	3594.11	866 (3)	3594.09	763200 (3)	3594.09

Elimination

0 [1] programs are eliminated.

[263]

10 [5] programs are still correct.

117, 121, 140, [153], [166], 167, 177, 186, 208, 237, 238, 249, [254], [257], [260]

Ranks

Ranks for all examples are shown below. The rank of a program is defined as the number of in-contest programs that produce shorter output, plus one. Progams that fail on some example are not ranked.

Results are given as rank (improvement) programs.

icfp2000

1 (7711): 249; 2 (7121): 121; 3 (6924): [166], 177; 4 (6863): 167; 5 (6835): 140; 6 (6828): 238, [257]; 7 (6691): 237, [254], [260]; 8 (6401): 117, [153], 186; 9 (6077): 208;

exhaustive

1 (1016633): 121; 2 (1007111): [166], 177, [254]; 3 (1007040): 140; 4 (1001935): 117, 208; 5 (999525): 237, 249; 7 (995140): 238, [257]; 8 (981050): [153], 186, [260]; 9 (929716): 167;

validate-big

1 (53846): 121; 2 (53610): 249; 3 (51682): [166], 177; 4 (51389): 140; 5 (50128): 237; 6 (50033): 167; 7 (49191): [153], 186, [254], [260]; 8 (49030): 238, [257]; 9 (48989): 208; 10 (48636): 117;

validate-small

1 (16448): 121; 2 (15343): 140; 3 (14448): [166], 177; 4 (13306): 167; 5 (13054): 238, [257]; 6 (12853): 237; 7 (12815): 208; 8 (11793): [153], 186, [254], [260]; 9 (10348): 117, 249;

the-random-returns

1 (5869): 249; 2 (5847): 140; 3 (5766): 208; 4 (5683): 121; 5 (5426): 238, [257]; 6 (5205): 237, [254]; 7 (5120): 167; 8 (4967): 117, [153], 186, [260]; 9 (4908): [166], 177;

hevea

1 (1176371): 121; 2 (1172902): [153], [166], 177, 186, [260]; 4 (1172884): 140; 5 (1155514): 249; 6 (1150299): 237; 7 (1147436): 238, [257]; 8 (1122944): 167, [254]; 9 (967788): 208; 10 (787): 117;

suite

1 (7208): 121; 2 (7157): 249; 3 (7100): 186; 4 (7014): [153], 237; 5 (6964): [166], 177, [260]; 6 (6890): 140; 7 (6863): 238, [257]; 8 (6657): 117, 167; 9 (5433): 208, [254];

hand-again

1 (958): 249; 2 (942): 121; 3 (866): [153], 186; 4 (783): [166], 177; 5 (762): 140; 6 (754): 208; 7 (710): 167; 8 (666): 238, [254], [257]; 9 (543): 117, 237, [260];

fractal-big

1 (770855): 249; 2 (769436): 208; 3 (761837): 121; 4 (756809): [153], 186; 5 (756672): 237; 6 (751305): 238, [257]; 7 (733383): 117, 140, [254], [260]; 8 (723369): [166], 177; 9 (633975): 167;

Ranks for this round

A given program is given a score by summing up its ranks for all the examples. Then programs are ranked according to their scores. Numerical ranks (in bold) are computed by considering in-contest programs only.

Results are given as rank : programs score.

1 : 121: 16
2 : 249: 27
3 : 140: 38
4 : 177, [166]: 39
5 : 186: 51
6 : [153]: 52
6 : 237: 53
7 : 208: 58
8 : [257], 238: 59
9 : [260]: 61
9 : [254], 167: 62
10 : 117: 73