Planner Checks
This page contains current status information on all active competitors of the IPC 2020. For each competitor we show whether the planner currently compiles and whether it solves a given set of sample problems. The logs of the compilation and every run are available for download by clicking on the blue links. The test instances can be downloaded by clicking at the columns headers.
Each of the six sample problems is divided into two sections. The one on the top shows whether the planner is able to find a plan (green) or not (red). The second section below shows whether the generated plan is valid. Green indicates that the plan is valid, red that it is not, and blue that no plan was found in the first place. If the planner produced only a primitive plan and did not provide a decomposition witness, we will indicate with cyan that the primitive plan is executable. Yellow indicates instances that the planner does not support (either due to recursion or partial order).
For the last column, we let each planner run for 10 seconds on a larger set of benchmark instances. As a summary per domain we report:
- SOL - the planner has solved the problem with a valid plan,
- INVAL - the planner has solved the problem, but the plan failed verification, and
- TLE - the planner exceeded the timelimit of 10 seconds.
Note that INVAL here also includes cases where the planner produced only a primitive plan which was valid (but the decomposition hierarchy was missing).
Competitor | Compile Status | rover01 | satellite01 | um-translog01 | transport01 | p-rover01 | p-transport01 | 10 seconds run (SOL,INVAL,TLE) |
---|---|---|---|---|---|---|---|---|
Lilotane recursion: yespartial order: no | Compile Log 495.34 sec519912 kbyte | Planner Log 0.45 sec24312 kbyte | Planner Log 0.36 sec24732 kbyte | Planner Log 0.50 sec24552 kbyte | Planner Log 0.38 sec24832 kbyte | not supported | not supported | Miconic: 7 / 0 / 0 Zenotravel: 5 / 0 / 0 UM-Translog: 22 / 0 / 0 Satellite: 25 / 0 / 0 Woodworking: 11 / 0 / 0 SmartPhone: 7 / 0 / 0 rover: 19 / 0 / 1 transport: 28 / 0 / 2 Planner Log |
Verify Log 0.00 sec3292 kbyte | Verify Log 0.00 sec2492 kbyte | Verify Log 0.01 sec4664 kbyte | Verify Log 0.01 sec2700 kbyte | no plan | no plan | |||
HPDL-planner recursion: yespartial order: yes | Compile Log 210.51 sec435944 kbyte | Planner Log 0.67 sec24228 kbyte | Planner Log 0.68 sec24084 kbyte | Planner Log 0.76 sec24136 kbyte | Planner Log 0.91 sec24068 kbyte | Planner Log 0.76 sec24476 kbyte | Planner Log 0.66 sec24220 kbyte | Miconic: 7 / 0 / 0 Zenotravel: 5 / 0 / 0 UM-Translog: 22 / 0 / 0 Satellite: 25 / 0 / 0 Woodworking: 3 / 0 / 8 SmartPhone: 2 / 0 / 5 rover: 13 / 0 / 7 transport: 1 / 0 / 29 Planner Log |
Verify Log 0.00 sec3372 kbyte | Verify Log 0.00 sec2500 kbyte | Verify Log 0.01 sec4668 kbyte | Verify Log 0.00 sec2704 kbyte | Verify Log 0.01 sec3368 kbyte | Verify Log 0.00 sec2704 kbyte | |||
HyperTensioN recursion: yespartial order: no | Compile Log 31.81 sec186360 kbyte | Planner Log 0.37 sec24704 kbyte | Planner Log 0.36 sec24784 kbyte | Planner Log 0.38 sec25244 kbyte | Planner Log 0.41 sec24884 kbyte | not supported | not supported | Miconic: 7 / 0 / 0 Zenotravel: 5 / 0 / 0 UM-Translog: 22 / 0 / 0 Satellite: 25 / 0 / 0 Woodworking: 6 / 0 / 5 SmartPhone: 7 / 0 / 0 rover: 19 / 0 / 1 transport: 30 / 0 / 0 Planner Log |
Verify Log 0.01 sec3932 kbyte | Verify Log 0.00 sec2492 kbyte | Verify Log 0.01 sec4668 kbyte | Verify Log 0.00 sec2704 kbyte | no plan | no plan | |||
PDDL4J recursion: yespartial order: no | Compile Log 183.17 sec711248 kbyte | Planner Log 2.27 sec99224 kbyte | Planner Log 2.18 sec94976 kbyte | Planner Log 2.22 sec107300 kbyte | Planner Log 2.01 sec96372 kbyte | not supported | not supported | Miconic: 7 / 0 / 0 Zenotravel: 5 / 0 / 0 UM-Translog: 22 / 0 / 0 Satellite: 25 / 0 / 0 Woodworking: 6 / 0 / 5 SmartPhone: 0 / 0 / 7 rover: 20 / 0 / 0 transport: 28 / 0 / 2 Planner Log |
Verify Log 0.00 sec3212 kbyte | Verify Log 0.00 sec2492 kbyte | Verify Log 0.02 sec4668 kbyte | Verify Log 0.00 sec2708 kbyte | no plan | no plan | |||
PDDL4J recursion: yespartial order: yes | Compile Log 219.01 sec705092 kbyte | Planner Log 2.13 sec100244 kbyte | Planner Log 2.20 sec93680 kbyte | Planner Log 2.23 sec99680 kbyte | Planner Log 2.43 sec94628 kbyte | Planner Log 2.22 sec91740 kbyte | Planner Log 2.22 sec94964 kbyte | Miconic: 7 / 0 / 0 Zenotravel: 5 / 0 / 0 UM-Translog: 22 / 0 / 0 Satellite: 25 / 0 / 0 Woodworking: 5 / 0 / 6 SmartPhone: 0 / 0 / 7 rover: 20 / 0 / 0 transport: 26 / 0 / 4 Planner Log |
Verify Log 0.00 sec3216 kbyte | Verify Log 0.00 sec2496 kbyte | Verify Log 0.01 sec4668 kbyte | Verify Log 0.00 sec2704 kbyte | Verify Log 0.00 sec3240 kbyte | Verify Log 0.00 sec2700 kbyte | |||
pyHiPOP recursion: yespartial order: yes | Compile Log 102.70 sec416480 kbyte | Planner Log 5.51 sec69188 kbyte | Planner Log 2.53 sec38240 kbyte | Planner Log 57.21 sec1539936 kbyte | Planner Log 2.15 sec44764 kbyte | Planner Log 60.13 sec24968 kbyte | Planner Log 2.53 sec47664 kbyte | Miconic: 2 / 0 / 5 Zenotravel: 4 / 0 / 1 UM-Translog: 17 / 0 / 5 Satellite: 11 / 0 / 14 Woodworking: 2 / 0 / 9 SmartPhone: 4 / 0 / 3 rover: 4 / 0 / 16 transport: 1 / 0 / 29 Planner Log |
Verify Log 0.01 sec3936 kbyte | Verify Log 0.00 sec2492 kbyte | Verify Log 0.02 sec4668 kbyte | Verify Log 0.00 sec2704 kbyte | no plan | Verify Log 0.00 sec2700 kbyte |
Competitor | test01 | test02 | test03 | test04 | test05 | test06 | test07 |
---|---|---|---|---|---|---|---|
empty method | forall | forall2 | no abstracts | constants in domain | synonymes | arguments | |
Lilotane recursion: yespartial order: no | Planner Log 0.46 sec24684 kbyte | Planner Log 0.37 sec25156 kbyte | Planner Log 0.37 sec24612 kbyte | Planner Log 0.34 sec24740 kbyte | Planner Log 0.37 sec24880 kbyte | Planner Log 0.33 sec24548 kbyte | Planner Log 0.38 sec24524 kbyte |
Verify Log 0.89 sec2332 kbyte | Verify Log 0.05 sec2344 kbyte | Verify Log 0.01 sec2356 kbyte | Verify Log 0.00 sec2328 kbyte | Verify Log 0.00 sec2340 kbyte | Verify Log 0.00 sec2480 kbyte | Verify Log 0.00 sec2344 kbyte | |
HPDL-planner recursion: yespartial order: yes | Planner Log 0.78 sec24836 kbyte | Planner Log 0.63 sec24284 kbyte | Planner Log 0.60 sec24248 kbyte | Planner Log 0.61 sec24236 kbyte | Planner Log 0.63 sec24556 kbyte | Planner Log 0.59 sec23868 kbyte | Planner Log 0.63 sec23996 kbyte |
Verify Log 0.17 sec2312 kbyte | Verify Log 0.01 sec2344 kbyte | Verify Log 0.00 sec2356 kbyte | Verify Log 0.00 sec2328 kbyte | Verify Log 0.00 sec2344 kbyte | Verify Log 0.00 sec2484 kbyte | Verify Log 0.00 sec2348 kbyte | |
HyperTensioN recursion: yespartial order: no | Planner Log 0.37 sec24496 kbyte | Planner Log 0.34 sec24196 kbyte | Planner Log 0.36 sec24288 kbyte | Planner Log 0.35 sec24584 kbyte | Planner Log 0.38 sec24672 kbyte | Planner Log 0.36 sec24964 kbyte | Planner Log 0.37 sec25188 kbyte |
Verify Log 0.00 sec2336 kbyte | Verify Log 0.00 sec2344 kbyte | Verify Log 0.00 sec2352 kbyte | Verify Log 0.00 sec2332 kbyte | Verify Log 0.00 sec2344 kbyte | Verify Log 0.00 sec2480 kbyte | Verify Log 0.00 sec2348 kbyte | |
PDDL4J recursion: yespartial order: no | Planner Log 1.99 sec92508 kbyte | Planner Log 1.94 sec85444 kbyte | Planner Log 1.91 sec93584 kbyte | Planner Log 2.04 sec92488 kbyte | Planner Log 1.95 sec93816 kbyte | Planner Log 2.09 sec90792 kbyte | Planner Log 2.03 sec93996 kbyte |
Verify Log 0.00 sec2332 kbyte | Verify Log 0.00 sec2348 kbyte | Verify Log 0.00 sec2352 kbyte | Verify Log 0.00 sec2324 kbyte | Verify Log 0.00 sec2340 kbyte | Verify Log 0.00 sec2480 kbyte | Verify Log 0.00 sec2344 kbyte | |
PDDL4J recursion: yespartial order: yes | Planner Log 2.18 sec92144 kbyte | Planner Log 2.07 sec91020 kbyte | Planner Log 2.10 sec92008 kbyte | Planner Log 2.19 sec93092 kbyte | Planner Log 2.13 sec93904 kbyte | Planner Log 2.33 sec86124 kbyte | Planner Log 2.00 sec85936 kbyte |
Verify Log 0.00 sec2332 kbyte | Verify Log 0.01 sec2348 kbyte | Verify Log 0.00 sec2352 kbyte | Verify Log 0.00 sec2328 kbyte | Verify Log 0.00 sec2340 kbyte | Verify Log 0.00 sec2484 kbyte | Verify Log 0.00 sec2344 kbyte | |
pyHiPOP recursion: yespartial order: yes | Planner Log 1.34 sec32260 kbyte | Planner Log 1.60 sec32428 kbyte | Planner Log 1.44 sec32380 kbyte | Planner Log 1.47 sec32072 kbyte | Planner Log 1.44 sec32404 kbyte | Planner Log 1.40 sec32760 kbyte | Planner Log 1.39 sec32428 kbyte |
Verify Log 0.00 sec2328 kbyte | Verify Log 0.00 sec2344 kbyte | Verify Log 0.00 sec2352 kbyte | Verify Log 0.00 sec2332 kbyte | Verify Log 0.00 sec2340 kbyte | Verify Log 0.00 sec2484 kbyte | Verify Log 0.00 sec2340 kbyte |