Changes between Version 3 and Version 4 of DSC/zf_validation


Ignore:
Timestamp:
Mar 8, 2014, 6:09:22 PM (10 years ago)
Author:
seskar
Comment:

—

Legend:

Unmodified
Added
Removed
Modified

  • DSC/zf_validation

    v3 v4  
    1 = Image Validation Procedure =
     1= Image Validation Procedure (Preliminary Torunament) =
     2
     3[[TOC(DSC*,depth=2)]]
    24
    35  1. Decide on the image name (e.g. team-image-name.ndz) and store it in /.orbit-image
    … …  
    3133  1. Not alter the image in any way (including renaming it) for the image you want to be used in the preliminary competition.
    3234  1. If you have multiple images that were scored, tell the ORBIT team which one you want to be used otherwise last one that was successfully verified will be used.
     35
     36= Image Validation Procedure (Final Tournament) =
     37
     38'''Please note that the submitted image has to be validated for both competitive and cooperative match'''
     39
     40  1. Decide on the image name (e.g. '''team-image-name.ndz''') and store it in /.orbit-image
     41  1. Run prepare.sh and let the node shut down
     42  1. Run "omf save" and save the image
     43{{{
     44      omf save -n node2-1.grid.obit-lab.org
     45}}}
     46  1. ssh into repository1 and rename the image
     47{{{
     48  ssh repository1
     49  cd /export/omf/omf-images
     50  mv expf-id-based-image-name.ndz team-image-name.ndz
     51}}}
     52  == Validate With Basic Script ==
     53  === Validate Competitive Match ===
     54  1. On the grid console load the saved image into one pair of the competitive match nodes and load one of the bots into the other pair i.e.:
     55{{{
     56  omf load -i team-image-name.ndz -t system:topo:dsc-teamXp
     57  omf load -i dsc-bot1.ndz -t system:topo:dsc-teamYp
     58}}}
     59  1. Execute competitive match and receive at least one packet successfully
     60{{{
     61  omf exec system:exp:dsc-match -- --mode COMP --arena PRI
     62}}}
     63
     64  === Validate Cooperative Match ===
     65  1. On the grid console load the saved image into one pair of cooperative match nodes and load two other bots into the other two sets of cooperative match nodes i.e.:
     66{{{
     67  omf load -i team-image-name.ndz -t system:topo:dsc-teamAp
     68  omf load -i dsc-bot6.ndz -t system:topo:dsc-teamBp
     69  omf load -i dsc-bot5.ndz -t system:topo:dsc-teamCp
     70}}}
     71  1. Execute competitive match and receive at least one packet successfully
     72{{{
     73  omf exec system:exp:dsc-match -- --mode COOP --arena PRI
     74}}}
     75  1. After every successful validation, you should receive confirmation email with the score. Note that you can validate multiple images.
     76  1. Do not alter the image in any way (including renaming it) once you received validation emails for the image you want to be used in the final competition.
     77  1. Fill in the submission form with the image name that was successfully validated (you have to choose one image out of the set that passed the validation procedure) and submit it over email.
     78
     79  == Validate With Tournament Scripts ==
     80  1. To set the [wiki:/DSC/zdc_framework-ext extended framework] create the three configuration files in current working directory:
     81{{{#!th
     82'''teams.yaml'''
     83}}}
     84{{{#!th
     85'''comp_matches.yaml'''
     86}}}
     87{{{#!th
     88'''coop_matches.yaml'''
     89}}}
     90{{{#!tr
     91{{{#!td
     92{{{
     93T0:
     94  name: Team Name
     95  image: team-image-name.ndz
     96T1:
     97  name: ORBIT team 1
     98  image: dsc-bot1.ndz
     99T2:
     100  name: ORBIT team 2
     101  image: dsc-bot2.ndz
     102T3:
     103  name: ORBIT team 3
     104  image: dsc-bot3.ndz
     105T4:
     106  name: ORBIT team 1
     107  image: dsc-bot4.ndz
     108T5:
     109  name: ORBIT team 2
     110  image: dsc-bot5.ndz
     111T6:
     112  name: ORBIT team 3
     113  image: dsc-bot6.ndz
     114}}}
     115}}}
     116{{{#!td
     117{{{
     118G1:
     119   1: T0
     120   2: T2
     121}}}
     122}}}
     123{{{#!td
     124{{{
     125G1:
     126   1: T0
     127   2: T6
     128   3: T5
     129}}}
     130}}}
     131}}}
     132  1. For competitive validation, in the same directory execute:
     133{{{
     134  dsc-comp 1 A
     135}}}
     136  1. For cooperative validation, in the same directory execute:
     137{{{
     138  dsc-coop 1
     139}}}
     140  1. After every successful validation, you should receive confirmation email with the score. Note that you can validate multiple images.
     141  1. Do not alter the image in any way (including renaming it) once you received validation emails if you want to use it for the final competition.
     142  1. Fill in the submission form with the image name that was successfully validated (you have to choose one image out of the set that passed the validation procedure) and submit it over email.
     143  1. We strongly encourage teams to play at least one match in all 6 possible arenas i.e.:
     144{{{
     145  dsc-comp 1 A
     146  dsc-comp 1 B
     147  dsc-comp -s 1 A
     148  dsc-comp -s 1 B
     149  dsc-coop 1
     150  dsc-coop -s 1
     151}}}