Judging

Modelpalooza and AMPS Judging Process

Groups 1 to 7 will be scored using the Modelpalooza Scoring System discussed below. Groups 8-12 (Military Vehicles) will be scored using AMPS methodology.

Modelpalooza judges will generally be assigned to one of two shifts on Saturday to score entries:

10 AM until 12pm
1 PM until 3pm

Judges need to be prepared to score model entries for at least two and possibly three of our Entry Groups below.  Judges also need to be available for consultation on scores and follow-up questions from the Head Judge.The purpose of this guide is to prepare all Judges for the “Open System” scoring process as it will be implemented by Modelpalooza. The general idea is to award each Entry based upon its own merits rather than by comparing the entries together as in the 1st, 2nd and 3rd places of typical IPMS shows. All Entries in Modelpalooza will be organized into seven general Groups:

•Group 7 Miscellaneous Other (anything not otherwise classified below) – Specific Instructions
•Group 6 Dioramas and Vignettes – Specific Instructions
•Group 5 Individual Figures – Specific Instructions
•Group 4 Science Fiction/Mecha/Real Space Vehicles – Specific Instructions
•Group 3 Nautical Craft – Specific Instructions
•Group 2 Automotive Cars/Trucks/Vehicles – Specific Instructions
•Group 1 Aircraft – Specific Instructions

The Judging process will be conducted as follows: All Judges will be assigned a unique Judge ID – write your number down.  Judges should make no distinction in scoring between the two adult divisions.  An adjustment factor will be made automatically for the new adult division in the ModelBase scoring system.  So judges will score all divisions the same (except Juniors).

1) Together with other assigned Judge, look at the Modeler ID number on the form and  identify all of a given Contestants Entries which should be placed together on the display table. Talk amongst yourselves and quickly assess all of the Contestants Entries and determine if they are all of similar quality. If one Entry stands out as being better, you will only score that one Entry. If the entries are similar, then Entries are scored as a collection so that a “Display Medal” may be awarded. The tablet will be used to record all scores assigned. Enter the Score as specified in step 2) below. Enter the Entry ID and then the Judge ID to begin scoring.  Once scoring is completed mark a slash through each Entries Sheet to indicate that is was scored.

2) Judges should determine which criteria are present for the Entry by placing a check mark in the “Max. Possible” column. For missing criteria, do not check the Max Possible column and do not enter a Raw Score.  Confirm that both judges will be scoring the same criteria.

3) Consider the entry score sheet and determine if it is “OOTB” or “Scratch-built”. Verify each of these – instructions should be present for OOTB entries. OOTB Entries must be an unmodified commercially produced kit, WITH KIT INSTRUCTION SHEET provided next to the model. If no instruction sheet is present, the Entry will not be judged as OOTB. Judges should then refer to the front side of the Entry Sheet and cross out the OOTB marking. Seams may be filled if necessary, rigging, antennas and paper seat-belts may be added.  Entry may be painted as desired and substitute decals may be used (same as regular IPMS rules).
Scratch-built Entries must be more than 50% Contestant supplied parts. Scratch-built models may incorporate parts from other kits, but these should be generally unrelated to their original identity, except for minor parts such as wheels, guns, etc. (same as regular IPMS rules). If it is marked OOTB and there are no instructions present, write “no instructions” on the score sheet. If it appears that a scratch-built entry is not scratched, then write “not scratch” on the score sheet.

4) At last, now to record the Score of the entry. Alone without the other Judge’s input, the Judge should then score the Entry (recording the score in the ‘Raw Score’ column) using the 1 to 10 scoring for each of the individual criteria. Refer to the individual instructions for each Group for specific scoring directions. The criteria for each entry group are different – so be careful.  You may wish to confer with the other judge on the entry characteristics, but this is not a requirement.  Do NOT try to calculate the score for any entry, focus on the proper score for each criteria element.

5) At the end of your shift (or periodically), return the tablet to the Head Judge. The final weighted score is automatically calculated by ModelBase. The Registrar may request additional information from the Judges if issues are identified.

Medals will be generally awarded using this scale (but may be adjusted as necessary):

•Gold / Gold Display Medal – 9 or 10
•Silver / Silver Display Medal – 7 or 8
•Bronze / Bronze Display Medal – 5 or 6
•Highly Commendable Certificate – 3 or 4
•No recognition – 1 or 2

A “0” value will serve to denote that a particular criteria is absent from the entry.

Score Validation (done by Registrar)
After scores are tabulated and keyed into ModelBase, various quality assurance checks will be performed on the Entries score. For example, if Judges Scores are widely dispersed, ModelBase will detect this and provide a report to show these discrepancies. Judges may be asked to re-convene and consider such disparities in scores upon request. One Judge may have seen a problem or error which the other Judge had missed causing a wide variation in scores. Another validation check looks for the same criteria elements being scored for the same Entry.

Score Calibration (done by Registrar with the Chief Judges input)
ModelBase also allows for a Judge’s average scores to be calibrated together with other Judges. This means that if one Judge is scoring “hard” and another is scoring “easy”, this can be detected and corrected across a Group and even the entire show. Judges should attempt to just be consistent. We don’t expect all Judges to score identically, so some calibration may be necessary. An overall assessment of the Judges scoring scales will be performed by the Head Judge to determine that there is equality among all the various Groups and these are calibrated together. Judges scores may be revised based upon this assessment.