Model Challenge Timeline

2015	DEVELOPMENT PHASE
February-June	Model Committee meets monthly to discuss possible scope of challenge
June 20/21	Face-to-face meeting to define challenge targets, goals, and parameters
July-September	Finalization of challenge formulation. Requests to map contributors to provide any missing data (e.g., half-maps, unfiltered, unsharpened, unmasked maps)
2015/2016	CHALLENGE PHASE
October 14	Pre-Challenge Announcement, Challenger and Assessor Registration Opens
January-June 17	Challenge Site Open for Model Entry Submissions
June 17 21:00 UTC	Model entry submission window closes
2016/2017	ASSESSMENT PHASE
June-November	Challenge Data review by the Model Committee
December-May	Challenge Data review opened to volunteer assessors (blind analysis--entry authorship suppressed)
May 29	Face-to-Face Meeting to discuss preliminary outcomes of assessments
mid July	Assessors provide written reports on their results
mid July	Reports on Models sent to Challengers; Full workflow info provided to all challengers and assessors
Aug 15	Feedback from Challengers on their reports
Sept 1	Deadline for Assessors to update their reports
Oct 5-8	Challenges Meeting (Maps and Models)
Post-workshop	Challenge Writeups (multiple articles) for a Journal Special Issue

Please send your challenge questions, comments and feedback to challenges@emdataresource.org

EM Validation Challenges