2019 Model Metrics Challenge Outcomes Preprint

June 15 2020: "Outcomes of the 2019 EMDataResource model challenge: validation of cryo-EM models at near-atomic resolution" is available as a preprint at BioRxiv while under consideration for publication.  Feburary 2021 update: The final version of the paper is now published in Nature Methods with an accompanying News & Views commentary.

The manuscript, co-authored by all participants, including modelers, assessors, expert advisors, and EMDR team members, provides an overview of the analysis pipeline, the quality of the models submitted, and a careful analysis of the evaluation metrics based on correlation and statistical analyses of the submitted model scores. The paper concludes with recommendations regarding use of the evaluated metrics by individual researchers and structure archives with broad relevance to the cryo-EM and larger scientific communities.