HAO Colloquium - Mike Liemohn, University of Michigan

Advocating robust data-model comparisons in space physics research

The magnetospheric physics research community uses a broad array of quantitative data-model comparison methods – metrics – when conducting their research investigations. It is often the case, though, that any particular study will only use one or two metrics, with the two most common being Pearson correlation coefficient and root mean square error (RMSE). Because metrics are designed to test a specific aspect of the data-model relationship, limiting the comparison to only one or two metrics reduces the physical insights that can be gleaned from the analysis, restricting the possible findings from modeling studies. Additional physical insights can be obtained when many types of metrics are applied. Metrics exist for assessing many facets of how the model reproduces certain aspects of the observed value set. They metrics are briefly reviewed and categorized to optimize selection of the metrics that best suit a particular use. In the context of space physics examples, best practices for choosing metrics for particular studies are presented and discussed.

This will be an interactive presentation with structured Q&A throughout the talk.

Date and time: 
Wednesday, January 6, 2021 - 2:00pm to 3:00pm