A global climatology of extratropical transition. Part II: Statistical performance of the cyclone phase space

This study analyzes the differences between an objective, automated identification of tropical cyclones (TCs) that undergo extratropical transition (ET), and the designation of ET determined subjectively by human forecasters in best track data in all basins globally. The objective identification of ET is based on the cyclone phase space (CPS), calculated from the Japanese 55-yr Reanalysis (JRA-55) or the ECMWF interim reanalysis (ERA-Interim). The resulting classification into ET storms and non-ET storms underlies the global climatology of ET presented in Part I of this study. Here, the authors investigate how well the CPS classifications agree with those in the best track records calculated from JRA-55 or from ERA-Interim data. According to F1 scores and Matthews correlation coefficients (MCCs), the classification of ET storms in the CPS agrees best with the best track classification in the western North Pacific (MCC > 0.7) and the North Atlantic (MCC > 0.5). In other basins, the correlation between the CPS classification and the best track classification is only slightly higher than that of a random classification. The JRA-55 classification achieves higher performance scores than does the ERA-Interim classification, and the differences are statistically significant in all basins. The lower performance of ERA-Interim is mainly due to a higher false alarm rate, particularly in the eastern North Pacific. Overall, the results show that while the CPS-based classifications are good enough to be useful for many purposes, there is almost certainly room for improvement-in the representation of the storms in reanalyses, in our objective metrics of ET, and in our scientific understanding of the ET process.