Metrics to evaluate treatment summaries and survivorship care plans: A scorecard

The Institute of Medicine (IOM) and Commission on Cancer have called for provision of treatment summaries (TSs) and survivorship care plans (SCPs) at the end of primary cancer therapy and endorsed guidelines for content. Institutions are providing TS/SCPs but with little guidance concerning concordance with IOM recommended content. This manuscript presents a recently developed tool to allow rating of breast cancer-specific TS/SCPs as a model for assessing concordance with IOM recommendations and facilitating research and clinical fidelity. An interdisciplinary team developed items mapped to the IOM recommendations for TS/SCP content as well as scoring rules. Dual raters used this tool to independently assess 65 completed TS/SCPs from 13 different cancer treatment facilities affiliated with the LIVESTRONG Survivorship Centers of Excellence to assess reliability. The final set of measures contained 92 items covering TSs and SCPs. The TS scale consisted of 13 informational domains across 60 items, while the SCP scale had 10 domains across 32 items. Inter-rater reliability within TSs indicated substantial agreement (M kappa = 0.76, CI = 0.73-0.79), and interclass correlation (ICC) was high (ICC = 0.85, CI = 0.76-0.91). For the SCP scale, inter-rater reliability was also substantial (M kappa = 0.66, CI = 0.62-0.70), as was interclass correlation (ICC = 0.75, CI = 0.62-0.84). Concordance with IOM recommendations for TS/SCP information can be reliably assessed using this instrument, which should facilitate implementation efforts, allow comparison of different TS/SCPs, and facilitate research into the utility of TS/SCPs including which elements are essential.