Determinants of usefulness in professional behaviour change interventions: observational study of a 15-year national program

Objective Educational, and audit and feedback interventions are effective in promoting health professional behaviour change and evidence adoption. However, we lack evidence to pinpoint which particular features make them most effective. Our objective is to identify determinants of quality in professional behaviour change interventions, as perceived by participants. Design We performed a comparative observational study using data from the Veterans' Medicines Advice and Therapeutics Education Services program, a nation-wide Australian Government Department of Veterans' Affairs funded program that provides medicines advice and promotes physician adoption of best practices by use of a multifaceted intervention (educational material and a feedback document containing individual patient information). Setting Primary care practices providing care to Australian veterans. Participants General practitioners (GPs) targeted by 51 distinct behaviour change interventions, implemented between November 2004 and June 2018. Primary and secondary outcome measures We extracted features related to presentation (number of images, tables and characters), content (polarity and subjectivity using sentiment analysis, number of external links and medicine mentions) and the use of five behaviour change techniques (prompt/cues, goal setting, discrepancy between current behaviour and goal, information about health consequences, feedback on behaviour). The main outcome was perceived usefulness, extracted from postintervention survey. Results On average, each intervention was delivered to 9667 GPs. Prompt and goal setting strategies in the audit and feedback were independently correlated to perceived usefulness (p=0.030 and p=0.005, respectively). The number of distinct behaviour change techniques in the audit and feedback was correlated with improved usefulness (Pearson's coefficient 0.45 (0.19, 0.65), p=0.001). No presentation or content features in the educational material were correlated with perceived usefulness. Conclusions The finding provides additional evidence encouraging the use of behaviour change techniques, in particular prompt and goal setting, in audit and feedback interventions.