> Resources and Publications > PHC RIS infonet > April 2007 > Rigorous evaluation is worth the effort

Divisions Network matters: Rigorous Evaluation is Worth the Effort in this Division

Yvonne Rowling is the CEO of Sutherland Division, who gained skills in and awareness of the possibilities of systematic rigorous evaluation through her postgraduate study in Epidemiology at Newcastle University in 1998, to the benefit of her Division. Yvonne outlines an example of the value of formal evaluation to program partners including the Division.

Although program evaluation is a demanding exercise which consumes time and resources, divisions need assurance that the health improvement we are striving for has been achieved and if not, why not. At Sutherland Division we feel informal evaluation is adequate for ongoing program assessment, but explicit, formal and justifiable evaluation procedures are important to make decisions on organisational viability, efficiency or even program changes.

In response to low physical activity levels in the community, Sutherland Division initiated a partnership with the local Council and Area Health Promotion in early 2002 to develop a program designed to get inactive residents ‘active'.

The program, entitled the ‘GP Exercise Referral Scheme' (GPERs), aims to:

1. increase GP prescription of physical activity to sedentary patients
2. increase numbers of previously inactive patients undertaking regular physical activity
3. collaborate with key stakeholders in the implementation of a specifically targeted physical activity intervention.

During program development, partners agreed a systematic way of measuring achievement and/or improvement against these objectives was essential to test effectiveness, inform program development, and demonstrate accountability to the community, partner organisations and funding bodies. The evaluation needed to be a participatory process. Concerns about patient privacy and confidentiality were also considered.

Within the partnership we had the skills and committed the resources and funding for a systematic ongoing evaluation. We developed a framework using multiple tools across a number of dimensions to capture and analyse reliable data:

• biometric parameters, body composition, aerobic capacity, flexibility and strength are assessed by the exercise physiologist on enrolment and completion
• patients are surveyed at 3, 6, 12 and 18 months to determine satisfaction with program components and adherence to an exercise regime
• GPs are surveyed annually on their satisfaction with referral, feedback, quality of program
• stakeholders review program processes and outcomes quarterly.

Data from these sources has informed and continues to guide the program partners in the design and delivery of GPERs. One direct recent result is enhancing the program to include ‘higher risk' patients discharged from cardiac and respiratory rehabilitation.

For further information please contact:
Yvonne Rowling, CEO, Sutherland Division of General Practice
E: yrowling@shiregps.org.au
Web: http://shiregps.org.au/Default.asp?PageID=164