This event has ended. Visit the official site or create your own event on Sched.
Conference registrations have closed | Presenter and chair briefing notes and other information available here.
Self-guided historical walking tours: These walking tours are accessed via the Sydney Culture Walks app and highlight Aboriginal history, heritage & culture: https://www.sydneyculturewalksapp.com/barani-redfern 
Back To Schedule
Wednesday, September 18 • 2:00pm - 2:30pm
The dance of evaluation: Engaging stakeholders to develop an evaluation framework across a highly diverse training organisation

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Racheal Norris (GP Synergy), Linda Klein (GP Synergy)

This presentation will outline the processes and challenges involved in developing an efficient evaluation framework, using a state-wide vocational training organisation as a case-study. GP Synergy delivers an accredited General Practice training program, across eight highly diverse subregions of NSW and the ACT, for doctors wishing to specialise as General Practitioners. A small Evaluation Team was established in 2017 to develop a rigorous, adaptive evaluation system to monitor and report on delivery of educational activities.

Using evidence-based methodology, the team adopted a participatory approach and engaged stakeholders across three key levels:

Education Executive
An interactive program logic workshop was held to discuss and identify various evaluation priorities at the senior-level.

Medical Educators
The team worked closely with individual educators to design evaluation tools that were standardised, yet responsive to the unique needs of each region. This involved careful consideration of psychometric properties to ensure robust and reliable measures of key outcomes. A semi-automated reporting system was created to maximise efficiency of delivering timely feedback, and the team guided educators to correctly interpret and utilise this information for continuous improvement.

GP Registrars
The team consulted with registrars (trainees) to explore and develop pathways to "close the loop" and communicate evaluation findings and implications for the training program. This also involved educating registrars about the broader theoretical framework behind evaluation and how to provide useful, constructive feedback.

Evaluation at GP Synergy remains an evolving process, with ongoing multi-level engagement ensuring evaluation systems continue to be responsive and adaptable to stakeholder needs. The role of the Evaluation Team in educating stakeholders and colleagues about evaluation 'steps' has been fundamental to successful data collection and reflection on findings resulting in change. Insights will be offered to others developing evaluation frameworks/methods within settings where flexibility and responsiveness are key.

avatar for Duncan Rintoul

Duncan Rintoul

Director, Rooftop Social
ECB devotee, mentor in the AES group mentoring program, used to be on the AES board, still have heaps to learn. Keeping busy doing research and evaluation and facilitation work in education and justice and sustainability and health and you name it. Looking forward to catching up with... Read More →

avatar for Racheal Norris

Racheal Norris

Evaluations Officer, GP Synergy
Racheal is an Evaluation Officer within the NSW & ACT Research and Evaluation Unit of GP Synergy. Racheal is involved in the collection and reporting of feedback from GP registrar and supervisor development workshops. Racheal also contributes to the ongoing development of a broader... Read More →
avatar for Linda Klein

Linda Klein

Deputy Director Research & Evaluation, GP Synergy
Linda Klein, BSc MSc PhDI have an academic background in psychology and public health, with over 30 years of practical experience in evaluation in sectors spanning health, education/training and business. At GP Synergy, I take primary responsibility for the evaluation of educational... Read More →

Wednesday September 18, 2019 2:00pm - 2:30pm AEST