This event has ended. Visit the official site or create your own event on Sched.
Conference registrations have closed | Presenter and chair briefing notes and other information available here.
Self-guided historical walking tours: These walking tours are accessed via the Sydney Culture Walks app and highlight Aboriginal history, heritage & culture: https://www.sydneyculturewalksapp.com/barani-redfern 
Tuesday, September 17 • 1:30pm - 2:30pm
Designing Evaluations for Policy Coherence: The Differentiated Support for School Improvement Case

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Janet Clinton (University of Melbourne), Ruth Aston (University of Melbourne), Emily Qing (University of Melbourne), Ghislain Arbour (University of Melbourne), Anne Tonkin (Department of Education and Training), Stephanie Moorhouse (Department of Education and Training)

What if an evaluation of the implementation of a policy could generate information about the relationships between interrelated policies, such that governments could identify how implementers can be supported through actionable feedback, to support targeted and responsive policy implementation.

It is this question (among others) that we are tackling in the evaluation of the Differentiated support for school improvement (DSSI) initiatives, funded by the Victorian Government Department of Education and Training. More than ever, public sector policy evaluations need to incorporate the relationships between policies and identify the cumulative and collective influence of multiple policies which may not necessarily be the 'evaluand'.

This panel presentation will discuss;
  1.   Evaluation design for testing intended policy coherence, including fixed and flexible components for  repeated measures over time, with responsive measures that adapt to changing information needs
  2.   Multi-purpose measurement model that supports data aggregation, and triangulation across multiple evaluations
  3.   Co-design of the DSSI data portal and facilitating data ownership among the policy implementers
  4.   Functional partnerships between the evaluators and the commissioner
Presenters from the evaluation team (University of Melbourne) and the commissioner (Department of Education and Training), will discuss the methodological and practical considerations for the design of evaluations that include gathering progressive large-scale mixed implementation and impact data, to generate regular and tailored feedback. We will discuss how we are embracing disruption using a personalised online platform, to facilitate data collection and access to tailored feedback and for users to give feedback. Finally, the presenters will also share findings of how engagement in evaluation can become part of policy implementation, through predicting implementation behaviours and impact.

The session moderator will be Dr Ghislain Arbour, who will pose questions to the panel, and facilitate discussion from the audience. Dr Arbour has considerable expertise and evaluation experience in the public sector.

avatar for Lee-Anne Molony

Lee-Anne Molony

Director, Clear Horizon
Principled-focused evaluation Evaluating place-based approachesOrg level evaluation frameworks

avatar for Janet Clinton

Janet Clinton

Professor, University of Melbourne
Professor Janet Clinton is Director of the Centre for Program Evaluation (‘CPE’) at the Melbourne Graduate School of Education (‘MGSE’). She was previously the senior academic in Program Evaluation and the Academic Director for the School of Population Health at the University... Read More →
avatar for Ruth Aston

Ruth Aston

Senior Lecturer, Assessment and Evaluation Research Centre (AERC)
Dr Ruth Aston is a Senior Lecturer at the Assessment and Evaluation Research Centre and Honorary Research Fellow at the Centre for Adolescent Health at Murdoch Children's Research Institute. Ruth has a background in public health, including working on a three-year national project... Read More →

Emily Qing

Research Fellow, Centre for Program Evaluation
Emily is a Research Fellow at the Centre for Program Evaluation, Melbourne Graduate School of Education. She has worked on a range of large-scale evaluations of education programs, and has been engaged in the design of monitoring and evaluation systems for complex education initiatives... Read More →
avatar for Stephanie Moorhouse

Stephanie Moorhouse

Senior Project Officer, Department of Education and Training (Vic)
Stephanie Moorhouse is a Senior Project Officer at the Victorian Department of Education and Training. Since 2017, she has worked on the implementation of Differentiated support for school improvement (DSSI); a four-year project that takes a partnering approach to strengthen teaching... Read More →
avatar for Ghislain Arbour

Ghislain Arbour

Senior Lecturer, The University of Melbourne
Doctor Ghislain Arbour is a Senior Lecturer at the University of Melbourne where he coordinates the Master of Evaluation.*Research and consultancy*A primary research interest of Dr Arbour is the clarification of necessary concepts in the analysis and judgement of the performance of... Read More →

Tuesday September 17, 2019 1:30pm - 2:30pm AEST
Pyrmont Theatre