This event has ended. Visit the official site or create your own event on Sched.

aes19 International Evaluation Conference

Conference registrations have closed | Presenter and chair briefing notes and other information available here.
Self-guided historical walking tours: These walking tours are accessed via the Sydney Culture Walks app and highlight Aboriginal history, heritage & culture: https://www.sydneyculturewalksapp.com/barani-redfern
https://www.sydneyculturewalksapp.com/barani-warrane

9:00am AEST

Opening plenary: Welcome to Country, followed by Tracy Westerman "Without measurability there is no accountability. Why we are failing to gather evidence of what works" Pyrmont TheatreUncle Charles (Chicka) Madden • Tracy Westerman

11:00am AEST

Evaluation governance: creating fertile ground C2.6Larissa Brisbane • Julian Thomas • Ariane Hermann • Amanda Shipway Logic is the beginning of wisdom, not the end of it C2.5Squirrel Main • Caroline Anderson • Alice Knight Integrating Behavioural Insights into Evaluation C2.2Eleanor Williams • Georgia Marett • Jack Cassidy Applying Systems Evaluation Theory C2.4Gill Westhorp • Brian Keogh • Ralph Renger • Lewis Atkinson The un-boxed game: Snakes and Ladders for illustrating the variability of evaluation projects over the career of the evaluator C2.3Sarah Renals • Anne Markiewicz • Susan Garner Bringing the voice and knowledge of indigenous people and communities to evidence building and evaluation in a way that empowers Pyrmont TheatreEmma Walke • Doyen Radcliffe • Simon Jordan • Megan Williams • Nattlie Smith Using evidence for impact: the client-consultant relationship C2.1Donna Stephens • Brendan Rigby • Matt Wright • Ruth Aston • Megan Kerr • Jess Dart

11:30am AEST

Early insights from evaluating post-disaster community recovery C2.6Larissa Brisbane • Claire Grealy • Christina Bagot Contribution analysis: Evaluating the impact of intensive family services, applying theory in a real-world context. C2.5Squirrel Main • Jane Howard Evaluating creatively: Capturing the diverse voices of children and young people involved in early intervention programs C2.2Eleanor Williams • Kylie Evans-Locke

12:00pm AEST

Empathy mapping - Discovering what they value C2.6Larissa Brisbane • Victoria Carling • Andy Moore Unpacking the skills required for an evaluator - Learning from the past to prepare us for the future C2.3Sarah Renals • Anthea Rutter The Consolations of Evaluation Theory C2.5Squirrel Main • Brad Astbury • Andrew Hawkins The role of evaluation in social impact bonds C2.4Gill Westhorp • Ruby Leahy Gatfield • Sue Leahy • Claudia Lennon A trauma informed approach to capturing the voices of vulnerable children in Out-of-Home-Care evaluation C2.2Eleanor Williams • Dr. Suzanne Evas • Antoniette Bonaguro Yuwaya Ngarra-li: Evaluating an Aboriginal community-led partnership working towards systemic change in Walgett, NSW C2.1Donna Stephens • Ruth McCausland

1:30pm AEST

'Games of Firsts': The evaluation and monitoring framework for Gold Coast 2018 Commonwealth Games Legacy program C2.4Matt Healey • Robert Grimshaw A Practical Application of a Realist Synthesis Method C2.5Ian Patrick • Jo Hall Beyond co-design to co-evaluation: Reflections on collaborating with consumer researchers C2.6Christina Kadmos • Rachel Aston • Amber Provenzano • Amelia Walters Introduction to Evaluation C2.2Rae Fry • Charlie Tulloch Digital Disruption - the next industrial revolution is here. What does this all mean for evaluators? Pyrmont TheatreGeorge Argyrous • Jenny Riley • Kristi Mansfield • Reuben Stanton • Chris Newman • Jess Dart What the arts can teach evaluators C2.3Josephine Norman • Gerard Atkinson Logic and Creative Evaluation that Embraces our Young People - Measuring Personal Growth, Aspirations, Dreams and Commitment? C2.1James Smith • Evita Puruntatameri • Sophia Tipuamatumirri • Bronwyn Rossingh • Moya Perry

2:00pm AEST

Frameworks for program evaluation: considerations on research, practice and institutions C2.5Ian Patrick • Ghislain Arbour Travel Behaviour Change Evaluation: Embracing ticketing data insights and moving beyond the box of self-reports C2.4Matt Healey • Zarin Salter Does empowerment evaluation work? Findings from a case-study C2.6Christina Kadmos • Kerrie Ikin

2:30pm AEST

Evaluation for enlightenment: Creating value through process evaluation C2.3Rae Fry • Rory Sudfelt Necessary components of a theory of change for system level interventions C2.5Ian Patrick • Nerida Rixon Machine-assisted qualitative analysis in Evaluation Pyrmont TheatreGeorge Argyrous • Georgia Marett • Jasper Odgers • David Wakelin Movies, art and virtual reality - Innovative evaluation story methods for participatory approaches C2.2Josephine Norman • Samantha Abbato • Margi MacGregor Harnessing the power of co - practical tips C2.1James Smith • Jade Maloney • Alexandra Lorigan The Perpetrator Perspective: Breaking down the barriers in family violence research and evaluation C2.6Christina Kadmos • Luke Condon • Karen Kellard • Jenny Anderson

2:35pm AEST

So, you're an evaluation consultant - what's that? C2.4Matt Healey • Vanessa Hood

2:40pm AEST

Using a template to collect interview notes for rapid upload and autocoding in NVivo C2.4Matt Healey • Carolyn Hooper

2:45pm AEST

"You seriously need to play more - Let's go! (Participatory design and facilitation with Lego Serious Play)" C2.4Matt Healey • Kahiwa Sebire

3:30pm AEST

The evaluation box needs more pictures: A multidisciplinary approach to reducing words and numbers for evaluation capacity building (ECB) C2.3Margaret Moon • Samantha Abbato • Margi MacGregor Maximising Effectiveness of "Evaluation to Policy Making " Process C2.2Leanne Kelly • Rini Mowson Innovation in government program evaluation C2.5Sean Chung • Katherine Barnes • Angelina Bruno When the West Meets the East: Collaborative design, analysis and delivery of program evaluation in rural generalist training program in Japan C2.6Rebecca Arnold • Takara Tsuzaki Finding your voice: sharing your knowledge and elevating evaluation through social media, blogging and the Evaluation Journal of Australasia C2.1Greg Masters • Liz Gould • Carol Quadrelli • Bronwyn Rossingh • Jade Maloney • Eunice Sotelo How do we know? Implications of epistemology for evaluation practice C2.4Mardi Trompf • Gill Westhorp Out of the box and in country: Tracking stories to collaboratively develop and evaluate an Indigenous-led wellbeing innovation in remote Australia Pyrmont TheatreFarida Fleming • Samantha Togni • Margaret Smith • Rene Kulitja • Nyunmiti Burton

4:00pm AEST

Making the numbers count: Being evaluation ready for administrative data analysis C2.3Margaret Moon • Fiona Christian • David Wakelin Knowing the value of knowledge: emerging approaches to evaluating research through end user perspectives. C2.5Sean Chung • Larissa Brisbane • Emily Prentice How can implementation quality be evaluated? An example from a pilot initiative in Victorian child and family services. C2.2Leanne Kelly • Dr Jessica Hateley-Browne Evaluating a place-based partnership program: Can Get Health in Canterbury C2.6Rebecca Arnold • Amy Bestman

4:30pm AEST

Plenary 2: David Fetterman "Empowerment Evaluation: a powerful stakeholder involvement approach fit for the times" Pyrmont TheatreDavid Fetterman

5:30pm AEST

Australian Evaluation Society 2019 AGM & 2019-2022 Strategy launch Pyrmont TheatreJohn Stoney

9:00am AEST

Plenary 3: What’s beyond the box of program evaluation and what does this mean for us? Pyrmont TheatreEmily Verstege • Jacqueline (Jax) Wechsler • Jenny Riley • Jess Dart • Kate McKegg • Adrian Field

11:00am AEST

Stories of strength: using educators' reflections on implementing a strength-based approach to Aboriginal and Torres Strait Islander education to understand mechanisms for change C2.5Linda Klein • Cathy Jackson The challenges of establishing and growing an internal evaluation unit: Experiences from two large state government departments C2.6Florent Gomez • Eleanor Williams • Josephine Norman • Amanda Reeves #aes19SYD unconference: evaluation for a better world C2.2-C2.3 Bringing values into evaluation: A tool for practitioners C2.4Anne Markiewicz • Mathea Roorda Rubrics - a tool for unboxing evaluative reasoning Pyrmont TheatreRonelle Hutchinson • Julian King • Nan Wehipeihana • Judy Oakden • Kate McKegg • Adrian Field Unpacking Rainbow Boxes: Exploring multiculturalism and interculturality in evaluation practice. C2.1Kathryn Dinh • Eva Sarr • Erin Blake • Stafford Hood • Rodney Hopson

11:30am AEST

Sharing perspectives and creating meaning through insider/outsider evaluation of an Aboriginal transfer of care program from hospital to community C2.5Linda Klein • Liz Norsa • Raylene Blackburn • Karen Beetson

12:00pm AEST

Internal Evaluation Capacity Building: Unpacking what works in a (very) large government department C2.6Florent Gomez • Liam Downing • Rydr Tracy Using Program Design Logic to manage the risk of program failure Pyrmont TheatreRonelle Hutchinson • Andrew Hawkins Aboriginal Family Planning Circle evaluation: empowering Aboriginal and Torres Strait Islander communities in evaluating and future-proofing Aboriginal-led community programs C2.5Linda Klein • Amy Lawton • Cheryl Jackson How to integrate intercultural considerations in evaluation debate and practice C2.1Kathryn Dinh • Rini Mowson • Sarah Leslie

12:05pm AEST

Alternate realities in evaluation: Possibilities for emerging tech in evaluation C2.4Anne Markiewicz • Matt Healey

12:10pm AEST

Collective impact evaluation in primary prevention of violence against women C2.4Anne Markiewicz • Louise Falconer

12:15pm AEST

Opening Up The Box: making evaluation useful to stakeholders C2.4Anne Markiewicz • Hwee Lee Seah

12:20pm AEST

Let's focus on the Big M and little e (Me) C2.4Anne Markiewicz • Damien Sweeney • Dave Green

1:00pm AEST

#aes19SYD unconference: evaluation for a better world (continued) C2.2-C2.3

1:30pm AEST

"Catching the MEL bug": Using an evaluation needs assessment to unpack evaluation capacity C2.6Carolyn Hooper • Mark Planigale Making sense of women's leadership through online SenseMaker C2.4Dr. Suzanne Evas • Alejandra Garcia Villamil "Fellows Forum Contributions of Theory to Evaluation Practice: Examples from the Field" C2.1Marion Norton • John Owen • Rick Cummings Designing Evaluations for Policy Coherence: The Differentiated Support for School Improvement Case Pyrmont TheatreLee-Anne Molony • Janet Clinton • Ruth Aston • Emily Qing • Stephanie Moorhouse • Ghislain Arbour Lessons learned co-designing a program and its evaluation in an emerging policy landscape C2.5Andy Moore • Poppy Wise • Malcolm Haddon • Zainab Kadhim

2:00pm AEST

The retrospective development of a monitoring and evaluation framework for the Northern Territory chronic conditions prevention and management strategy: Unpacking the problems and possibilities C2.6Carolyn Hooper • James Smith • Jenny Summerville Learning from feminist economics to measure what counts to women C2.4Dr. Suzanne Evas • Farida Fleming • Menka Goudan

2:30pm AEST

Communities of Practice, mentoring and evaluation advice: using soft power approaches to build capacity C2.6Carolyn Hooper • Florent Gomez • Michelle Bowron Ethics unveiled: Foregrounding who is holding the box in the evaluation of higher education equity programs C2.1Marion Norton • Matthew Lumb • Rhyall Gordon From impact evaluation to evaluating with impact: Trialling a new approach to increase uptake of evaluation results Pyrmont TheatreLee-Anne Molony • Kathryn Dinh • Peta Leeman From theory to practice in gender evaluation: A systematic review of approaches in international development C2.4Dr. Suzanne Evas • Jess MacArthur Achieving successful outcomes through evaluation: A practical example of evidence-based practice for an Indigenous program C2.5Andy Moore • Janice Smith • Kristy Saarenpaa

3:30pm AEST

Plenary 4: Gary VanLandingham "Evaluation in the age of evidence-informed policy-making -- opportunities, challenges and paths forward" Pyrmont TheatreGary VanLandingham

9:00am AEST

Plenary 5: Jane Davidson "Unboxing the core like our lives depend on it – because they do" Pyrmont TheatreJane Davidson

10:30am AEST

Front-end loading: The value of formative evaluation in setting program focus: a case study of the Australian Volunteers Program C2.6Kiri Parata • Keren Winterford • Farooq Dar • Anna Gero Giving evaluation data back to the end user: experience from two workplace health initiatives C2.5Anthea Rutter • Jason Thompson • Jorja Millar Inside, outside, all around: Three perspectives on evaluation capacity building C2.1Kerrie Ikin • Stewart Muir • Alisha Heidenreich • Nerida Joss • Mandy Charman The early career evaluator experience: exploring pathways into and up in evaluation C2.3Jess MacArthur • Francesca Demetriou • Eunice Sotelo Un-boxed: Developmental evaluation's great strength and ultimate challenge Pyrmont TheatreGhislain Arbour • Samantha Togni • Kate McKegg • Nan Wehipeihana Value for Investment: unboxing a transdisciplinary approach to valuing C2.4Natalie Fisher • Julian King Navigating Indigenous evaluation contexts: A time for critical reflection C2.2Ruth McCausland • James Smith • Donna Stephens • Kim Robertson

11:00am AEST

Not champions, advocates! Supporting evaluation in non-profit organisations C2.5Anthea Rutter • Alison Rogers

11:05am AEST

Surprise! No one read your organisations annual corporate performance report. Now what? C2.6Kiri Parata • Brooke Edwards

11:10am AEST

He Whetū Arataki (Guiding Star) youth leadership programme evaluation C2.6Kiri Parata • Gill Potaka Osborne • Teresa Taylor

11:15am AEST

What's beyond the box: Learning from 'tribal' communities and encouraging community ownership of evaluation - a collaborative approach, building on translational research, using an implementation science evaluation... C2.6Kiri Parata • Robert Simpson

11:20am AEST

Design tips for visualising your data C2.6Kiri Parata • David Wakelin

11:30am AEST

A Primer on Using Qualitative Comparative Analysis (QCA) in Evaluation C2.4Natalie Fisher • Brad Astbury Increasing policy impact of disability inclusive evaluation by using an inclusive citizenship lens C2.5Anthea Rutter • Karen Fisher • Sally Robinson A fundamental choice: Internal or external evaluation capacity building? Or a bit of both? C2.1Kerrie Ikin • Vanessa Hood • Liam Downing Confidence for evaluators: The unspoken skill C2.3Jess MacArthur • Matt Healey Evaluation: What is the value in the box? Pyrmont TheatreGhislain Arbour • Laurence Denholm • Anthea McClintock • Lyn Alderman • Geoff Gallop • Nicholas Gruen • William Murphy • Simon Smith • Jonathan Wheaton Better Evaluation: Aboriginal and Torres Strait Islander Evaluation Project C2.2Ruth McCausland • Donna Stephens • Sharon Babyack • Belinda Gibb • Greet Peersman

11:35am AEST

The whole box and dice: economic evaluation trends and forecasts C2.6Kiri Parata • Mark Galvin • Alain Nader

11:40am AEST

Using e-diaries to collect evaluation data C2.6Kiri Parata • Carolyn Hooper

11:45am AEST

Lessons from the Dark Side: How Corporates do Client Experience C2.6Kiri Parata • Emily Verstege

12:00pm AEST

Part 2 Take your idea and make it speak: Publishing your evaluation stories C2.5Anthea Rutter • Liz Gould • Carol Quadrelli • Bronwyn Rossingh • Jade Maloney • Eunice Sotelo Evaluating system change: Exploring how project innovations transform business as usual C2.4Natalie Fisher • Julian King • Adrian Field

1:30pm AEST

MEL in fragile and conflict-affected settings: Remote monitoring of the aid program in Afghanistan C2.4Peter Ellis • Ulla Keech-Marx • Sarah Ransom Participatory Action Research - An approach for evaluators to discover and celebrate community strengths C2.5Mia Bromley • Sharon Babyack • Belinda Gibb • Doyen Radcliffe Peer Assessment as a step toward professionalisation C2.1Lee-Anne Molony • Sue Leahy • Delyth Lloyd • Professor Helen Simons FAcSS, FRSA Unpacking the complex boxes C2.3Mathea Roorda • Jo Farmer Unboxing the Inquiry - the Independent Inquiry into the Australian Public Service and its implications for evaluation Pyrmont TheatreSusan Garner • John Stoney • Mary Welsh • Alexandra Ellinson • Andrew Hawkins Disrupting power dynamics and bringing diverse voices to evaluation C2.2Karen Fisher • Jade Maloney

1:35pm AEST

Personality preferences - Implications for influencing evaluation design and utilisation C2.6Duncan Rintoul • Eve Barboza

1:40pm AEST

A live unboxing: The evaluation capacity building role C2.6Duncan Rintoul • Liam Downing

1:45pm AEST

Evolving from academic researcher to evaluator C2.6Duncan Rintoul • Natalia Krzyzaniak

1:50pm AEST

Getting past the imposter syndrome: you don't have to be an expert to help build evaluation capacity in your organisation. C2.6Duncan Rintoul • Margaret Moon

2:00pm AEST

The dance of evaluation: Engaging stakeholders to develop an evaluation framework across a highly diverse training organisation C2.6Duncan Rintoul • Racheal Norris • Linda Klein Exploring 'beyond the box': Applying implementation theory to evaluate a quality improvement project in Aboriginal and Torres Strait Islander primary health care C2.4Peter Ellis • Alison Laycock

2:15pm AEST

Aboriginal engagement, Aboriginal evaluation: Owning an evaluation through comprehensive co-design. C2.5Mia Bromley • Lisa Jackson Pulver • Tosh Kelly

2:30pm AEST

Unpacking the competencies - among commissioners, managers and evaluators Pyrmont TheatreAmy Gullickson • Jane Davidson • Sue Leahy • Delyth Lloyd Assessing achievements in implementing place-based initiatives - unboxing the assessment process C2.3Mathea Roorda • Patricia O'Connor • Greer Edsall Operationalising systems-thinking approaches to evaluating health system innovations: The example of HealthPathways Sydney C2.6Duncan Rintoul • Carmen Huckel Schneider • Sarah Norris Co-designing a place-based evaluation C2.4Peter Ellis • Roxanne Bainbridge • Robyn Bailey Buddhist Evaluation: Thinking outside the box of Western-derived methods C2.2Karen Fisher • Kathryn Dinh This presentation is now in Pyrmont C2.1Lee-Anne Molony • Amy Gullickson • Sue Leahy • Delyth Lloyd

3:00pm AEST

Closing plenary: Evaluation, un-boxed Pyrmont TheatreJade Maloney • Jane Davidson • David Fetterman • Gary VanLandingham • Kiri Parata • Gill Westhorp • Jo Farmer • Ben Barnes