This event has ended. Visit the official site or create your own event on Sched.
Conference registrations have closed | Presenter and chair briefing notes and other information available here.
Self-guided historical walking tours: These walking tours are accessed via the Sydney Culture Walks app and highlight Aboriginal history, heritage & culture: https://www.sydneyculturewalksapp.com/barani-redfern 
Back To Schedule
Monday, September 16 • 2:30pm - 3:00pm
Machine-assisted qualitative analysis in Evaluation

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Jasper Odgers (ARTD Consultants), Klas Johansson (ARTD Consultants)

We will tell you how Natural Language Processing (NLP) can be used to reduce time and costs associated with qualitative analysis by up to 75%. Our experience with this technology will allow for a vibrant discussion about the real benefits of machine-assisted qualitative analysis. The ethics, limitations and future directions of the technology will also be discussed.

This technology can be used to analyse large amounts of unstructured text data in a way that reduces the resource burden of analysing large qualitative datasets. By using techniques such as topic modelling and keyword identification, analysts can interpret the contents of large datasets in a fraction of the time it would take to do manually. Improvements in this technology will have profound impacts on the practice of evaluation as the use of the technology becomes more widespread. Much of the analysis work that was a large part of an evaluator’s job will be able to be done quickly and easily by machine-assisted technology; however, we focus on the continued need for humans to be involved throughout the analysis process. NLP is also adept at identifying themes from data which may not be apparent to human analysts. Integrating this technology with ongoing monitoring data means that evaluators don’t need to constantly analyse incoming data but can easily keep up to date and concentrate on interpretation and innovative reporting.

As the technology improves and becomes more widespread it is inevitable that it will have an impact on how evaluations are designed and therefore the theory which underpins them.

avatar for George Argyrous

George Argyrous

Research and evaluation manager, Institute for Public Policy and Governance, UTS

avatar for Georgia Marett

Georgia Marett

Consultant, ARTD Consultants
I have many and varied interests when it comes to evaluation. I work across a variety of sectors including education, health and disability. I have a masters in Behavioural Economics so I am always keen to talk about the latest innovations in this space. I also have an interest in... Read More →
avatar for Jasper Odgers

Jasper Odgers

Manager, ARTD Consultants
Jasper has been studying and working in quantitative research and data analysis for the past eight years. He manages online surveys, quantitative data analysis and data visualisation for all of ARTD’s reporting. He has recently managed several stakeholder surveys for NSW Government... Read More →
avatar for David Wakelin

David Wakelin

Senior Consultant, ARTD Consultants
I am a keen data analyst with a passion for data visualisation. I've been working on a wide range of projects lately and have seen immense value in being able to tell stories with data I am working with.

Monday September 16, 2019 2:30pm - 3:00pm AEST
Pyrmont Theatre