aes19 International Evaluation Conference

John Owen (The University of Melbourne), Rick Cummings (Murdoch University)

Purpose. To identify different meanings of theory as they have emerged within the evaluation discipline over time and through this show how relevant evaluation theory can enhance the quality of evaluation practice.

Argument. The notion of theory can be a mystery, especially to neophyte evaluators. This is not surprising as there is no one meaning assigned to evaluation theory; we have identified four such meanings in the literature: (1) Scriven/Fournier's basic theory (judgment of program worth) (2) Bennett/Chen's program theory (logic), (3) Shadish's theories of action of significant evaluators (eg Carol Weiss), and (4) 'funded knowledge', social theories or meta-analyses now known as best practice reviews in a field of knowledge, (eg staff development). Practising evaluators need to be mindfully clear about each of these theory types and distinctions, and to understand how they have influenced and advanced the development of evaluation as a discipline.

Implications for Practice. We believe that the quality of evaluation will be enhanced if evaluators are in a position to consider knowledge and concepts that arise from these theories when scoping evaluation work; and to incorporate them into their research designs, and in the dissemination of findings to key audiences.

Session Format. A panel of AES Fellows will provide examples of how the use of theory has contributed to a study in which they have been the principal evaluator. There will be opportunities for other Fellows to comment, and for the audience to pose questions and/or contribute examples that illustrate the advantages of incorporating theory into evaluation designs.

Conclusion. The incorporation of theory in an evaluation is a sign that this area of knowledge can be regarded as a discipline, as distinct from a craft. An important message is that aspiring evaluators need to participate in formal or informal training programs which offer opportunities to come to grips with the salience of evaluation theory.