Review of Evaluation: An Integrated Framework for Understanding, Guiding, and Improving Policies and Programs (Hardcover)

This book serves two purposes.It is a comprehensive text on evaluation aimed at both practitioners and academics, but most importantly, it is a treatise aimed at introducing a new evaluation framework.It is a textbook with a point of view.The authors begin with the premise that the fundamental purpose of evaluation is social betterment, which is "...the reduction or prevention of social problems, the improvement of social conditions, and the alleviation of human suffering." From these roots, they build a new `realistic' evaluation framework.Although aimed primarily at public and non-profit organizations, many of the lessons can be applied in the private sector as well.

Part one examines why one would want to do an evaluation in the first place.The authors purport that evaluation is a fundamental part of the democratic process because it is crucial in informing policy and decision makers about the effectiveness of public policy and programs.The book reviews the four purposes of evaluation (assessment of merit and worth, program and organizational improvement, oversight and compliance, and knowledge development) and introduces the four inquiry modes (description, classification, causal analysis and values inquiry).The authors provide extensive coverage and a critique of the academic debates concerning purposes, modes and methodology.This leads to the proposal of a realistic philosophy, which aims to move beyond traditional paradigm silos.The authors argue that by focusing on the ultimate goal of social betterment and by seeking to surface underlying values, it is possible to follow a path that tailors methodology to intended purpose.

Part two covers evaluation planning and begins the practical application part of the book.Different evaluation purposes become paramount and are more aptly suited, depending on the environment (stable, competitive, shifts in funding or new policy/program).Choosing appropriate methodology and evaluation extensiveness (i.e. quality) is aided by an understanding of primary and secondary evaluation purposes; the book provides decision-making matrices as well as many examples and references.The authors expand on their notion of a `common-sense realistic' philosophy and provide an extensive overview of the supporting principles.It is a philosophy underlined by the notion of evaluation as `assisted sensemaking' that aims to build upon and extend natural human perceptual processes.In practice, it is flexible, antiformalist and rejects the fact-value and qualitative-quantitative dichotomies.In short, it aims to do what works in a given situation and contributes the most to social betterment.

Part three provides extensive detail on the four inquiry modes (description, classification, causal analysis and values inquiry).Each chapter provides a complete overview:detailed arguments about how the selected mode can be used to support the four evaluation purposes, examples of specific evaluation methodology, interactions, notable caveats and pitfalls and an overview of critical opinion.The sections on classification and causal analysis are especially extensive, full of detailed methodology and references to external sources.The authors expand on the notion of how values inquiry can be critical in a complementary role with other modes.

The authors conclude with a statement that the field of evaluation is "...moving towards yet another rite of passage." They argue that evaluators need "...to take their proper place in the policy community"and they must become "...shameless in broadly spreading their findings...." They make a final argument in support of their realistic philosophy.

The book is often dense with citations, making for difficult reading at times.In places, especially in part one, the level of detail is far beyond that needed by the average practitioner.However, this would seem to suit the academic audience, who would find the sections devoted to methodology (aimed at practitioners) unnecessary.It seems a happy compromise.Name and subject indexes facilitate use of the book as a reference text.A thorough bibliography points the reader to external sources.It is a text thoroughly worth the attention of anyone interested in the field of evaluation.



Click Here to see more reviews about: Evaluation: An Integrated Framework for Understanding, Guiding, and Improving Policies and Programs (Hardcover)