Format

T11P04. Taking Stock of Evaluation Methods for Public Policy

Methodologies
PANEL CHAIR(S)
A. KEMMERLING
Main chair
T. BODENSTEIN
Second chair
CATEGORISATION
POLICY TOPIC
Methodologies
SECTOR
KEYWORDS
GENERAL OBJECTIVES, RESEARCH QUESTIONS AND SCIENTIFIC RELEVANCE

The idea of this panel is to bring together papers on evaluation methods. In recent years, evaluation has become a kind of industry for practitioners and a field of study in many domains of public policymaking. At the same time, evaluation methods are rapidly evolving. However, these discussions are often in other disciplines than public policy as scientific discipline. Moreover, while quantitative methodologists have created a type of 'gold standard' usually based on some method of causal identification, qualitative methods of evaluation go in all types of directions: process tracing, contribution analysis, realist evaluation, participatory approaches to name but a few. In this panel we would like to bring together contributions in this area and discuss trends, controversies and applications of evaluation methods in public policymaking. We would like to take stock of methods, compare their usage, and understand what types of methods have become more popular over time. We would also like to understand better when and why certain methods are chosen for what type of policy issues. Finally, we are interested in understanding whether there is a 'practitioner/ academic' divide in the type of methods discussed. As for the latter, we would also like to invite contributions from 'practitioners' in the field and those who work in institutions that effectively straddle academic and applied forms of evaluation.

 

CALL FOR PAPERS

The idea of this panel is to bring together papers on evaluation methods. In recent years, evaluation has become a kind of industry for practitioners and a field of study in many domains of public policymaking. At the same time, evaluation methods are rapidly evolving. However, these discussions are often in other disciplines than public policy as scientific discipline. What contributions can public policy research bring to evaluation, and what can public policy research learn from new evaluation methods? More specifically, while quantitative methodologists have created a type of 'gold standard' usually based on some method of causal identification, qualitative methods of evaluation go in all types of directions: process tracing, contribution analysis, realist evaluation, participatory approaches to name but a few. The panel should help bringing these approaches together in a systematic way.

 

In this panel, we seek contributions that trends, controversies and applications of evaluation methods in public policymaking. We particularly invite contributions about qualitative methods in public policy analysis. Interesting papers would take stock of existing methods, do 'research on evaluation', or discuss trends in methods from a critical perspective. Papers on evidence-based policymaking are also interesting especially if they have a clear focus on evaluation methods. Applications could range from health policies and the recent COVID-19 discussion to other classic fields of evaluation such as development. Papers could also discuss the application of specific methods on a particular policy problem or case as long as the papers contain some discussion as to whether the insights would also travel to other applications. Finally, we also invite contributions discussing the 'practitioner/ academic' divide: is there a difference between how people doing (quantatitive or qualitative) methods and those who do academic research on the topic? We therefore also appreciate submissions from practitioners in the field of applied evaluation.