CATEGORISATION
KEYWORDS
GENERAL OBJECTIVES, RESEARCH QUESTIONS AND SCIENTIFIC RELEVANCE
This workshop combines "The merits and demerits of the third paradigm in policy implementation research and beyond: assessment and prospects" and "Learning about implementation through realistic evaluation and design recovery case studies" constituting this new working group.
Learning about implementation through realistic evaluation and design recovery case studies:
Ever since public policies became systematic objects of scientific research, by the middle of the 20th Century, the investigation of what happened between design and outcomes, of how did a policy worked (or not) has occupied a central interest in both fields (Pressman and Wildavsky). Implementation studies, single or multiple, were the cradle of policy analysis and public administration research (Lasswell) and, as we shall argue, should continue to be their meeting point. Yet policy analysis and public administration have often failed to share or interact.
The label “implementation” is more often than not found within the field of policy analysis. But there is good reason to think this is because implementation is often considered a dependent variable in research projects, both because it is naturally uncomfortable to investigate, and because linking design with outcome is perhaps more dramatic and thus fashionable. Studies that provide in-depth understanding of such link is uncommon.
On the public administration side, specialization made implementation studies the exclusive playground of evaluation. A myriad of highly specific tools to frame and study policy, with a legitimate pretention to be “scientific”, are used to answer the classical normative, often prescriptive questions of the field. But evaluations, as it is been known for some time (McLaughlin), generally privilege the study of outcomes, relating them directly to design, and failing to grasp the realization process explaining the links.
In this proposed workshop we seek to combine two traditions that, we shall argue, could greatly benefit of dialogue, and eventually crossings over: public management (when possible, design-oriented) case studies and (when possible, process-oriented) realistic evaluations.
Case studies derive from a commonsense way to draw lessons from experience. But, as suggested by Ragin or Yin, they grew to become a sophisticated tool in political science, as they part from the celebration and diffusion of best practices toward in-depth, qualitative knowledge on the “how” of phenomena. Recently, Michael’s Barzelay design-oriented case study methods provide a way forward for this perspective.
Embedded in a venerable tradition of understanding public organizations as purposeful phenomena –artificial organisms, or “artifacts”– Barzelay draws a genealogy aligning Herbert Simon’s artificial organisms, Henry Mintzberg’s organizational configurations, Eugene Bardach’s smart practices and Mark Moore’s public-value oriented strategic management. The blend produced a compelling array of “questions to asks” and “answers to find” when understanding the role of design in why and how public management artifacts –organizations, campaigns, systems— became “working phenomena” or “functioning wholes”.
Realistic evaluation, as in Pawson and Tilley, is an applied form of scientific research aimed at identifying “the worth and the value” of policy, and to inform it to decision-makers and practitioners. It should seek -at least that is the way it is conceptually presented- the best method for each peculiar circumstance, framing it as a program and condensing results in terms of mechanisms-context-outcomes popularly known today as “theory of change”. Implementation (Love) or process evaluation studies aim at identifying and isolating the causal power of implementation issues as something distinct from design issues.
The point of choosing realistic evaluation as a “partner” to design-oriented case studies is their outstanding sharing (a) the importance of theory-based phenomena analysis (as opposed to solely evidence-based analysis) and (b) the backbone formula for explanation: mechanisms + context = outcome, and (c) the goal of producing “transferable” detailed answers to the questions about why programs worked, for whom, and under what circumstances.
The merits and demerits of the third paradigm in policy implementation research and beyond: assessment and prospects
This workshop provides an arena to discuss and assess the merits and demerits of the so-called third generation of policy implementation research. Policy implementation is a long-standing concern in public policy and administration research. Over the decades, the study of implementation dynamics, the main implementation arrangements and role of implementation in the policy-making process has continued to attract the attention of policy analysts and public administration scholars (see, among others: Sager and Gofen 2022; Casula and Steinebach 2023; Knill et al. 2023). Current scholarship is increasingly interested in understanding the link between implementation and other stages of the policy process (in particular the dynamic policy design/implementation link and its effects in terms of problem solution), as well as in advanced research designs including neighbouring disciplines such as economics and organization studies.
Goggin famously divided the evolution of policy implementation research in three generations. The first generation emerged during the 1970s and was characterized by an explorative, and a-theoretical character, a single case focus, and the use of qualitative methods and approaches; the second generation emerged during the 1980s and it had the merits of proposing the first analytical-theoretical frameworks for the study of policy implementation. Goggin was the promoter of the third-generation research paradigm. In the scale between relevance and rigor, Goggin clearly stood at the rigor-pole. His “third paradigm” claims the rigorous research designs considered insufficient in the first two generations. Goggin et al. (1990, 19) defined the main trait of this third-generation research paradigm in the following way:
- Key concepts and related variables must be clearly defined and operationalized;
- Hypotheses derived from theoretical constructs should guide empirical analysis;
- More use of statistical analysis using quantitative data to supplement qualitative analysis;
- More comparison across different units of analysis within the same policy sector;
- More comparison across different policy sectors;
- More longitudinal research design (i.e., research time frame of at least 5 to 10 years).
After more than 30 years, implementation studies following the third-generation research paradigm clearly highlighted the difficulty (and perhaps impossibility) of arriving at a shared theory of implementation. According to Winter (2012), in fact, implementation studies will improve by: (1) Accepting theoretical diversity rather than looking for one common theoretical framework; (2) Developing and testing partial theories and hypotheses rather than trying to reach for utopia in constructing a general implementation theory.
The aim of this workshop is to provide an assessment of how implementation studies still follow the claims of the third paradigm, how they have changed, and in which direction they are heading today.
The aims are twofold: 1) to reflect on the potentials and pitfalls of the key elements of this paradigm (Goggin 1986; Goggin et al. 1990) when doing implementation research; and 2) to discuss how policy implementation can improve (if it needs to improve) towards overcoming the limits of the third generation research paradigm.
To achieve these aims, we will provide an arena to discuss and assess the merits and demerits of the so-called third generation of policy implementation research requesting analytic rigour in the study of implementation when it comes to theory and research design (Goggin et al. 1990, 19). Doing so, this workshop will be an opportunity to present and discuss contributions able, from a theoretical, analytical or empirical point of view, to show show the study of different implementation dynamics in multiple institutional and organizational setting is changing in modern societies within the third-generation research paradigm, and beyond.
CALL FOR PAPERS
Call for papers
Beside personal invitations to be sent to many colleagues, the workshop will welcome academic, pracademics, professional and students that commit to the rule of submitting fully written documents at an adequate date for collective reading and assessment, taking the following three formats:
1) Public policy / public organizations / public initiatives case studies, single or multiple, in-depth or comparative, where the implementation / management dimensions are a/the central feature of research.
2) Public policy / public organizations / public initiatives fully-developed / in-progress summative / process evaluations or evaluation designs that are centered in (or include an explicit interest in) what links impact to design.
3) Methodological and theoretical discussions on how to design, conduct and/or assess implementation case studies and evaluations, or studies discussing the state of these arts.
In addition to this call, a number of personal invitations have been sent to colleagues actively involved in the related fields of work, in many universities around the world.
ABSTRACT
Implementation studies is a general label for many different approaches, all sharing the interest of considering the critical relevance of the "how", beside the what and the why, in public administration and policy. This workshp intends to provide a space for exchange to different traditions in implementation studies, with special regard to case studies oriented to design recovery and realistic evaluation. We will be delighted to bring together different strains of work into dialogue for mutual learning.
BIOGRAPHICAL PRESENTATION
Michael Barzelay has is Professor of Public Management at the London School of Economics and Political Science since 1995. Professor Barzelay’s academic career included an undergraduate degree at Stanford University, and graduate work at Yale University, where he first earned a Masters’ in Public and Private Management (MPPM) and then a PhD in Political Science, under the supervision of Charles E. Lindblom. He started teaching and researching at Harvard’s John F. Kennedy School of Government, then at University of California, Berkeley. Throughout the past 20 years, Professor Barzelay has been working on research to expand professional knowledge about public organizations and professional practice within them. Milestones of this route have been Preparing for the Future: Strategic Planning in the U.S. Air Force, which received the Louis Brownlow Book Award from the US National Academy of Public Administration; “Learning from Second-hand Experience: Methodology for Extrapolation-Oriented Case Research”; and Public Management as a Design-Oriented Professional Discipline, published by Edward Elgar in September 2019, a manifesto book presenting a full-fledged new design for public management as a professional discipline. Professor Barzelay has served in editorial roles for leading scholarly journals that cover public management: Governance: An International Journal of Policy, Administration, and Institutions, and the International Public Management Journal. He is presently a co-editor of Perspectives on Public Management and Governance, published by the Public Management Research Association (PMRA) and serves on the editorial boards of Policy Design and Practice and Evaluation and Program Planning. Professor Barzelay was awarded a Doctor Honoris Causa in Political Science by the University of St. Gallen, Switzerland, for his outstanding research in the field of public management and governance, in particular his contributions to theory development and the internationalization of the field as well as his explicit interdisciplinary approach.
Luciano Andrenacci is a Political Scientist specialized in Public Policy and Administration and Citizenship Studies (BD in the Universidad Nacional de Rosario, Argentina, 1991; MD and PhD in the Université Sorbonne-Nouvelle / Paris III, France, 1998). He is an Associate Professor at the Escuela de Política y Gobierno of the Universidad Nacional de San Martín, Buenos Aires, where he serves as Director of the Postgraduate Program in Public Policy Planning and Evaluation and Co-Director of the State, Public Policy and Public Administration Research Program. He also holds responsibilities at the Argentine chapter of the Facultad Latinoamericana de Ciencias Sociales (FLACSO), where he is the Director of the Postgraduate Program in Social Policy, and the Academic Coordination of the Postgraduate Program in Human Development. He has been an active academic and practitioner since 1998, conducting multiple research projects and authoring widely read publications. Along his professional career, he has been Project Coordinator and Consultant for different agencies of the United Nations System; the Interamerican Development Bank; and the Governments of Argentina (national and subnational levels), Guatemala, Honduras, Haiti and Peru. He is teaching and has taught in university postgraduate programmes in Argentina, Chile, Colombia, New Zealand, Peru, Spain, the United Kingdom, Uruguay and the USA.
CO-AUTHORS
ABSTRACT
There is increasing awareness that public policy design, development and implementation should contribute to the public good (Junginger, 2017), contributing to “public value” (Bojang, 2022), including enabling trust and legitimacy of the agencies involved (Talbot, 2008). Developing partnerships between agencies and service users around design, development and implementation is central to this (Narbutaite Aflaki, 2021). Co-design, co-creation, and co-production have moved from vague, substitutable terms to definitions that describe relations between the institution and its service users (Vargas et al., 2022). However, attempts to implement full engagement of the public struggle at scale, and the reasons for this are unclear (Van Gestel, 2021).
Increasing public value has been connected to epistemic justice (Liabo et al., 2022). This recent advance in philosophical ethics might improve trust and legitimacy in agencies as it seeks to establish fairness under conditions of information asymmetry (Akerlof, 1970). This way, values can be maintained even when one side can privilege their information with respect to another (Radoilska & Foreman, 2023), and potentially unfair discounting can be avoided.
Van Gestel (2019) described conflicts of policies and values adversely affecting the adoption of collaborative approaches such as co-creation. A bureaucracy focused on resource preservation (Niskanen, 2017) might be unresponsive to need if not sufficiently well expressed or advocated for, but the current solution of “street-level bureaucracy” (Cohen, 2018) is arguably a form of epistemic injustice, as the service user becomes a supplicant when there is a policy granting a claim right. Epistemic injustice bedevils mental health (Carel & Kidd, 2014) for service users but also professionals. At scale, mental health research is only 6% of the United Kingdom’s total health research budget by value (UK Clinical Research Collaboration, 2018) when it accounts for 13% of disability-adjusted life years (Vigo et al., 2016).
I will present the design and preliminary results from an action research project, using philosophical techniques to abstract, explicate and describe updating of concepts used by different actors co-creating perinatal services with their users to see if this improves and stabilises co-creation of service delivery across organisations and scales in the UK NHS.
In the UK, perinatal services have successfully collaborated with service users of all kinds in driving development, using networks of statutory & professional bodies in collaboration with charities to influence policymakers. Perinatal services also have active experts by experience—patients who develop expertise in recommending how services can be optimised for their personal needs and values and are embedded in national and local services. They are included in “local offers” to communities (Foreman, 2016a), which could function as a protective policy instrument for them, unlike other preschool services (Foreman, 2016b). Output from a philosophical conceptual analysis comparing local and national levels will be aggregated and input into Royal College of Psychiatrists’ guidance, which is influential across scale. This guidance will be evaluated by reviewing the convergence of attitudes, intentions & perceptions of epistemic justice among service users, clinicians and policymakers.
CO-AUTHORS
ABSTRACT
Worldwide, public environmental agencies play central roles in formulating and implementing environmental policy. Meanwhile, vast scholarship spanning comparative politics, public administration, and other political science sub-fields has demonstrated the profound influence that institutional features of public agencies can have on their performance. Yet we know little about how these features vary across countries, let alone what explains this variation. This makes it difficult to understand the role that public agency design plays in environmental outcomes and inhibits efforts to strengthen environmental state capacity where it is weak. Synthesizing multiple secondary datasets, I document substantial variation in a range of institutional features – including measures of agency autonomy, manager characteristics, the existence of various agency functions, and citizen engagement – for 42 national environmental agencies spanning six continents. I then explore potential explanations for this variation, including characteristics of national political systems, levels of economic development, and international donor activity. Finally, I examine associations between institutional features and a range of environmental measures related to greenhouse gas emissions, local pollution, and biodiversity. Altogether, this paper contributes one of the first systematic, cross-national comparisons of public environmental agencies. In doing so, it provides a preliminary understanding of the ways in which these organizations differ, why, and to what end, laying groundwork for more detailed studies on this topic and enhancing our understanding of the role that public agency reform may play in ameliorating pressing environmental crises.
CO-AUTHORS
ABSTRACT
In this paper, we draw on ideas from the “third-generation research paradigm” of policy implementation to study the implementation of India’s Forest Rights Act (FRA). Among other provisions, the FRA provides a framework to recognize community forest rights (CFRs) of communities having traditionally accessed forest land in their villages (Government of India, 2008). De jure recognition of CFRs is expected to allow communities to practice democratic forest management and conservation. The implementation structure emphasizes the role of district-level actors, particularly the District Collector (DC), who chairs the District Level Committee (DLC) tasked with accepting and recognizing claims. In contrast to most empirical work on the topic that has examined the issue cross-sectionally, we adopt a longitudinal research design. Although we had picked an entire region consisting of seven key districts (Vidarbha) because of their relatively better track record (Sahu, 2020), we describe the data challenges that led us to study the progress of CFRs claim recognition in a single district (Gadchiroli) over 13 years. We focus on an extreme case for theory building (Eisenhardt & Graebner, 2007). We analyze district-level quantitative and qualitative data on CFRs claim receipts from communities, their recognition, the meeting minutes, other documents of the DLC, and interviews of relevant key actors from the local government and the society. Reaffirming the need to study implementation longitudinally, we find that CFRs claim receipts and recognition have varied across eight DCs of the DLC during the study period, with only a few DCs responsible for much of the perceived “success” as measured by broad summative measures of recognition. Using more granular data to study implementation, we find that the nature of produced outputs substantively varied even within the two prominent implementation spurts. Drawing inductively from case studies of these two spurts, we find the DCs adopting significantly different approaches to implementing what otherwise construed the same policy and drawing on different sources of power and authority, even while fulfilling the same role. The case studies lead us to theoretically examine the leadership styles (Van Wart, 2011) adopted by the DCs. In doing so, we bring the leadership and policy implementation literature into productive conversation with each other. Even as we find merit in some of the provocations of the “third-generation research paradigm”, particularly the need to study implementation longitudinally as well as engage more rigorously with theoretical constructs; we remain skeptical of the possibility of the emergence of a universal theory of implementation across the wide range of contexts in which policy implementation comes to occur in practice. Instead, we argue that following the policy implementation story over time with a framework that is grounded in theory but seeking new constructs and concepts that adapt to the contingent nature of policy implementation might help us both broaden as well as deepen our understanding.
References:
Eisenhardt, K. M., & Graebner, M. E. (2007). Theory Building from Cases: Opportunities and Challenges. Academy of Management Journal, 25-32.
Government of India. (2008). The Scheduled Tribes and Other Traditional Forest Dwellers (Recognition of Forest Rights) Rules, 2008. New Delhi: Ministry of Tribal Affairs.
Sahu, G. (2020). Implementation of Community Forest Rights: Experiences in the Vidarbha Region of Maharashtra. Economic and Political Weekly, 46-52.
Van Wart, M. (2011). Dynamics of Leadership in Public Service: Theory and Practice. Armonk, New York: M.E. Sharpe.
CO-AUTHORS
ABSTRACT
Prevention and control of food fraud is now an emerging policy goal for different governments. Food fraud is intentionally adulterating food intended for personal gain and deceiving consumers. Adulterated food continues to be a significant threat to Egypt's food sector because of its negative impact on the food industry's reputation. Additionally, it jeopardizes the success of initiatives to increase investment, tourism, and exports in Egypt. Addressing fraud is, by definition, the most challenging food control system form because it directly addresses a personal stake benefiting from fraud behavior. In light of the importance of food fraud prevention as an emerging policy, this research aims to answer the question: How is the government of Egypt’s policy working to prevent food fraud, and to what extent is it effective? The study primarily understands food fraud policies in Egypt, explores the current legal and regulatory framework used to deal with food fraud violations in Egypt, and covers the entire food production chain "from farm to fork.” The research also explores the main challenges facing the government to mitigate the problem, the recent and ongoing reforms that the government did to overcome the obstacles, and the new reforms that are happening or need to happen to reduce the problem. A qualitative approach is adopted. Thirteen in-depth interviews were conducted with different food fraud prevention policymakers and implementers from the competent authorities involved. The analysis revealed specific challenges and gaps in the food fraud laws and regulations, food fraud control management system, inspection services, laboratory services, education, and communication. In conclusion, the research introduces a comprehensive set of recommendations that Egypt can apply to strengthen its legal and regulatory framework and improve its policy implementation to fight food fraud in identified areas, including the updating of food fraud laws and regulations, strengthening the food fraud control management system, promoting inspection services, expanding laboratory services, and promoting information, education, and communication.
CO-AUTHORS
ABSTRACT
This article is to share with researchers and practitioners from different parts of the world the Viet Nam Provincial Governance and Public Administration Performance Index (PAPI), which is a tool to monitor the effectiveness of policy implementation in Viet Nam on an annual basis since 2009. Over its 15 years of development, PAPI has played a unique role in Viet Nam as a mirror reflecting citizens’ assessment of how local governments have delivered on their commitments through the Constitution, laws, regulations, and national policies on aspects that are close to the life, needs, and demands of the Vietnamese people. PAPI’s wealth of quantitative data collected through one-on-one interviews with citizens randomly selected from multi-layered clustering sampling processes, have provided important evidence for the policy making and implementation processes that must involve stakeholders from the grassroots to the central levels in an inclusive and participatory manner. PAPI has also brought together policymakers, practitioners and citizens to dialogues about what the central and local governments need to do more to better serve the Vietnamese people so that no one is left behind in the country’s sustainable development endeavours. With a practitioner's perspective, the author hopes to contribute to the workshop, which speaks directly to the demand of policymakers worldwide that evaluation of policy implementation is essential as it provides evidence to review past performance and to anticipate policy actions moving forward.
I hope to be able to come and present offline at the conference if there is any financial support for part of my travel and acommodation costs.
CO-AUTHORS
ABSTRACT
Over the past decades, three generations of researchers have studied policy implementation with different objectives and methodological approaches. They have identified a vast collection of factors that influence the success or failure of policy implementation. However, a systematic review of the literature that considers how different methodological approaches and implementation settings influence the relative importance of factors in implementation success or failure is missing. Our study addresses this research gap by systematically reviewing 150 empirical articles that examine the factors that influence implementation success and failure. We identify several analytical and contextual dimensions, including research methods, types of instruments, definitions of policy implementation success and failure, policy areas, target groups and geographical contexts. We then classify the influencing factors and analyse their distribution across the identified contextual dimensions, revealing patterns of policy implementation success and failure. In doing so, the paper contributes to a more nuanced understanding of the existing factors influencing policy implementation success and failure in the cross-disciplinary policy implementation literature, thereby contributing to better policy design and ultimately policy implementation success.
CO-AUTHORS
ABSTRACT
Introduced worldwide to address public problems, Policy innovation labs (PILs) are new emergent organizational structures characterized by innovation, collective co-design and experimentation (Wellstead, et al. 2021; Blomkamp, and Lewis 2023). Devoted to ‘user at the center’ approach (e.g., Lewis et al. 2020; Olejniczak et al. 2020; Whicher, and Crick 2019), PILs exemplify policy design processes during which implementation considerations are taken into account. To better understand PILs as an intersection of design and implementation, this study focuses on the responsiveness of European PILs to sustainable development goals (SDGs) and especially on labs’ motivations and practices. Data draws on a unique database of 211 European PILs and specifically on the labs’ websites content as well as on semi-structured interviews with 25 senior PILs’ employees. Preliminary results indicate that PIL responsiveness to the SDGs often demonstrates an internal consistency that reflects an institutional logic, exemplified in the role SDGs play in the lab day-to-day work. Our analysis identified three distinct institutional logics that a lab exemplifies, namely, professional, political and instrumental. The three logics differ in three aspects of the PIL day-to-day work, namely assessment, orientation and evidence-based policymaking. Shifting attention to PILs’ institutional logics provides two main contributions. First, PILs’ current literature emphasizes characteristics, methods, approach, and influence, whereas the institutional logic of a PIL is understudied. Second, linking motivations and practices for PILs’ responsiveness to SDG shifts attention to PILs at the intersection of design and implementation.
Keywords: Policy innovation labs, Institutional logics, Sustainable Development Goals, policy design, implementation
References
Blomkamp, E., & Lewis, J. M. (2023). 10. Magic PILs to cure the ills of public management? The rise of public innovation labs as design-for-policy entrepreneurs. Handbook on Strategic Public Management, 147.
Lewis, J. M., McGann, M., & Blomkamp, E. (2020). When design meets power: Design thinking, public sector innovation and the politics of policymaking. Policy & Politics, 48(1), 111-130.
Olejniczak, K., Borkowska-Waszak, S., Domaradzka-Widła, A., & Park, Y. (2020). Policy labs: the next frontier of policy design and evaluation?. Policy & Politics, 48(1), 89-110.
Wellstead, A. M., Gofen, A., & Carter, A. (2021). Policy innovation lab scholarship: past, present, and the future–Introduction to the special issue on policy innovation labs. Policy Design and Practice, 4(2), 193-211.
Whicher, A., & Crick, T. (2019). Co-design, evaluation and the Northern Ireland innovation lab. Public Money & Management, 39(4), 290-299.
CO-AUTHORS
ABSTRACT
Electricity meters are one of the most ubiquitous objects associated with the electricity supply infrastructure. Meters are the primary artifact of governance for the utilities and can also be equated to the measuring scale used by the traders and shopkeepers to trade their goods. Further, with newer functionalities they are also acting as silent digital watchdogs that keep a constant vigil on the system and the consumers. The electricity meter has also been an object of intense experimentation worldwide and has witnessed enormous transitions both in its technology and capabilities. This has been primarily driven by the state’s pursuit of disciplining, rationalizing, and ordering the electricity consumers and thereby shielding the infrastructure from the attempts to subvert it. The complexity of electricity measurement makes the electricity bill totally vague and incomprehensible to the consumer. Absence of proper implementation in replacement or Up- gradation of meters might result in policy failure, also any change in the metering policy directly affects millions of consumers.
With the ushering in of Neo-liberal era, legislative and structural reforms were brought in India to improve the health of the electricity sector. These reform efforts were aimed at liberalizing the sector and depoliticizing it, concept of power trading and efforts to introduce competition in the sector. Also, the government introduced schemes like APDRP & IPDS for technology up gradation in the sector. Despite all these efforts the Electricity distribution sector in India has been struggling with inefficiencies, losses and indebtedness, and the results of sectoral reforms and technology up gradation have been ambiguous. This seminar report intends to present a case study of one such policy dealing with the up gradation of metering technology which ended up in arbitrary outcomes, if not in complete failure.
This case study was conducted on the meter replacement/ up gradation policy of the central zone electricity distribution company of the central province of Madhya Pradesh in central India. The distribution company is officially known as the Madhya Pradesh Madhya kshetra vidyut vitaran co ltd (MPMKVVCL) and 16 districts of the state come under it, covering around 20 million populations with more than 3.3 million electricity connections. This case study takes up the case of an area in the city of Bhopal in MP to unpack and discuss the policy and its outcomes. The case study of the policy of Madhya Pradesh’s central zone electricity utility of replacing the existing meters of the high value consumers with the new AMR (Automatic meter reading) combined unit meters discussed, revealed the issues in the top down policy approach that the field staff and consumers faced during its implementation on the ground. Through this the case study also examined whether the goals and objectives set by policymakers actually persist and are realized during and after implementation.
CO-AUTHORS
ABSTRACT
The study examines the Mahatma Gandhi National Fellowship (MGNF), conceived in India as part of the Skills Acquisition and Knowledge Awareness Livelihood Promotion (SANKALP) scheme supported by the World Bank. The MGNF programme was one of the largest "fellowships" carried out by the state-academia praxis involving 581 "fellows" who were deployed into the district administrations of almost all the states and union territories in India. The study argues that the MGNF programme was an innovative intervention not just in terms of its design of involving non-state actors to support the existing street-level bureaucracy but also in producing a new cadre of street-level bureaucrats in the form of these fellows. Given the overarching demographic and institutional challenges, they were groomed to be the catalysts of social change with the primary responsibility of augmenting the state's capacity. A preliminary field examination of the MGNF programme has revealed elements consistent with the street-level bureaucracy theory, following which the study has used the extended case method to examine this programme further through in-depth interviews and secondary data. By investigating the involvement of non-state actors acting as street-level bureaucrats, the study makes a case for extending our understanding of the street-level bureaucracy theory to accommodate newer phenomenon like the fellowships that are carrying out important responsibilities of the state.
Keywords: Developing Countries, Street-Level Bureaucracy, Non-State Actors, Extended Case Method
CO-AUTHORS
ABSTRACT
This paper presents the results of a study on the two-year campaign set up by the State government of Uttar Pradesh, India, to organize a better Kumbh Mela, the largest of all Hindi traditional religious festivals in the state and the country, in 2019. The Prayagraj’s Kumbh Mela of 2019 (hereon, PKM 2019) is credited to have received more than 200 million visitors in about 5 weeks, and perhaps up to 240 million according to official sources. It was arguably one of the biggest human gatherings on the planet to that date, and presumably will remain so until the next version takes place in 2025.
Relative to the context, the set goals and the multiple problems endemic to previous versions of the festival, organizational challenges and political stakes were extremely high. But everything rolled exceeding expectations, even for critical observers. Although PKM 2019’s features and outcomes have been studied in different fields, the publicly available research does not engage directly with the traditions of public administration in general and public management in particular, and their double-pronged, scientific and professional interest. This study presents a plausible explanation of the campaign’s success and the way this is related to its design and operationalization, based in a post-event reconstruction of the case through field research.
The research material was analyzed with what will be called an ‘artifactual perspective’. Such a perspective views human organizations and initiatives as artificial organisms (Simon, 1996) or purposeful phenomena (Barzelay, 2019), “artifacts” that need to solve socio-political and material reality conundrums through their internal (organizational) and external (contextual) interfaces. These interfaces work through a variety of systems and mechanisms designed to align or fit outcomes to purpose, and managed throughout implementation to provide their intended results in the limited conditions of visibility and operationality that characterize social agency. Mixed methods linked to public administration’s heterogeneous epistemic traditions are usually the best options for such a treatment (Riccucci, 2010; Barzelay et al, 2022).
Cases thus treated have a double value for the field of public administration. Beside deserving the production of evidence-based hypotheses aiming to establish causality for communities of scientific interest, they are fertile sources of hypotheses on the value of its circumstances and features as precedent for communities of professional interest (Bardach, 1994; Barzelay, 2007).
CO-AUTHORS
ABSTRACT
Governments continuously face new challenges that result in policy expansion. Implicit in this process is the expectation that there will be a bureaucracy with the corresponding capacities to implement the new, expanded, policies. Even when strong policy coalitions succeed in advancing a new issue, policy expansion is not automatically implemented. Rather, implementation is contingent upon the existing policy capacities of the agencies in charge of transforming the new mandate into a reality. Although empirical works frequently pinpoint policy capacities as independent variables, they are often ambiguously defined, let alone operationalized, thus generating partial explanations of implementation outcomes.
In this paper I study with analytic rigor the influence of policy capacities in the implementation process, to provide insights that allow us to reflect on the potentials and pitfalls of the key elements of the third paradigm of policy implementation research. This study responds to the general question of how public sector organizations fill capacity gaps while implementing policy expansion, and specifically to the overlooked process of coping with capacity deficits for policy change in general, and for policy expansion in particular. In this paper I argue that existing policy capacities influence the type of coping strategy that agencies develop to implement the new policy, thus shaping the type of policy expansion.
To develop my argument, I first explore the theoretical assumptions where the literatures on policy implementation and capacities are built. To make sure that I was not excluding any coping strategy deployed by implementing agencies when experiencing capacity deficits, the resulting categories next structure a systematic literature review where I identify instances of limited capacities in implementation processes, and the organizational responses to such shortfalls. I find that shortages of policy capacity render three possible coping strategies: either implementing agencies develop the capacity, they outsource it or they alter the mandate to fit their extant capacities. In order to make empirically observable the coping strategies derived from the theoretical analysis, based on a comparative research design I analyze three cases of policy expansion where implementing agencies face capacity deficits. By analyzing the dynamic nature of capacities and their potential to influence the implementation process with analytical rigor, this paper contributes to the discussion of the merits and demerits of the so-called third generation of policy implementation research.
CO-AUTHORS
ABSTRACT
In London, the University of London and Greater London Authority have founded the London Research and Policy Partnership (LRaPP). Working closely with London Councils, the LRaPP is aimed at promoting greater joint working between London government and London’s academic research community.
As part of a realist evaluation, the author collected extensive ethnographic data (n=127 survey responses, n=96 interviews) to map the existing ecosystem of ad-hoc, informal and short-term knowledge brokerage, between academic researchers and policy professionals London government. This contextualised data provided evidence on various knowledge brokerage practices (and combinations of several): what works, for whom, in which context, to enable long-term academic policy partnerships. The purpose of the realist evaluation was to design a knowledge brokerage service for LRaPP, to enable improved, more strategic, long-term regional academic policy engagement in London. The current landscape of largely, ad-hoc, informal and short-term engagements between academic researchers and London government (GLA, London Councils, London Boroughs) policymakers is not working for London (as well as it could be), and both the policymaking and academic research communities seek to establish and sustain longer-term academic-policy partnerships to address London’s strategic policy challenges.
Realist evaluation offered insights about why academic-policy engagement works, for whom and under what circumstances. In London, both communities are not currently structured in a way that enables knowledge brokerage to be easy, or simple. Most approaches are initiated informally through personal contacts and relationships and are subject to barriers such as funding models / availability, staff turnover, and misalignment between the culture, and ways of working of the two communities. This messy reality takes place within the fast-paced political and policy context of London, and its need to respond to urgent, short-term policy priorities, as well as the capital’s medium to longer term strategic challenges, through innovative, collective solutions, in an equitable and accessible manner.
Building on the realist evaluation, further evaluation data on various knowledge brokerage activities co-ordinated by LRaPP were collected to better understand the link between design of these activities, their implementation, and the impact on knowledge brokerage and academic-policy engagement.
CO-AUTHORS
ABSTRACT
This article addresses two criticisms to implementation studies from the third generation. First, they put too much emphasis on “predicting the type of implementation behavior that is likely to occur in the future” (Goggin et al., 1990:18). In contrast, drawing on seminal studies from the first generation of implementation studies (Cohen et al., 1972; Pressman & Wildavsky, 1984), I argue that non-linearity and unpredictability are two key features of any policy process. Thus, what matters for implementation studies is to differentiate how policy stakeholders react to these unexpected events, and whether their reactions lead to a greater or to a lower fulfillment of policy objectives. Therefore, I will rely on Deborah Stone's (2012) typology of causal mechanisms to also consider unintended consequences of policy actions (i.e. accidental and inadvertent causes) in my analysis.
My second criticism to third generation studies is their binary vision of policy outcomes. Indeed, Goggin et al. (1990: chap. 7) evaluate the failure or success of policy programs based on the initial objectives set by the legislator, without analyzing who benefits the most from policy successes and policy failures. In other words, Goggin et al. (1990) consider that any public policy pursues the common good, and seems to ignore that getting access to legislative arenas and implementation resources is easier for some actors like corporate businesses, than for others like civic and cultural organizations (see Hunter, 1953; Schattschneider, 1975; C. N. Stone, 1989).
To go beyond third generation studies, I draw on two recent studies that have called for more scholarly attention to be paid to a) the various streams of actors and events (Howlett, 2019), and to b) the power dynamics that are shaping policy implementation and its rules in use (Sager & Gofen, 2022). Thus, I apply the Multiple Streams Framework of Kingdon (2003), with a particular attention to the stream of politics. I focus on the impact of two federal policies in the planning policies of two Swiss cities (Zurich and Geneva) over a period of two decades (1999-2020). The first federal policy is the liberalization of network industry of 1999. It was not designed to influence the planning policies at cantonal and municipal levels, but finally had a tremendous impact on them. The second federal policy is the revision of the Federal Spatial Planning Act of 2014 which ask cantons and cities to reduce urban sprawl and foster the densification of urban centers.
My overall hypothesis is that implementing agents are not equal when it comes to reacting to the unexpected. Those benefitting from a long-term vision of planning policies and of more implementation resources will react by creating critical junctures of the three streams (policy, problem and politics) which will foster the implementation of other policy objectives (case of Zurich). In contrast, implementing agents with a short-term vision and less implementation resources will favor solutions aligning with their interests, but undermining the fulfillment of other policy objectives (case of Geneva).
CO-AUTHORS
ABSTRACT
The COVID-19 pandemic has been an unprecedented event that has affected all nations in the world, but its impact has been particularly devastating in countries with high levels of corruption and inefficient management systems, such as Guatemala. The poor management of the pandemic, exacerbated by corruption, has not only aggravated the health crisis but has also left deep social and economic consequences.
The health management of COVID-19 in Guatemala has been the subject of complaints of corruption and lack of transparency. Multiple cases of irregular aid distributions, overvalued purchases and lack of transparency in awards related to the health emergency were reported.
In July 2021, an official from the Ministry of Health was the subject of an investigation for signing a contract with a company without revealing its details. This investigation has not concluded and the new government that took office at the beginning of 2024 found a warehouse full of vaccines that were not used.
In addition, confidentiality agreements were signed with several pharmaceutical companies for the purchase of COVID-19 vaccines, which has raised concerns about transparency in these transactions.
The work consists of an evaluative case study that uses qualitative and quantitative indicators to obtain a comprehensive understanding of the problematic patterns that permeated the management of the pandemic. The first is Public Trust in Health Institutions, which explores the population's perceptions and attitudes towards the effectiveness, transparency and integrity of health institutions during the pandemic.
On the other hand, the Quality and Accessibility of Public Information: how clear, accurate and accessible was the information provided by the government on health measures, pandemic statistics and safety protocols.
Finally, the public and expert perception of the coherence, adequacy and effectiveness of the implemented health policies. The perception of experts offers an evaluation based on technical knowledge, which can validate the scientific solidity and effectiveness of policy responses, or highlight their shortcomings. Integrating these insights into public policy evaluation is crucial to adjust strategies, improve communication, and ensure that interventions are both scientifically sound and socially accepted.
A coherent policy is one that presents a uniform and consistent approach, which is key to fostering public understanding and trust. Adequacy refers to the ability of policies to meet the specific needs of a diverse population and effectively address the health challenges at stake. Effectiveness, for its part, is measured by tangible results in terms of reducing virus transmission, decreasing hospitalization and mortality rates, and achieving broad vaccination coverage.
CO-AUTHORS
ABSTRACT
This study delves into the inherent challenges associated with contemporary megaprojects, highlighting the fallacy rooted in the belief that the mere formulation of these projects is sufficient for their implementation. A concerning trend is observed where the formulation of megaprojects primarily originates from politicians or technicians lacking direct experience in the execution of public works. Over time, this results in seemingly endless constructions, excessively prolonged execution timelines, insurmountable obstacles, and significant cost overruns. These circumstances, in turn, lead to project modifications, partial inaugurations, opposition movements, and substantial financial losses to the public treasury. The hypothesis posited is that the lack of technical leadership represents a critical impediment to the effective implementation of megaprojects. Consequently, the article is grounded in a case study of the Deep Drainage Project in Mexico City, unraveling its network of stakeholders during the implementation phase to concretely illustrate the impact of technical leadership on the execution of the most challenging segments of the project. In concluding terms, the imperative need is underscored for decision-makers to provide effective empowerment to technical professionals responsible for the execution of megaprojects. This proactive measure is presented as an essential requirement to prevent the modification or cancellation of megaprojects with evident potential to contribute significantly to social development and the overall well-being of the population on a significant scale.
CO-AUTHORS
ABSTRACT
Introduction: mHealth programs have proven to increase maternal and child health service uptake. We aimed to elicit the initial program theories towards explaining how, why, for whom and under what health system conditions the MomConnect program works or not.
Method: As the first step of a realist evaluation, we used a multi-method approach to elicit the initial program theory of the MomConnect programme in South Africa. Nuggets of information were obtained from a scoping review, a MomConnect document review and stakeholder interviews to create the initial program theory that explained how the MomConnect program was expected to work. Retroductive theorizing was applied using deductive and inductive analysis methods, in which we obtained relevant evidence and abductive thinking to formulate the initial program theory.
Results: Three program theories were developed corresponding to the policy implementation and user levels of the MomConnect program. At system level our IPTs reveal that stewardship, monitoring and evaluation, political clout plays a major role in the implementation of the MomConnect program by district and facility managers. And this is affected by the lack of buy-in from districts and facilities managers and funders’s side. At providers level the initial program theory reveals that when healthcare providers (HCPs) perceive health system and political support through the MomConnect program, they should improve their healthcare performance and the quality of health service delivery. Likewise, at the users’ s level exposure to the MomConnect program should provide pregnant women and mothers with accurate knowledge when they perceive how easy and valuable the Help Desk is in providing them with needed information. The requisite information should encourage pregnant women and mothers to use the relevant MCH services.
CO-AUTHORS
ABSTRACT
This article provides an assessment of the so-called third generation of implementation research. To do so, we propose a systematic literature review able to show how the main trait of this third-generation research paradigm has been accepted by public policy and public administration scholars doing implementation research after more than 30 years of the famous Gaggin’s definition of this generation of implementation research. Doing so, we are able to provide a final assessment of how implementation studies are currently following the claims of the third paradigm, how they have changes, and in which direction they are heading today. The aim of this presentation is to open the discussion within the workshop about a general reflection on the potential and pitfalls of the key elements of this paradigm when doing implementation research, as well as to better understand if and to what extent implementation studies can improve in the future towards an its possible redefinition or reorientation.
CO-AUTHORS
ABSTRACT
CCL
CO-AUTHORS
ABSTRACT
An Invitation to Recovering Designs in Cases
Michael Barzelay
London School of Economics (LSE)
CO-AUTHORS
ABSTRACT
There is increasing awareness that public policy design, development and implementation should contribute to the public good (Junginger, 2017), contributing to “public value” (Bojang, 2022), including enabling trust and legitimacy of the agencies involved (Talbot, 2008). Developing partnerships between agencies and service users around design, development and implementation is central to this (Narbutaite Aflaki, 2021). Co-design, co-creation, and co-production have moved from vague, substitutable terms to definitions that describe relations between the institution and its service users (Vargas et al., 2022). However, attempts to implement full engagement of the public struggle at scale, and the reasons for this are unclear (Van Gestel, 2021).
Increasing public value has been connected to epistemic justice (Liabo et al., 2022). This recent advance in philosophical ethics might improve trust and legitimacy in agencies as it seeks to establish fairness under conditions of information asymmetry (Akerlof, 1970). This way, values can be maintained even when one side can privilege their information with respect to another (Radoilska & Foreman, 2023), and potentially unfair discounting can be avoided.
Van Gestel (2019) described conflicts of policies and values adversely affecting the adoption of collaborative approaches such as co-creation. A bureaucracy focused on resource preservation (Niskanen, 2017) might be unresponsive to need if not sufficiently well expressed or advocated for, but the current solution of “street-level bureaucracy” (Cohen, 2018) is arguably a form of epistemic injustice, as the service user becomes a supplicant when there is a policy granting a claim right. Epistemic injustice bedevils mental health (Carel & Kidd, 2014) for service users but also professionals. At scale, mental health research is only 6% of the United Kingdom’s total health research budget by value (UK Clinical Research Collaboration, 2018) when it accounts for 13% of disability-adjusted life years (Vigo et al., 2016).
I will present the design and preliminary results from an action research project, using philosophical techniques to abstract, explicate and describe updating of concepts used by different actors co-creating perinatal services with their users to see if this improves and stabilises co-creation of service delivery across organisations and scales in the UK NHS.
In the UK, perinatal services have successfully collaborated with service users of all kinds in driving development, using networks of statutory & professional bodies in collaboration with charities to influence policymakers. Perinatal services also have active experts by experience—patients who develop expertise in recommending how services can be optimised for their personal needs and values and are embedded in national and local services. They are included in “local offers” to communities (Foreman, 2016a), which could function as a protective policy instrument for them, unlike other preschool services (Foreman, 2016b). Output from a philosophical conceptual analysis comparing local and national levels will be aggregated and input into Royal College of Psychiatrists’ guidance, which is influential across scale. This guidance will be evaluated by reviewing the convergence of attitudes, intentions & perceptions of epistemic justice among service users, clinicians and policymakers.
CO-AUTHORS
ABSTRACT
Worldwide, public environmental agencies play central roles in formulating and implementing environmental policy. Meanwhile, vast scholarship spanning comparative politics, public administration, and other political science sub-fields has demonstrated the profound influence that institutional features of public agencies can have on their performance. Yet we know little about how these features vary across countries, let alone what explains this variation. This makes it difficult to understand the role that public agency design plays in environmental outcomes and inhibits efforts to strengthen environmental state capacity where it is weak. Synthesizing multiple secondary datasets, I document substantial variation in a range of institutional features – including measures of agency autonomy, manager characteristics, the existence of various agency functions, and citizen engagement – for 42 national environmental agencies spanning six continents. I then explore potential explanations for this variation, including characteristics of national political systems, levels of economic development, and international donor activity. Finally, I examine associations between institutional features and a range of environmental measures related to greenhouse gas emissions, local pollution, and biodiversity. Altogether, this paper contributes one of the first systematic, cross-national comparisons of public environmental agencies. In doing so, it provides a preliminary understanding of the ways in which these organizations differ, why, and to what end, laying groundwork for more detailed studies on this topic and enhancing our understanding of the role that public agency reform may play in ameliorating pressing environmental crises.
CO-AUTHORS
ABSTRACT
In this paper, we draw on ideas from the “third-generation research paradigm” of policy implementation to study the implementation of India’s Forest Rights Act (FRA). Among other provisions, the FRA provides a framework to recognize community forest rights (CFRs) of communities having traditionally accessed forest land in their villages (Government of India, 2008). De jure recognition of CFRs is expected to allow communities to practice democratic forest management and conservation. The implementation structure emphasizes the role of district-level actors, particularly the District Collector (DC), who chairs the District Level Committee (DLC) tasked with accepting and recognizing claims. In contrast to most empirical work on the topic that has examined the issue cross-sectionally, we adopt a longitudinal research design. Although we had picked an entire region consisting of seven key districts (Vidarbha) because of their relatively better track record (Sahu, 2020), we describe the data challenges that led us to study the progress of CFRs claim recognition in a single district (Gadchiroli) over 13 years. We focus on an extreme case for theory building (Eisenhardt & Graebner, 2007). We analyze district-level quantitative and qualitative data on CFRs claim receipts from communities, their recognition, the meeting minutes, other documents of the DLC, and interviews of relevant key actors from the local government and the society. Reaffirming the need to study implementation longitudinally, we find that CFRs claim receipts and recognition have varied across eight DCs of the DLC during the study period, with only a few DCs responsible for much of the perceived “success” as measured by broad summative measures of recognition. Using more granular data to study implementation, we find that the nature of produced outputs substantively varied even within the two prominent implementation spurts. Drawing inductively from case studies of these two spurts, we find the DCs adopting significantly different approaches to implementing what otherwise construed the same policy and drawing on different sources of power and authority, even while fulfilling the same role. The case studies lead us to theoretically examine the leadership styles (Van Wart, 2011) adopted by the DCs. In doing so, we bring the leadership and policy implementation literature into productive conversation with each other. Even as we find merit in some of the provocations of the “third-generation research paradigm”, particularly the need to study implementation longitudinally as well as engage more rigorously with theoretical constructs; we remain skeptical of the possibility of the emergence of a universal theory of implementation across the wide range of contexts in which policy implementation comes to occur in practice. Instead, we argue that following the policy implementation story over time with a framework that is grounded in theory but seeking new constructs and concepts that adapt to the contingent nature of policy implementation might help us both broaden as well as deepen our understanding.
References:
Eisenhardt, K. M., & Graebner, M. E. (2007). Theory Building from Cases: Opportunities and Challenges. Academy of Management Journal, 25-32.
Government of India. (2008). The Scheduled Tribes and Other Traditional Forest Dwellers (Recognition of Forest Rights) Rules, 2008. New Delhi: Ministry of Tribal Affairs.
Sahu, G. (2020). Implementation of Community Forest Rights: Experiences in the Vidarbha Region of Maharashtra. Economic and Political Weekly, 46-52.
Van Wart, M. (2011). Dynamics of Leadership in Public Service: Theory and Practice. Armonk, New York: M.E. Sharpe.
CO-AUTHORS
ABSTRACT
Prevention and control of food fraud is now an emerging policy goal for different governments. Food fraud is intentionally adulterating food intended for personal gain and deceiving consumers. Adulterated food continues to be a significant threat to Egypt's food sector because of its negative impact on the food industry's reputation. Additionally, it jeopardizes the success of initiatives to increase investment, tourism, and exports in Egypt. Addressing fraud is, by definition, the most challenging food control system form because it directly addresses a personal stake benefiting from fraud behavior. In light of the importance of food fraud prevention as an emerging policy, this research aims to answer the question: How is the government of Egypt’s policy working to prevent food fraud, and to what extent is it effective? The study primarily understands food fraud policies in Egypt, explores the current legal and regulatory framework used to deal with food fraud violations in Egypt, and covers the entire food production chain "from farm to fork.” The research also explores the main challenges facing the government to mitigate the problem, the recent and ongoing reforms that the government did to overcome the obstacles, and the new reforms that are happening or need to happen to reduce the problem. A qualitative approach is adopted. Thirteen in-depth interviews were conducted with different food fraud prevention policymakers and implementers from the competent authorities involved. The analysis revealed specific challenges and gaps in the food fraud laws and regulations, food fraud control management system, inspection services, laboratory services, education, and communication. In conclusion, the research introduces a comprehensive set of recommendations that Egypt can apply to strengthen its legal and regulatory framework and improve its policy implementation to fight food fraud in identified areas, including the updating of food fraud laws and regulations, strengthening the food fraud control management system, promoting inspection services, expanding laboratory services, and promoting information, education, and communication.
CO-AUTHORS
ABSTRACT
This article is to share with researchers and practitioners from different parts of the world the Viet Nam Provincial Governance and Public Administration Performance Index (PAPI), which is a tool to monitor the effectiveness of policy implementation in Viet Nam on an annual basis since 2009. Over its 15 years of development, PAPI has played a unique role in Viet Nam as a mirror reflecting citizens’ assessment of how local governments have delivered on their commitments through the Constitution, laws, regulations, and national policies on aspects that are close to the life, needs, and demands of the Vietnamese people. PAPI’s wealth of quantitative data collected through one-on-one interviews with citizens randomly selected from multi-layered clustering sampling processes, have provided important evidence for the policy making and implementation processes that must involve stakeholders from the grassroots to the central levels in an inclusive and participatory manner. PAPI has also brought together policymakers, practitioners and citizens to dialogues about what the central and local governments need to do more to better serve the Vietnamese people so that no one is left behind in the country’s sustainable development endeavours. With a practitioner's perspective, the author hopes to contribute to the workshop, which speaks directly to the demand of policymakers worldwide that evaluation of policy implementation is essential as it provides evidence to review past performance and to anticipate policy actions moving forward.
I hope to be able to come and present offline at the conference if there is any financial support for part of my travel and acommodation costs.
CO-AUTHORS
ABSTRACT
Over the past decades, three generations of researchers have studied policy implementation with different objectives and methodological approaches. They have identified a vast collection of factors that influence the success or failure of policy implementation. However, a systematic review of the literature that considers how different methodological approaches and implementation settings influence the relative importance of factors in implementation success or failure is missing. Our study addresses this research gap by systematically reviewing 150 empirical articles that examine the factors that influence implementation success and failure. We identify several analytical and contextual dimensions, including research methods, types of instruments, definitions of policy implementation success and failure, policy areas, target groups and geographical contexts. We then classify the influencing factors and analyse their distribution across the identified contextual dimensions, revealing patterns of policy implementation success and failure. In doing so, the paper contributes to a more nuanced understanding of the existing factors influencing policy implementation success and failure in the cross-disciplinary policy implementation literature, thereby contributing to better policy design and ultimately policy implementation success.
CO-AUTHORS
ABSTRACT
Introduced worldwide to address public problems, Policy innovation labs (PILs) are new emergent organizational structures characterized by innovation, collective co-design and experimentation (Wellstead, et al. 2021; Blomkamp, and Lewis 2023). Devoted to ‘user at the center’ approach (e.g., Lewis et al. 2020; Olejniczak et al. 2020; Whicher, and Crick 2019), PILs exemplify policy design processes during which implementation considerations are taken into account. To better understand PILs as an intersection of design and implementation, this study focuses on the responsiveness of European PILs to sustainable development goals (SDGs) and especially on labs’ motivations and practices. Data draws on a unique database of 211 European PILs and specifically on the labs’ websites content as well as on semi-structured interviews with 25 senior PILs’ employees. Preliminary results indicate that PIL responsiveness to the SDGs often demonstrates an internal consistency that reflects an institutional logic, exemplified in the role SDGs play in the lab day-to-day work. Our analysis identified three distinct institutional logics that a lab exemplifies, namely, professional, political and instrumental. The three logics differ in three aspects of the PIL day-to-day work, namely assessment, orientation and evidence-based policymaking. Shifting attention to PILs’ institutional logics provides two main contributions. First, PILs’ current literature emphasizes characteristics, methods, approach, and influence, whereas the institutional logic of a PIL is understudied. Second, linking motivations and practices for PILs’ responsiveness to SDG shifts attention to PILs at the intersection of design and implementation.
Keywords: Policy innovation labs, Institutional logics, Sustainable Development Goals, policy design, implementation
References
Blomkamp, E., & Lewis, J. M. (2023). 10. Magic PILs to cure the ills of public management? The rise of public innovation labs as design-for-policy entrepreneurs. Handbook on Strategic Public Management, 147.
Lewis, J. M., McGann, M., & Blomkamp, E. (2020). When design meets power: Design thinking, public sector innovation and the politics of policymaking. Policy & Politics, 48(1), 111-130.
Olejniczak, K., Borkowska-Waszak, S., Domaradzka-Widła, A., & Park, Y. (2020). Policy labs: the next frontier of policy design and evaluation?. Policy & Politics, 48(1), 89-110.
Wellstead, A. M., Gofen, A., & Carter, A. (2021). Policy innovation lab scholarship: past, present, and the future–Introduction to the special issue on policy innovation labs. Policy Design and Practice, 4(2), 193-211.
Whicher, A., & Crick, T. (2019). Co-design, evaluation and the Northern Ireland innovation lab. Public Money & Management, 39(4), 290-299.
CO-AUTHORS
ABSTRACT
Electricity meters are one of the most ubiquitous objects associated with the electricity supply infrastructure. Meters are the primary artifact of governance for the utilities and can also be equated to the measuring scale used by the traders and shopkeepers to trade their goods. Further, with newer functionalities they are also acting as silent digital watchdogs that keep a constant vigil on the system and the consumers. The electricity meter has also been an object of intense experimentation worldwide and has witnessed enormous transitions both in its technology and capabilities. This has been primarily driven by the state’s pursuit of disciplining, rationalizing, and ordering the electricity consumers and thereby shielding the infrastructure from the attempts to subvert it. The complexity of electricity measurement makes the electricity bill totally vague and incomprehensible to the consumer. Absence of proper implementation in replacement or Up- gradation of meters might result in policy failure, also any change in the metering policy directly affects millions of consumers.
With the ushering in of Neo-liberal era, legislative and structural reforms were brought in India to improve the health of the electricity sector. These reform efforts were aimed at liberalizing the sector and depoliticizing it, concept of power trading and efforts to introduce competition in the sector. Also, the government introduced schemes like APDRP & IPDS for technology up gradation in the sector. Despite all these efforts the Electricity distribution sector in India has been struggling with inefficiencies, losses and indebtedness, and the results of sectoral reforms and technology up gradation have been ambiguous. This seminar report intends to present a case study of one such policy dealing with the up gradation of metering technology which ended up in arbitrary outcomes, if not in complete failure.
This case study was conducted on the meter replacement/ up gradation policy of the central zone electricity distribution company of the central province of Madhya Pradesh in central India. The distribution company is officially known as the Madhya Pradesh Madhya kshetra vidyut vitaran co ltd (MPMKVVCL) and 16 districts of the state come under it, covering around 20 million populations with more than 3.3 million electricity connections. This case study takes up the case of an area in the city of Bhopal in MP to unpack and discuss the policy and its outcomes. The case study of the policy of Madhya Pradesh’s central zone electricity utility of replacing the existing meters of the high value consumers with the new AMR (Automatic meter reading) combined unit meters discussed, revealed the issues in the top down policy approach that the field staff and consumers faced during its implementation on the ground. Through this the case study also examined whether the goals and objectives set by policymakers actually persist and are realized during and after implementation.
CO-AUTHORS
ABSTRACT
The study examines the Mahatma Gandhi National Fellowship (MGNF), conceived in India as part of the Skills Acquisition and Knowledge Awareness Livelihood Promotion (SANKALP) scheme supported by the World Bank. The MGNF programme was one of the largest "fellowships" carried out by the state-academia praxis involving 581 "fellows" who were deployed into the district administrations of almost all the states and union territories in India. The study argues that the MGNF programme was an innovative intervention not just in terms of its design of involving non-state actors to support the existing street-level bureaucracy but also in producing a new cadre of street-level bureaucrats in the form of these fellows. Given the overarching demographic and institutional challenges, they were groomed to be the catalysts of social change with the primary responsibility of augmenting the state's capacity. A preliminary field examination of the MGNF programme has revealed elements consistent with the street-level bureaucracy theory, following which the study has used the extended case method to examine this programme further through in-depth interviews and secondary data. By investigating the involvement of non-state actors acting as street-level bureaucrats, the study makes a case for extending our understanding of the street-level bureaucracy theory to accommodate newer phenomenon like the fellowships that are carrying out important responsibilities of the state.
Keywords: Developing Countries, Street-Level Bureaucracy, Non-State Actors, Extended Case Method
CO-AUTHORS
ABSTRACT
This paper presents the results of a study on the two-year campaign set up by the State government of Uttar Pradesh, India, to organize a better Kumbh Mela, the largest of all Hindi traditional religious festivals in the state and the country, in 2019. The Prayagraj’s Kumbh Mela of 2019 (hereon, PKM 2019) is credited to have received more than 200 million visitors in about 5 weeks, and perhaps up to 240 million according to official sources. It was arguably one of the biggest human gatherings on the planet to that date, and presumably will remain so until the next version takes place in 2025.
Relative to the context, the set goals and the multiple problems endemic to previous versions of the festival, organizational challenges and political stakes were extremely high. But everything rolled exceeding expectations, even for critical observers. Although PKM 2019’s features and outcomes have been studied in different fields, the publicly available research does not engage directly with the traditions of public administration in general and public management in particular, and their double-pronged, scientific and professional interest. This study presents a plausible explanation of the campaign’s success and the way this is related to its design and operationalization, based in a post-event reconstruction of the case through field research.
The research material was analyzed with what will be called an ‘artifactual perspective’. Such a perspective views human organizations and initiatives as artificial organisms (Simon, 1996) or purposeful phenomena (Barzelay, 2019), “artifacts” that need to solve socio-political and material reality conundrums through their internal (organizational) and external (contextual) interfaces. These interfaces work through a variety of systems and mechanisms designed to align or fit outcomes to purpose, and managed throughout implementation to provide their intended results in the limited conditions of visibility and operationality that characterize social agency. Mixed methods linked to public administration’s heterogeneous epistemic traditions are usually the best options for such a treatment (Riccucci, 2010; Barzelay et al, 2022).
Cases thus treated have a double value for the field of public administration. Beside deserving the production of evidence-based hypotheses aiming to establish causality for communities of scientific interest, they are fertile sources of hypotheses on the value of its circumstances and features as precedent for communities of professional interest (Bardach, 1994; Barzelay, 2007).
CO-AUTHORS
ABSTRACT
Governments continuously face new challenges that result in policy expansion. Implicit in this process is the expectation that there will be a bureaucracy with the corresponding capacities to implement the new, expanded, policies. Even when strong policy coalitions succeed in advancing a new issue, policy expansion is not automatically implemented. Rather, implementation is contingent upon the existing policy capacities of the agencies in charge of transforming the new mandate into a reality. Although empirical works frequently pinpoint policy capacities as independent variables, they are often ambiguously defined, let alone operationalized, thus generating partial explanations of implementation outcomes.
In this paper I study with analytic rigor the influence of policy capacities in the implementation process, to provide insights that allow us to reflect on the potentials and pitfalls of the key elements of the third paradigm of policy implementation research. This study responds to the general question of how public sector organizations fill capacity gaps while implementing policy expansion, and specifically to the overlooked process of coping with capacity deficits for policy change in general, and for policy expansion in particular. In this paper I argue that existing policy capacities influence the type of coping strategy that agencies develop to implement the new policy, thus shaping the type of policy expansion.
To develop my argument, I first explore the theoretical assumptions where the literatures on policy implementation and capacities are built. To make sure that I was not excluding any coping strategy deployed by implementing agencies when experiencing capacity deficits, the resulting categories next structure a systematic literature review where I identify instances of limited capacities in implementation processes, and the organizational responses to such shortfalls. I find that shortages of policy capacity render three possible coping strategies: either implementing agencies develop the capacity, they outsource it or they alter the mandate to fit their extant capacities. In order to make empirically observable the coping strategies derived from the theoretical analysis, based on a comparative research design I analyze three cases of policy expansion where implementing agencies face capacity deficits. By analyzing the dynamic nature of capacities and their potential to influence the implementation process with analytical rigor, this paper contributes to the discussion of the merits and demerits of the so-called third generation of policy implementation research.
CO-AUTHORS
ABSTRACT
In London, the University of London and Greater London Authority have founded the London Research and Policy Partnership (LRaPP). Working closely with London Councils, the LRaPP is aimed at promoting greater joint working between London government and London’s academic research community.
As part of a realist evaluation, the author collected extensive ethnographic data (n=127 survey responses, n=96 interviews) to map the existing ecosystem of ad-hoc, informal and short-term knowledge brokerage, between academic researchers and policy professionals London government. This contextualised data provided evidence on various knowledge brokerage practices (and combinations of several): what works, for whom, in which context, to enable long-term academic policy partnerships. The purpose of the realist evaluation was to design a knowledge brokerage service for LRaPP, to enable improved, more strategic, long-term regional academic policy engagement in London. The current landscape of largely, ad-hoc, informal and short-term engagements between academic researchers and London government (GLA, London Councils, London Boroughs) policymakers is not working for London (as well as it could be), and both the policymaking and academic research communities seek to establish and sustain longer-term academic-policy partnerships to address London’s strategic policy challenges.
Realist evaluation offered insights about why academic-policy engagement works, for whom and under what circumstances. In London, both communities are not currently structured in a way that enables knowledge brokerage to be easy, or simple. Most approaches are initiated informally through personal contacts and relationships and are subject to barriers such as funding models / availability, staff turnover, and misalignment between the culture, and ways of working of the two communities. This messy reality takes place within the fast-paced political and policy context of London, and its need to respond to urgent, short-term policy priorities, as well as the capital’s medium to longer term strategic challenges, through innovative, collective solutions, in an equitable and accessible manner.
Building on the realist evaluation, further evaluation data on various knowledge brokerage activities co-ordinated by LRaPP were collected to better understand the link between design of these activities, their implementation, and the impact on knowledge brokerage and academic-policy engagement.
CO-AUTHORS
ABSTRACT
This article addresses two criticisms to implementation studies from the third generation. First, they put too much emphasis on “predicting the type of implementation behavior that is likely to occur in the future” (Goggin et al., 1990:18). In contrast, drawing on seminal studies from the first generation of implementation studies (Cohen et al., 1972; Pressman & Wildavsky, 1984), I argue that non-linearity and unpredictability are two key features of any policy process. Thus, what matters for implementation studies is to differentiate how policy stakeholders react to these unexpected events, and whether their reactions lead to a greater or to a lower fulfillment of policy objectives. Therefore, I will rely on Deborah Stone's (2012) typology of causal mechanisms to also consider unintended consequences of policy actions (i.e. accidental and inadvertent causes) in my analysis.
My second criticism to third generation studies is their binary vision of policy outcomes. Indeed, Goggin et al. (1990: chap. 7) evaluate the failure or success of policy programs based on the initial objectives set by the legislator, without analyzing who benefits the most from policy successes and policy failures. In other words, Goggin et al. (1990) consider that any public policy pursues the common good, and seems to ignore that getting access to legislative arenas and implementation resources is easier for some actors like corporate businesses, than for others like civic and cultural organizations (see Hunter, 1953; Schattschneider, 1975; C. N. Stone, 1989).
To go beyond third generation studies, I draw on two recent studies that have called for more scholarly attention to be paid to a) the various streams of actors and events (Howlett, 2019), and to b) the power dynamics that are shaping policy implementation and its rules in use (Sager & Gofen, 2022). Thus, I apply the Multiple Streams Framework of Kingdon (2003), with a particular attention to the stream of politics. I focus on the impact of two federal policies in the planning policies of two Swiss cities (Zurich and Geneva) over a period of two decades (1999-2020). The first federal policy is the liberalization of network industry of 1999. It was not designed to influence the planning policies at cantonal and municipal levels, but finally had a tremendous impact on them. The second federal policy is the revision of the Federal Spatial Planning Act of 2014 which ask cantons and cities to reduce urban sprawl and foster the densification of urban centers.
My overall hypothesis is that implementing agents are not equal when it comes to reacting to the unexpected. Those benefitting from a long-term vision of planning policies and of more implementation resources will react by creating critical junctures of the three streams (policy, problem and politics) which will foster the implementation of other policy objectives (case of Zurich). In contrast, implementing agents with a short-term vision and less implementation resources will favor solutions aligning with their interests, but undermining the fulfillment of other policy objectives (case of Geneva).
CO-AUTHORS
ABSTRACT
The COVID-19 pandemic has been an unprecedented event that has affected all nations in the world, but its impact has been particularly devastating in countries with high levels of corruption and inefficient management systems, such as Guatemala. The poor management of the pandemic, exacerbated by corruption, has not only aggravated the health crisis but has also left deep social and economic consequences.
The health management of COVID-19 in Guatemala has been the subject of complaints of corruption and lack of transparency. Multiple cases of irregular aid distributions, overvalued purchases and lack of transparency in awards related to the health emergency were reported.
In July 2021, an official from the Ministry of Health was the subject of an investigation for signing a contract with a company without revealing its details. This investigation has not concluded and the new government that took office at the beginning of 2024 found a warehouse full of vaccines that were not used.
In addition, confidentiality agreements were signed with several pharmaceutical companies for the purchase of COVID-19 vaccines, which has raised concerns about transparency in these transactions.
The work consists of an evaluative case study that uses qualitative and quantitative indicators to obtain a comprehensive understanding of the problematic patterns that permeated the management of the pandemic. The first is Public Trust in Health Institutions, which explores the population's perceptions and attitudes towards the effectiveness, transparency and integrity of health institutions during the pandemic.
On the other hand, the Quality and Accessibility of Public Information: how clear, accurate and accessible was the information provided by the government on health measures, pandemic statistics and safety protocols.
Finally, the public and expert perception of the coherence, adequacy and effectiveness of the implemented health policies. The perception of experts offers an evaluation based on technical knowledge, which can validate the scientific solidity and effectiveness of policy responses, or highlight their shortcomings. Integrating these insights into public policy evaluation is crucial to adjust strategies, improve communication, and ensure that interventions are both scientifically sound and socially accepted.
A coherent policy is one that presents a uniform and consistent approach, which is key to fostering public understanding and trust. Adequacy refers to the ability of policies to meet the specific needs of a diverse population and effectively address the health challenges at stake. Effectiveness, for its part, is measured by tangible results in terms of reducing virus transmission, decreasing hospitalization and mortality rates, and achieving broad vaccination coverage.
CO-AUTHORS
ABSTRACT
This study delves into the inherent challenges associated with contemporary megaprojects, highlighting the fallacy rooted in the belief that the mere formulation of these projects is sufficient for their implementation. A concerning trend is observed where the formulation of megaprojects primarily originates from politicians or technicians lacking direct experience in the execution of public works. Over time, this results in seemingly endless constructions, excessively prolonged execution timelines, insurmountable obstacles, and significant cost overruns. These circumstances, in turn, lead to project modifications, partial inaugurations, opposition movements, and substantial financial losses to the public treasury. The hypothesis posited is that the lack of technical leadership represents a critical impediment to the effective implementation of megaprojects. Consequently, the article is grounded in a case study of the Deep Drainage Project in Mexico City, unraveling its network of stakeholders during the implementation phase to concretely illustrate the impact of technical leadership on the execution of the most challenging segments of the project. In concluding terms, the imperative need is underscored for decision-makers to provide effective empowerment to technical professionals responsible for the execution of megaprojects. This proactive measure is presented as an essential requirement to prevent the modification or cancellation of megaprojects with evident potential to contribute significantly to social development and the overall well-being of the population on a significant scale.
CO-AUTHORS
ABSTRACT
Introduction: mHealth programs have proven to increase maternal and child health service uptake. We aimed to elicit the initial program theories towards explaining how, why, for whom and under what health system conditions the MomConnect program works or not.
Method: As the first step of a realist evaluation, we used a multi-method approach to elicit the initial program theory of the MomConnect programme in South Africa. Nuggets of information were obtained from a scoping review, a MomConnect document review and stakeholder interviews to create the initial program theory that explained how the MomConnect program was expected to work. Retroductive theorizing was applied using deductive and inductive analysis methods, in which we obtained relevant evidence and abductive thinking to formulate the initial program theory.
Results: Three program theories were developed corresponding to the policy implementation and user levels of the MomConnect program. At system level our IPTs reveal that stewardship, monitoring and evaluation, political clout plays a major role in the implementation of the MomConnect program by district and facility managers. And this is affected by the lack of buy-in from districts and facilities managers and funders’s side. At providers level the initial program theory reveals that when healthcare providers (HCPs) perceive health system and political support through the MomConnect program, they should improve their healthcare performance and the quality of health service delivery. Likewise, at the users’ s level exposure to the MomConnect program should provide pregnant women and mothers with accurate knowledge when they perceive how easy and valuable the Help Desk is in providing them with needed information. The requisite information should encourage pregnant women and mothers to use the relevant MCH services.
CO-AUTHORS
ABSTRACT
This article provides an assessment of the so-called third generation of implementation research. To do so, we propose a systematic literature review able to show how the main trait of this third-generation research paradigm has been accepted by public policy and public administration scholars doing implementation research after more than 30 years of the famous Gaggin’s definition of this generation of implementation research. Doing so, we are able to provide a final assessment of how implementation studies are currently following the claims of the third paradigm, how they have changes, and in which direction they are heading today. The aim of this presentation is to open the discussion within the workshop about a general reflection on the potential and pitfalls of the key elements of this paradigm when doing implementation research, as well as to better understand if and to what extent implementation studies can improve in the future towards an its possible redefinition or reorientation.
CO-AUTHORS
ABSTRACT
CCL
CO-AUTHORS
ABSTRACT
An Invitation to Recovering Designs in Cases
Michael Barzelay
London School of Economics (LSE)
EXPORT PDF (FULL)