By Thomas Archibald
Associate Professor, Department of Agricultural, Leadership, and Community Education, Virginia Tech
To achieve the Sustainable Development Goals (SDGs) and recover from the devastating impacts of COVID-19, business as usual is unacceptable. Paradigmatic transformations are needed as civil society, industry, and governments alike rethink how they work and how they define success in relation to social, economic, and ecological impacts. In parallel, conventional evaluation approaches are inadequate. Reductionist, linear, technical-rationalistic modes of thinking and evaluating are ill-equipped to face the complex dynamic challenges confronting us. As Michael Quinn Patton and the Blue Marble Evaluation (BME) community suggest, evaluating transformation requires transforming evaluation.
One way to foster transformation in evaluation is to intentionally and explicitly focus on critical and evaluative thinking skills. Specifically, evaluative thinking can broaden recognition of evaluation as a powerful tool to improve public accountability and good governance, while simultaneously bolstering evaluation systems and capacities among evaluators and programme implementors alike.
Evaluating transformation requires transforming evaluation.
The needed transformations of evaluation
One clarion call about transformation is from the BME approach, with its three overarching principles: global thinking, Anthropocene as context and transformative engagement.
The premise of the third principle is that, “Global, anthropogenic problems are so severe, threatening the future sustainability of the planet and humanity, that major and rapid systems transformations are needed.”
Another call for transformation is from Thomas Schwandt, reflected on thoughtfully by Zenda Ofir. Against the backdrop and predominance of ‘normal evaluation,’ which is “wedded to notions of scientific rationality, social progress, effectiveness and efficiency in social programming, and the broad ideology of modernization,” post-normal evaluation draws on:
Resilience thinking as a rationality of governing
The return of politics to the people
A recovery of practical reasoning
Co-production to redefine the relationship between professionals and citizens, and
Yet another call for transformation is the call for equitable evaluation, as expressed via the principles of the Equitable Evaluation Initiative, including that evaluation should be in service of equity, should be multiculturally valid and orientated toward participant ownership, and should answer critical questions about the historical and structural entanglements of societal conditions and the strategies designed to address them.
One final call for transformation with clear implications for the evaluation of the SDGs is the movement towards decolonizing evaluation—which requires that evaluation itself be decolonized while simultaneously acting as a decolonizing force in society. This topic is discussed beautifully in a Twende Mbele webinar featuring Candice Morkel, Mjiba Frehiwot, and Mokgophana Ramasobana.
Taken together, Blue Marble Evaluation, post-normal evaluation, equitable evaluation, and decolonizing evaluation can guide evaluation towards the radical reimagining required by the challenges of evaluating the SDGs and COVID-19 recovery well. All four of these trends also highlight the importance of critical and evaluative thinking.
Blue Marble Evaluation, post-normal evaluation, equitable evaluation, and decolonizing evaluation can guide evaluation towards the radical reimagining required by the challenges of evaluating the SDGs and COVID-19 recovery well.
Evaluative thinking for transformative evaluation
What is evaluative thinking? It must be the thinking we (or any one does) while evaluating, you might say. In a sense, that is true, but in recent years, a number of evaluation scholars and practitioners have taken a deeper dive into this elusive concept. According to Patton,
“Evaluation is an activity. Evaluative thinking is a way of doing business. This distinction is critical. It derives from studies of evaluation use. Evaluation is more useful—and actually used—when the programme and organizational culture manifests evaluative thinking.”