Notice: Undefined index: id in /home/ft4user/foreststreesagroforestry.org/wp-content/themes/FTA/template-parts/content.php on line 3
  • Home
  • Outcome Evaluation Approach – 5 Case Studies from FTA

Outcome Evaluation Approach – 5 Case Studies from FTA


Notice: Undefined variable: id_overview in /home/ft4user/foreststreesagroforestry.org/wp-content/themes/FTA/template-parts/content.php on line 64
Yordana Yawate, carries a sack of sago pith to be filtered on the banks of the Tuba river in Honitetu village, Maluku province, Indonesia. Photo by Ulet Ifansasti/CIFOR
Posted by

FTA communications

Two recent publications discuss how to effectively assess the impact of transdisciplinary (TDR) research and apply these methods to 5 case studies.

The creation of the CGIAR Research Programs (CRP) was aimed to increase the social, economic, and environmental impacts of research. These programs have intentionally developed broader and deeper partnerships with a wide range of policy and development actors (i.e., international conservation and development organizations, NGOs, policy actors, other stakeholders), as well as with other researchers and research organizations. These efforts mirrored a shift in the broader research environment toward more engaged, problem-centred research. Such research, known variously as Transdisciplinary Research (TDR), Mode 2 Research, and Sustainability Science, among other terms, actively involves stakeholders to help ensure the relevance of the research, incorporate a broader range of expertise in the research process, and promote the co-generation of knowledge with research users.

In theory, engaged TDR approaches should help address complex sustainability problems and contribute to more and better outcomes. However, the increased complexity of these approaches makes impact assessment even more challenging than for traditional research approaches. Research impact assessment is chronically challenged by the fact that the uptake and use of research-based knowledge is incremental, with multiple steps and other intervening factors, often with long time-lags. Measuring and attributing impact are difficult. CGIAR research impact assessment has typically attempted to measure the benefits of improved technologies generated by CGIAR research; this assumes that the main contributions of the research are bundled within an improved plant variety or other technology package. TDR deliberately aims to contribute to several impact pathways simultaneously, by supporting capacity-building and empowerment among partners, facilitating dialogue and political processes, co-generating knowledge that will be implemented directly by partners, as well as through more conventional research products. However, empirical evidence of whether and how transdisciplinary approaches contribute to (more) effective scientific and social outcomes remains limited.

CIFOR Senior Associate Scientist Brian Belcher and his team in the Sustainability Research Effectiveness Program (SRE) at Royal Roads University have developed methods to assess TDR. The SRE Program has also conducted a series of case studies of completed FTA research projects to investigate the link between transdisciplinary research and societal effects. They recently published two papers to share lessons from their work.

A refined method for theory-based evaluation of the societal impacts of research [pdf]
A refined method for theory-based evaluation of the societal impacts of research” (Belcher et al., 2020) provides a detailed description of concepts and a method for assessing the relationship between research processes, outputs, and outcomes. The Outcome Evaluation Approach uses an actor-centred Theory of Change as the analytical framework, and accounts for complexity by recognizing the role of other actors, context, and external processes in change. The article provides stepwise guidance on how to:

  • document a theory of change;
  • determine data needs and sources;
  • collect data;
  • manage and analyze data; and
  • present findings.

 

The paper responds to the need for appropriate methods to demonstrate (for accountability) and analyze (for learning) whether and how research projects contribute to change processes, in an effort to make research more effective in addressing complex sustainability challenges.

Linking transdisciplinary research characteristics and quality to effectiveness [pdf]
Linking Transdisciplinary Research Characteristics and Quality to Effectiveness: A Comparative Analysis of Five Research-for-Development Projects” (Belcher et al., 2019) reports lessons from outcome evaluations [1] of five FTA projects. The five projects:

  1. Brazil Nut Project (BNP)
  2. Sustainable Wetlands Adaptation and Mitigation Program (SWAMP)
  3. Fire and Haze Indonesia (F&H)
  4. Global Comparative Study on Forest Tenure Reform-Peru (GCS-FTR), and
  5. Support to the Development of Agroforestry Concessions in Peru (SUCCESS)

 

 

represent a wide range of research approaches, social and policy contexts, and outcomes. Each case study used the Outcome Evaluation Approach described in Belcher et al. (2020) to document the project’s Theory of Change and assess whether and how outcomes were realized. The analysis also used Belcher et al.’s (2016) Transdisciplinary Research Quality Assessment Framework (QAF) to characterize each project by the degree to which its design and implementation conformed with transdisciplinary criteria.

Each project had a deliberate focus on moving beyond knowledge production to influence policy and practice. To do that, the projects employed a variety of strategies that crossed disciplinary bounds and engaged a range of partners and stakeholders at different levels. The results demonstrate that projects employing more transdisciplinary characteristics make more diverse contributions as they tend to leverage more diverse mechanisms of change. The participation of various system actors contributed to projects’ relevance and strongly contributed to the uptake and use of the research. Projects that invested most in developing and facilitating participation (e.g., the Global Comparative Study on Forest Tenure Reform-Peru and the Support to the Development of Agroforestry Concessions in Peru projects) were the most successful in generating social learning and building coalitions. Projects that employed the most traditional scientific models (e.g., the Brazil Nut Project and the Sustainable Wetlands Adaptation and Mitigation Program) but still invested in outreach and engagement, were able to realize significant outcomes. Research project efforts to support social processes helped translate and broker knowledge outputs and made substantial additional contributions through capacity-building, initiating and supporting discourse, and relationship-building.

Given the results, it is clear that research aiming to influence policy and practice change should consider integrating and reflecting on TDR characteristics more intentionally from the early planning stages and throughout the whole research process. This new Outcome Evaluation Approach will help linking outcomes, outputs and TDR more effectively, justifying the need for more transdisciplinary science, with an increase in overall results and global benefits.

[1] Two individual  project outcome evaluation reports have been published (Brazilian Nut, SWAMP), while the others are forthcoming (F&H, GCS-FTR, SUCCESS).


FTA is the world’s largest research for development program to enhance the role of forests, trees and agroforestry in sustainable development and food security and to address climate change. CIFOR leads FTA in partnership with Bioversity International, CATIE, CIRAD, INBAR, ICRAF and TBI. FTA’s work is supported by the CGIAR Trust Fund.


Notice: Undefined index: id in /home/ft4user/foreststreesagroforestry.org/wp-content/themes/FTA/template-parts/content.php on line 3
  • Home
  • Interview: Leveraging peat to beat the heat in Peru

Interview: Leveraging peat to beat the heat in Peru


Notice: Undefined variable: id_overview in /home/ft4user/foreststreesagroforestry.org/wp-content/themes/FTA/template-parts/content.php on line 64
Peatlands are home to diverse fauna and flora like this colorful butterfly. Photo by Jeffrey van Lent/CIFOR
Posted by

FTA COMMUNICATIONS TEAM

A researcher measures peat degradation in Peru. Photo by Kristell Hergoualc’h/CIFOR

FTA researchers are working to recognize the potential of Peru’s rich peatlands in tackling climate change.

Peru – Peruvian peatlands are of huge environmental importance, not only locally but also globally. They not only house enormous stores of carbon, but are home to diverse flora and fauna, and provide essential ecosystems services that support local livelihoods.

Located in Amazonia, the Pastaza Marañon Basin stores an amount of carbon in peat soil equivalent to more than 100 years of the country’s anthropogenic emissions of greenhouse gases (GHG).

However, most of this carbon has only been partially protected and now, Peruvian peatlands are showing clear signs of degradation. At this vital crossroad, these peatlands can either become part of the problem, or the solution in the global battle against climate change. This depends greatly on the country’s actions towards their sustainable management.

In work that forms part of the CGIAR Research Program on Forests, Trees and Agroforestry, Kristell Hergoualc’h, a scientist at the Center for International Forestry Research (CIFOR), has been studying Peruvian peatlands for CIFOR’s Sustainable Wetlands Adaptation and Mitigation Program (SWAMP).

Based in Peru, Hergoualc’h was part of a team of scientists who recently published a pilot study that was the first one to attempt to map and characterize the degradation of palm swamp peatlands in the Peruvian Amazon. The study combined remote sensing data and carbon in biomass from inventories.

Read also: FTA seeks to influence debate at GLF on peatlands

Peatland is pictured in Peru. Photo by Kristell Hergoualc’h/CIFOR

“Providing solid and credible estimations of the impacts of degradation is an essential step in planning and adopting conservation strategies,” says Hergoualc’h. “Peruvian peatlands should be considered as priorities in any national conservation program for climate change mitigation.”

Hergoualc’h discussed the study’s results and the pressing need for the country to develop strategies and policies that ensure their sustainable management.

What are peatlands and why are they important, particularly in the context of Peru?

Peatlands are wetland ecosystems located in depressions that remain flooded during most of the year. The continued oxygen-poor conditions in the soil lead to a slow decomposition of the dead branches, leaves and roots and result, over thousands of years, in the accumulation of a soil layer extremely rich in carbon.

This layer can be very deep. For example, in Peru, peat deposits with a depth up to nine meters were found in the Amazon basin. Peatlands are therefore very important in terms of carbon storage and cycling. Peru holds a substantial area of peatlands, most of which is located in the Amazon basin, but there are also peatlands in the Andes. Lowland peatlands are mostly forests hosting a high density of Mauritia flexuosa palms – locally known as aguajes.

What is causing the current degradation of Peruvian peatlands?

There are different types of activities causing peatland degradation, such as peat extraction in the Andes or illegal gold mining in the region of Madre de Dios. We’ve been looking more specifically at the degradation of the palm-dominated forests that spans the entire Amazonian basin.

People consume the fruit of the aguaje palm and a weevil – called suri– that develops inside the dead trunk of the palms. These products are important sources of vitamins and proteins, especially for rural communities. Unfortunately, the harvest of the fruit has not been very sustainable. It has been extensively cultivated in the past decades by cutting down the entire palm instead of climbing it.

Water ripples in a peat landscape in Peru. Photo by Kristell Hergoualc’h/CIFOR

What are some of the conclusions of your recent study into the drivers of Peruvian peatland degradation?

We’ve been working in an area of about 350,000 hectares in the region of Loreto and combined data obtained by remote sensing and data collected on the ground to evaluate the extent of degradation and the impact of degradation on the structure and composition of the forest.

We found that 73 percent of the area of palm swamp forest on peat was degraded. Our results suggest that degradation induces a shift in forest composition; the forest becomes dominated by woody trees instead of palms.

We also found that degradation translates into significant reductions in tree carbon stocks with initial stocks decreased by 11 percent and 17 percent following medium and high degradation.

Are Peruvian peatlands being protected?

Some areas that include peatlands like the Pacaya Samiria reserve in Loreto are protected. However, Peru doesn’t have a regulatory framework for specifically protecting its peatlands. The country doesn’t have a soil classification map and has not adopted a definition for peat soil or peatlands. The term “peatland” appears in only one official document – The Wetlands National Strategy – where it is used to designate high-altitude peatlands in the Andes.

What actions should be taken to ensure their conservation?

The peatland areas that are legally under protection were effectively conserved which is encouraging, but these sites remain limited and should be extended. Initiatives such as REDD+ projects should be regarded as an opportunity for more peatland protection.

There is also a general need to bring awareness about what peatlands are and why they are important for Peru at the decision-making level in the national and regional governments, as well as in academia.

Peatlands are home to diverse fauna and flora like this colorful butterfly. Photo by Jeffrey van Lent/CIFOR

You have studied Indonesian peatlands as well, which have been largely deforested and degraded. What are some recommendations you have for Peru so that it does not encounter the same scenario?

Indonesian peatlands have been devastated as the result of large governmental programs aimed at relocating people within the country, expanding agriculture, and extracting timber. For these purposes peatlands have been drained and, as a consequence, turned into fire-prone areas. The environmental, social and economic damages caused by land-use change and fires in Indonesian peatlands are considerable and are of major international concern.

Read also: Managing peatlands in Indonesia: Challenges and opportunities for local and global communities

Peatlands are not suitable areas for agriculture because the soil is acid and nutrient-poor and most crops can’t cope with flooded conditions. It is unexpected and dicey for the Peruvian national strategy for forests and climate change to recommend technical capacity-building on wetland drainage as a way to reduce migration of communities towards fertile soils and/or forested areas.

The main lesson we learned about peatlands worldwide is that they should not be drained. There are other sustainable options for livelihoods in these ecosystems, and these need to be defined and developed in tandem with the communities living within them.

By Yoly Gutierrez, originally published at CIFOR’s Forests News.


For more information on this topic, please contact Kristell Hergoualc’h at k.hergoualc’h@cgiar.org.

This research forms part of the CGIAR Research Program on Forests, Trees and Agroforestry.

This research was supported by USAID.


Back to top

Sign up to our monthly newsletter

Connect with us