Researchers and research organizations are under increasing pressure to demonstrate that their work contributes to positive change and helps solve pressing societal challenges. There is a simultaneous trend towards more engaged transdisciplinary research that is complexity-aware and appreciates that change happens through systems transformation, not only through technological innovation. Appropriate evaluation approaches are needed to evidence research impact and generate learning for continual improvement. This is challenging in any research field, but especially for research that crosses disciplinary boundaries and intervenes in complex systems. Moreover, evaluation challenges at the project scale are compounded at the programme scale. The Forest, Trees and Agroforestry (FTA) research programme serves as an example of this evolution in research approach and the resulting evaluation challenges. FTA research is responding to the demand for greater impact with more engaged research following multiple pathways. However, research impact assessment in the CGIAR (Consultative Group on International Agricultural Research) was developed in a technology-centric context where counterfactual approaches of causal inference (experimental and quasi-experimental) predominate. Relying solely on such approaches is inappropriate for evaluating research contributions that target policy and institutional change and systems transformation. Instead, we propose a multifaceted, multi-scale, theory-based evaluation approach. This includes nested project- and programme-scale theories of change (ToCs); research quality assessment; theory-based outcome evaluations to empirically test ToCs and assess policy, institutional, and practice influence; experimental and quasi-experimental impact of FTA-informed ‘large n’ innovations; ex ante impact assessment to estimate potential impacts at scale; and logically and plausibly linking programme-level outcomes to secondary data on development and conservation status.								
								
									Authors:
									Belcher, B.; Hughes, K.								
																
									Subjects:
									impact assessment								
															
									Publication type:
									Evaluation report, ISI, Journal Article, Publication								
																
									Year:
									2020								
								
																		ISSN:
									0958-2029								
																
								 
						 Restoration
																	Restoration																 Plantations and tree crop commodities
																	Plantations and tree crop commodities																 Enhanced nutrition and food security
																	Enhanced nutrition and food security																 Biodiversity, safeguarding and conservation
																	Biodiversity, safeguarding and conservation																 Nationally determined contributions
																	Nationally determined contributions																 Bioenergy and biomaterials
																	Bioenergy and biomaterials																 Blue carbon and peatlands
																	Blue carbon and peatlands																 Climate change adaptation
																	Climate change adaptation																 Landscape governance
																	Landscape governance																 Gender
																	Gender																 Silvopastoral systems
																	Silvopastoral systems																 Market-based agroforestry-forestry
																	Market-based agroforestry-forestry																 Farm-forest policy interface
																	Farm-forest policy interface																 Agroecology
																	Agroecology																 Livelihood trajectory modelling and assessment
																	Livelihood trajectory modelling and assessment																 Inclusive finance and business models
																	Inclusive finance and business models																 Innovating finance for sustainable landscapes
																	Innovating finance for sustainable landscapes																 Public and private commitments to zero deforestation
																	Public and private commitments to zero deforestation																 Orphan tree crops
																	Orphan tree crops																 Effectiveness of approaches to sustainable supply
																	Effectiveness of approaches to sustainable supply																 Quality of FTA research for development
																	Quality of FTA research for development																 Sentinel landscapes
																	Sentinel landscapes																 Foresight
																	Foresight																 Seeds and seedlings delivery systems
																	Seeds and seedlings delivery systems																 Smallholder tree-crop commodities
																	Smallholder tree-crop commodities																 
																	 
																	 
																	 
																	 
																	 
																	 
																	 
																	 
																	 
					  							 
					  							 
					  							 
					  							 
					  							