1B1 Partnering Process Evaluation: Insights into Coherence, Relevance, and Collaboration Effectiveness of the Resilience and Inclusion Through Investment in Sustainable Agrikultura Initiative
The Resilience and Inclusion through Investment in Sustainable Agrikultura (RIISA) project, a project from the Canadian non-profit Mennonite Economic Development Associates (MEDA), aims to foster inclusive economic growth for cacao smallholder farmers (SHFs) in Mindanao, Philippines. The project utilizes MEDA’s Market Systems Development (MSD) approach, a theory of change focused on systemic, sustainable improvements and leverages local partnerships to drive sectoral improvements through financial support and the integration of Gender, Environmental, and Social Governance (G-ESG) practices. A clarificative evaluation conducted by the students of Carleton University’s Diploma in Policy and Program Evaluation (DPPE) assessed the alignment of MEDA’s partnership strategy with RIISA’s implementation. The evaluation focused on three objectives: understanding how the partnership strategy localized the MSD approach, improving partnership practices, and developing an MSD partnership framework applicable to MEDA’s global projects. Key findings highlight structural constraints in RIISA’s initial design that did not fully align with local needs, RIISA team success in fostering trust-based, responsive relationships with local partners, and an unrealized convener role within the cacao market system. Through this first experience conducting an evaluation, the students drew many lessons on the challenges of converting international development theory into practices, on the impact of organizational context on implementation strategies, and on the influence of cultural context on evaluation results.
Geneviève Boily-Larouche, Managing Director, AMR Policy Accelerator
Geneviève Boily-Larouche is the Managing Director of the AMR Policy Accelerator, a thinktank based at the Global Strategy Lab at York University, which combines rigorous research expertise with client-focus and agile consultancy services to influence how institutions, instruments, and initiatives are designed in order to better address the pressing global challenge of antimicrobial resistance (AMR). In her role, she draws upon her significant expertise in global health research and policy to provide strategic leadership to the team.
Geneviève holds a Ph.D. in Virology & Immunology from the University of Montreal and a PG Certificate in Global Health Policy from the London School of Hygiene and Tropical Medicine. She has over 15+ years of experience in academic research, knowledge mobilization, science and public health policies, and has recently graduated from Carleton University Diploma in Policy and Program Evaluation (DPPE). She has extensive international experience and is passionate about global health with specific expertise in infectious diseases, women’s health, and pandemic response.
Billie Jane Hermosura, Consultant
Dr. Billie Jane Hermosura has over 25 years of interdisciplinary experience in healthcare, with a focus on professional competencies development, leadership, research, and program evaluation. Billie Jane holds a PhD in Education from the University of Ottawa, a Master of Adult Education from St. Francis Xavier University, and a Master of Applied Nutrition from the University of Guelph. Billie Jane’s work combines her expertise as a health professional, consultant, researcher, and part-time professor. Recently, she earned a Diploma in Program and Policy Evaluation from Carleton University, further strengthening her expertise in program evaluation.
1B2 Evaluation Division Review of AAFC Past Evaluations: A Focus on Recommendations Related to Performance Information Profiles
In each evaluation project, evaluators face limitations that can make the process more challenging. At the federal level, the performance information profile (PIP) of programs and its components, as well as the quality of available data, are elements that impact the evaluation process. The Agriculture and Agri-Food Canada (AAFC) Evaluation Division conducted a synthesis of recent evaluations within the Ministry to establish an overview and identify recurring themes, focusing specifically on recommendations related to PIPs. The findings of this review indicate that the majority of the evaluation reports analyzed highlight gaps in PIPs. This suggests a need to further analyze these gaps in order to improve PIPs, enable better reporting on results, and facilitate our work as evaluators.
Andres Canessa, Evaluation Manager, Agriculture and Agri-Food Canada
Since 2023, Andres Canessa has been working at Agriculture and Agri-Food Canada as an Evaluation Manager. He also has extensive experience in other departments, such as the Canada Border Services Agency, the Immigration and Refugee Board, and Global Affairs Canada. He has worked in various roles related to monitoring and evaluation, as well as program management. Before joining the public service, Andres completed consulting assignments for international organizations such as the IOM, the Pan American Health Organization in Washington, D.C., and the World Food Programme in South Sudan. He has also participated in international election observation missions. Andres holds a B.Sc. in Economics and an M.A. in International Relations. He is also a Qualified Evaluator (QE) from the Canadian Evaluation Society, PmP certified. In his free time, he enjoys swimming, jogging, and traveling.
1B3 Into the Great Unknown: How to Navigate Program Evaluation on an Unfamiliar Topic
Navigating program evaluation in unfamiliar areas presents unique challenges and opportunities. Drawing from our extensive experience in assessing diverse programs such as space science, horse racing, and quantum physics, we, as social scientists, have developed effective strategies for conducting evaluations without being subject matter experts. This presentation will outline essential steps, key strategies, and common challenges encountered in this process. We aim to inspire participants to share their own experiences and insights.
Emily Brennan, Senior Evaluation Manager, Office of Audit and Evaluation, Agriculture and Agri-Food Canada
Emily Brennan (she/her) is a Senior Evaluation Manager at Agriculture and Agri-Food Canada. While she is currently an internal evaluator for the federal government focused on agriculture related programs, she previously worked as a consultant and was able to engage in all types of evaluations with a wide variety of clients with programs in areas as varied as women’s rights to support for quantum physics research. Throughout her time as an evaluator, Emily has always focused on centering collaboration- with stakeholders and with other evaluators. This includes collaborating with contractors on specific projects and working with others in the evaluation community in her role as co-chair of the CES Educational Fund and in her previous role as President of the Canadian Evaluation Society’s National Capital Chapter. Emily is a credentialed evaluator, and holds a master’s degree in food, Agricultural and Resource Economics from the University of Guelph.
Susanna Beaudin, Partner, PRA Inc.
Susanna Beaudin, Partner at PRA Inc., is a bilingual Credentialed Evaluator and past President of the Canadian Evaluation Society’s National Capital Chapter. She has managed numerous evaluations for organizations in the not-for-profit and community sectors, as well as for federal and provincial departments and agencies.
Of interest since her master’s studies, where she considered the role of women and children in armed conflict situations, a significant portion of Susanna’s practice focuses on gender-based and intimate partner violence, child welfare, gender-based analysis plus, public safety and the criminal justice system. She is passionate about ensuring that those most impacted by a program are meaningfully included in evaluation activities, and that evaluation findings are clearly communicated to decision-makers and other interest holders. She brings that same focus to her work in other areas, namely health, natural resources and the environment. While she focuses on program evaluation, she leads strategic planning exercises for community organizations, facilitates public consultations and town halls, and conducts tailored research studies.