Please note the following are listed in chronological order starting
with the most recent publication.
Evaluation Tools | Evaluation
Reports
A Guide to Monitoring & Evaluation of NGO Capacity Building Interventions in Conflict Affected Settings (PDF, 1.39 MB)
The guide provides a conceptual framework which highlights the role and importance of high-quality M&E of capacity building interventions for NGOs operating in conflict-affected settings. Drawing on case studies, past research in the area of capacity measurement and field testing, the guide offers principles for planning and implementing capacity M&E; provide a selection of tools by which to measure progress against capacity building objectives; and offers a set of indicators which NGOs can draw upon and adapt in this process. Participatory approaches to capacity building M&E are emphasized. It is based on past capacity building experience which has demonstrated that meaningful participation of organizational staff and volunteers is critical to the success of capacity building interventions. JSI Research & Training Institute, Astarte Project. February 2009.
Building a Standard Laboratory Equipment List (PDF, 1.30 MB)
This document is a tool to aid country laboratory program decision makers in one aspect of standardization: Identifying, documenting, and evaluating criteria to select laboratory equipment to appear on the country's standard equipment list. JSI/USAID|DELIVER PROJECT. June 2008.
Adult Hypertension Information Checklist (PDF, 190 KB)
This tool is intended to promote blood pressure screening for adults who visit primary care sites for any reason. The ultimate goal of this tool is to help identify disease, and improve case management and treatment. JSI worked to improve the quality of care for maternal and child health health under ZdravPlus. JSI/ZdravPlus Project, 2007.
Adult Hypertension Patient Reminder Form (PDF, 189 KB)
Cardio vascular disease and hypertension represents a growing burden of disease in Central Asia. This pamphlet is intended to support patient adherence to behaviors that improve the management and control of high blood pressure, including daily intake of prescribed medication. This tool is also a reminder for providers on evidence-based prescribing and counseling practices associated with improved quality of care for patients with hypertension. JSI worked to improve the quality of care for maternal and child health health in particular under ZdravPlus. JSI/ZdravPlus Project, 2007.
Tool to Assess Site Readiness for Initiating Antiretroviral Therapy (ART) (PDF, 227 KB)
This tool is an innovative guide that can be used to evaluate a site's level of capacity, vision, and HIV activities and services that are required for the rational introduction and expansion of ART. The tool was created based upon JSI staff's experience in HIV clinical care programs in the U.S. and following DELIVER's logistics assessment of Zimbabwe's readiness to initiate and expand ARV therapy. It has since been tested in a number of countries and undergone multiple revisions based on feedback from users. JSI & DELIVER projects. 2007.
Tool to Assess Site Readiness for Initiating Pediatric Antiretroviral Therapy (PDF, 432 KB)
This tool is similar to the Tool to Assess Site Readiness for Initiating Antiretroviral Therapy or Capacity for Existing ART Sites. There are six domains that are used to assess site readiness to provide pediatric ART or the current status of services if ART delivery has already begun. The stages rating system can be used to identify steps needed to advance a site along different stages, from the Beginning Site (Stage 1) to the ultimate stage of Expansion and Resource Site (Stage 5). The number of points received by a site help to identify the stage of site readiness for provision of ARV services and to develop a set of recommendations and next steps to be done for development of pediatric HIV/AIDS services. Ruslan Malyuta, Lisa Hirschhorn, Andrew Fullem, Michael Farabaugh, John Snow, Inc. 2007.
Monitoring and Evaluation Indicators for Assessing Logistics Systems Performance (PDF, 1.63 MB)
Quality monitoring is an integral part of any health logistics system, as it can describe the performance of the logistics system, evaluate strengths and weaknesses, and allow for accountability and advocacy. This document describes several indicators that are useful tools in monitoring and evaluating a logistics system for reproductive health commodities. These indicators can be used to measure the availability of commodities in a health facility, the performance of the logistics system, and, ultimately, commodity security. 2006.
Assessing Supply Chains for HIV/AIDS Commodities (PDF, 2.85 MB)
This paper is a resource for assessing supply chain management systems for HIV & AIDS programs. While many tools and indicators for different types of assessments will remain relatively standardized across commodity groups, including forecasting and monitoring and evaluation for the purposes of system design, a number of key differences exist for HIV/AIDS commodities, notably in the types of assessments, the special considerations during the process, and the frequency and follow up of assessments. This paper is a guide for advisors and in-country partners to understand the types of assessments that are undertaken to measure or monitor system performance, the purpose behind the different assessments, and the tools that are appropriate and valuable to use in the different circumstances. JSI/DELIVER Project. May 2006.
Monitoring and Evaluation Indicators for Assessing Logistics Systems Performance (PDF, 1.63 MB)
Quality monitoring is an integral part of any health logistics system, as it can describe the performance of the logistics system, evaluate strengths and weaknesses, and allow for accountability and advocacy. This document describes several indicators that are useful tools in monitoring and evaluating a logistics system for reproductive health commodities. These indicators can be used to measure the availability of commodities in a health facility, the performance of the logistics system, and, ultimately, commodity security. JSI/ USAID|DELIVER PROJECT. 2006.
Data Demand and Information Use in the Health Sector: Strategies and Tools (PDF, 1.99 MB)
Data Demand and Information Use (DDIU) is a strategy to identify opportunities for and constraints to effective and strategic data collection, analysis, availability, and use. This strategy begins with an assessment that helps stakeholders, policy-makers, and monitoring and evaluation (M&E) practitioners determine points of entry for DDIU intervention. Once specific needs are identified, DDIU core tools can be utilized to stimulate data demand and capacity building and enhance evidence-based decision making. K. Foreit, S. Moreland, Anne LaFond, 2006.
Guidelines for Implementing Computerized Logistics Management Information Systems (LMIS) (PDF, 4.17 MB)
This guide defines the computerized logistics management information system (CLMIS), recommends the components of a successful computerized LMIS and explains development, implementation and operations for such a system. It also provides lessons learned and sample reports and graphs. JSI/DELIVER Project, 2006.
Routine Immunization Checklist (PDF, 63 KB)
This document lists 12 indicators to help district- and national-level staff strengthen the performance of their routine immunization programs. JSI/IMMUNIZATIONbasics, 2005.
Rapid Assessment of Referral Care Systems: A Guide for Program Managers (PDF, 3.23 MB)
This tool is designed to help national and district-level managers quickly assess the status of and constraints to referring severely ill children from the first-level of care to secondary and tertiary levels of care. The assessment uses a cross-sectional study design that includes a review of medical records, interviews with caretakers of children less than five years of age, interviews with health providers, and focus group discussions with caretakers. Prevalence estimates describe referral care patterns of caretakers and providers, referral and counter-referral relationships, frequency of self-referral to higher levels of care, caretaker barriers to compliance with referral, and provider barriers to compliance with referral guidelines. Assessment results are for use by Ministries of Health and other partners to design national- and district-level interventions to improve the successful referral of severely ill children. John Snow, Inc./BASICS II. 2003.
A Guide to Monitoring and Evaluation of Capacity-Building Interventions in the Health Sector in Developing Countries (PDF, 774 KB)
This guide was developed to assist health planners and evaluators to gain a clear understanding of the concepts of capacity and capacity building. It looks at ways to critically evaluate the strengths and limitations of current approaches to capacity measurement, as well as design a capacity-building monitoring and evaluation plan that outlines a systematic approach to measuring capacity and assessing the results of capacity-building interventions in the health sector. Anne LaFond and Lisanne Brown, MEASURE Evaluation Project/JSI Research & Training Institute, Inc., 2003.
Mapping Capacity in the Health Sector: A Conceptual Framework (PDF, 184 KB)
Building capacity has become central to strategies used to develop health systems in developing countries. However, despite the growing interest in capacity improvement, there has been little consensus among practitioners and academics on definitions of capacity building and how to evaluate it. This paper reviews current knowledge and experiences from ongoing efforts to define, monitor and evaluate capacity building interventions in the health sector in developing countries. It presents a conceptual framework for mapping capacity and measuring the effects of capacity building intervention. International Journal of Health Planning Management, 17(1):3-22. Anne K. LaFond, Lyndon Brown, K. Macintyre. 2002.
Back to top
Evaluation Reports
Outreach Assessment and Gap Analysis for Medicaid and CHP+ Expansion: Report (PDF, 778 KB)
In 2009 the Colorado state legislature passed the Colorado Health Care Affordability Act (HB-1292), which will expand coverage to more than 100,000 uninsured Coloradoans over the next five years. The ultimate success of the Act is dependent on the degree to which newly eligible individuals enroll in Medicaid and CHP+, and are linked with an appropriate source of care. JSI collaborated with the Colorado Department of Health Care Policy and Financing to identify existing and historic outreach efforts by conducting a high-level literature review and interviewing key informants. This report describes the project's approach; details project findings on national best practices, current outreach efforts and current enrollment practices; and offers recommendations on how to address gaps, barriers and challenges to maximizing the impact of outreach and enrollment to the expansion populations. JSI Research & Training Institute, Inc. October 2010.
Community Health Workers: Exploring Volunteerism as a Sustainability Model Policy Brief (PDF, 240 KB)
This brief presents the findings of a qualitative study exploring the potential of non-financial incentives (NFIs) in motivating voluntary Community Health Workers (vCHWs) in four of the largest regions in Ethiopia.
Rhode Island Diabetes State Plan 2010-2015
The Rhode Island (RI) Diabetes State Plan was facilitated by the RI Diabetes Prevention and Control Program (RI-DPCP) at the RI Department of Health. The purpose is to help diabetes stakeholders in RI provide a coordinated approach to the goal of reducing the burden of diabetes in the state over the next five years, with a particular focus on reducing disparities related to diabetes. JSI developed the plan with input from five multi-disciplinary groups of stakeholders in RI with over 60 participants. The groups used RI-specific data to identify goals, objectives, and action steps to lead the state toward the mission of reducing the burden of diabetes in RI. Jennifer Kawatu, JSI Research & Training Institute, Inc. July 2010.
Rhode Island Diabetes State Plan 2010-2015
The GAVI Alliance Civil Society Organizations Type B Case Studies: Afghanistan, the Democratic Republic of the Congo, Ethiopia and Pakistan (PDF, 1.21 MB)
Global Alliance for Vaccines and Immunizations (GAVI Alliance) support helps strengthen the coordination and representation of civil society organizations in national-level coordination mechanisms. This paper documents best practices and lessons learned from CSO and government collaboration in the Democratic Republic of the Congo, Ethiopia, the Islamic Republic of Afghanistan and Pakistan. In particular, this paper highlights processes and practices supported with GAVI CSO Type B funding related to hard-to-reach populations, technical assistance and capacity building and social mobilization and advocacy. The information was collected in November 2009. Wendy Abramson/JSI Research & Training Institute, Inc. March 2010.
HIV Prevention Needs Among Hispanic/Latino Men Who Have Sex with Men in the Denver Metro Area (PDF, 2.48 MB)
JSI conducted formative evaluation to guide HIV prevention services for urban Hispanic/Latino MSM in 2010. The resulting in-depth report uses community input to reveal the perceptions of Hispanic/Latino men who have sex with men (MSM) on the current state of and suggestions for HIV prevention services in the Denver Metro area. The report is the result of a formative evaluation study that the JSI Denver office conducted in November and December 2009 funded by the Colorado Department of Public Health & Environment, Disease Control & Environmental Epidemiology Division, STI/HIV Section. JSI conducted 6 focus groups and 12 interviews, half in Spanish and half in English, with Hispanic/Latino MSM that reside and receive HIV prevention services in the Denver metropolitan area in Colorado. JSI Research & Training Institute, Inc. 2010.
Bantwana Schools Integrated Program (BSIP) Child Profiling Report (PDF, 5.92 MB)
Bantwana, in collaboration with researchers from Harvard University, developed a child profiling tool to gather information on the impact of the Bantwana Schools Integrated Program (BSIP) at the level of the child. This report presents key findings from the data collected in BSIP-supported schools in 2008 using the child profiling tool; these findings have implications for current and future OVC programming. Areas examined include nutrition, education, health, psychosocial support, preventing risky behaviors, abuse and exploitation, and knowledge about HIV prevention.
The results of the child profiling baseline collection were presented to each school, as well as at the national level to key stakeholders, including government officials, international implementing agencies, and donors. Ivelina Borisova, Mavis Vilane, Bantwana Initiative, 2009.
Non-Financial Incentives for Voluntary Community Health Workers: A Qualitative Study (PDF, 701 KB)
The Ethiopia health extension program extends its reach through a diverse network of voluntary Community Health Workers (vCHWs), who spread health messages and practices to families residing in every part of a community or kebele. One of the objectives of the Last 10 Kilometers (L10K) project is to ensure the sustained engagement of these volunteers through non-financial incentives (NFIs). The NFIs proposed by L10K are mechanisms that recognize vCHWs' work; support from Health Extension Workers in the form of ongoing mentoring, training and follow-up, certification, performance reviews, and support by kebele and woreda (i.e., district) leaders. Successful communities and families are rewarded, celebrations are organized periodically, badges and ID cards are provided - in addition to other identification methods like posting their photographs at public places, as well as the provision of refreshments during performance review meetings. Through in-depth interviews and focus group discussions, this study explores the potential efficacy of NFIs proposed by the project. The results of the study outline factors motivating vCHWs, indicate other NFI mechanisms for consideration, and suggest programmatic recommendations. Yared Amare, JSI/Last 10 Kilometers Project, 2009.
Dutchess County Cancer Control Needs Assessment Report (PDF, 573 KB)
As part of the Dutchess County Department of Health efforts to develop a county-level cancer control plan, JSI Research & Training Institute completed a comprehensive assessment of cancer prevention, screening, treatment, and support services in the county. The report includes three substantive parts: an epidemiologic profile of the burden of cancer in Dutchess County; detailed findings from the three components of the needs assessment (key informant interviews, the resource inventory survey, and focus groups); and a set of themes and recommendations to Dutchess County based on these findings. Together, these themes and recommendations form a basis and provide direction for the next stage of comprehensive cancer control in Dutchess County. Stewart Landers, JSI Research & Training Institute, Inc., 2008.
Evaluation of UNICEF Multiple Indicator Cluster Surveys Round 3 (PDF, 2.66 MB)
The Multiple Indicator Cluster Surveys (MICS) represent a bold undertaking on the part of United Nations Children's Fund (UNICEF), which is the world's lead agency for children. Initiated in the mid-1990s to monitor progress toward the World Summit for Children (WSC) goals, the program of household (HH) surveys has grown and changed rapidly. UNICEF commissioned this evaluation of the MICS third round (MICS3) to judge if the initiative's results are justified by the expenses and commitments made, as well as to learn how best to use and improve the MICS and similar data in support of global goals and targets. The evaluation team found that information from the MICS3 is clearly an important part of the evidence base for programming and policy within UNICEF. The MICS3 is valued among global-level partners for global monitoring and advocacy, particularly as related to the Millennium Development Goals (MDGs). John Snow, Inc. 2008.
Evaluation of Vermont's Alzheimer's Disease Demonstration Grant to States Programming Report (PDF, 495 KB)
JSI Research & Training Institute, Inc., conducted an evaluation of Vermont programs that provide supportive, educational and direct service interventions to caregivers of people with Alzheimer's disease or a related disorder (ADRD) for the Vermont Department of Disabilities, Aging and Independent Living. JSI's evaluation presents important considerations for other states which may be planning similar programs. Craig Stevens, JSI Research & Training Institute, Inc., 2008.
Evaluation of the African Youth Alliance Program in Ghana, Tanzania, and Uganda: Impact on Sexual and Reproductive Health Behavior among Young People: Summary Report (PDF, 1.71 MB)
In 2005, the Bill & Melinda Gates Foundation asked JSI Research & Training Institute, Inc., to evaluate the impact of The African Youth Alliance (AYA) program. The main objective of the evaluation was to determine whether exposure to AYA's comprehensive, integrated program resulted in improved adolescent sexual and reproductive health (ASRH) knowledge, attitudes, and sexual behaviors among male and female youth age 17-22 in areas where AYA worked in Ghana, Tanzania, and Uganda.
Results from the evaluation show that a significant number of young people in AYA implementation areas were reached by AYA programs and were able to recall ASRH messages, although the degree of exposure varied by country and by type of intervention. Results further demonstrated a significant positive impact of AYA on several variables, most notably condom use, contraceptive use, partner reduction, and several self-efficacy and knowledge antecedents. Overall, the impact of AYA on ASRH behaviors and their antecedents was greater for young women than for young men, especially in Ghana and Uganda. AYA was implemented from 2000 - 2006 by a unique partnership between the United Nations Population Fund, Pathfinder International, and the Program for Appropriate Technology in Health. Tim Williams, Stephanie Mullen, Ali Karim, Jessica Posner, JSI Research & Training Institute, Inc., 2007.
Cultural Diversity: Focus Group Report (PDF, 822 KB)
This final report presents findings from a qualitative study of elders from diverse communities conducted on behalf of the Boston Partnership on Elder Adults and the Eldercare Alliance. The consultant utilized community-based participatory research methods to rapidly organize focus groups with elders from different ethnic and social groups. The key questions focused on whether elders from each community would use various community- and home-based services and the factors influencing their choices. The findings were presented at a 2005 summit entitled What Does It Take to Keep an Elder at Home? in Roxbury, Massachusetts. JSI Research & Training Institute, Inc., June 2005.
Republic of Georgia Contraceptive Availability Assessment: Final Report (PDF, 548 KB)
This assessment identifies contraceptive availability issues, such as public sector supplies, availability and affordability in the private sector, existing policies, and supply chain constraints for the Republic of Georgia. It also provides recommendations on contraceptive availability and analyses key issues such as forecasting and costs.
JSI Research & Training Institute, Inc./Healthy Women in Georgia (HWG) Program. November, 2004.
Health Care Purchasing Among Private and Public Employers in California (PDF, 1.74 MB)
This report presents the findings from a comprehensive survey of health purchasing practices among 318 of California's largest private and public employers. Conducted by researchers at the JSI Research & Training Institute and the Massachusetts Institute of Technology, the survey attained a response rate of 85 percent, presenting an accurate view of health benefits among large employers in California. JSI Research & Training Institute, Inc. 2004
Ritual Use of Mercury: Assessment and Education Project Report (PDF, 233 KB)
In June 2003, JSI conducted an educational program and assessed the use of elemental mercury for spiritual, ritual, and cultural practices among Latino residents of Lawrence, Massachusetts. The study was conducted by Latino residents who have been hired and trained as environmental health educators in the community. JSI Center For Environmental Health Studies. 2003.
Evaluation of the WIN Project: Evidence of Effectiveness (PDF, 1.31 MB)
From 1999 to 2003, the Women and Infant Health (WIN) Project worked in close collaboration with the Ministry of Health of the Russian Federation to improve the quality of maternal and newborn services and to increase access to and demand for high quality reproductive health services in three Russian cities. This report compiles the findings from the project's varied baseline and endline facility and household surveys and routine facility monitoring system in a data-based description of project results. JSI/WIN Project, August 2003.
Contraceptive Logistics Guidelines For Refugee Settings (PDF, 1.11 MB)
The guidelines in this manual provide an outline of basic contraceptive logistics management principles and procedures used by program managers in camps for refugees or displaced persons. By using the steps outlined in the manual, program managers can design and implement a simple contraceptive logistics system in a camp where family planning programs are underway. Chapters cover estimating quantities of contraceptives needed, designing and developing contraceptive logistics management information systems, managing contraceptive inventories, and storing contraceptives. JSI/Family Planning Logistics Management (FPLM). 1996.
Back to top
