This training and reference guide was developed for family planning service providers interested in using the checklist entitled How to be Reasonably Sure a Client is Not Pregnant commonly referred to as the Checklist. Designed to serve as both a training and reference tool the guide is composed of two parts: a training module and a collection of essential up-to-date reference materials. This guide is part of a series to train on other checklists including the Checklist for Screening Clients Who Want to Initiate Combined Oral Contraceptives the Checklist for Screening Clients Who Want to Initiate DMPA (or NET-EN) and the Checklist for Screening Clients Who Want to Initiate Use of the Copper IUD. The Pregnancy Checklist was developed to assist service providers in ruling out pregnancy among women who wish to initiate their contraceptive method of choice. This simple job aid is based on criteria endorsed by the World Health Organization (WHO) and provides an alternative to pregnancy testing for women who are not menstruating at the time of their visit to their provider. The Pregnancy Checklist has been shown to be 99 percent accurate in identifying women who are not pregnant. (excerpt)
Background There is increasing evidence that mobile phone health interventions (“mHealth”) can improve health behaviors and outcomes and are critically important in low-resource, low-access settings. However, the majority of mHealth programs in developing countries fail to reach scale. One reason may be the challenge of developing financially sustainable programs. The goal of this paper is to explore strategies for mHealth program sustainability and develop cost-recovery models for program implementers using 2014 operational program data from Mobile for Reproductive Health (m4RH), a national text-message (SMS) based health communication service in Tanzania. Methods We delineated 2014 m4RH program costs and considered three strategies for cost-recovery for the m4RH program: user pay-for-service, SMS cost reduction, and strategic partnerships. These inputs were used to develop four different cost-recovery scenarios. The four scenarios leveraged strategic partnerships to reduce per-SMS program costs and create per-SMS program revenue and varied the structure for user financial contribution. Finally, we conducted break-even and uncertainty analyses to evaluate the costs and revenues of these models at the 2014 user volume (125,320) and at any possible break-even volume. Results In three of four scenarios, costs exceeded revenue by $94,596, $34,443, and $84,571 at the 2014 user volume. However, these costs represented large reductions (54%, 83%, and 58%, respectively) from the 2014 program cost of $203,475. Scenario four, in which the lowest per-SMS rate ($0.01 per SMS) was negotiated and users paid for all m4RH SMS sent or received, achieved a $5,660 profit at the 2014 user volume. A Monte Carlo uncertainty analysis demonstrated that break-even points were driven by user volume rather than variations in program costs. Conclusions These results reveal that breaking even was only probable when all SMS costs were transferred to users and the lowest per-SMS cost was negotiated with telecom partners. While this strategy was sustainable for the implementer, a central concern is that health information may not reach those who are too poor to pay, limiting the program’s reach and impact. Incorporating strategies presented here may make mHealth programs more appealing to funders and investors but need further consideration to balance sustainability, scale, and impact.
Many mobile health (mHealth) interventions have the potential to generate and store vast amounts of system-generated participant interaction data that could provide insight into user engagement, programmatic strengths, and areas that need improvement to maximize efficacy. However, despite the popularity of mHealth interventions, there is little documentation on how to use these data to monitor and improve programming or to evaluate impact.This study aimed to better understand how users of the Mobile for Reproductive Health (m4RH) mHealth intervention engaged with the program in Tanzania from September 2013 to August 2016.We conducted secondary data analysis of longitudinal data captured by system logs of participant interactions with the m4RH program from 127 districts in Tanzania from September 2013 to August 2016. Data cleaning and analysis was conducted using Stata 13. The data were examined for completeness and "correctness." No missing data was imputed; respondents with missing or incorrect values were dropped from the analyses.The total population for analysis included 3,673,702 queries among 409,768 unique visitors. New users represented roughly 11.15% (409,768/3,673,702) of all queries. Among all system queries for new users, 46.10% (188,904/409,768) users accessed the m4RH main menu. Among these users, 89.58% (169,218/188,904) accessed specific m4RH content on family planning, contraceptive methods, adolescent-specific and youth-specific information, and clinic locations after first accessing the m4RH main menu. The majority of these users (216,422/409,768, 52.82%) requested information on contraceptive methods; fewer users (23,236/409,768, 5.67%) requested information on clinic location. The conversion rate was highest during the first and second years of the program when nearly all users (11,246/11,470, 98.05%, and 33,551/34,830, 96.33%, respectively) who accessed m4RH continued on to query more specific content from the system. The rate of users that accessed m4RH and became active users declined slightly from 98.05% (11,246/11,470) in 2013 to 87.54% (56,696/64,765) in 2016. Overall, slightly more than one-third of all new users accessing m4RH sent queries at least once per month for 2 or more months, and 67.86% (278,088/409,768) of new and returning users requested information multiple times per month. Promotional periods were present for 15 of 36 months during the study period.The analysis of the rich data captured provides a useful framework with which to measure the degree and nature of user engagement utilizing routine system-generated data. It also contributes to knowledge of how users engage with text messaging (short message service)-based health promotion interventions and demonstrates how data generated on user interactions could inform improvements to the design and delivery of a service, thereby enhancing its effectiveness.
Summary A job aid is a tool, such as a flowchart or checklist, that makes it easier for staff to carry out tasks by providing quick access to needed information. Many public health organizations are engaged in the production of job aids intended to improve adherence to important medical guidelines and protocols, particularly in resource-constrained countries. However, some evidence suggests that actual use of job aids remains low. One strategy for improving utilization is the introduction of job aids in training workshops. This paper summarizes the results of two separate evaluations conducted in Uganda and the Dominican Republic (DR) which measured the usefulness of a series of four family planning checklists 7–24 months after distribution in training workshops. While more than half of the health care providers used the checklists at least once, utilization rates were sub-optimal. However, the vast majority of those providers who utilized the checklists found them to be very useful in their work.
BACKGROUND Many mobile health (mHealth) interventions have the potential to generate and store vast amounts of system-generated participant interaction data that could provide insight into user engagement, programmatic strengths, and areas that need improvement to maximize efficacy. However, despite the popularity of mHealth interventions, there is little documentation on how to use these data to monitor and improve programming or to evaluate impact. OBJECTIVE This study aimed to better understand how users of the Mobile for Reproductive Health (m4RH) mHealth intervention engaged with the program in Tanzania from September 2013 to August 2016. METHODS We conducted secondary data analysis of longitudinal data captured by system logs of participant interactions with the m4RH program from 127 districts in Tanzania from September 2013 to August 2016. Data cleaning and analysis was conducted using Stata 13. The data were examined for completeness and “correctness.” No missing data was imputed; respondents with missing or incorrect values were dropped from the analyses. RESULTS The total population for analysis included 3,673,702 queries among 409,768 unique visitors. New users represented roughly 11.15% (409,768/3,673,702) of all queries. Among all system queries for new users, 46.10% (188,904/409,768) users accessed the m4RH main menu. Among these users, 89.58% (169,218/188,904) accessed specific m4RH content on family planning, contraceptive methods, adolescent-specific and youth-specific information, and clinic locations after first accessing the m4RH main menu. The majority of these users (216,422/409,768, 52.82%) requested information on contraceptive methods; fewer users (23,236/409,768, 5.67%) requested information on clinic location. The conversion rate was highest during the first and second years of the program when nearly all users (11,246/11,470, 98.05%, and 33,551/34,830, 96.33%, respectively) who accessed m4RH continued on to query more specific content from the system. The rate of users that accessed m4RH and became active users declined slightly from 98.05% (11,246/11,470) in 2013 to 87.54% (56,696/64,765) in 2016. Overall, slightly more than one-third of all new users accessing m4RH sent queries at least once per month for 2 or more months, and 67.86% (278,088/409,768) of new and returning users requested information multiple times per month. Promotional periods were present for 15 of 36 months during the study period. CONCLUSIONS The analysis of the rich data captured provides a useful framework with which to measure the degree and nature of user engagement utilizing routine system-generated data. It also contributes to knowledge of how users engage with text messaging (short message service)-based health promotion interventions and demonstrates how data generated on user interactions could inform improvements to the design and delivery of a service, thereby enhancing its effectiveness.
To address low contraceptive use in Tanzania, a pilot intervention using a mobile job aid was developed to guide community health workers (CHWs) to deliver integrated counseling on family planning, HIV, and other sexually transmitted infections (STIs). In this article, we describe the process of developing the family planning algorithms and implementation of the mobile job aid, discuss how the job aid supported collection of real-time data for decision making, and present the cost of the overall system based on an evaluation of the pilot. The family planning algorithm was developed, beginning in June 2011, in partnership with the Tanzania Ministry of Health and Social Welfare based on a combination of evidence-based tools such as the Balanced Counseling Strategy Plus Toolkit. The pilot intervention and study was implemented with 25 CHWs in 3 wards in Ilala district in Dar es Salaam between January 2013 and July 2013. A total of 710 family planning users (455 continuing users and 255 new users) were registered and counseled using the mobile job aid over the 6-month intervention period. All users were screened for current pregnancy, questioned on partner support for contraceptive use, counseled on a range of contraceptives, and screened for HIV/STI risk. Most new and continuing family planning users chose pills and male condoms (59% and 73%, respectively). Pills and condoms were provided by the CHW at the community level. Referrals were made to the health facility for pregnancy confirmation, injectable contraceptives, long-acting reversible contraceptives and HIV/STI testing. Follow-up visits with clients were planned to confirm completion of the health facility referral. The financial cost of implementing this intervention with 25 CHWs and 3 supervisors are estimated to be US$26,000 for the first year. For subsequent years, the financial costs are estimated to be 73% lower at $7,100. Challenges such as limited client follow-up by CHWs and use of data by supervisors identified during the pilot are currently being addressed during the scale-up phase by developing accountability and incentive mechanisms for CHWs and dashboards for data access and use.