As part of an investment by the Bill & Melinda Gates Foundation to support the Government of Bihar to improve reproductive, maternal, newborn and child health and nutrition (RMNCHN) statewide, BBC Media Action implemented multiple communication tools to support front-line worker (FLW) outreach. We analyse the impacts of a package of mHealth audio messaging and paper-based job aids used by FLWs during government-sponsored village health, sanitation and nutrition days (VHSNDs) on knowledge and practices of childbearing women across the RMNCHN continuum of care. Data from two surveys collected between July and September 2016 were analysed using logistic regression to compare health-related knowledge and behaviours between women who had been exposed at VHSNDs to the mHealth GupShup Potli (GSP) audio recordings or interpersonal communication (IPC) tools versus those who were unexposed. Exposure to GSP recordings (n=2608) was associated with improved knowledge across all continuum-of-care domains, as well as improved health-related behaviours in some domains. The odds of having taken iron-folic acid (IFA) tablets were significantly higher in exposed women (OR 1.5, 95% CI 1.1 to 2.2), as was contraceptive use (OR 2.0, 95% CI 1.2 to 3.2). There were no differences in birth preparedness or complementary feeding practices between groups. Exposure to IPC paper-based tools (n=2002) was associated with a twofold increased odds of IFA consumption (OR 2.3, 95% CI 1.7 to 3.2) and contraceptive use (OR 1.8, 95% CI 1.2 to 2.8). Women exposed to both tools were generally at least twice as likely to subsequently discuss the messages with others. BBC Media Action's mHealth audio messaging job aids and paper-based IPC tools were associated with improved knowledge and practices of women who were exposed to them across multiple domains, suggesting their important potential for improving health outcomes for beneficiaries at scale in low-resource settings. NCT02726230.

Background

Mobile health (mHealth) tools have potential for improving the reach and quality of health information and services through community health workers in low- and middle-income countries. This study evaluates the impact of an mHealth tool implemented at scale as part of the statewide reproductive,maternal, newborn and child health and nutrition (RMNCHN) program in Bihar, India.

Methods

Three survey-based data sets were analysed to compare the health-related knowledge, attitudes and behaviours amongst childbearing women exposed to the Mobile Kunji and Dr. Anita mHealth tools during their visits with frontline workers compared with those who were unexposed.

Results

An evaluation by Mathematica (2014) revealed that exposure to Mobile Kunji and Dr. Anita recordings were associated with significantly higher odds of consuming iron-folic acid tablets (odds ratio (OR) = 2.3, 95% confidence interval (CI) = 1.8-3.1) as well as taking a set of three measures for delivery preparedness (OR = 2.8, 95% CI = 1.9-4.2) and appropriate infant complementary feeding (OR = 1.9, 95% CI = 1.0-3.5). CARE India's Community-based Household Surveys (2012-2017) demonstrated significant improvements in early breastfeeding (OR = 1.64, 95% CI = 1.5-1.78) and exclusive breastfeeding (OR = 1.46, 95% CI = 1.33-1.62) in addition to birth preparedness practices. BBC Media Action's Usage & Engagement Survey (2014) demonstrated a positive association between exposure to Mobile Kunji and Dr. Anita and exclusive breastfeeding (58% exposed vs 43% unexposed, P < 0.01) as well as maternal respondents' trust in their frontline worker.

Conclusions

Significant improvements in RMNCHN-related knowledge and behaviours were observed for Bihari women who were exposed to Mobile Kunji and Dr. Anita. This analysis is unique in its rigorous evaluation across multiple data sets of mHealth interventions implemented at scale. These results can help inform global understanding of how best to use mHealth tools, for whom, and in what contexts.

Study registration

ClinicalTrials.gov number NCT02726230.

In 2010, the Bill and Melinda Gates Foundation (BMGF) partnered with the Government of Bihar (GoB), India to launch the Ananya program to improve reproductive, maternal, newborn and child health and nutrition (RMNCHN) outcomes. The program sought to address supply- and demand-side barriers to the adoption, coverage, quality, equity and health impact of select RMNCHN interventions. Approaches included strengthening frontline worker service delivery; social and behavior change communications; layering of health, nutrition and sanitation into women's self-help groups (SHGs); and quality improvement in maternal and newborn care at primary health care facilities. Ananya program interventions were piloted in approximately 28 million population in eight innovation districts from 2011-2013, and then beginning in 2014, were scaled up by the GoB across the rest of the state's population of 104 million. A Bihar Technical Support Program provided techno-managerial support to governmental Health as well as Integrated Child Development Services, and the JEEViKA Technical Support Program supported health layering and scale-up of the GoB's SHG program. The level of support at the block level during statewide scale-up in 2014 onwards was approximately one-fourth that provided in the pilot phase of Ananya in 2011-2013. This paper - the first manuscript in an 11-manuscript and 2-viewpoint collection on Learning from Ananya: Lessons for primary health care performance improvement - seeks to provide a broad description of Ananya and subsequent statewide adaptation and scale-up, and capture the background and context, key objectives, interventions, delivery approaches and evaluation methods of this expansive program. Subsequent papers in this collection focus on specific intervention delivery platforms. For the analyses in this series, Stanford University held key informant interviews and worked with the technical support and evaluation grantees of the Ananya program, as well as leadership from the India Country Office of the BMGF, to analyse and synthesise data from multiple sources. Capturing lessons from the Ananya pilot program and statewide scale-up will assist program managers and policymakers to more effectively design and implement RMNCHN programs at scale through technical assistance to governments.

Background

The Government of Bihar (GoB) in India, the Bill and Melinda Gates Foundation and several non-governmental organisations launched the Ananya program aimed to support the GoB to improve reproductive, maternal, newborn and child health and nutrition (RMNCHN) statewide. Here we summarise changes in indicators attained during the initial two-year pilot phase (2012-2013) of implementation in eight focus districts of approximately 28 million population, aimed to inform subsequent scale-up.

Methods

The quasi-experimental impact evaluation included statewide household surveys at two time points during the pilot phase: January-April 2012 ("baseline") including an initial cohort of beneficiaries and January-April 2014 ("midline") with a new cohort. The two arms were: 1) eight intervention districts, and 2) a comparison arm comprised of the remaining 30 districts in Bihar where Ananya interventions were not implemented. We analysed changes in indicators across the RMNCHN continuum of care from baseline to midline in intervention and comparison districts using a difference-in-difference analysis.

Results

Indicators in the two arms were similar at baseline. Overall, 40% of indicators (20 of 51) changed significantly from baseline to midline in the comparison districts unrelated to Ananya; two-thirds (n = 13) of secular indicator changes were in a direction expected to promote health. Statistically significant impact attributable to the Ananya program was found for 10% (five of 51) of RMNCHN indicators. Positive impacts were most prominent for mother's behaviours in contraceptive utilisation.

Conclusions

The Ananya program had limited impact in improving health-related outcomes during the first two-year period covered by this evaluation. The program's theories of change and action were not powered to observe statistically significant differences in RMNCHN indicators within two years, but rather aimed to help inform program improvements and scale-up. Evaluation of large-scale programs such as Ananya using theory-informed, equity-sensitive (including gender), mixed-methods approaches can help elucidate causality and better explain pathways through which supply- and demand-side interventions contribute to changes in behaviour among the actors involved in the production of population-level health outcomes. Evidence from Bihar indicates that deep structural constraints in health system organisation and delivery of interventions pose substantial limitations on behaviour change among health care providers and beneficiaries.

Study registration

ClinicalTrials.gov number NCT02726230.

Background

Self-help group (SHG) interventions have been widely studied in low and middle income countries. However, there is little data on specific impacts of health layering, or adding health education modules upon existing SHGs which were formed primarily for economic empowerment. We examined three SHG interventions from 2012-2017 in Bihar, India to test the hypothesis that health-layering of SHGs would lead to improved health-related behaviours of women in SHGs.

Methods

A model for health layering of SHGs - Parivartan - was developed by the non-governmental organisation (NGO), Project Concern International, in 64 blocks of eight districts. Layering included health modules, community events and review mechanisms. The health layering model was adapted for use with government-led SHGs, called JEEViKA+HL, in 37 other blocks of Bihar. Scale-up of government-led SHGs without health layering (JEEViKA) occurred contemporaneously in 433 other blocks, providing a natural comparison group. Using Community-based Household Surveys (CHS, rounds 6-9) by CARE India, 62 reproductive, maternal, newborn and child health and nutrition (RMNCHN) and sanitation indicators were examined for SHGs with health layering (Pavivartan SHGs and JEEViKA+HL SHGs) compared to those without. We calculated mean, standard deviation and odds ratios of indicators using surveymeans and survey logistic regression.

Results

In 2014, 64% of indicators were significantly higher in Parivartan members compared to non-members residing in the same blocks. During scale up, from 2015-17, half (50%) of indicators had significantly higher odds in health layered SHG members (Parivartan or JEEViKA+HL) in 101 blocks compared to SHG members without health layering (JEEViKA) in 433 blocks.

Conclusions

Health layering of SHGs was demonstrated by an NGO-led model (Parivartan), adapted and scaled up by a government model (JEEViKA+HL), and associated with significant improvements in health compared to non-health-layered SHGs (JEEViKA). These results strengthen the evidence base for further layering of health onto the SHG platform for scale-level health change.

Study registration

ClinicalTrials.gov number NCT02726230.

Background

The objective of this study was to assess the impact of self-help groups (SHGs) and subsequent scale-up on reproductive, maternal, newborn, child health, and nutrition (RMNCHN) and sanitation outcomes among marginalised women in Bihar, India from 2014-2017.

Methods

We examined RMNCHN and sanitation behaviors in women who were members of any SHGs compared to non-members, without differentiating between types of SHGs. We analysed annual surveys across 38 districts of Bihar covering 62 690 women who had a live birth in the past 12 months. All analyses utilised data from Community-based Household Surveys (CHS) rounds 6-9 collected in 2014-2017 by CARE India as part of the Bihar Technical Support Program funded by the Bill & Melinda Gates Foundation. We examined 66 RMNCHN and sanitation indicators using survey logistic regression; the comparison group in all cases was age-comparable women from the geographic contexts of the SHG members but who did not belong to SHGs. We also examined links between discussion topics in SHGs and changes in relevant behaviours, and stratification of effects by parity and mother's age.

Results

SHG members had higher odds compared to non-SHG members for 60% of antenatal care indicators, 22% of delivery indicators, 70% of postnatal care indicators, 50% of nutrition indicators, 100% of family planning and sanitation indicators and no immunisation indicators measured. According to delivery platform, most FLW performance indicators (80%) had increased odds, followed by maternal behaviours (57%) and facility care and outreach service delivery (22%) compared to non-SHG members. Self-report of discussions within SHGs on specific topics was associated with increased related maternal behaviours. Younger SHG members (<25 years) had attenuated health indicators compared to older group members (≥25 years), and women with more children had more positive indicators compared to women with fewer children.

Conclusions

SHG membership was associated with improved RMNCHN and sanitation indicators at scale in Bihar, India. Further work is needed to understand the specific impacts of health layering upon SHGs. Working through SHGs is a promising vehicle for improving primary health care.

Study registration

ClinicalTrials.gov number NCT02726230.

Background

Despite increasing focus on health inequities in low- and middle income countries, significant disparities persist. We analysed impacts of a statewide maternal and child health program among the most compared to the least marginalised women in Bihar, India.

Methods

Utilising survey-weighted logistic regression, we estimated programmatic impact using difference-in-difference estimators from Mathematica data collected at the beginning (2012, n = 10 174) and after two years of program implementation (2014, n = 9611). We also examined changes in disparities over time using eight rounds of Community-based Household Surveys (CHS) (2012-2017, n = 48 349) collected by CARE India.

Results

At baseline for the Mathematica data, least marginalised women generally performed desired health-related behaviours more frequently than the most marginalised. After two years, most disparities persisted. Disparities increased for skilled birth attendant identification [+16.2% (most marginalised) vs +32.6% (least marginalized), P < 0.01) and skin-to-skin care (+14.8% vs +20.4%, P < 0.05), and decreased for immediate breastfeeding (+10.4 vs -4.9, P < 0.01). For the CHS data, odds ratios compared the most to the least marginalised women as referent. Results demonstrated that disparities were most significant for indicators reliant on access to care such as delivery in a facility (OR range: 0.15 to 0.48) or by a qualified doctor (OR range: 0.08 to 0.25), and seeking care for complications (OR range: 0.26 to 0.64).

Conclusions

Disparities observed at baseline generally persisted throughout program implementation. The most significant disparities were observed amongst behaviours dependent upon access to care. Changes in disparities largely were due to improvements for the least marginalised women without improvements for the most marginalised. Equity-based assessments of programmatic impacts, including those of universal health approaches, must be undertaken to monitor disparities and to ensure equitable and sustainable benefits for all.

Study registration

ClinicalTrials.gov number NCT02726230.

Background

The Ananya program in Bihar implemented household and community-level interventions to improve reproductive, maternal, newborn and child health and nutrition (RMNCHN) in two phases: a first phase of intensive ancillary support to governmental implementation and innovation testing by non-government organisation (NGO) partners in eight focus districts (2012-2014), followed by a second phase of state-wide government-led implementation with techno-managerial assistance from NGOs (2014 onwards). This paper examines trends in RMNCHN indicators in the program's implementation districts from 2012-2017.

Methods

Eight consecutive rounds of cross-sectional Community-based Household Surveys conducted by CARE India in 2012-2017 provided comparable data on a large number of indicators of frontline worker (FLW) performance, mothers' behaviours, and facility-based care and outreach service delivery across the continuum of maternal and child care. Logistic regression, considering the complex survey design and sample weights generated by that design, was used to estimate trends using survey rounds 2-5 for the first phase in the eight focus districts and rounds 6-9 for the second phase in all 38 districts statewide, as well as the overall change from round 2-9 in focus districts. To aid in contextualising the results, indicators were also compared amongst the formerly focus and the non-focus districts at the beginning of the second phase.

Results

In the first phase, the levels of 34 out of 52 indicators increased significantly in the focus districts, including almost all indicators of FLW performance in antenatal and postnatal care, along with mother's birth preparedness, some breastfeeding practices, and immunisations. Between the two phases, 33 of 52 indicators declined significantly. In the second phase, the formerly focus districts experienced a rise in the levels of 14 of 50 indicators and a decline in the levels of 14 other indicators. There was a rise in the levels of 22 out of 50 indicators in the non-focus districts in the second phase, with a decline in the levels of 13 other indicators.

Conclusions

Improvements in indicators were conditional on implementation support to program activities at a level of intensity that was higher than what could be achieved at scale so far. Successes during the pilot phase of intensive support suggests that RMNCHN can be improved statewide in Bihar with sufficient investments in systems performance improvements.

Study registration

ClinicalTrials.gov number NCT02726230.