Evidence & Impact

The evidence behind CommCare

Peer-reviewed research, third-party evaluations, and grey literature on how CommCare changes outcomes for frontline workers and the people they serve.

Overview

Why this evidence base exists

Frontline workers are the first point of care in many low-resource communities. Governments and NGOs increasingly equip them with digital tools to improve service delivery. This page synthesizes 16 years of independent research on whether CommCare, Dimagi’s open-source frontline platform, actually does that.

Equipping frontline workers with CommCare improves their service delivery and leads to improved client outcomes and behaviors.

The CommCare Evidence Base is the live list of every peer-reviewed study and consequential grey-literature paper that helps answer this question. New studies are added as they’re published. The summary below walks through the five major themes that emerge from the research; independent third-party evaluations of CommCare’s reach are summarized separately under Beyond outcomes.

Methodology & growth of the evidence base

“Grey literature” refers to research not published in peer-reviewed journals, such as reports and evaluations. The Evidence Base includes studies that meet two criteria:

  • 1The study helps assess the effect of frontline workers using CommCare in terms of frontline worker service delivery, client behaviors, or outcomes.
  • 2Either the study is described in a peer-reviewed publication, or it is a “grey literature” study that, in our opinion, contributes substantially to understanding the value of frontline workers using CommCare relative to peer-reviewed publications.

We interpret the first criterion broadly: we exclude studies that happened to use CommCare for data collection in lieu of paper surveys, since that use isn’t relevant to how CommCare affects the work of frontline workers. We include all relevant peer-reviewed studies and a curated subset of grey-literature studies.

Category definitions (matching the chart above): Client: peer-reviewed papers investigating client outcomes. Frontline worker: peer-reviewed papers on frontline worker service delivery. Feasibility: peer-reviewed papers on acceptability or conceptual frameworks. Data: studies demonstrating value derived from CommCare-collected data. Grey lit: non-peer-reviewed studies we deemed important.

Findings by theme

Each theme’s studies and figures are shown below.

Theme 1 · Findings

Client health outcomes and behaviors

Two randomized controlled trials (RCTs) and several field studies on how equipping frontline workers with CommCare improves clients’ health behaviors and outcomes.

2 RCTsBihar · Tanzania · Uttar Pradesh · Guatemala

Bihar, India

Improved client behaviors and outcomes

A study by Mathematica Policy Research provides statistically significant evidence of behavior change in clients whose frontline workers use CommCare [Borkum, 2015]. The setting was Saharsa district in Bihar, a district with persistently low health outcomes in one of India’s poorest and most populous states. The study surveyed 1,500 women across 70 sub-centers, half randomized to intervention and half to control.

All 70 sub-centers already received an extensive health-system-strengthening package. The only difference in the intervention arm: frontline workers used a CommCare application with a scheduler supported by MOTECH (a separate digital health platform).

The CommCare intervention produced statistically significant improvements across antenatal care, delivery and newborn care, child nutrition, and reproductive health; child immunizations were the only domain without a significant effect. All four significant impacts were positive. These results are especially notable given the strong non-ICT health system strengthening already in place in the control arm, showing CommCare's value on top of extensive community health support.

Most notably, women whose frontline workers used CommCare were 73% more likely to attend at least three antenatal care visits. Interestingly, improvements in client health outcomes were not always matched by increases in client knowledge of those behaviors, suggesting CommCare also reduced non-knowledge barriers such as cultural norms.

At least 3 ANC visits***
73%
At least 90 IFA tablets consumed***
58%
Use of permanent methods of contraception**
36%
Use of any modern method of contraception (ever)***
34%
Use of temporary methods of contraception (ever)**
32%
Child began eating solid food by age 6 months**
29%
Use of any modern method of contraception (current)**
26%
Obtained phone number for delivery**
23%
Immediate breastfeeding**
22%
Child eats solid or semisolid food*
16%
Skin-to-skin care*
13%
At least 2 TT injections**
5%

Statistically Significant Indicators, Intervention Difference as Percent of Control mean

Figure 2: The statistically significant improvements in antenatal care, delivery and newborn care, child nutrition, and reproductive health in the CommCare intervention group [Borkum, 2015].

The report also suggests several areas for improvement in implementing CommCare. There were a few indicators where behaviors decreased, though these were not statistically significant results. On a programmatic level, the study reported challenges with data connectivity and broken mobile phones, which sometimes resulted in poor coordination between frontline workers and supervisors. Frontline workers also experienced an increased workload due to the continuation of paper documentation required by the government.

Despite these logistical challenges and the lack of improvements in supervision, equipping frontline workers with CommCare created a significant impact on client health outcomes and behaviors.

Tanzania

Increased facility-based delivery rates

The results from an RCT in rural Tanzania report that mothers tracked by frontline workers using CommCare had increased facility-based delivery rates, especially among first-time mothers with low antenatal care uptake [Hackett, 2018]. As with the study in Bihar, both the control and intervention groups received health system strengthening services; in this case, those services were administered by World Vision. The frontline workers in the intervention group were also equipped with CommCare applications (implemented and supported by D-tree International) to assist with data collection, education, danger sign identification, and referrals.

The study included 32 villages that were cluster-randomized to control or intervention. The study surveyed a total of 572 women and found that “The smartphone intervention was associated with significantly higher facility delivery: 74% of mothers in intervention areas delivered at or in transit to a health facility, versus 63% in control areas. The odds of facility delivery among women counseled by smartphone-assisted health workers were double the odds among women living in control villages (OR, 1.96; CI, 1.21±3.19; adjusted analyses).” First-time mothers with low antenatal care uptake saw the biggest gains: their facility-based delivery rates were 32% higher than the control group.

Uttar Pradesh, India

Improvements in antenatal and postnatal care

In India, Catholic Relief Services (CRS) deployed the ReMiND (‘Reducing Maternal and Newborn Deaths’) project developed on the CommCare platform. The intervention required development and implementation of a mobile application used as a job aid by ASHAs for registering pregnant women and for providing real-time guidance through key counseling points, decision support, timely alerts and referral algorithms for various maternal and child health issues.

A study of the effectiveness of ReMiND found a statistically significant increase in coverage of iron and folic acid supplementation (12.58%), self-reporting of complications during pregnancy (13.11%) and after delivery (19.6%). The coverage of three or more antenatal care visits increased significantly in the intervention area (10.3%) [Prinja, 2017].

Guatemala

Reduced maternal and infant mortality

A study on TulaSalud’s implementation of CommCare in Guatemala provides evidence of reduced maternal mortality rates (MMR) and infant mortality rates (IMR), as compared to the control areas and the provincial average [Martinez-Fernandez, 2015].

The ICT intervention took place in Alta Verapaz, a predominantly rural region of northern Guatemala with high maternal and infant mortality rates. 125 frontline workers in Alta Verapaz were equipped with mobile phones and the Kawok system developed by TulaSalud, which was built on CommCare, to assist with making client consultations, collecting epidemiological data, receiving continuous training, and performing community health promotion and prevention activities. After five years (2008 to 2012) of this intervention that included CommCare, an observational study was conducted to compare the MMR and IMR between the districts with frontline workers using CommCare, and those without it. Both the intervention and control areas had similar hospital access, racial/ethnic makeup, age, education, etc.

The study found that in intervention areas, MMR decreased by 18% from 309 to 254 maternal deaths per 100,000 live births (p<0.05), and IMR decreased by 48% from 25 to 13 infant deaths per 1,000 live births (p=0.054). Figure 3 describes the IMR rates over time in the areas with and without the ICT intervention, as well as the entire region between 2008 and 2012.

0510152025303520082009201020112012withtelemedicinewithouttelemedicinewholedepartmentInfant Mortality RateYear
Figure 3: This figure maps the decrease in IMR rate from 2008 to 2012, dropping from 25 infant deaths to 13 infant deaths per 1,000 live births within the intervention as compared to the control areas and the entire region [Martínez-Fernández, 2015].

Other studies

Client health outcomes and behaviors

Several other studies also showed client health-seeking behavior change in the areas of antenatal care, institutional delivery, and postnatal care. While the above studies are each more rigorous than the ones described in this section, these additional studies suggest that the findings are generalizable to other contexts.

Several other studies reported high institutional delivery rates among clients of frontline workers using CommCare [Amoah, 2016] [Battle, 2015] [Hoy, 2015] [World Vision, 2013]. For example, D-tree International implemented a project using CommCare in Zanzibar to increase the institutional delivery rates, especially in cases of complicated pregnancies [Hoy, 2015]. Traditional birth attendants (TBAs) were equipped with CommCare to identify danger signs, refer clients, record family members’ permission to transport the women to a health facility in case of emergencies, and facilitate transportation payment to local vehicle owners. The intervention reported a 71% institutional delivery rate, compared to the regional average of 32%.

These studies demonstrate that the effects of CommCare hold over a wide range of geographies and maternal and child health programs. The results show that women with previously lower antenatal care uptake [Hackett, 2018] and lower castes [Borkum, 2015] experience a higher positive impact in CommCare interventions. Taken together, there is a strong pool of evidence indicating that pregnant women who are tracked by frontline workers using CommCare have improved health outcomes and behaviors in the areas of antenatal care, institutional deliveries, and child health.

Theme 2 · Findings

Frontline worker performance

How equipping frontline workers with CommCare affects their legitimacy, knowledge, activity, and overall performance in the field.

2 RCTsLegitimacy · Knowledge · Activity · Performance

Frontline worker legitimacy and client interaction

Several studies have shown that CommCare improves frontline workers’ personal credibility and the credibility of the health messages they deliver [Bhavsar, 2014] [Medhi, 2012] [Schwartz, 2013] [Braun, 2016] [Gopalakrishnan, 2020]. These findings have emerged from qualitative interviews with frontline workers, who have reported that CommCare enhances their credibility in their communities, and that clients and clients’ families perceive recorded messages as more trustworthy. CommCare is widely viewed as an independent, objective source of information, which greatly benefits frontline workers’ ability to deliver sensitive messages. Frontline workers and clients in Tanzania reported that CommCare is a highly acceptable counseling tool, particularly for its improved sense of privacy and trust with clients [Braun, 2016].

A study of 50 frontline workers in India found that home visits with pregnant women were more inclusive and interactive when CommCare was used. The client’s husband and mother-in-law were 60% and 110% more likely to participate during the visit, respectively, and the client was 33% more likely to ask questions when CommCare was used by the frontline worker [Mohamed, 2014]. The Mathematica study in Bihar also found that frontline workers who use CommCare were 37% more likely to report a high level of confidence in their skill and ability to do their job, and 20% more likely to run regular frontline worker meetings by themselves [Borkum, 2015]. In a qualitative study examining both frontline workers’ and beneficiaries’ perceptions of a CommCare intervention in Bihar and Madhya Pradesh, frontline workers reported being better able to engage and build trust with influential household members beyond their direct clients, such as mothers-in-law, which in turn increased direct clients’ ability to interact with frontline workers and receive necessary care. Frontline workers also reported that features of this intervention intrigued other community members and encouraged them to gather around frontline workers to receive information, thus allowing frontline workers to engage with more clients [Gopalakrishnan, 2020].

Frontline worker knowledge

Frontline workers who use CommCare for maternal and child health interventions have been shown to be more knowledgeable about the health topics and services they provide. A study on CommCare in India showed improvements in frontline worker knowledge of at least three to five pregnancy danger signs by 22% [Kumar, 2012]. In Nigeria, frontline workers combating the Ebola Virus Disease improved their knowledge of the disease, with statistically significant improvements (p<.05) on questions about human transmission of the virus, common symptoms, and whether Ebola fever is preventable. The study also noted reinforcement against risky behaviors such as contact with Ebola patients, eating bush meat, and risky burial practices [Otu, 2016].

Frontline worker activity

Frontline workers whose tasks are tracked through CommCare have been found to perform more efficiently and consistently. A study in South Africa observed an increase in adverse event form submission from 5% to 27% when switching from paper forms to CommCare [Chaiyachati, 2013]. Two studies in India found that CommCare improves frontline worker performance during home visits, particularly in their frequency and timeliness [Borkum, 2015]. In particular, CRS found that, after introducing CommCare, the percentage of women ever visited by a frontline worker increased by 15%, the number of frontline worker visits per pregnant woman nearly doubled, and the percentage of women receiving counseling from their frontline worker increased by 28% [Murless, 2015]. In Bihar, India, Mathematica surveyed clients about frontline worker home visit consistency and found that frontline workers using CommCare were more likely to conduct visits at critical times throughout pregnancy and early childhood than in the control group (Figure 4) [Borkum, 2015].

Control
Treatment (regression adjusted)
At least two home visits in final trimester
42
52
**
Home visit within 24 hours of delivery
39
43
Home visit within 1 week of delivery
60
73
***
Home visit within 1 month of delivery
67
74
*
Complementary feeding home visit (child 5 months or older)
36
45
**
Family planning home visit
27
29
Figure 4: Frontline Worker Visit Frequency (reported by clients). Increases in frontline worker visit frequency, particularly in the final trimester and within one week of delivery, among women in the CommCare intervention group as compared to the control [Borkum, 2015].

Home visit consistency improved at every recorded stage of maternal and newborn care among frontline workers who used CommCare in the Mathematica study in Bihar. In a study conducted in Indonesia, the ability to track frontline worker tasks through CommCare was cited as a mechanism for motivation and engagement [Walton, 2020]. These findings reinforce the notion that CommCare’s capacity to track when and how frontline workers perform tasks in the field increases performance and accountability.

Frontline worker performance

Two RCTs have been conducted to measure the added impact of supplemental features to the CommCare application on frontline worker performance. The first study uses text message reminders while the second uses web- and voice-based performance feedback to evaluate the added impact of the CommCare additions on frontline worker performance.

Text message feedback. An RCT in Tanzania found that text message feedback generated from data collected by CommCare increased frontline worker visit frequency. The approach hinges on the fact that frontline workers’ visits are reported in near real-time to CommCare’s web portal, where visit data is monitored by frontline worker supervisors. The study found that text message reminders that were escalated to a supervisor in the case of a missed visit improved frontline worker visit timeliness by 86%, compared to CommCare-using frontline workers who did not receive text message reminders [DeRenzi, 2012].

Self-Tracking Tool. An RCT in India was conducted to measure the impact of phone-based motivational messages on frontline worker performance [DeRenzi, 2016]. The intervention was randomized into two groups, one who received generic advice and encouragement messages irrespective of their performance, and the intervention group who was given a self-tracking tool allowing frontline workers to monitor their own performance through visual graphs and audio messages. The study found that the intervention group made 24% more visits than the control group within the 12-month intervention period. The study also found a correlation between frontline worker performance and usage of the self-tracking tool. Within the intervention group, most frontline workers used both web- and voice-based feedback channels, highlighting the demand for diverse feedback mechanisms in frontline worker programs.

Theme 3 · Findings

Quality of care

Guiding health workers through clinical protocols to improve antenatal care, delivery, and adherence in low-resource settings.

Cluster RCTBurkina Faso · Nigeria · Kenya · India

Antenatal care and delivery

CommCare has proven effective in improving antenatal care and delivery. In Nigeria, Pathfinder International found that CommCare increased the antenatal care visit quality score from 13.3 at baseline to 17.2 (out of 25) at end-line in antenatal care clinics. The study found that CommCare improved the quality of health counseling during ANC, and the frequency at which healthcare providers performed more technical aspects of care during antenatal care visits, particularly the increased provision of HIV tests from 67.5% to 82.2% [McNabb, 2015]. In India, a mobile partograph (mLabour) built on the CommCare platform was created to overcome barriers to partograph use in under-resourced health systems. mLabour provides labor unit staff with decision support, automatic graphing to replace the paper partograph, and reminders prompting clinicians to conduct patient exams [Khalid, 2015]. A preliminary study found that data collected through mLabour was more complete than the corresponding paper charts, and users reported that the application reduced patient neglect [Schweers, 2015].

Adherence to protocols

CommCare has also been used to improve adherence to protocols by frontline workers in low-resource settings. An RCT in South Africa found that frontline workers using CommCare for cardiovascular disease screenings had no errors in calculating risk scores, compared to 3.8% error when using the paper tool [Surka, 2014]. Clinicians using a CommCare precursor for Integrated Management of Childhood Illness (IMCI) classification completed 20% more of the required steps on average [DeRenzi, 2008]. They also were able to more accurately classify diseases (90.9% versus 82.7%) that were more prevalent across clinics [Mitchell, 2013].

More recently, Terre des Hommes and partners implemented the Integrated eDiagnosis Approach (IeDA) interventions at large scale in Burkina Faso, which includes non-technology components and technology components, including using CommCare to guide health providers through the IMCI protocols. An independent, stepped-wedge cluster randomized study was conducted to assess whether the IeDA increased adherence to the IMCI guidelines during under-five child consultations [Sarrassat, 2019]. The intervention districts showed a much higher adherence rate, including that the frontline workers in the intervention completed 79% of their tasks compared to 54% in the control areas, from a baseline of 48% (p=.0002).

Frontline workers were compared to nurses who classified the children separately. The frontline workers in the intervention completed 79% of their tasks compared to 73% in the control areas, from a baseline of 75% (p=.04), showing a smaller but still important improvement in classification accuracy than the improvement in following protocols.

Additionally, significant improvements were found while classifying and prescribing malnutrition and dysentery. Though the sample size was small, the data also showed consistency around improvement in danger sign identification, correct referrals/hospitalisations and management of severe malaria or severe febrile illness.

In Wajir, Kenya, an intervention assessing the effect of a CommCare app on integrated management of acute malnutrition (IMAM) service delivery among 40 health facilities found a 25% reduction in reporting errors, as well as an improvement in adherence to treatment protocols. Among a control group using paper-based systems, 28% of weight-for-height Z-scores (WHZ) were miscalculated, and 17% of children were misdiagnosed, leading to their wrongful admission to the IMAM treatment program. Use of the CommCare app, which automatically calculated WHZ scores, allowed for 99.3% accuracy [Keane, 2018].

CommCare has also been used to improve the accuracy of disease screenings for HIV in South Africa [Mitchell, 2012], Acute Malnutrition in India [Chanani, 2015], nutrition-related stunting and anemia in children under the age of 2 in Indonesia [Htet, 2019] and Rheumatic Heart Disease (RHD) in Zambia [van Dam, 2015]. Two studies have found that CommCare improves medicine dosing [Segal, 2015] [Palazuelos, 2013]. In Guatemala, CommCare was used to improve efficiency in calculating prescription dosages by 20%, and decreased consultation time [Segal, 2015]. In Mexico and Guatemala, CommCare use resulted in a higher medicine dosing accuracy compared to paper-based tools [Palazuelos, 2013].

Theme 4 · Findings

Program efficiency

Programmatic gains in productivity, communication, supervision, and cost-effectiveness across frontline programs.

Cost-effectivenessProductivity · Communication · Cost

Program productivity

Several studies discuss the impact of CommCare on data collection and transmission in projects across water, sanitation, and hygiene, malaria, and HIV/AIDS programs. A water, sanitation, and hygiene study across Vietnam, Cambodia, and Mozambique found that CommCare improved the efficiency of water data quality transmission from water supply structures to upper administrative levels [Ball, 2013]. Research on the use of algorithms to evaluate data submitted by frontline workers found that CommCare is able to identify false data with 80% sensitivity and 90% specificity, validating CommCare as a monitoring and evaluation and data collection tool for frontline programs [Birnbaum, 2012]. Two studies discuss the impact of CommCare’s improved data collection on infectious disease control efforts. In Zimbabwe, improved transmission of malaria test data through CommCare resulted in faster and more accurate diagnoses [Dell, 2014]. A study by MEASURE Evaluation in Mozambique found CommCare to be a more efficient, effective, and cost-effective tool for monitoring HIV/AIDS patient adherence to treatment programs and appointments than paper-based systems [Nascimento, 2014]. An RCT in South Africa found that frontline workers using CommCare for cardiovascular disease screenings took 75% less time to be trained than frontline workers using paper-based screening tools, and 41% less time to diagnose patients for cardiovascular disease than those using paper tools [Surka, 2014].

Program communication and supervision

As a result of improved data collection and accessibility, several studies have found that CommCare can impact supervision and communication within frontline programs. In one project in India, improved data completeness via CommCare resulted in a reduction in the average data transmission time from frontline workers to supervisors from 48 days to 8 hours [Medhi, 2012]. The Mathematica study in Bihar found that frontline workers who used CommCare were 31% more likely to communicate about coordinating home visits in their catchment area than frontline workers who did not use CommCare (p=.018). It also highlighted challenges with supervision, such as low understanding and usage of a specialized CommCare application for supervisors, resulting in no substantial increase to frontline worker supervision (although none of the supervision indicators were statistically significant) [Borkum, 2015]. Both studies in India saw improved communication with the use of CommCare by frontline workers, although only minor improvements in direct supervision were observed.

The study examining the use of CommCare on IMAM service delivery in Wajir, Kenya saw a large decrease in the amount of time for data to become available in the national Health Management Information System (HMIS) when using CommCare (1.3 days on average) compared to paper-based systems (approximately 40 days). Use of paper-based systems necessitated physically sending reports to offices for personnel to then enter into the HMIS, which sometimes led to data loss throughout the process. Use of CommCare eliminated this need for physical data transfer [Keane, 2018].

Program cost-effectiveness

USAID commissioned an independent cost-effectiveness analysis for the ReMiND project in Uttar Pradesh (described above). The purpose of the study was to estimate the incremental cost per disability adjusted life year (DALY) averted and the cost of each death averted as a result of ReMiND intervention, as compared to routine maternal and child health programs without ReMiND [Prinja, 2018]. The researchers built an Excel model to estimate change in DALYs and cost from both a health system and societal perspective, assuming ReMiND over a 10 year period if ReMiND were scaled to all of Uttar Pradesh. Probabilistic sensitivity analysis was undertaken to account for parameter uncertainties. The analysis found that over a 10-year time period, implementing the ReMiND intervention in Uttar Pradesh averted 312 maternal and 149,468 neonatal deaths. This implies that the ReMiND program led to a reduction of 0.2% maternal and 5.3% neonatal deaths. From a health system perspective, ReMiND incurs an incremental cost of USD $205 per DALY averted and USD $5,865 per death averted. The cost-effectiveness of the program is higher than that of vaccines for cholera, typhoid, and haemophilus influenza type ‘b’ at current market rates in India.

A study by USAID’s Health Finance and Governance Project evaluated the cost-effectiveness of a CommCare-based Integrated Management of Childhood Illness (IMCI) application implemented by D-tree International [Kukla, 2015]. The study evaluated the ratio of the additional cost per frontline worker to the improved effectiveness per frontline worker of a pilot project involving 50 frontline workers. The study concluded that “compared with the existing paper-based system, the mobile tool costs an additional $10.43 per annum for an HSA to improve his/her diagnostic and treatment accuracy by 1 percent.” Given the low marginal cost of increasing the number of frontline workers using the tool, and assumed consistency in relative effect per frontline worker, the authors also estimated a cost-effectiveness of $1.07 per 5,000 frontline workers, concluding that a much higher return on investment is achieved when taking mobile tools to scale.

Another study evaluated the costs of collecting and processing 24-hour dietary recall data in both Vietnam and Burkina Faso, comparing a CommCare-based dietary assessment platform (INDDEX24) to traditional pen-and-paper interviews (PAPI). Compared to PAPI, the cost of using INDDEX24 was lower in Vietnam ($820/respondent vs. $755/respondent, respectively) and slightly lower in Burkina Faso ($541/respondent vs. $538/respondent, respectively). In both countries, the initial costs associated with INDDEX24 (preparing surveys, purchasing devices) were offset by the higher costs associated with PAPI (data entry, cleaning, and processing) [Adams, 2021].

Independent evaluations have also put numbers on the savings that come from running a program on CommCare rather than on paper. Two separate studies found that launching CommCare would save the state of Colorado $15 million over 3 years [Colorado, 2021], and between $830,000 and $1.7 million a year for a government program in Burkina Faso [London School of Hygiene, 2018]. Separately, an analysis by USAID’s Development Innovation Ventures team found that one CommCare-supported attendance-monitoring program returned more than $24 in social value for every dollar invested [USAID DIV, 2021].

Theme 5 · Findings

Challenges in implementing digital health programs

An honest look at the technical and programmatic challenges of implementing CommCare, including null results.

LimitationsHonest reporting

There are various studies that describe challenges with implementing CommCare. Several studies cited technical issues, such as broken phones that remained unfixed, lack of convenient power source to charge devices, and inconsistent connectivity which limited data sharing and synchronization among frontline worker teams [Chaiyachati, 2013] [Borkum, 2015] [Style, 2017] [Adler, 2020] [Gopalakrishnan, 2020] [Nigussie, 2021].

Other studies also identified programmatic issues that limited CommCare’s impact. One challenge with large-scale digital health implementations is that adopting organizations may have limited IT capacity to adequately maintain technology [DeRenzi, 2012] [Chaiyachati, 2013]. Low adoption rates among users or a decrease in usage over time, often referred to as the ‘novelty effect’ of new technology, has also been observed in CommCare projects [Borkum, 2015] [Chaiyachati, 2013] [DeRenzi, 2012] [DeRenzi, 2016] [Segal, 2015]. Chaiyachati attributed low adoption rates to a disconnect between the application design and the actual value the application provided to frontline workers in their everyday work. Frontline workers reported that they did not find the primary functionality of the application useful, although using the mobile phones for text messages and phone calls did improve communication between frontline workers and their clients and coordination among frontline workers [Chaiyachati, 2013].

It is also worth noting that what may be perceived as beneficial to frontline workers through the use of digital health tools may not always be perceived the same way by or be most impactful for the client if careful considerations are not made. For example, the study examining frontline worker and client perspectives on a digital health intervention in Bihar and Madhya Pradesh, India found that although the majority of interviewed frontline workers and clients saw the tool as a facilitator to engagement and communication, some clients felt that the use of certain features intended to improve healthcare delivery, such as video, ultimately limited interpersonal communication and led to rushed interactions, which may discourage clients from being comfortable enough to share health history or ask questions. Additionally, there may be socio-cultural factors that could impact service delivery when implementing digital health interventions (such as customs related to leaving the home, or the practice of women returning to their natal homes during pregnancy and the postpartum period); these may be seen as barriers that can limit uptake or frontline worker engagement with intended clients if not considered ahead of time [Gopalakrishnan, 2020].

The Mathematica study also reported that CommCare’s supervisory functionality had several challenges (though it has since been improved), and that CARE had to provide extensive training sessions (16 3-hour sessions over the course of 8 weeks) to achieve an adequate level of impact [Borkum, 2015]. Other programmatic issues highlighted in CommCare projects include delayed top-up payments to frontline workers [Borkum, 2015], limited stock of medical supplies (in this case, Tetanus Toxoid injections) [McNabb, 2015], concerns about long-term sustainability due to the cost of devices or desired features (i.e. centralized text message delivery) [Adler, 2020], and the risk of inaccuracy in self-reported data [DeRenzi, 2012].

Additionally, a study of mWellcare did not find positive results. The mWellcare system used CommCare as a clinical decision support system and an e-health record storage system to drive integrated management of five chronic conditions. The trial found no statistical difference in this setting vs. primary care setting, which had only enhanced usual care for patients with diabetes mellitus and hypertension [Prabhakaran, 2019]. While no improvement was found across secondary outcomes of fasting blood glucose, depression score, total cholesterol, predicted 10-year risk of cardiovascular disease, or tobacco and alcohol use; however, the mWellcare arm had higher self-reported adherence to medications. The null result highlights the potential value of using nonphysician providers and improving access to needed medications which can be used while drafting public health interventions by policy makers.

Beyond outcomes

Reach & independent recognition

In addition to the studies in the Evidence Base, a number of independent reviews speak to CommCare’s technical capabilities and reach, both within specific sectors and across the wider field. These reviews rank or profile CommCare alongside other tools rather than measuring program outcomes, so they are not counted among the peer-reviewed and grey-literature studies in the full database. We wanted to share them here all the same.

By sector

  • Ranked a top 1–2 data-collection tool of 17 evaluated for agricultural research. ACIAR, 2017
  • One of only two tools, of 58 reviewed, meeting every technical and functional criterion for the West Africa Ebola response. Helmholtz / JMIR, 2018
  • One of two standout platforms, of 9 assessed, for COVID-19 case management and contact tracing. Johns Hopkins, 2020
  • One of five mobile apps highlighted for community health workers to manage supply-chain data. USAID GHSC, 2022
  • One of five tools cited for the supportive supervision of immunization health workers. Gavi, 2024

General reach & capabilities

  • The most popular mobile platform among frontline health workers in developing countries, across 140 programs studied. Johns Hopkins, 2016
  • Scored highest of 17 digital data-collection tools by an independent technology evaluator. Kopernik, 2019
  • Top product-maturity score (100/100) in a catalog of digital solutions for governments and funders. Digital Impact Alliance, 2021
Conclusion

Collective findings and the path forward

These studies collectively show that CommCare can strengthen frontline programs through improved client health outcomes and behaviors, frontline worker performance, quality of care, and program efficiency. The upward trend in rigorous outcome evaluations is particularly notable. The evidence is clear that it is the frontline workers themselves who deliver critical services to underserved populations, and organizations must continually train and support them to get the most from mobile technology in service delivery.

As the Evidence Base expands, we hope to see more studies focused on client health outcomes. These remain the most direct measure of public health impact and the most important lens for evaluating CommCare as a tool for frontline workers.

Growth of the evidence base

The evidence keeps growing

A decade-plus of peer-reviewed and grey-literature research. … avg. entries / yr (last 5) · … peer-reviewed.

Cumulative entries by category. Each color is a research category; see Methodology above for definitions.
Studies & Evaluations Directory

Search the complete research database

Every peer-reviewed study and grey-literature paper about CommCare. Search by author, organization, country, or keyword. Independent third-party evaluations are summarized under Beyond outcomes and are not part of this database.

Year▾SourceCategory▾Country▾Study▾Link
2025Peer-reviewedFrontline workerGuatemalaDuffy 2025
“Calculated overall diagnostic accuracy for CHWs was 93% (95% CI = 90.4%, 95.7%).”
2025Peer-reviewedFeasibilitySierra LeonePognon 2025
“The study findings showed that CommCare users are more likely to have higher acceptance as compared to [Electronic Medical Record] users”
2025Peer-reviewedFeasibilityNigeriaOmotayo 2025
“64,079 people with presumptive TB were identified, of which 10.1% were diagnosed with TB and 97% of those diagnosed were placed on treatment.”
2025Peer-reviewedFrontline workerEthiopiaBeza 2025
“HEWS identified with equal accuracy as master's prepared nurses those in the community at high, moderate and low CVD risk using the non-laboratory risk score algorithm via a mobile health app.”
2024Peer-reviewedFeasibilityMany / UnspecificAgbeyangi 2024
“The study reveals that despite noteworthy progress, unresolved challenges persist, necessitating further attention to enable the optimal performance of software systems in low-resource environments.”
2024Grey literatureFeasibilityBurkina FasoLazenby 2024
“By June 30, 2021, it is expected to cover 84 percent of PHC facilities (1,755) across 54 districts.”
2024Peer-reviewedFeasibilitySomaliaFarid 2024
“By 31 December 2022, 42.1% (6 597 293/15 670 530) of the population had completed the primary COVID-19 vaccination – 36.6% in 2022 versus 5.5% in 2021”
2024Peer-reviewedFeasibilityNepalDelawalla 2024
“CHWs use Android-based mobile phones with the CommCare application to collect data, view task reminders, and access decision support and counseling tools, even when the phone is offline.”
2024Peer-reviewedFrontline workerSomaliaHürlmann 2024
“Out of the 116 antibiotic treatments for children being diagnosed with URTI pre-ALMANACH, 112 (96.6%) should not have resulted in an antibiotic prescription according to clinical guidelines whereas only one of the 32 antibiotic treatments in the post-implementation round was considered unreasonable.”
2024Peer-reviewedFeasibilityColombiaCaceres Rivera 2024
“The agreement between the evaluators was approximately 80% for most of the defining characteristics.”
2024Peer-reviewedFeasibilityUSAPoudyal 2024
“Participants found the app to be usable, with an average System Usability Scale score of 72.5 (SD 18.1), consistent with the industry benchmark of 68.”
2024Peer-reviewedFeasibilityMexicoAranda 2024
“From a roster of 2,177 named contacts, 1,187 (54.5%) received at least one home visit by a CHW and 560 (25.7%) had successful completion of contact tracing according to intervention guidelines.”
2024Peer-reviewedFeasibilityIndiaSingla 2024
“In general, most treatment providers and clinical experts reported encountering more facilitators than barriers when using the app, indicating the majority of responses for key themes related to acceptability (user experience and adherence) and feasibility (app effectiveness).”
2023Peer-reviewedFrontline workerMozambiqueKarajeanes 2023
“the platform located 1,673 (90%) of the index patients (patients in ART default)”
2023Peer-reviewedFeasibilityKenyaLyles 2023
“The number of visits, BMI, physical activity, and next visit were frequently reported in the NCD app (≥99%) but not in the EMR (≤15%).”
2023Peer-reviewedFrontline workerBurkina FasoMaïga 2023
“The intervention arm had a significantly higher score difference in women's knowledge of received counselling (16.4 points, 95% CI 10.37 to 22.49)”
2023Peer-reviewedFeasibilityMany / UnspecificWallis 2023
“All of the tools reviewed have features necessary to support the reporting process of CBS; only 3 (CommCare, Community Health Toolkit, and DHIS2 Tracker) provided all 10 attributes included in the mapping.”
2023Peer-reviewedFrontline workerUgandaKällander 2023
“Appropriate treatment was 11% higher in the mHealth compared to the control arm (risk ratio [RR] 1.11, 95% CI 1.02, 1.21; p = 0.018).”
2023Peer-reviewedFeasibilityUSAJenny 2023
“Our performance-based evaluation, which had a participation rate of 61% (n = 118), had a 98% pass rate on the first attempt by trainees based on the rubric.”
2023Peer-reviewedFeasibilityIndiaBhaise 2023
“The Apps were user-friendly, required minimal prior training, had built-in validation checks for erroneous data entry and provided automated calculations.”
2023Peer-reviewedFrontline workerNepalTiwari 2023
“There was, on average, a 30% increase in IBR (p<0.0001) post-intervention as compared to pre-intervention, adjusting for other variables.”
2023Peer-reviewedFeasibilityMany / UnspecificHamani 2023
“In rounds 1, 2 and 3, 99.6%, 99.6%, and 99.9% of payments, respectively, were made successfully to workers.”
2023Peer-reviewedFrontline workerMozambiqueSoremekun 2023
“Coverage of the appropriate treatment of cases of MDP increased by 26% in the intervention arm (adjusted RR 1.26 95% CI 1.12–1.42, p<0.001).”
2022Grey literatureFrontline workerMozambiqueMariano 2022
“Between December 2020 and June 2022, about 4,707 women in labor were followed with mParto.”
2022Peer-reviewedFeasibilityNigeriaBartlett 2022
“Initial review shows significant improvement in the uptake of services and the rate of follow-up.”
2022Peer-reviewedFrontline workerBangladeshJahan 2022
“The referrals made by the CHWs had high sensitivity (93.3%), specificity (96.2%), and almost perfect agreement (K = 0.80) with the referrals made by the physician.”
2022Peer-reviewedFrontline workerBangladeshAhmed 2022
“During these 4.5 months, 249,452 individuals from 10 Rohingya camps were screened for COVID-19 case registration.”
2022Peer-reviewedFeasibilityPeruElson 2022
“MDC systems provide an opportunity to enhance the integrity of the data collected during a large-scale trial in an urban resource-poor setting by reducing data entry errors, allowing timely data collection, and facilitating real-time data access.”
2022Peer-reviewedFeasibilityMany / UnspecificAdams 2022
“the 24HR cost US $111 004 ($755/respondent, n 147) using INDDEX24 and $120 483 ($820/respondent, n 147) using PAPI.”
2022Peer-reviewedFrontline workerMany / UnspecificRadvan 2022
“No cases of COVID-19 were attributed to any of the NTD-related activities.”
2022Peer-reviewedFrontline workerTanzaniaHo 2022
“All six specialists and 10 LHWs expressed overall satisfaction with mPCL among 49 intervention arm patients.”
2022Peer-reviewedClientUSAFee 2022
“We found a significant increase in self-efficacy from baseline to 12 months (mean 0.61, SD 0.28; P=.02)”
2021Grey literatureFeasibilityUnited StatesColorado 2021
“a vendor was selected in just 19 days”
2021Grey literatureFeasibilityMany / UnspecificUSAID DIV 2021
“CommCare resulted in a 4% reduction in infant mortality due to innovation, returning over $24 per dollar invested by DIV.”
2021Peer-reviewedFrontline workerTanzaniaNgoma 2021
“Similar rates of care satisfaction in both groups suggest that mPCL may support symptom-focused care coordination in a more efficient and scalable manner than phone contact.”
2021Peer-reviewedDataMany / UnspecificSilenou 2021
“Approximately 13% of the tools (4/30; Surveillance Outbreak Response Management and Analysis System, Go.Data, CommCare, and District Health Information Software 2) covered 93% (14/15) of the identified attributes.”
2021Peer-reviewedFrontline workerGhanaHenry 2021
“We could not relocate only 6.3% of respondents in our second study compared to 14.1% in the first.”
2021Peer-reviewedFeasibilityNigeriaTaiwo 2021
“Compared with baseline, the odds of virologic suppression was higher at 24 weeks (odds ratio = 14.00, P < 0.001)”
2021Peer-reviewedFeasibilityMany / UnspecificAdams 2021
“In the primary analysis, in Viet Nam, the 24HR cost US $111 004 ($755/respondent, n 147) using INDDEX24 and $120 483 ($820/respondent, n 147) using PAPI.”
2021Grey literatureFeasibilityMyanmarThar 2021
“Discussion Support is a collaborative approach between farmers, whereas Decision Support is a more instructive approach providing recommendations which can be misinterpreted.”
2021Peer-reviewedFeasibilitySyriaPatel 2021
“To improve efficiencies within bakeries....GOAL supported the establishment of a process of digitization, utilizing the mobile digital data gathering tool Commcare for the bakery market data collection.”
2021Peer-reviewedClientUSABechtel 2021
“Despite strong perceptions of the SPIRIT app system's benefits, the findings suggest actionable barriers prevented wider adoption.”
2021Peer-reviewedDataMozambiqueFeldman 2021
“A daily series of SMS messages (currently totally more than 140,000), developed and shaped by knowledge gaps highlighted through the KAP study, were sent to a total of approximately 2,500 APEs.”
2021Peer-reviewedFeasibilityIndonesiaLopez 2020
“Over 90% of incarcerated PLWH felt the mHealth application offered adequate comfort, privacy, and accuracy in recording their responses.”
2021Peer-reviewedFeasibilityUSAFuller 2021
“System Usability Scale (SUS) scores were 68 for peers and 66 for RCs, indicating good usability.”
2021Peer-reviewedFeasibilityUSABurgess 2021
“The mean SUS score was 70/100 (SD = 17), indicating relative ease of use.”
2021Peer-reviewedFeasibilityTanzaniaMorse 2021
“Results from the usability and pilot testing demonstrated that all users were able to successfully navigate the app”
2021Peer-reviewedFrontline workerKenyaHossain 2021
“In both subcounties, we observed positive changes in mentees' immunization knowledge, skills, and practices.”
2021Peer-reviewedFrontline workerEthiopiaNigussie 2021
“Data from the mHealth app showed an increase in pregnant mother registration by the HEWs in the first and second trimesters”
2020Grey literatureClientMalawiHyman 2020
“The average total of newly identified patients referred to IC3 increased from 0.94 to 6.8 patients per month following the roll out of the project, and the percentage linked to and enrolled in IC3 of those referred in CommCare increased from 55% to 70%.”
2020Peer-reviewedClientGuatemala Duffy 2020
“The hemoglobin A1c percentage decreased significantly at 3 months (-1.0; 95% CI=-1.7, -0.6), 6 months (-1.5; 95% CI=-2.2, -0.8), 9 months (-1.3; 95% CI=-2.0, -0.6), and 12 months (-1.0; 95% CI=-1.7, -0.4).”
2020Peer-reviewedDataNepalNepal 2020
“The average per capita annual cost is US$3.05 (range: US$1.94 to US$4.70 across 24 villages)”
2020Peer-reviewedFeasibilitySouth AfricaGous 2020
“Nearly all participants (296/300; 98.7%) found the AspectTM HIVST app easy to use”
2020Peer-reviewedFeasibilityUSAGuss 2020
“Although perceived usability was low, qualitative feedback from CMs and use patterns suggested that direct messaging and timely, remote, and secure sharing of laboratory results and documents (including electronic signatures) between CMs and AYA living with HIV can be particularly useful and have potential value in supporting care coordination and promoting patient self-efficacy and quality of life.”
2020Peer-reviewedFeasibilityTanzaniaSchroeder 2020
“mNavigator will be developed using CommCare, a highly validated, HIPAA-compliant, open-source digital health platform developed by Dimagi Inc.”
2020Grey literatureFeasibilityMany / UnspecificAgarwal 2020
“According to the authors, DHIS2 Tracker and CommCare stand out in the context of patient triage, referral for testing, and contact listing and follow-up.”
2020Peer-reviewedFrontline workerIndiaZhang 2020
“A total of 18,706 cases (n) (1.36%) were reported with presumptive TB.”
2020Peer-reviewedFrontline workerGhanaAdler 2020
“ComHIP presents an example of a task-sharing programme with a high level of acceptability to all participants.”
2020Peer-reviewedFrontline workerIndonesiaWalton 2020
“The VVP resulted in 960 actions (356 agricultural; 604 health), helping in 97% of contacts, most (55-61%) by providing information.”
2020Peer-reviewedFrontline workerIndiaGopalakrishnan 2020
“The mHealth intervention was acceptable to the CHWs who felt that CAS improved their status in the communities where they worked.”
2019Peer-reviewedClientIndiaPrabhakaran 2019
“There was no evidence of difference between the 2 arms for systolic blood pressure (Δ=-0.98; 95% CI, -4.64 to 2.67) and glycated hemoglobin (Δ=0.11; 95% CI, -0.24 to 0.45)”
2019Peer-reviewedClientGhanaAdler 2019
“After 1 year of intervention, 72% (95% CI: 67% to 77%) of participants had their hypertension under control.”
2019Peer-reviewedClientGuatemala Duffly 2019
“A smartphone application providing algorithmic clinical decision support enabled community health workers to improve diabetes control... CHWs can safely and effectively manage diabetes with the assistance of a smartphone application and remote physician supervision.”
2019Peer-reviewedClientGhanaNyarko 2019
“The pilot screening detected 2 diabetic subjects (2% of the cohort) showing WHO diabetic glycemic values, and 20 pre-diabetic subjects (19.8% of the cohort)”
2019Grey literatureClientBurkina FasoSarrassat 2019
“The proportion of children for whom the validation nurses and the HCWs recorded the same classifications (ignoring the severity) was 73 and 79% in the control and intervention districts respectively (cluster-level mean difference = 10.1%; P-value = 0.004).”
2019Peer-reviewedDataLiberia and Sierra LeoneColubri 2019
“Models were incorporated into an app highlighting the signs/symptoms with the largest contribution to prognosis.”
2019Peer-reviewedDataNepalPradhan 2018
“The results of this process have been threefold: facilitation of data collection, creation of an accurate database and provision of clear insights with access to data visualization dashboards.”
2019Peer-reviewedFrontline workerMany / UnspecificChhetri 2019
“CommCare is more specific to CHWs, having more weight on the configuration (where configuration was quicker) and end-user affordances (with an ability to display images which could be used for health promotion) compared to DHIS2, but it had weak organisational affordance mostly due to license fees.”
2019Peer-reviewedFrontline workerMexicoMolina 2019
“Use of the adapted SCC improved quality of care through increased adherence with essential and respectful delivery practices.”
2019Peer-reviewedFrontline workerWest AfricaTom-Aba 2019
“Only 3 tools, namely Community Care (CommCare), Sense Ebola Followup, and Surveillance and Outbreak Response Management and Analysis System (SORMAS) supported all 4 of these functionalities.”
2019Peer-reviewedFrontline workerBurkina FasoBessat 2019
“The use of eICMI was widely accepted and perceived as a powerful tool guiding daily practice.”
2019Peer-reviewedFrontline workerSierra Leone:Danquah 2019
“For 25 laboratory-confirmed cases for whom paper-based contact tracing was conducted, data for only 39% of 408 contacts were returned to the District, and data were often incomplete.”
2019Peer-reviewedFrontline workerSenegalMacDonald 2019
“CommCare, while a powerful tool of information, clinical support, surveillance, and data collection, is also a social technology that connects and motivates people, transforming relationships in ways that can optimize its potential to improve maternal health care.”
2019Peer-reviewedFrontline workerIndonesiaHtet 2019
“We found a higher percentage of children classified as acceptable energy reporters (reported energy intake within the 95% CI of Total Energy Expenditure) with the electronic data capture compared with paper-based data capture (i.e., 60.8%, 72.4% and 80.7% for 6–8-, 9–11- and 12–23-month-old children, respectively, vs. 40.9%, 56.9%, and 54.3%, respectively).”
2018Grey literatureFeasibilityBurkina FasoLondon School of Hygiene 2018
“improved substantially HCWs' adherence to IMCI clinical assessment tasks, leading to some overall increase in correct classifications but to little or no improvement in correct prescriptions.”
2018Peer-reviewedClientTanzaniaHackett 2018
“The odds of facility delivery among women counseled by smartphone-assisted health workers were double the odds among women living in control villages (OR, 1.96; CI, 1.21–3.19; adjusted analyses).”
2018Peer-reviewedClientIndiaPrinja 2018
“From health system perspective, ReMiND incurs an incremental cost of INR 12,993 (USD 205) per DALY averted”
2018Peer-reviewedFeasibilityNepalCitrin 2018
“We describe the development of an integrated care system involving community healthcare worker networks that utilize a home-to-facility electronic health record platform for rural municipalities in Nepal.”
2018Peer-reviewedFeasibilityKenyavan Dam 2018
“With a study of this size, the team was expecting to have to manage around 100 data queries, but with the use of the mobile platform only 21 queries were raised.”
2018Peer-reviewedFrontline workerUSABauer 2018
“The mean SUS score at week 8 among four patients who completed this measure was 91.9 (range 72.5-100).”
2018Peer-reviewedFrontline workerMalawiPimmer 2018
“Three main themes emerged from the analysis: phone-aided audio counselling (1) legitimises the CHWs' use of mobile phones during household visits; (2) helps CHWs to deliver a comprehensive counselling message; (3) supports CHWs in persuading communities to change their health practices.”
2018Grey literatureFrontline workerKenyaKeane 2018
“By contrast, 100 per cent of patient data from the 20 intervention health facilities via the IMAM app was usable and available.”
2017Grey literatureFeasibilityIndiaAgapitova 2017
“Through a partnership with the Government of India and the Bill and Melinda Gates Foundation, a CommCare-based application is being scaled across eight Indian states to strengthen the monitoring of the service delivery of anganwadi center's in the country.”
2017Peer-reviewedClientIndiaPrinja 2017
“Three of eight services which were targeted for improvement under ReMiND project registered a significant improvement as result of m-health intervention.”
2017Peer-reviewedFeasibilityUSABauer 2017
“Our early work supported the overall feasibility and acceptability of a Collaborative Care app for patients and for providers.”
2017Grey literatureFeasibilityMany / UnspecificFrank 2017
“With time, practice and support, health workers in all five countries learned to use and trust the app and saw many benefits, including better quality information; stronger communication with remote supervisors”
2017Peer-reviewedFeasibilityNepalStyle 2017
“EDC using three interlinked mobile data management systems (FrontlineSMS, ODK and CommCare) was a feasible and effective method of data capture in a complex large-scale trial in the plains of Nepal.”
2017Peer-reviewedFrontline workerLesothoHirsch-Moverman 2017
“Uptake of the SMS intervention was high, with 92.1% of 713 eligible patients choosing to receive SMS messages.”
2017Peer-reviewedFrontline workerMexicoMolina 2017
“384 (85.9%) women were attended by staff that used the adapted SCC during delivery.”
2016Peer-reviewedClientGhanaAmoah 2016
“The proposed prenatal care approach showed that 62.5 % of pregnant women who gave birth during the observation period included in the project (n=40) had their labor attended in clinics or hospitals as against 37.5 % among the cases reported in the pre-survey.”
2016Peer-reviewedFrontline workerIndiaDeRenzi 2016
“We find that ASHAs with access to the ASTA system made significantly more client visits, with average monthly visits 21.5% higher than ASHAs who had access to a control system.”
2016Peer-reviewedFrontline workerTanzaniaBraun 2016
“CHWs perceived benefits to service quality, including timelier and more convenient care; better quality of information; increased method choice; and improved privacy, confidentiality and trust with clients.”
2016Peer-reviewedFrontline workerIndiaKaphle 2016
“receiving performance feedback on the duration of counseling increased mean counseling times by 3.860 minutes (P=.004)”
2016Peer-reviewedFrontline workerNigeriaOtu 2016
“Further analysis showed an 11% improvement in average knowledge levels between pre- and post-intervention scores”
2015Peer-reviewedClientTanzaniaBattle 2015
“At the end of the program, of the 13,231 women who delivered in the program, 75% did so at a facility and 78% under skilled care compared to a baseline of 35% according to the Demographic and Health Survey of 2010 (DHS).”
2015Peer-reviewedClientTanzaniaHoy 2015
“The intervention achieved a 71.0% facility delivery rate in the project zone, compared to the regional average of 32.0%.”
2015Peer-reviewedClientGuatemala Martínez-Fernández 2015
“If we compare the data from the intervention group in 2008 with the data from 2012, we see a significant change in trend with 14 maternal deaths (meeting our criteria) in populations served by the 125 tele-CFs (233.445 inhabitants), giving a MMR of 254.”
2015Peer-reviewedClientIndiaMurless 2015
“The evaluation showed that the greatest success of the project has been in increasing the linkages between pregnant women and the health system.”
2015Grey literatureClientIndiaBorkum 2015
“The intervention resulted in an 11 percentage point increase in FLW antenatal home visits during the third trimester (P = 0.04).”
2015Peer-reviewedFeasibilityMany / UnspecificKumpel 2015
“mobile phone-based water quality data management applications will provide minimal benefits for Type A or B institutions, but prove worthwhile for Type C institutions in some contexts.”
2015Peer-reviewedFrontline workerIndiaChanani 2015
“The mobile calculator significantly reduces an important component of human error in using the WHO tables to assess acute malnutrition at the community level.”
2015Peer-reviewedFrontline workerMany / UnspecificDayalu 2015
“There were 634 workers who used CommCare for at least one year and were active for at least 10 months of that first year.”
2015Peer-reviewedFrontline workerIndiaKaphle 2015
“The quality score for high users of CommCare was higher by 33.4% (P=.04), on average, compared to low users”
2015Peer-reviewedFrontline workerIndiaKhalid 2015
“mLabour provides real-time decision support to healthcare providers in order to assess the course of labour and promote the appropriate interventions as necessary.”
2015Peer-reviewedFrontline workerNigeriaMcNabb 2015
“Overall, the quality score increased from 13.3 at baseline to 17.2 at endline (p<0.0001), out of a total possible score of 25”
2015Peer-reviewedFrontline workerGuineaSacks 2015
“210 contact tracers in the 5 prefectures were actively using the mobile system, to collectively monitor 9,162 contacts.”
2015Peer-reviewedFrontline workerMany / UnspecificSchweers 2015
“We then discuss the results of a preliminary study of the application's usage, which suggests that mLabour has promise as a tool to improve patient care.”
2015Peer-reviewedFrontline workerGuatemala Segal 2015
“Among 366 prescriptions, dosages were 40% more likely to be correct when calculated using the app (relative risk: 1.39; 95% CI 1.16 to 1.68; p=0.0005).”
2015Peer-reviewedFrontline workerZambiavan Dam 2015
“Preliminary lessons learned from early field testing of the eRegister in Zambia include demonstration that the tool was overall easy to use, and that local programme staff were able to be trained to use the eRegister in a relatively short time and without specific prior technical knowledge or experience.”
2015Grey literatureFrontline workerMalawiKukla 2015
“the mobile tool costs an additional $10.43 per annum for an HSA to improve his/her diagnostic and treatment accuracy by 1 percent.”
2014Peer-reviewedFeasibilityGhanaAmoah 2014
“The health workers followed 212 new pregnancy, sending more than 400 messages, cumbersome circumstances such as ectopic and breech delivery have been detected and addressed properly, thanks to the early detection performed using the portable ultrasound machine.”
2014Peer-reviewedFeasibilityIndiaBhavsar 2014
“Efficiencies gained from the mobile tool go beyond the frontline users and can reach the supervisory and program management levels, in retrospect, achieving systems-level improvements as well.”
2014Peer-reviewedFrontline workerSouth AfricaSurka 2014
“Incorrect calculations (4.3% of average systolic BP measurements, 10.4% of BMI and 3.8% of CVD risk score) were found when using the paper-based chart tool while all the mobile phone calculations were correct.”
2014Peer-reviewedFrontline workerUSADavidyock 2014
“The ScreenFlow screening instrument created from the FHS data had good discriminatory ability for subjects with moderate-or-worse COPD in an urban, demographically mixed population.”
2014Peer-reviewedFrontline workerZimbabweDell 2014
“Prove that our systems can be effectively integrated into existing information ecosystems in low-resource settings and demonstrate that they are usable and appropriate under the constraints experienced at all levels of the information hierarchy.”
2014Peer-reviewedFrontline workerGuatemala Kanter 2014
“The NEMS-S mobile app provides for more rapid data collection, with equivalent reliability and validity to the NEMS-S paper version.”
2014Peer-reviewedFrontline workerIndiaMohamed 2014
“This gives a pathway to engage key decision makers and ultimately, allow beneficiaries to access care.”
2014Peer-reviewedFrontline workerZambiaSchuttner 2013
“CHWs performed one or more follow-ups on 74% (n=871) of active requests and obtained outcomes on 63% (n=741).”
2014Grey literatureFrontline workerMozambiqueNascimento 2014
“This report provides findings from a Mozambique pilot using mobile telephones to follow up on patients who have defaulted on their ART or have missed appointments or lab test dates.”
2013Grey literatureClientAfghanistanWorld Vision 2013
“In addition, mothers in the intervention group were significantly more likely than mothers in the comparison group to have had a CHW coordinate referral to a facility (17% vs. 5%).”
2013Peer-reviewedFrontline workerVietnam, Cambodia, MozambiqueBall 2013
“The use of the application improved the efficiency of information flows in all three settings, and increased data availability at upper administrative levels in Mozambique.”
2013Peer-reviewedFrontline workerSouth AfricaChaiyachati 2013
“Mobile HCWs submitted nine of 33 (27%) expected adverse events forms, conflicting with qualitative results in which mobile HCWs stated that Mobilize improved adverse events communication.”
2013Peer-reviewedFrontline workerMexico, GuatemalaPalazuelos 2013
“93% (13/14) rated the phone as being easy or very easy to use, and 56% (5/9) who used the paper-based tool rated it as easy or very easy.”
2013Peer-reviewedFrontline workerIndiaSchwartz 2013
“This work maps these rules against actual instrumental (work-related, non-prescribed) and non-instrumental (personal) device use, and enforcement of these rules, in eight projects using a popular mobile-based job aid, CommCare.”
2012Peer-reviewedDataTanzaniaBirnbaum 2012
“We demonstrate the feasibility of tools for automated data quality control by showing that the algorithms detect the fake data in the labeled set with a high sensitivity and specificity, and that they detect compelling anomalies in the unlabeled sets.”
2012Peer-reviewedFeasibilityIndiaTreatman 2012a
“Sangeeta had recently finished a three-day training on using a new mobile phone application called CommCare as a job-aid tool for counselling adolescent girls and women on menstrual hygiene, sexually transmitted diseases, and family planning methods.”
2012Peer-reviewedFrontline workerTanzaniaDeRenzi 2012
“In further studies, researchers found the comparative effect of adding a phone call from supervisors to alert midwives about missed and late visits was associated with an 86% reduction in the number of days that CHWs were overdue in visiting their clients.”
2012Peer-reviewedFrontline workerIndiaMedhi, 2012
“Through a three-month unsupervised field trial with ten rural health workers we report data management gains in terms of data quality, completeness and timeliness for 836 recorded patient cases, and demonstrate strong preference of the system by health workers.”
2012Peer-reviewedFrontline workerIndiaTreatman 2012b
“We find that multimedia increases client engagement as well as CHW credibility and suggest identifying an engaging speaker and determining optimal audio message length as potential strategies for creating effective multimedia.”
2012Grey literatureFrontline workerIndiaKumar 2012
“Qualitative data also indicated that after using the tool, the AHSA were more confident in their abilities, felt they were seen as more credible among their clients, and offered better counseling during home visits.”
2011Peer-reviewedFeasibilityMany / UnspecificDeRenzi 2011a
“This paper presents the CommCare framework for representing case-management tools for CHWs.”
2011Peer-reviewedFeasibilityMany / UnspecificDeRenzi 2011b
“In this article we highlight 6 key functions that health systems currently perform where mobile tools can provide the most benefit.”
2010Peer-reviewedFeasibilitySierra LeoneBraa 2010
“We present the case of Sierra Leone and use this case to motivate and illustrate an architecture that allows us to provide services at each level of the health system (national, regional, facility and community) and provide different configurations of the tools as appropriate for the individual area.”
2010Peer-reviewedFeasibilityTanzaniaMangilima 2010
“This paper reports on CommCare a phone based tool designed to support community health workers in their work providing home-based care and social support to HIV+ and other chronically ill patients within Pathfinder International's Home based Care program.”
2010Peer-reviewedFeasibilityMany / UnspecificRouten 2010
“We adapted the Population Council's Balanced Counseling Strategy for local conditions and for community health workers and developed a mobile phone application incorporating the resulting algorithm.”
2009Peer-reviewedFeasibilityTanzaniaBogan 2009
“While the formal evaluation of the program is still in progress, initial findings show that the phone-based system is generally viewed positively by the users and by the clients as more discreet and better for privacy than the paper-based system.”
2009Peer-reviewedFeasibilityTanzaniaMhila 2009
“In this paper, we present a phone-based application called CommCare which supports community health workers (CHWs) as they provide home-based care and social support to HIV+ and other chronic patients.”
COMMON QUESTIONS

Evidence base FAQs

About the Evidence Base

How many studies are in the CommCare Evidence Base?
The Evidence Base includes 130+ studies and independent evaluations of CommCare, including 120 peer-reviewed publications and 8 randomized controlled trials. It is a live list: new studies are added as they’re published.
What criteria does a study need to meet to be included?
Two criteria. The study must help assess the effect of frontline workers using CommCare on service delivery, client behaviors, or outcomes. It must also either be described in a peer-reviewed publication or be a grey-literature study that contributes substantially to understanding the value of frontline workers using CommCare. Studies that only used CommCare in place of paper surveys are excluded.
What is grey literature?
Grey literature is research not published in peer-reviewed journals, such as reports and evaluations. The Evidence Base includes all relevant peer-reviewed studies and a curated subset of grey-literature studies.
Can I search the full research database?
Yes. The full database on this page covers every peer-reviewed study and consequential grey-literature paper about CommCare. You can search it by author, organization, country, or keyword, and filter by year, source, and category.

Findings & Recognition

What does the research show about CommCare's impact?
The studies collectively show that CommCare can strengthen frontline programs across five themes: client health outcomes and behaviors, frontline worker performance, quality of care, program efficiency, and challenges in implementing digital health programs. Headline findings include a 48% decrease in infant mortality in rural Guatemala, 40% more delivery protocols adhered to by midwives in Tanzania, and a 75% reduction in worker training time in South Africa.
Has CommCare been recognized outside of these studies?
Yes. Independent reviews from organizations including Johns Hopkins, ACIAR, USAID, Gavi, Kopernik, and the Digital Impact Alliance have ranked or profiled CommCare alongside other tools. A 2016 Johns Hopkins review found CommCare to be the most popular mobile platform among frontline health workers in developing countries, across 140 programs studied. These reviews are summarized under Beyond outcomes.
How long has CommCare been studied?
The Evidence Base synthesizes 16 years of independent research on whether equipping frontline workers with CommCare improves their service delivery and leads to improved client outcomes and behaviors. The number of rigorous outcome evaluations continues to trend upward.
The Evidence

See the proof. Make the case

Get in Touch