Skip to main content

Advertisement

Cost-effectiveness of health care service delivery interventions in low and middle income countries: a systematic review

Abstract

Background

Low and middle income countries (LMICs) face severe resource limitations but the highest burden of disease. There is a growing evidence base on effective and cost-effective interventions for these diseases. However, questions remain about the most cost-effective method of delivery for these interventions. We aimed to review the scope, quality, and findings of economic evaluations of service delivery interventions in LMICs.

Methods

We searched PUBMED, MEDLINE, EconLit, and NHS EED for studies published between 1st January 2000 and 30th October 2016 with no language restrictions. We included all economic evaluations that reported incremental costs and benefits or summary measures of the two such as an incremental cost effectiveness ratio. Studies were grouped by both disease area and outcome measure and permutation plots were completed for similar interventions. Quality was judged by the Drummond checklist.

Results

Overall, 3818 potentially relevant abstracts were identified of which 101 studies were selected for full text review. Thirty-seven studies were included in the final review. Twenty-three studies reported on interventions we classed as “changing by whom and where care was provided”, specifically interventions that entailed task-shifting from doctors to nurses or community health workers or from facilities into the community. Evidence suggests this type of intervention is likely to be cost-effective or cost-saving. Nine studies reported on quality improvement initiatives, which were generally found to be cost-effective. Quality and methods differed widely limiting comparability of the studies and findings.

Conclusions

There is significant heterogeneity in the literature, both methodologically and in quality. This renders further comparisons difficult and limits the utility of the available evidence to decision makers.

Background

Low and middle income countries (LMIC) face the highest burden of disease which they must tackle despite severe resource limitations [1]. A key aspect of this is ensuring that health services and the delivery of health care are run in the most efficient way possible. This includes deployment of the least expensive human resources compatible with competent practice, for example. However, the majority of economic evaluation evidence concerns high income countries, [2] which is unlikely to be generalizable to LMICs [3]. Furthermore, while methods for the economic evaluation of patient-level clinical interventions such as specific pharmaceuticals have been well-developed and embedded into health technology assessment in high income countries [4], very limited evidence exists for service delivery interventions. And again this mainly concerns high income countries [5, 6].

A service delivery intervention can be conceived as sitting between clinical interventions acting directly on the patient and national or regional level policy interventions [5]. More specifically, service delivery interventions affect: to whom care is provided, and by whom; where care is provided; information, communication and technology that enhance the care process; and improvements to the quality and safety of care. Specific service delivery interventions in LMICs include: task shifting from more highly trained healthcare professionals to other health workers with less training and fewer qualifications, such as community health workers (CHWs); use of secondary care providers in guideline dissemination to change outpatient referral rates; outreach clinics, such as provision of a night clinic for sex workers; and emergency care quality improvement training [7]. We exclude financing and governance arrangements, which are considered policy-level interventions.

A number of previous and ongoing attempts have been made to review and rank clinical interventions in LMICs by cost-effectiveness [8,9,10]. A notable example is the World Bank’s Disease Control Priorities in Developing Countries, which aims to identify the most effective and cost-effective interventions to tackle a wide range of disease areas across LMICs. The discussion of cost-effectiveness in these analyses is typically with respect to whether or not to provide an intervention or treatment. For example, provision of anti-retroviral therapy to prevent mother-to-child transmission of HIV/AIDS or isoniazid treatment for TB are widely considered cost-effective when the comparator is no treatment [10]. However, knowledge remains limited regarding the most cost-effective way to organise the delivery of these interventions.

There is a growing volume of literature assessing CHW programs. The use of CHWs has proven to be an important service delivery innovation in low income countries as they can provide basic health services at a low cost. Recent systematic reviews of economic evaluations of CHW programs have identified a number of relevant studies [11, 12]. However, they concluded that these were generally for the introduction of small, vertical programs and not more relevant large scale, horizontally-focussed initiatives. From an economic perspective many of these studies were furthermore of limited utility, because they did not include a measure that integrated estimates of incremental costs and incremental benefits, such as the expected net benefits or incremental cost-effectiveness ratio (ICER), which is required to inform resource allocation and service delivery decisions [13]. The review by Nkonki and colleagues incorporated many studies that reported only costs or average costs and average benefits [11]. There remains a question around the evidence from ‘full’ economic evaluations for service delivery interventions, including those for CHW programmes.

In 2008, Lewin et al. conducted an overview of the evidence of the effectiveness of service delivery interventions in LMICs with the aim of “supporting the delivery of cost-effective interventions.” They organised these interventions into three categories: delivery arrangements, governance arrangements, and financial arrangements [7]. At the time the authors identified a lack of high quality evidence in this area and did not consider whether the interventions themselves were indeed cost-effective. However, they provided a useful taxonomy and definition of service delivery interventions, which we make use of here to examine the published evidence on their incremental cost-effectiveness or cost-benefit.

We aimed to review the use of health economic evaluation for service delivery interventions in LMICs. There is often considerable heterogeneity in study design between health economic evaluations, even for the same intervention. Various forms of effectiveness evidence may be incorporated, a wide variety of models may be used to extrapolate to the endpoints of interest, and the endpoints themselves may vary from disease specific outcomes, such as cases of tuberculosis treated, to generic outcomes, such as disability adjusted life years (DALY) averted. These differences may make it difficult for a decision-maker to discern which evidence is relevant to them. There is therefore a strong need to conduct systematic searches of studies in this area and amalgamate and review them. The aims of this article are fourfold. First, we aim to describe the scope of economic evaluations in service delivery research in LMICs. Second, to describe the quality of the studies and to compare and contrast methods used. Third, to summarise as far as possible the findings from the studies. And fourth, to make recommendations for policy and practice.

Methods

We conducted a systematic review of economic evaluations of service delivery interventions in LMICs.

Definition of a service delivery intervention

There exists no universally accepted definition of a service delivery intervention, which we discern to lie between clinical interventions and policy interventions in their proximity to the patient. Acknowledging inevitable overlap between intervention types, we considered (for the purpose of this review) service delivery interventions as those that could be judged as being classified in the taxonomy specified by Lewin et al. as affecting ‘Delivery arrangements’, but not financial and governance arrangements, which were considered policy interventions [7]. Specifically, service delivery interventions affect: (i) to whom care is provided and efforts made to reach them, (ii) by whom care is provided, (iii) where care is provided, (iv) with what information and communication and technology is care provided, and/or (v) how the quality and safety of care is improved and monitored.

Search strategy

We adapted the search strategy from Lewin et al., who conducted a systematic review of reviews of evidence of the effectiveness of service delivery interventions in primary health care in LMICs. To adapt this strategy we removed terms pertaining specifically to reviews and specifically to primary care. We added terms to identify economic evaluations including cost-benefit analysis, cost-effectiveness analysis, cost per DALY, cost*, economic evaluation and so forth. The full search strategy is available in the Supplementary Information. We searched PUBMED, MEDLINE, EconLit, and NHS EED for studies published between 1st January 2000, when the millennium development goals were initiated, and 30th October 2016. There were no language restrictions. LMICs were defined according to the World Bank [14]. This review was initiated as part of an internal project and the protocol was submitted to and approved by the medical school but was not registered with PROSPERO. It is provided in the Supplementary Information. Each abstract was reviewed independently by two reviewers. Full text articles were obtained for all studies selected by at least one reviewer. Disagreements about inclusion were resolved through team discussion.

Inclusion criteria

Studies were included if: (i) it was an economic evaluation that reported both incremental outcomes and incremental costs. These included studies reporting incremental cost-effectiveness ratios (ICER; e.g. cost per case cured), incremental cost-benefit ratios (e.g. cost per DALY), and expected incremental net benefit estimates (net monetary value); (ii) the study examined a service delivery intervention as defined above; (iii) the study considered only intervention(s) implemented in a LMIC, and (iv) the study was published between 1st January 2000 and 30th October 2016.

Exclusion criteria

Evaluations reporting only cost differences, effectiveness estimates, or average costs or effects were excluded, including cost-minimisation analyses. No restrictions on language were applied.

Data extraction

The following data were extracted from each study where reported: author(s); publication date; study date; description of intervention(s) and comparator(s); study country(ies); methods; source(s) of effectiveness evidence and their sample size(s), unit of effectiveness, mean age(s) of participants, and sex; source(s) of costs evidence; mean and median costs for treatment and comparator and their differences and 95% confidence intervals; currency; cost utility; cost benefit or cost-effectiveness ratio and 95% confidence intervals or expected net benefits; probability cost-effective; time horizon, and perspective. HS extracted the data and SW independently cross-checked the data against the original studies.

Quality assessment

The quality of the economic evaluations was judged using the ten point Drummond checklist. [15] Each study was scored independently by two authors (SW and HS) out of a maximum of ten points. Disagreements were resolved by discussion.

Synthesis and evaluation

Interventions were grouped according to the taxonomy in Lewin et al. (Panel 1) discussed above [7]. Estimates of ICERs or equivalent outcomes were grouped by both disease area and outcome. Permutation plots were completed for interventions judged through discussion to be similar and with similar comparators [16]. To aid comparability between results from different countries and over different time periods, ICERs, or equivalent outcomes, were converted into multiples of GDP per capita for the relevant year and country. This also permits comparability with World Health Organisation (WHO) recommendations of cost-effectiveness thresholds; less that one times GDP per capita per DALY averted is considered highly cost-effective and less than three times is considered cost-effective [17]. GDP per capita was obtained from the World Bank for the year of the relevant study in nominal, purchasing power parity terms to enable comparability between studies of different years in this metric. Where study year was not reported, publication year was used instead. A meta-analysis was not deemed appropriate for these data, as service delivery interventions are typically adapted to specific contexts, and methods and data differ widely between studies.

Results

Studies included and excluded

Overall, 3818 potentially relevant abstracts were identified of which 101 studies were selected for full text review. Sixty-five studies were excluded: 15 were considered clinical interventions and 10 were considered policy (governance or finance) interventions, nine studies were not economic evaluations; an incremental ratio or net benefits could not be calculated from 23 studies, two studies were not in an LMIC country, and the remaining six did not report on a specific intervention. In total, 36 full text articles were included in the review (Fig. 1). The included studies are reported in Table 1. The clinical topics covered were HIV (ten studies), obstetric care (four studies), child health (three studies), while the rest covered other or multiple areas of care.

Fig. 1
figure1

PRISMA diagram

Table 1 Summary of studies included in the review

Comparison of methods

The 36 included studies differed widely in terms of the measures of effectiveness, perspective, time horizon, and other methods. Table 2 details the methods and approaches used in the included studies. Nine studies were economic evaluations alongside a randomised trial, while the other studies were a mix of economic evaluations from observational evidence or modelling studies. The majority (21) of the included studies used basic arithmetic approaches to calculate ICERs or equivalent, the others used more complex model structures to extrapolate from trial-based or other sources of evidence. Most studies (26) reported conducting some form of sensitivity analysis although only 13 conducted probabilistic analyses.

Table 2 Methods used by the studies included in the review

As an illustration of methodological heterogeneity between studies, ten studies examined delivery interventions for HIV/AIDS in Sub-Saharan Africa (Tables 1 and 2) [18,19,20,21,22,23,24,25,26,27]. None of these studies used the same effectiveness measures. Some used health outcomes: QALYs, DALYs, ‘favourable’ immune response, life expectancy, death rate, cases averted, and undetectable viral load. The others used ‘surrogate’ endpoints: cases identified, uptake of testing, patients retained, and “in care and responding”. As shown in Table 2 eight of these ten studies took a provider or health care perspective [18,19,20, 22, 24,25,26,27] and two a societal perspective [21, 23]; the time horizon varied from less than one year to 20 years; and only four included cost savings contingent on reduced morbidity. This heterogeneity was reflected across all the studies included in the review rendering any further comparisons between studies and interventions inappropriate.

Comparison of study quality

Quality scores varied widely according to the Drummond ten point checklist. Scores ranged from three to ten out of ten (Table 1). Aside from the difficulties with comparability between studies, the most common weaknesses in the included studies were the establishment of effectiveness evidence (question 3: 17/36 studies meeting the criterion) and the credible valuation of costs and consequences (question 6: 21/36 studies). Poor reporting also prevented determination of whether criteria were met. As reported in Table 2, it was not possible to establish discount rates for a number of studies (Question 7: 14/36 studies); discount rates were potentially not reported for short time horizons, but may have still been required for the valuation of capital.

Assessment of task shifting interventions

The most widely studied types of delivery intervention were ones that altered “by whom and where” care was provided. We classified 11 and 12 of the 36 included studies in these categories, respectively. The predominant focus of these interventions was provision of typically doctor-led care by nurses or CHWs (eight studies [18, 19, 28,29,30,31,32,33]), or shifting place of care, such as providing treatment at home or in the community instead of at a facility (12 studies [20,21,22,23,24,25,26, 34,35,36,37,38]). The remaining three studies compared guardian to CHW supervised treatment for TB [39], increasing midwifery staffing, [40] and an integrated community-based programme for infectious disease (as compared to standard facility based care) [41].

Twenty of these 23 studies evaluated shifting care to potentially less costly settings: specifically either from doctors to nurses or CHWs, or from a facility to the home or community. Nine of these 20 reported the incremental cost per DALY averted or cost per QALY gained so that the results could be compared to WHO thresholds [20, 24, 29,30,31, 35,36,37, 41]. Seven of these nine that reported DALYs were considered highly cost-effective or cost-saving, i.e. less costly and at least as effective, when compared to WHO thresholds. A further three of the 20 studies were likely to be considered cost-effective on the basis of life years saved [23, 32, 38], and four more studies reporting other effectiveness outcomes were estimated to be cost-saving overall compared to a relevant alternative [18, 22, 28, 33]. Fig. 2(a) shows a permutation plot of the 20 studies examining shifting care to potentially less costly settings grouped by their estimated changes to costs and health outcomes and the resulting implications for decision makers. Taken together the evidence suggests that shifting tasks from doctors to CHWs, nurses, and/or from facility into the community is likely to be cost-effective and even potentially cost-saving.

Fig. 2
figure2

Permutation plots summarising the number of economic evaluations according to their findings. Numbers in cells represent numbers of studies. a Shifting care to less costly settings: Community based care or task shifting versus facility based or doctor-led care. b Quality improvement: QI initiatives for community, primary, and secondary care

Assessment of quality improvement interventions

Nine studies reported an economic evaluation of a quality improvement initiative. Their incremental costs and benefits are summarised in Fig. 2(b) [27, 42,43,44,45,46,47,48,49]. Five of these examined quality improvement in health care facilities, all of which were considered highly cost-effective [43, 45,46,47,48]. These schemes were comprised typically of staff training and improved supervision. Medical equipment and quality assurance was also included in two of these studies [46, 47]. Beyond quality improvement initiatives in formal health care facilities, one study compared high and low staff to patient ratios, but did not find that well-staffed HIV clinics were cost-effective compared to the standard care with lower staff-patient ratios [27]. A large rural primary care quality improvement initiative in Ethiopia that implemented and improved community and primary care infrastructure, funding, and services simultaneously also failed to demonstrate cost-effectiveness [46]. However, drug safety training for drug-dispensing shopkeepers was estimated to be highly cost-effective in Uganda [42]. This latter finding reflects the results from similar, non-quality focussed initiatives included in the review but classified in other categories, such as interventions to improve the knowledge of lay trauma first-responders in Uganda [32], and providing cardio-vascular disease training to CHWs in South Africa [29]. Taken altogether there appears to be good evidence that quality improvements through training and supervision are highly cost-effective. Only four quality improvement studies appeared to take into account cost-savings to the health service contingent on reduced morbidity [43, 45, 47, 49].

Assessment of other types of service delivery intervention

There were four further studies included in the review that examined a range of different interventions. Two considered information and communication technology interventions for hospitals, one in China [50] and one in India [51]. Two articles considered interventions expanding helminth control programs: one to schools [52] and the other to the whole community [53]. All four of these interventions were estimated to be cost-effective or cost-saving.

Discussion

For two broad classes of intervention identified in this review the evidence suggests that they are cost-effective or potentially cost-saving. Firstly, shifting basic care from facilities to the community or the home, or from doctors to nurses or CHWs has been shown to be cost-effective across a broad range of conditions. Testing, counselling, and management of HIV at home was generally more costly but also more effective than doing so in facilities. Similarly, involving and training lay members of the community in emergency care, CVD management, and mental health all proved cost-effective. However, the task shifting programs were generally small-scale, local initiatives by researchers or healthcare providers, Further evidence is required to assess these interventions at scale. Secondly, quality improvement initiatives in community, primary, and secondary care involving staff training, supervision, and equipment upgrades were also generally considered cost-effective. However, the significant heterogeneity in the design and reporting of the economic evaluations rendered more specific quantitative comparisons of results between interventions inappropriate.

A key purpose of economic evaluation is to inform decisions. But even within the same disease area in the same region, a decision maker would have difficulty synthesising the available studies to come to an informed decision on the basis of the studies reviewed here. For example, service delivery interventions for HIV in Sub-Saharan Africa used a wide range of different outcomes, perspectives, methods, and time horizons. Without knowledge of how the results compare in terms of general cost-effectiveness measures, such as a cost per DALY, a decision maker would not be able to choose from among the many similar but ultimately mutually exclusive alternative organisational arrangements. There is a strong case for a more standardised way of conducting and reporting economic evaluations in this area, while respecting the differences between context-specific interventions. This is a key area for future research and reporting guidelines.

Lewin and colleagues studied service delivery research across LMICs ten years ago and noted a ‘dearth of evidence in low and middle income countries’ [7]. More recent reviews of service delivery interventions, such as CHW programs, [11, 12] show that the evidence base is growing in this area. Nevertheless, these recent reviews of CHW programs and the results presented here demonstrate that there is still insufficient good quality evidence to support policy makers’ decisions in this area. The subject is clearly still at an early stage of development and the time is propitious to influence the development of the field.

There is no clear line that delineates service delivery interventions from policy or clinical interventions. Rather these interventions exist on a spectrum. A clinical intervention is applied directly to a patient whereas a service delivery intervention is applied to the organisation of a clinical intervention and its delivery [5]. As such, there may be some disagreement with regard to the eligibility of studies selected for inclusion here, for example, whether the extension of helminth control programs or public health behavioural change interventions are service delivery interventions. Governance and finance arrangements were excluded as they were classed as policy interventions and concern decision makers at a different level. For example, we excluded an economic evaluation of a private sector capitation model for the public sector for diabetes in South Africa [54]. The economic evaluation of health care policy in LMICs is important for effective decision making on health care organisation and should be the subject of future research. We did not formally consider publication bias given the lack of an agreed method to do so for economic evaluations. It is possible that there is a bias towards publishing results that appear cost-effective, or that economic evaluations are undertaken only for interventions thought to be effective. This is another important area for future research.

The design and organisation of health services is a growing and important issue. The severe resource limitations in many LMICs necessitate high quality economic evaluation. Guidelines and data resources for economic evaluation in LMICs such as WHO Choice are available [55]. However, there is a high level of methodological heterogeneity between studies in LMICs and when compared to studies in high income countries. This may be due to levels of health economics research capacity or different expectations of funders, journals, or peer reviewers [56]. Previous research has also demonstrated the wide differences in results from different approaches, such as between top-down and bottom up costing approaches [57]. A key recommendation of this study is therefore standardisation of research methods and ensuring adherence to reporting guidelines. This can be achieved by funders, journals, and policy makers. Standardising outcomes may be hindered by data limitations, although DALY values for many diseases are published, such as by the Global Burden of Disease studies [58]. Other studies have emphasized the need for broad measures of general health and well-being to both capture benefits across multiple dimensions and ensure comparability between studies [59].

Conclusions

There is a large evidence base supporting effective and cost-effective treatment of the diseases afflicting LMIC such as HIV, TB, and malaria. However, the evidence supporting the optimal configuration of services is highly limited and is an important direction for future research.

Available evidence generally supports shifting care to less costly settings, such as in the community instead of a health care facility, or task shifting from doctors to CHWs. Quality improvement initiatives were generally found to be more costly and more effective. However, there is significant heterogeneity in the literature, both in methodological approaches and in quality. This renders further comparisons difficult and limits the utility of the available evidence to decision makers. Given the severe resource limitations in LMICs, there is a pressing need for high quality economic evaluation of service delivery interventions and a need for standardisation of methods and reporting to facilitate its use to decision makers.

Abbreviations

CHW:

Community health worker

CVD:

Cardiovascular disease

DALY:

Disability adjusted life year

GDP:

Gross domestic product

HIV:

Human immunodeficiency virus

ICER:

Incremental cost-effectiveness ratio

LMIC:

Low and middle income country

QALY:

Quality adjusted life year

TB:

Tuberculosis

References

  1. 1.

    Wang H, Naghavi M, Allen C, Barber RM, Bhutta ZA, Carter A, et al. Global, regional, and national life expectancy, all-cause mortality, and cause-specific mortality for 249 causes of death, 1980–2015: a systematic analysis for the global burden of disease study 2015. Lancet. 2016;388:1459–544.

  2. 2.

    Pitt C, Goodman C, Hanson K. Economic evaluation in global perspective: a bibliometric analysis of the recent literature. Health Econ. 2016;25:9–28.

  3. 3.

    Boehler CEH, Lord J. Mind the gap! A multilevel analysis of factors related to variation in published cost-effectiveness estimates within and between countries. Med Decis Mak. 2016;36:31–47.

  4. 4.

    Drummond M, Sculpher M, Claxton K, Stoddart G, Torrance G. Methods for the economic evaluation of health care programmes. 4th ed. Oxford: Oxford University Press; 2015.

  5. 5.

    Lilford RJ, Chilton PJ, Hemming K, Girling AJ, Taylor C a, Barach P. Evaluating policy and service interventions: framework to guide selection and interpretation of study end points. BMJ 2010;341:c4413–c4413.

  6. 6.

    Watson SI, Lilford RJ. Integrating multiple sources of evidence: a Bayesian perspective. In: Raine R, Fitzpatrick R, Barratt H, et al., editors. Challenges, solutions and future directions in the evaluation of service innovations in health care and public health. Southampton: NIHR Journals Library; 2016. (Health Services and Delivery Research, No. 4.16.) Essay 1.

  7. 7.

    Lewin S, Lavis JN, Oxman AD, Bastías G, Chopra M, Ciapponi A, et al. Supporting the delivery of cost-effective interventions in primary health-care systems in low-income and middle-income countries: an overview of systematic reviews. Lancet. 2008;372:928–39.

  8. 8.

    Laxminarayan R, Mills AJ, Breman JG, Measham AR, Alleyne G, Claeson M, et al. Advancement of global health: key messages from the disease control priorities project. Lancet. 2006;367:1193–208.

  9. 9.

    Shillcutt SD, Walker DG, Goodman C a, Mills AJ. Cost effectiveness in low- and middle-income countries: a review of the debates surrounding decision rules. PharmacoEconomics 2009;27:903–917.

  10. 10.

    Jamison DT, Breman JG, Measham AR, Alleyne G, Claeson M, Evans DB, et al., editors. Disease control priorities in developing countries. 2nd ed. New York: Oxford University Press and The World Bank; 2006.

  11. 11.

    Nkonki L, Tugendhaft A, Hofman K. A systematic review of economic evaluations of CHW interventions aimed at improving child health outcomes. Hum Resour Health. 2017;15(1):19.

  12. 12.

    Vaughan K, Kok MC, Witter S, Dieleman M. Costs and cost-effectiveness of community health workers: evidence from a literature review. Hum Resour Health. 2015;13:71.

  13. 13.

    Claxton K. The irrelevance of inference: a decision-making approach to the stochastic evaluation of health care technologies. J Health Econ. 1999;18(3):341–64.

  14. 14.

    World Bank. Country and Lending Groups. Available from: http://data.worldbank.org/about/country-and-lending-groups. Accessed: 25 Jan 2016.

  15. 15.

    Drummond MF, Jefferson TO. Guidelines for authors and peer reviewers of economic submissions to the BMJ. BMJ. 1996;313:275–83.

  16. 16.

    Nixon J. Summarising economic evaluations in systematic reviews: a new approach. BMJ. 2001;322:1596–8.

  17. 17.

    World Health Organization. Monitoring the building blocks of health systems: a handbook of indicators and their measurement strategies. Geneva; 2010. Available from: http://www.who.int/healthinfo/systems/WHO_MBHSS_2010_full_web.pdf

  18. 18.

    Long L, Brennan A, Fox MP, Ndibongo B, Jaffray I, Sanne I, et al. Treatment outcomes and cost-effectiveness of shifting Management of Stable ART patients to nurses in South Africa: an observational cohort. PLoS Med. 2011;8:e1001055.

  19. 19.

    Barton GR, Fairall L, Bachmann MO, Uebel K, Timmerman V, Lombard C, et al. Cost-effectiveness of nurse-led versus doctor-led antiretroviral treatment in South Africa: pragmatic cluster randomised trial. Trop Med Int Heal. 2013;18:769–77.

  20. 20.

    Babigumira JB, Sethi AK, Smyth KA, Singer ME. Cost effectiveness of facility-based care, home-based care and mobile clinics for provision of antiretroviral therapy in Uganda. PharmacoEconomics. 2009;27:963–73.

  21. 21.

    Babigumira JB, Castelnuovo B, Stergachis A, Kiragga A, Shaefer P, Lamorde M, et al. Cost effectiveness of a pharmacy-only refill program in a large urban HIV/AIDS clinic in Uganda. PLoS One. 2011;6:1–7.

  22. 22.

    Mulogo EM, Batwala V, Nuwaha F, Aden a S, Baine OS. Cost effectiveness of facility and home based HIV voluntary counseling and testing strategies in rural Uganda. Afr Health Sci. 2013;13:423–9.

  23. 23.

    Bassett IV, Govindasamy D, Erlwanger AS, Hyle EP, Kranzer K, Van Schaik N, et al. Mobile HIV screening in cape town, South Africa: clinical impact, cost and cost-effectiveness. PLoS One. 2014;9:e85197.

  24. 24.

    Smith JA, Sharma M, Levin C, Baeten JM, van Rooyen H, Celum C, et al. Cost-effectiveness of community-based strategies to strengthen the continuum of HIV care in rural South Africa: a health economic modelling analysis. Lancet HIV. 2015;2:e159–68. Smith et al. Open Access article distributed under the terms of CC BY

  25. 25.

    Tabana H, Nkonki L, Hongoro C, Doherty T, Ekström AM, Naik R, et al. A cost-effectiveness analysis of a home-based HIV counselling and testing intervention versus the standard (facility based) HIV testing strategy in rural South Africa. PLoS One. 2015;10:1–13.

  26. 26.

    Marseille E, Kahn JG, Beatty S, Jared M, Perchal P. Adult male circumcision in Nyanza, Kenya at scale: the cost and efficiency of alternative service delivery modes. BMC Health Serv Res. 2014;14:31.

  27. 27.

    Vella V, Govender T, Dlamini SS, Moodley I, David V, Taylor M, et al. Cost-effectiveness of staff and workload profiles in retaining patients on antiretroviral therapy in KwaZulu-Natal, South Africa. AIDS Care. 2011;23:1146–53.

  28. 28.

    Islam MA, Wakai S, Ishikawa N, Chowdhury AMR, Vaughan JP, et al. Cost-effectiveness of community health workers in tuberculosis control in Bangladesh. Bull World Health Organ. 2002;80:445–50.

  29. 29.

    Gaziano T a, Bertram M, Tollman SM, Hofman KJ. Hypertension education and adherence in South Africa: a cost-effectiveness analysis of community health workers. BMC Public Health 2014;14:240.

  30. 30.

    Saokaew S, Permsuwan U, Chaiyakunapruk N, Nathisuwan S, Sukonthasarn A, Jeanpeerapong N. Cost-effectiveness of pharmacist-participated warfarin therapy management in Thailand. Thromb Res. 2013;132:437–43.

  31. 31.

    Buttorff C, Hock RS, Weiss HA, Naik S, Araya R, Kirkwood BR, et al. Economic evaluation of a task-shifting intervention for common mental disorders in India. Bull World Health Organ. 2012;90:813–21.

  32. 32.

    Jayaraman S, Mabweijano JR, Lipnick MS, Cadwell N, Miyamoto J, Wangoda R, et al. First things first: effectiveness and scalability of a basis prehospital trauma care program for lay first-responders in Kampala, Uganda. PLoS One. 2009;4:1–7.

  33. 33.

    Khan MA, Walley JD, Witter SN, Imran A, Safdar N. Costs and cost-effectiveness of different DOT strategies for the treatment of tuberculosis in Pakistan. Directly Observed Treatment. Health Policy Plan. 2002;17:178–86.

  34. 34.

    Chanda P, Hamainza B, Moonga HB, Chalwe V, Banda P, Pagnoni F. Relative costs and effectiveness of treating uncomplicated malaria in two rural districts in Zambia: implications for nationwide scale-up of home-based management. Malar J. 2011;10:159.

  35. 35.

    Kahn JG, Muraguri N, Harris B, Lugada E, Clasen T, Grabowsky M, et al. Integrated HIV testing, malaria, and diarrhea prevention campaign in Kenya: modeled health impact and cost-effectiveness. PLoS One. 2012;7:1–9.

  36. 36.

    Jafar TH, Islam M, Bux R, Poulter N, Hatcher J, Chaturvedi N, et al. Cost-effectiveness of community-based strategies for blood pressure control in a low-income developing country: findings from a cluster-randomized, factorial-controlled trial. Circulation. 2011;124:1615–25.

  37. 37.

    Chen AT, Pedtke A, Kobs JK, Edwards GS, Bullet J, Richard R, et al. Volunteer orthopedic surgical trips in Nicaragua: a cost-effectiveness evaluation. World J Surg. 2012;36:1–7.

  38. 38.

    Pitt C, Tawiah T, Soremekun S, ten Asbroek AHA, Manu A, Tawiah-Agyemang C, et al. Cost and cost-effectiveness of newborn home visits: findings from the Newhints cluster-randomised controlled trial in rural Ghana. Lancet Global Health. 2016;4:e45–56. World Health Organization

  39. 39.

    Prado TN, Wada N, Guidoni LM, Golub JE, Dietze R, Maciel ELN. Cost-effectiveness of community health worker versus home-based guardians for directly observed treatment of tuberculosis in Vitória, Espírito Santo state, Brazil. Cad Saude Publica. 2011;27:944–52.

  40. 40.

    Prinja S, Jeet G, Verma R, Kumar D, Bahuguna P, Kaur M, et al. Economic analysis of delivering primary health care services through community health workers in 3 north Indian states. PLoS One. 2014;9:e91781.

  41. 41.

    Marseille E, Jiwani A, Raut A, Verguet S, Walson J, Kahn JG. Scaling up integrated prevention campaigns for global health: costs and cost-effectiveness in 70 countries. BMJ Open. 2014;4:e003987.

  42. 42.

    Goodman CA, Mutemi WM, Baya EK, Willetts A, Marsh V. The cost-effectiveness of improving malaria home management: shopkeeper training in rural Kenya. Health Policy Plan. 2006;21:275–88.

  43. 43.

    Barasa EW, Ayieko P, Cleary S, English M. A multifaceted intervention to improve the quality of care of children in district hospitals in Kenya: a cost-effectiveness analysis. PLoS Med. 2012;9:13.

  44. 44.

    Curry LA, Byam P, Linnander E, Andersson KM, Abebe Y, Zerihun A, et al. Evaluation of the ethiopian millennium rural initiative: impact on mortality and cost-effectiveness. PLoS One. 2013;8:e79847.

  45. 45.

    Broughton EI, Gomez I, Nuñez O, Wong Y. Cost-effectiveness of improving pediatric hospital care in Nicaragua. Rev Panam Salud Publica. 2011;30:453–60.

  46. 46.

    Clark M, Spry E, Daoh K, Baion D, Skordis-Worrall J. Reductions in inpatient mortality following interventions to improve emergency Hospital Care in Freetown, Sierra Leone. PLoS One. 2012;7:5–9.

  47. 47.

    Alfonso YN, Bishai D, Bua J, Mutebi A, Mayora C, Ekirapa-Kiracho E. Cost-effectiveness analysis of a voucher scheme combined with obstetrical quality improvements: quasi experimental results from Uganda. Health Policy Plan. 2015;30:88–99.

  48. 48.

    Manasyan A, Chomba E, McClure EM, Wright LL, Krzywanski S, Carlo WA. Cost-effectiveness of essential newborn care training in urban first-level facilities. Pediatrics. 2011;127:e1176–81.

  49. 49.

    Prinja S, Bahuguna P, Mohan P, Mazumder S, Taneja S, Bhandari N, et al. Cost effectiveness of implementing integrated management of neonatal and childhood illnesses program in district Faridabad, India. PLoS One. 2016;11:1–19.

  50. 50.

    Li K, Naganawa S, Wang K, Li P, Kato K, Li X, et al. Study of the cost-benefit analysis of electronic medical record systems in general hospital in China. J Med Syst. 2012;36:3283–91.

  51. 51.

    Anchala R, Kaptoge S, Pant H, Di Angelantonio E, Franco OH, Prabhakaran D. Evaluation of effectiveness and cost-effectiveness of a clinical decision support system in managing hypertension in resource constrained primary health care settings: results from a cluster randomized trial. J Am Heart Assoc. 2015;4:e001213.

  52. 52.

    Brooker S, Kabatereine NB, Fleming F, Devlin N. Cost and cost-effectiveness of nationwide school-based helminth control in Uganda: intra-country variation and effects of scaling-up. Health Policy Plan. 2007;23:24–35.

  53. 53.

    Lo NC, Bogoch II, Blackburn BG, Raso G, N’Goran EK, Coulibaly JT, et al. Comparison of community-wide, integrated mass drug administration strategies for schistosomiasis and soil-transmitted helminthiasis: a cost-effectiveness modelling study. Lancet Glob Heal. 2015;3:e629–38.

  54. 54.

    Volmink HC, Bertram MY, Jina R, Wade AN, Hofman KJ. Applying a private sector capitation model to the management of type 2 diabetes in the south African public sector: a cost-effectiveness analysis. BMC Health Serv Res. 2014;14:444.

  55. 55.

    World Health Organization. Cost effectiveness and strategic planning (WHO-CHOICE). WHO-CHOICE; 2017. http://www.who.int/choice/cost-effectiveness/en/. Accessed 10 May 2018.

  56. 56.

    Griffiths UK, Legood R, Pitt C. Comparison of economic evaluation methods across low-income, middle-income and high-income countries: what are the differences and why? Health Econ. 2016;25:29–41.

  57. 57.

    Cunnama L, Sinanovic E, Ramma L, Foster N, Berrie L, Stevens W, et al. Using top-down and bottom-up costing approaches in LMICs: the case for using both to assess the incremental costs of new Technologies at Scale. Health Econ. 2016;25:53–66.

  58. 58.

    Global Burden of Disease Study 2013 Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 301 acute and chronic diseases and injuries in 188 countries, 1990–2013: a systematic analysis for the global burden of disease study 2013. Lancet. 2015;386:743–800.

  59. 59.

    Greco G, Lorgelly P, Yamabhai I. Outcomes in economic evaluations of public health interventions in low- and middle-income countries: health, capabilities and subjective wellbeing. Health Econ. 2016;25:83–94.

Download references

Funding

This research was commissioned by the National Institute for Health Research using Official Development Assistance (ODA) funding. The views expressed in this publication are those of the author(s) and not necessarily those of the NHS, the National Institute for Health Research or the Department of Health.

Availability of data and materials

All data generated or analysed during this study are included in this published article.

Author information

SW conceived the article. SW and HS developed the search strategy, reviewed all abstracts and selected papers, and scored papers for quality. HS extracted the data. SW, CT, YFC, and RL developed the figures for the paper. SW, HS, CT, YFC, and RL drafted the first manuscript and reviewed all subsequent versions. All authors read and approved the final manuscript.

Correspondence to Samuel I. Watson.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Keywords

  • Health service delivery
  • Economic evaluation
  • Service delivery intervention
  • Cost-effectiveness
  • Systematic review