Skip to main content

Evaluation of the effectiveness of surveillance policies to control the COVID-19 pandemic in São Paulo, Brazil

Abstract

Background

Surveillance efforts are essential to pandemic control, especially where the state is the primary health provider, such as Brazil. When public health testing guidelines limit molecular tests, there are reductions in detection efforts aimed at early recognition, isolation, and treatment of those infected with the virus. This study evaluates the effectiveness of surveillance policies to control the COVID-19 pandemic in São Paulo.

Methods

We conducted an interrupted time series analysis with a segmented regression model to analyze if changes in the state’s guidelines improved RT-PCR testing outcomes in Brazil’s most affluent and largest state, São Paulo. Anonymized daily data on the RT-PCR tests conducted in public laboratories belonging to the state-wide network from March 1, 2020 to June 5, 2021 were extracted from the Sao Paulo State open-source database, while the data on the genomic sequences were obtained from GISAID. We then aggregated these data for the 17 regional health departments in the state to evaluate regional-level outcomes.

Results

The public health system restricted RT-PCR testing to hospitalized cases in the first months. Testing was expanded to permit symptomatic testing of non-hospitalized persons only in July 2020, but a statistically significant increase in surveillance efforts was not observed. Case definition was expanded to allow case confirmation based on clinical, laboratory and image data criteria other than an RT-PCR test without increasing the testing effort for asymptomatic suspicious cases in September 2020. There was an increase in the mean volume of testing in each RHD, but the test positivity rate increased due to insufficient testing expansion. Results also show an uneven improvement in testing outcomes following these changes across the state’s regional health departments.

Conclusions

Evidence suggests that lower RT-PCR testing and genomic surveillance efforts are associated with areas characterized by a higher population concentration and a greater population reliance on the public health system. Our results highlight the need to structure health surveillance and information systems for disease control and prevention in emergency settings considering local demographics and vulnerabilities. In high prevalence settings, efforts at identifying and including vulnerable populations in routine and enhanced surveillance programs during COVID-19 must be significantly improved.

Introduction

Evidence from industrialized and low-resource countries has demonstrated that detection efforts to identify infected individuals are essential to an effective containment of COVID-19 along with policies aimed at movement restrictions that included border, school, and business closures, travel restrictions, restrictions on public gatherings, and local curfews [1,2,3,4]. There is growing consensus that coordinated and unified testing and genomic surveillance systems are needed to identify, track, and mitigate the transmission of SARS-CoV-2 and the variants of concern that have spread most rapidly. Molecular tests, commonly referred to as Reverse Transcription-Polymerase Chain Reaction (RT-PCR) tests, are considered the gold standard as they detect the virus’s RNA in infected individuals who are potentially transmitting the virus to other individuals [5]. RT-PCR and rapid lateral flow (antigen) tests are considered the first-best tests for diagnosis of COVID-19 and an essential part of a surveillance strategy that should include identifying and isolating infected individuals and ensuring the quarantine of close contacts. RT-PCR–positive samples are also the source used to conduct genomic surveillance, including the monitoring of variants of interest (VOI) and of concern (VOC) [6].

However, since the onset of the pandemic, the sizable volume of resources (monetary, laboratory, test kits) and continuous surveillance policies have been identified as significant impediments to the effective use of RT-PCR tests to contain the COVID-19 pandemic in poor and middle-income countries [7, 8]. As the developing world struggles to contain the spread of SARS-CoV-2 and faces an increasing number of fatalities [9], enhanced understanding is needed about whether specific diagnostic interventions are improving local epidemic control efforts.

Although Brazil has less than 3 percent of the world’s population and COVID-19 arrived relatively later than in Asia, Europe, and North America, the country has registered almost 10% of the world’s cases (over 21 million) and nearly 13% of all deaths (588,597) by July 2021 [10]. In this study, we analyze RT-PCR public health network testing data in the first 15 months of the COVID-19 pandemic in the state of São Paulo to assess surveillance efforts. São Paulo state, the most populous state in Brazil with over 40 million inhabitants, is the epicenter of the pandemic in the country [11], and 62 (%) of its population depends exclusively on the public health system [12]. To do so, we evaluate the effectiveness of surveillance policies to control the COVID-19 pandemic in São Paulo, considering the regional differences among the 17 Health Departments between March 2020 to June 2021.

Methods

Study setting

This study was conducted in São Paulo state, the most affluent and populated state in Brazil. The state of São Paulo has 20% of the Brazilian population but recorded 25% of deaths from COVID-19 in the country in two years of the pandemic, although it has the highest GDP and hospital coverage in the country [13, 14]. In addition to studying surveillance policies in the state of São Paulo, we also carried out a regional analysis covering the 17 Health Departments of the state from March 2020 to June 2021.

We analyzed the surveillance efforts provided by public health services since the Brazilian Health System is public and universal, known as Sistema Único de Saúde (SUS). The management of the SUS is conducted by all government levels (federal, states, and municipalities) with different responsibilities. The surveillance and information health systems are under the responsibility of public managers, and considering the specificities of the state of São Paulo, it has the largest infrastructure of health services among all the other 26 units of the federation [15].

Research design

We conducted a cross-sectional time-series study to evaluate the surveillance interventions effects between March 2020 to June 2021 across the 17 Health Departments of the São Paulo State [16]. This manuscript was based on the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) guidelines [17].

Variables

To identify variables for RT-PCR testing outcomes, we analyzed WHO, ECDC, and CDC technical guidelines and daily press conferences that specifically addressed testing [18,19,20,21,22,23] and other academic publications and platforms [24,25,26]. Based on these documents, we identified a total of nine indicators (see Table 1). Of the nine indicators, two monitor variant surveillance as these efforts determine if emerging mutations render the virus more contagious, more potent, or resistant to existing vaccines and medicines—the remainder focus on testing outcomes and laboratory capacities at the regional level. We constructed a weekly time-series for each testing outcome indicator during each epidemiological week (Sunday-Saturday), the period for each of the seventeen Regional Health Departments (RHD) in the state. The RHD is the central territorial entity in which the public health system is organized in Brazil. In the State of Sao Paulo, the median number of municipalities in an RHD is 39 (minimum 9 and maximum 102).

Table 1 Surveillance efforts of São Paulo State (Brazil) from March 1, 2020, to June 5, 2021

Based on a review of official state legislation, we identified four major testing interventions that were introduced by the State of São Paulo’s RT-PCR surveillance program: Testing limited to hospitalized cases and health professionals (Testing Policy I), which was published on March 17, 2020 [27]; Testing expanded to ambulatory symptomatic cases (Testing Policy II), which commenced on July 1, 2020 [28]; Inclusion of the clinical and epidemiological criteria as COVID-19 notification, in addition to RT-PCR testing (Testing Policy III) which was announced on September 15, 2020 [29]; and, genomic surveillance guidelines were introduced (Testing Policy IV), which were initiated on February 26, 2021 [30].

To identify if testing is associated with specific spatial and socioeconomic patterns in the public health networks across RHDs, we collected data on the 2020 population, and social vulnerability was provided from the Foundation for Statewide System Data Analysis [12]. The 2010 Social Vulnerability Index of São Paulo State is based on five socioeconomic and four demographic indicators. Social vulnerability is measured as the percentage of people living in each of the 17 RHD under high or very high social vulnerability (including urban and rural areas). For each RHD, these values represent the mean value of all municipalities in the specific region. We also obtained the proportion of the population which was exclusively dependent on the Brazilian public health system, known as Sistema Único de Saúde (SUS) in Portuguese, in May 2020. The per capita income estimates are based on 2010 census data.

Data collection and processing

Anonymized daily data on the RT-PCR tests conducted in the public laboratories belonging to the state-wide network from March 1, 2020 to June 5, 2021 were extracted from the Sao Paulo State Health Secretariat’s Intelligent Monitoring System (SIMI) [31]. This open-source database provides the number of RT-PCR performed in the network of public labs for hospitalized and ambulatory patients and the overall confirmed daily case count. Data on the laboratory processing capacity of these labs were also collected from the same source. The data on the genomic sequences collected and deposited by the Instituto Adolfo Lutz network, which is responsible for sequencing the cases identified by the Center for Epidemiological Surveillance (CVE) for genomic surveillance in São Paulo state, were obtained from the Global Initiative on Sharing All Influenza Data (GISAID), which is the platform used for registering SARS-CoV-2 sequences by Brazilian institutes [32]. Since the objective of this study is to evaluate regional-level outcomes, the data were aggregated for the 17 regional health departments in the state.

Data analysis

We reconstructed time series data to estimate the mean change in testing indicators and 95(%) confidence intervals (95% CIs) for the state, and for each of the 17 RHDs between March 1, 2020 and June 5, 2021. We then analyzed several RT-PCR testing effort variables in the period between the onset of each policy and the announcement of the revised policy, as the study’s objective was to analyze whether each intervention positively interfered in the increase in the diagnostic testing effort. Therefore, we analyzed the following periods: Testing Policy I: March 17—June 30, 2020; Testing Policy II: July 1—September 14, 2020; Testing Policy III: September 15, 2020—February 25, 2021; and, Testing Policy III: February 26—June 5, 2021(Fig. 1, Panel a). These policies were identified through searches in the archive of the official webpage of the State of São Paulo, using the search terms “RT-PCR,” “SARS-Cov-2,” “test,” “genomic surveillance,” and “diagnosis” for the period between March 1, 2020, until June 30, 2021.

Fig. 1
figure 1figure 1

RT-PCR Testing Policies, Tests, Test Positivity, and Laboratory Testing Capacity in the Public Health Network of São Paulo State, Brazil and in each RHD (March 1, 2020–June 5, 2021)

To do so, we conducted an interrupted time series analysis with a segmented regression model [33] to analyze if testing guidelines (Testing Policy II and III) produced changes in testing outcomes in each RHD and for the state overall. In other words, the same model was fitted to data from each RHD and for the entire state. We estimated the level and trend of the reported outcome testing indicator following testing policy interventions in 2020 for the state overall and for each RHD. An interrupted time series analysis of genomic surveillance (Testing Policy IV) in 2021 was restricted to the state overall as the small sample sizes limit more robust granular statistical analyses to be undertaken for this specific outcome. The analyses and figures were conducted using Stata version 16.1 and R 4.1.1.

Results

Surveillance policy efforts over time

The first confirmed case in Sao Paulo state was February 26, 2020. International importations accounted for a majority of cases at the outbreak’s start before local cases were detected [34]. Following the outbreak’s spread to local community transmission, there were four major policy changes in the state’s RT-PCR testing guidelines. From March 17 to June 30, 2020, state surveillance policies limited RT-PCR use to hospitalized and symptomatic individuals and health professionals. Under Testing Policy I, an average of 30 tests per 100,000 were conducted, and an average positivity rate of 25.67(%) was observed (Table 1). When São Paulo state expanded RT-PCR testing to permit testing of non-hospitalized, symptomatic cases (Policy II), an average of 166.23 tests per 100,000 were performed, and the positivity rate of 32.21(%) was observed from July 1, 2020 to September 14, 2020. There was a significant increase in COVID-19 cases during this period, with a peak in the average cases registered per 100,000 in weeks 32 and 33 of 2020. On September 15, 2020, the Brazilian Ministry of Health expanded the notification criteria, including clinical and epidemiological criteria (Policy III). This could have resulted in an expansion of the testing effort for asymptomatic and suspicious cases. However, an average of 197.41 tests per 100, 000 between September 15, 2020 to February 25 2021 were registered. In this period, the average positivity rate of 31.22(%) ranged from a weekly average rate of 19.76(%) (week 45, 2020) to 40.58(%) (week one, 2021) (Fig. 1, Panel b). The second highest peak in cases was observed in weeks two and four of 2021. When guidelines were revised to incorporate genomic surveillance as part of the state’s RT-PCR testing strategy from February 26 to June 5, 2021 (Policy IV), an average of 305.52 tests per 100,000 were conducted, and an average positivity rate of 41.80(%) was observed. This period coincides with the third highest peak in cases observed in week 22 of 2021.

Regional analyses

Significant variation in the volume of tests conducted across the state’s 17 Regional Health Departments (RHD) over the past fifteen months is observed. From March 1, 2020 to June 5, 2021, a weekly average of 168.41 RT-PCR tests per 100,000 were performed across the state. São José do Rio Preto was the RHD with the highest average of tests performed (322.07 tests per 100,000), while Grande São Paulo was the lowest average of tests conducted (74.18 tests per 100,000). There has also been a substantial variation in the positivity rate across the regions. The state average positivity rate was 31.21(%) throughout the period. Araraquara presented the lowest average positivity rate (23.16%) and Registro the highest average positivity rate (40.55%).

In the early months of the pandemic, public health testing efforts were coordinated by the Instituto Adolfo Lutz. In April 2020, a new public laboratory system was created with the Instituto Butantan as its central manager [35] to complement efforts undertaken in the IAL network. In this period, university laboratories and two private labs were incorporated into the public laboratory network to expand testing. Notwithstanding the expansion of the network and central management, public laboratories remain unequally distributed across the São Paulo state territory. Only 12 of the state’s 17 Regional Health Departments (RHD) have at least one local laboratory in their region. While Grande São Paulo has four local laboratories (Instituto Adolfo Lutz Central, Instituto Adolfo Lutz Santo André, Instituto Biológico, and Instituto Butantan), five RHD do not have a local laboratory (Barretos, Franca, Registro, São João da Boa Vista, and Taubaté). There was considerable delay in expanding public health laboratory capacity in the state. Initially, RT-PCR tests were limited to processing 1,200 tests per day in the Instituto Adolfo Lutz (IAL) lab (Fig. 1, Panel c). By September 2020, the public laboratory network had expanded its processing capacity to 13,154 RT-PCR tests per day. In February 2021, the state reached a capacity to process 17,394 tests per day. No further increases were observed after this date.

The state’s public laboratories processing capacity is also unevenly distributed. Some laboratories have still not acquired the capacity to process tests (Instituto Adolfo Lutz Araçatuba and Instituto Adolfo Lutz Campinas). The two public laboratories with the highest daily processing capacity (Instituto Adolfo Lutz Central with a capacity of 1,100 tests and the Instituto Butantan with 4,500 tests) are in the same RHD (Grande São Paulo). The State of São Paulo also contracts private laboratories to process RT-PCR tests. These providers (DASA and Grupo Fleury) were contracted to process 1,945 tests per day in 2020. In 2021, private laboratories were contracted to process 3,545 tests per day (20.1% of daily testing in the network). In contrast, there was a smaller increase in the IAL network testing capacity (2,304 tests per day in September 2020 to 2,895 tests per day by February 2021). Data are only published on the date and the lab that received the RT-PCR test. The lab processing and test result date are not informed in public data sources.

Between March 1, 2020, and June 5, 2021, 1,763 samples were collected for genomic sequencing from RT-PCR positive samples by the Instituto Adolfo Lutz network in the state of São Paulo (18.06% of the 9 761 samples collected and 20.65% of the 6,324 genomes sequenced in this period in GISAID for São Paulo state). However, given delays in uploading sequences to the registry database and missing values, only 1,299 of these genomic sequences were deposited with GISAID in the same period. On average, 0.0024 of RT-PCR positive tests in each RHD in the state of São Paulo were sequenced per week. In 2020, the number of sequences registered in GISAID was limited. On average, 0.70 sequences per RHD were registered per week in 2020 (based on 0.0025 of RT-PCR positive tests). While, on average, 3.32 sequences were registered per week in 2021 (based on 0.0023 of RT-PCR positive tests). The highest weekly average was observed in week six, 2021, when 9.12 genomic sequences were performed across the RHDs. Most of the sequences were uploaded to GISAID with considerable delay. The time lag between the specimen collection and submission has been remarkably high in 2020 (on average, 149.3 days). Since March 2021, there has been a marked rise in sequencing and submission. The time lag has substantially decreased in 2021 (54.4 days from specimen collection to submission).

Genomic sequencing by the IAL varies considerably across the state’s RHDs (Fig. 2, panel a). Grande São Paulo was the RHD with the highest weekly average of genomic sequencing performed (on average, 9.54 per week), while Franca was the lowest average of genomic sequencing conducted (on average, 0.33 per week). The lag in time from collection to submissions of the SARS-CoV-2 genome to GISAID by the IAL network has also varied significantly across RHDs (Fig. 2, Panel b). In 2020, the lowest average weekly time was 97.50 days from samples in São José do Rio Preto, and the highest average was 210 days from samples collected from Baixada Santista. In 2021, this period was considerably reduced. The IAL network performed the lowest average weekly time in Registro (41 days) and the highest average in Baixada Santista (68 days). The available data do not permit verification of whether the difference in processing time is due to which network laboratory is performing sequencing.

Fig. 2
figure 2

Genomic Sequencing in São Paulo State, Brazil (March 1, 2020–June 5, 2021)

Quantitative results

For the state overall, we transformed one of these dependent variables (RT-PCR tests Positivity Rate) into first differences of their natural logarithm, which is the per-week growth rate (Table 2). The results showed a 0.005 [95(%) confidence interval (CI) -0.003; 0.013] increase in the log of RT-PCR tests per 100,000, -0.0008 [95% confidence interval (CI) -0.0058; 0.0042] decrease in the ratio of RT-PCR tests per case, and a -0.0003(%) [95(%) confidence interval (CI) -0.0016; 0.001] decrease in the growth rate of the RT-PCR test positivity rate following Testing Policy II (Fig. 3, Panel a). In turn, Testing Policy III, results showed a 0.005 [95(%) confidence interval (CI) 0.002; 0.007] increase in the log of RT-PCR tests per 100,000, a 0.0076 [95(%) confidence interval (CI) -0.0046; 0.0197] increase in the ratio of RT-PCR tests per case, and an 0.002(%) [95(%) confidence interval (CI) 0.0004; 0.003(%)] increase in the growth rate of the RT-PCR positivity rate. As a result, Testing Policy II did not produce a statistically significant increase in surveillance efforts. Following Testing Policy III, there was an increase in the mean volume of testing in each RHD, but the test positivity rate increased due to insufficient testing expansion.

Table 2 Estimated Coefficients for the Segmented Regressions for RT-PCR Testing Policies in São Paulo (Brazil)
Fig. 3
figure 3

Segmented Regression for the RT-PCR Testing Policies in the Public Health Network. Notes Data from Public Health Network of São Paulo State, Brazil and in each RHD from March 29, 2020, to December 26, 2020. The figure reports the coefficients and 95% and 90% confidence interval of the post intervention linear trend estimated via interrupted time series analysis for Policy II (Testing Expanded to Non-Hospitalized Cases) and Policy III (Case Criteria Expanded). We excluded from the analysis the RHDs in which serial correlation was detected using the Cumby-Huzinga test. RHD I (Grande São Paulo), II (Araçatuba), III (Araraquara), IV (Baixada Santista), V (Barretos), VI (Bauru), VII (Campinas), VIII (Franca), IX (Marília), X (Piracicaba), XI (Presidente Prudente), XII (Registro), XIII (Ribeirão Preto), XIV (São João da Boa Vista), XV (São José do Rio Preto), XVI (Sorocaba), and XVII (Taubaté)

Uneven improvements in testing outcomes were observed across the state (Fig. 3, Panel b). Following Testing Policy II, an increase in the log of RT-PCR tests per 100,000 was only observed in four RHDs (RHD V, VIII, XI, and XVI) and a reduction in the log of RT-PCR tests positivity rate occurred in six RHDs (X, XI, XII, XIII, XIV, and XV). With respect to the ratio of RT-PCR tests per case, a decrease was observed in four RHDs (III, XIV, XV, and XVII) and an increase in five RHDs (I, II, VII, XIII, and XVI) after Testing Policy II. Under Testing Policy III, there was an increase in the log of RT-PCR tests per 100,000 in eight RHDs (I, III, VI, IX, XI, XII, XIV, XVI), and no reductions in test positivity rates were observed. Instead, test positivity rates increased after Testing Policy III in two RHDs (IX, XII). After Testing Policy III, the ratio of RT-PCR tests per case increased in two RHDs (VIII and XIII). These results are only with respect to those RHDs in which no evidence of first or second-order autocorrelation was found in the residuals after using Newey-Standard Errors for first-order serial correlation.

The impact of genomic surveillance efforts was analyzed based on the number of samples and the time delay between sample collection and deposit to the GISAID (Table 3). Testing Policy IV did not produce a statistically significant increase in genomic surveillance efforts. Results showed a -0.020 [95(%) confidence interval (CI) -0.046; 0.005] decrease in the number of samples and a 0.028 [95(%) confidence interval (CI) -0.142; 0.198] increase in the time delay between sample collection and deposit to the GISAID platform after the introduction of the policy.

Table 3 Estimated Coefficients for the Segmented Regression for Genomic Surveillance Policies in São Paulo State (Brazil)1

Considering the results related to the four analyzed policies, there is no significant association between the public RT-PCR testing variables and each policy. Figure 1 also shows no improvement in the testing effort in the period studied, even though the previous policies were maintained and could have shown accumulated positive effects, with an improvement in all RT-PCR testing effort variables.

RT-PCR tests per 100,000 are negatively correlated with high socioeconomic vulnerability (Pearson correlation coefficient = − 0.184, p < 0.001) and with a higher population density (Pearson correlation coefficient = − 0.196, p < 0.001). RT-PCR test positivity rate is positively correlated with high socioeconomic vulnerability (Pearson correlation coefficient = 0.251, p < 0.001) and with a higher population density (Pearson correlation coefficient = 0.0744, p-value = 0.013), and it is negatively correlated with average income per capita (Pearson correlation coefficient = − 0.066, p-value = 0.026) (see Fig. 4). COVID-19 cases, in turn, are negatively correlated with high socioeconomic vulnerability (Pearson correlation coefficient = − 0.066, p-value = 0.027) and higher population density (Pearson correlation coefficient = − 0.099, p < 0.001). The number of genomic sequences collected and uploaded at the GISAID is positively correlated with high socioeconomic vulnerability (Pearson correlation coefficient = 0.067, p-value = 0.025), higher population density (Pearson correlation coefficient = 0.437, p < 0.001), and income per capita (Pearson correlation coefficient = 0.263, p < 0.001), and it is negatively associated with a higher population dependent on SUS (Pearson correlation coefficient = − 0.143, p < 0.001). The average time delay between sample collection and deposit to the GISAID is positively correlated with high socioeconomic vulnerability (Pearson correlation coefficient = 0.136, p-value = 0.014), population density (Pearson correlation coefficient = 0.226, p < 0.001), and average income per capita (Pearson correlation coefficient = 0.167, p-value = 0.002).

Fig. 4
figure 4figure 4

Variation in Testing per 100,000 and Sociodemographic Indicators across Epidemiological Weeks in the Regional Health Departments. Notes Data from RHDs of São Paulo State, Brazil, from March 1, 2020 to June 5, 2021. RHDS ranked from lowest to highest in each panel

Discussion

When public health testing guidelines limit RT-PCRs, there are reductions in detection efforts aimed at early recognition, isolation, and treatment of those infected with SARS-CoV-2. In periods in which testing guidelines are expanded to authorize testing of a larger pool of suspected cases, we hypothesized that testing indicators would be associated with improvements in the incidence of COVID-19 infection. Findings across the state’s 17 regional health departments did not support our hypotheses based on the total number of RT-PCR tests conducted per 100,000, the test positivity rate, test processing time, proximity to local public health labs, as well as indicators to monitor surveillance efforts, including policies to conduct contact tracing, report testing outcomes based on repeated testing of individuals, and expand genomic surveillance.

There was limited improvement in surveillance efforts in the State of São Paulo. RT-PCR testing as a surveillance strategy was not strengthened as cases increased. A full month after the detection of the first case in the state, guidelines were issued to restrict testing to hospitalized patients with pneumonia and respiratory infection in late March 2020. The state expanded testing guidelines to include patients with respiratory infection evaluated in primary care settings in July 2020, but only after the first peak had occurred. Although test positivity rates remained above recommended maximum thresholds in subsequent weeks, the testing volume expanded gradually and sporadically. In most epidemiological weeks, testing remained below the public laboratory network’s processing capacity. Before the onset of the state’s second and most severe wave of cases and deaths, the regulation regarding COVID-19 notification was improved in September 2020 with the inclusion of clinical and epidemiological criteria. In comparison to the rest of Brazil, the state of Sao Paulo made early efforts to promote genomic surveillance. However, although genomic sequencing increased across RHDs (see Appendix 1), the speed of detection is not correlated with enhanced and targeted testing to further limit VOCs spread in the state. The information is also being shared with a considerable delay with the global health community.

To some extent, the observed variability in surveillance reflects the heterogeneity in Brazil’s most populated and well-endowed state. The Grande São Paulo region, for example, comprises 39 municipalities and has experienced high mortality rates [36]. In addition, in the Greater São Paulo region, where the state capital is located, there is an enormous private health service, including private laboratories. Despite the widespread availability of public laboratories compared to the rest of the state (and other settings in Brazil), the volume of testing was relatively low compared to other regions of the state. On the other hand, some RHDs with smaller populations and public health laboratory access improved their testing efforts considerably.

Incidence is impacted by physical distancing policies, their enforcement, and compliance [11, 37]. In the case of Sao Paulo, the state government coordinated the rolling implementation of various restrictions to increase distancing (starting in March 2020) across all regional health departments. When the government authorized the loosening of restrictions in June 2020, and throughout the subsequent period analyzed in this study, RT-PCR testing outcomes were not used in these assessments. Differing levels of public engagement in seeking testing across geographic settings and across times may differentially affect both individual and aggregate demand for diagnosis and reported test outcomes.

Our findings may help to explain the persistent and relatively high magnitude of cases observed in the State of Sao Paulo since the onset of the pandemic in early 2020. During the entire study period, no guidelines were identified to incorporate rapid, lateral flow antigen tests [38, 39] as an additional diagnostic test to increase the capacity to identify infectious individuals and more rapidly inform them of their testing status, especially in RHDs with limited local laboratory capacity. Despite growing evidence of its effectiveness in control and containment, a contact tracing program was not introduced with specific guidelines, nor were efforts incorporated to track secondary attack rates in the state [40].

Our study offers several contributions to how Brazilian surveillance policies and global health efforts to control the COVID-19 pandemic and other emergent diseases could be further strengthened. First, policies and resources must be directed at identifying infected individuals during their infectious period regardless of the severity of their symptoms, and these programs must further contribute resources to trace and test contacts and isolate positive cases. Second, the unequal distribution of existing infrastructure can lead to inadequate surveillance of important geographic territories and communities during an emergency. For this reason, investments must be directed at strengthening public laboratory capacities to enable speedy diagnostic testing, and to reduce their uneven distribution considering demographic and other determinants of vulnerability. Open-source databases with high quality and transparency are essential for the monitoring and improvement of surveillance efforts. Our study reveals that these systems were not significantly improved over the initial 16 months of the onset of the pandemic.

Our study has some limitations. First, high-quality, population-based health administrative databases are not publicly accessible in the State of São Paulo. Several indicators could not be evaluated as either restricted or no information was provided in the public databases accessed by this study. Second, the sample selection criteria by which positive cases are selected for sequencing are not disclosed to differentiate those cases selected based on random selection or other epidemiological criteria. Testing performed by private laboratories contracted by municipalities is not reported in the SIMI platform, nor are data on lateral flow tests conducted by municipalities in the public health system.

Conclusions

In this study, we used nine indicators to measure RT-PCR testing in the 17 Regional Health Departments (RHD) of São Paulo state, the epicenter of the COVID-19 pandemic in Brazil. These indicators are based on recommendations by the World Health Organization (WHO), the European Center for Disease Control (ECDC), and the Centers for Disease Control and Prevention (CDC). Overall, we find limited evidence that testing guidelines improved surveillance in Brazil’s largest state, especially in poorer and more populous RHDs.

Availability of data and materials

The data and replication materials will be made available in the Harvard Dataverse.

References

  1. Kim S, Castro MC. Spatiotemporal pattern of COVID-19 and government response in South Korea (as of May 31, 2020). Int J Infect Dis. 2020;98:328–33.

    Article  CAS  Google Scholar 

  2. Summers J, Cheng H-Y, Lin H-H, Barnard LT, Kvalsvig A, Wilson N, Baker MG. Potential lessons from the Taiwan and New Zealand health responses to the COVID-19 pandemic. Lancet Reg Health West Pac. 2020;4:100044. https://doi.org/10.1016/j.lanwpc.2020.100044.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Crozier A, Rajan S, Buchan I, McKee M. Put to the test: use of rapid testing technologies for covid-19. BMJ. 2021. https://doi.org/10.1136/bmj.n208.

    Article  PubMed  Google Scholar 

  4. Pitzer VE, Chitwood M, Havumaki J, et al. The impact of changes in diagnostic testing practices on estimates of COVID-19 transmission in the United States. Am J Epidemiol. 2021;190(9):1908–17.

    Article  Google Scholar 

  5. Vandenberg O, Martiny D, Rochas O, van Belkum A, Kozlakidis Z. Considerations for diagnostic COVID-19 tests. Nat Rev Microbiol. 2021;19(3):171–83.

    Article  CAS  Google Scholar 

  6. Novelli G, Biancolella M, Mehrian-Shai R, et al. COVID-19 one year into the pandemic: from genetics and genomics to therapy, vaccination, and policy. Hum Genom. 2021;15(1):1–13.

    Article  Google Scholar 

  7. Giri AK, Rana DR. Charting the challenges behind the testing of COVID-19 in developing countries: Nepal as a case study. Biosaf Health. 2020;2(2):53–6.

    Article  Google Scholar 

  8. Werneck GL, Porto LC, Sena A, da Costa O, Junior F, Cavalcanti AC, Santos ÂMG, Secco DA, Silva M, Mariani D, Chieppe A, Tanuri A. The incidence and geographical spread of SARS-CoV-2 in Rio de Janeiro, Brazil based on RT-PCR test results. Rev Soc Bras Med Trop. 2021. https://doi.org/10.1590/0037-8682-0779-2020.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Ranzani OT, Bastos LS, Gelli JGM, et al. Characterisation of the first 250 000 hospital admissions for COVID-19 in Brazil: a retrospective analysis of nationwide data. Lancet Respir Med. 2021;9(4):407–18.

    Article  CAS  Google Scholar 

  10. Johns Hopkins University. Coronavirus Resource Center. 2021.

  11. Castro MC, Kim S, Barberia L, et al. Spatiotemporal pattern of COVID-19 spread in Brazil. Science. 2021;372(6544):821–6.

    Article  CAS  Google Scholar 

  12. Fundação Estadual Sistema Estadual de Análise de Dados (SEADE). Data from: Sistema de projeções populacionais para os municípios do estado de São Paulo. 2020.

  13. IBGE (Brazilian Institute of Geography and Statistical). National accounts. Available at: https://www.ibge.gov.br/en/statistics/economic/national-accounts.html. (Last accessed 3 Feb 2022).

  14. Brazil. Ministry of Health. DATASUS. Available at: https://datasus.saude.gov.br/. (Last accessed 3 Feb 2022).

  15. Brazil. Lei 8080 de 19 de setembro de 1990. Available at: http://www.planalto.gov.br/ccivil_03/leis/l8080.htm. (Last accessed 3 Feb 2022).

  16. Wayne F, Roderick PM. Cross-sectional time series designs: a general transformation approach. Multivar Behav Res. 1991;26(2):247–54. https://doi.org/10.1207/s15327906mbr2602_3.

    Article  Google Scholar 

  17. von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. J Clin Epidemiol. 2008;61(4):344–9. https://doi.org/10.1016/j.jclinepi.2007.11.008.

    Article  Google Scholar 

  18. Centers for Disease Control and Prevention (CDC). SARS-CoV-2 testing strategy: considerations for non-healthcare workplaces. 2020. https://www.cdc.gov/coronavirus/2019-ncov/community/organizations/testing-non-healthcare-workplaces.html. (Last accessed 13 Sep 2021).

  19. Centers for Disease Control and Prevention (CDC). Evaluating case investigation and contact tracing success. 2020. https://www.cdc.gov/coronavirus/2019-ncov/php/contact-tracing/contact-tracing-plan/evaluating-success.html. (Last accessed 13 Sep 2021).

  20. European Center for Disease Prevention and Control (ECDC). Guidance for representative and targeted genomic SARS-CoV-2 monitoring. 2021. https://www.ecdc.europa.eu/en/news-events/ecdc-releases-new-dashboard-sars-cov-2-variants. (Last accessed 13 Sep 2021)

  21. World Health Organization (WHO). Public health criteria to adjust public health and social measures in the context of COVID-19 (Version from 12 May 2020). 2020.

  22. World Health Organization (WHO). Considerations for implementing and adjusting public health and social measures in the context of COVID-19 (Version 14 June 2021). 2021.

  23. Pan American Health Organization (PAHO). Diretrizes laboratoriais para detecção e diagnóstico de infecção pelo vírus da COVID-19. 2020. https://iris.paho.org/bitstream/handle/10665.2/52523/OPASIMSPHECOVID19200038_por.pdf?sequence=1&isAllowed=y (Last accessed 31 Aug 2021)

  24. Leal FE, Mendes-Correa MC, Buss LF, et al. Clinical features and natural history of the first 2073 suspected COVID-19 cases in the Corona São Caetano primary care programme: a prospective cohort study. BMJ Open. 2021;11(1):e042745.

    Article  Google Scholar 

  25. Harvard Global Health Institute (HGHI). Pandemics explained: unlocking evidence for better decision making. 2020. https://globalepidemics.org/key-metrics-for-covid-suppression/ (Last accessed 13 Sep 2021)

  26. Fiocruz-Instituto de Comunicação e Informação Científica e Tecnológica em Saúde (ICICT). MonitoraCovid-19. https://bigdata-covid19.icict.fiocruz.br/ (Last accessed 31 Aug 2021)

  27. São Paulo State Government. Resolução SS - 28, de 17-3-2020, published on March 17, 2020. Available at https://www.saopaulo.sp.gov.br/wp-content/uploads/2020/03/E_R-SS-CGOF-28_170320-1.pdf (February 9, 2022).

  28. São Paulo State Government. Deliberação CIB - 55, de 1º-7–2020, published on July 1, 2020. Available at http://saude.piracicaba.sp.gov.br/wp-content/uploads/2020/04/Delibera%C3%A7%C3%A3o-CIB-n%C2%BA.-552020.pdf. (9 Feb 2022).

  29. Brazil, Ministry of Health. Guia de Vigilância Epidemiológica – Emergência de Saúde Pública de Importância Nacional pela Doença pelo Coronavírus 2019, published on 5 Aug 2020

  30. Brazil, Ministry of Health. Vigilância genômica do vírus SARS-CoV-2 no âmbito da SVS/MS, published on February 20, 2021. Available at https://www.gov.br/saude/pt-br/coronavirus/publicacoes-tecnicas/guias-e-planos/vigilancia-genomica-do-virus-sars-cov-2. (9 Feb 2022).

  31. Governo de São Paulo. Data from: Sistema de Monitoramento Inteligente - SIMI. 2021.

  32. Global Initiative on Sharing All Influenza Data (GISAID). Data from: Genomic epidemiology of hCoV-19. 2021.

  33. Linden A. Conducting interrupted time-series analysis for single-and multiple-group comparisons. Stand Genom Sci. 2015;15(2):480–500.

    Google Scholar 

  34. Candido DS, Claro IM, De Jesus JG, et al. Evolution and epidemic spread of SARS-CoV-2 in Brazil. Science. 2020;369(6508):1255–60.

    Article  CAS  Google Scholar 

  35. Instituto Butantan. Governo de São Paulo lança plataforma de laboratórios para diagnóstico de Covid-19. 2020;

  36. Ribeiro KB, Ribeiro AF, de Sousa Mascena Veras MA, de Castro MC. Social inequalities and COVID-19 mortality in the city of São Paulo, Brazil. Int J Epidemiol. 2021;50(3):732–42. https://doi.org/10.1093/ije/dyab022.

    Article  PubMed  Google Scholar 

  37. Barberia LG, Cantarelli LGR, de Faria Oliveira MLC, de Paula Moreira N, Rosa ISC. The Effect of state-level social distancing policy stringency on mobility in the states of Brazil. Revista de Administração Pública. 2021;55(1):27–49. https://doi.org/10.1590/0034-761220200549.

    Article  Google Scholar 

  38. Mina MJ, Andersen KG. COVID-19 testing: one size does not fit all. Science. 2021;371(6525):126–7.

    Article  CAS  Google Scholar 

  39. Mina MJ, Peto TE, García-Fiñana M, Semple MG, Buchan IE. Clarifying the evidence on SARS-CoV-2 antigen rapid tests in public health responses to COVID-19. Lancet. 2021;397(10283):1425–7.

    Article  CAS  Google Scholar 

  40. Hellewell J, Abbott S, Gimma A, et al. Feasibility of controlling COVID-19 outbreaks by isolation of cases and contacts. Lancet Glob Health. 2020;8(4):e488–96.

    Article  Google Scholar 

Download references

Acknowledgements

The authors acknowledge the government of the State of Sao Paulo for making the data publicly available, which made this analysis possible.

Funding

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

Conception or design of the research: LB, NM, TM. Data collection: MZ, RC, IS. Data analysis and interpretation: LB, NM, BK, MV, MZ, RC, IS, TM. Drafting the article: LB, NM, IS., MZ, IS. Critical revision of the article: BK, MV, TM. All authors read and approved final manuscript.

Corresponding author

Correspondence to Lorena G. Barberia.

Ethics declarations

Ethics approval and consent to participate

Ethical approval is not required for this research, due to the public source of data.

Consent for publication

The authors consent to publication.

Competing interests

The authors declare no competing interests.

Appendix

Appendix

See Fig. 5.

Fig. 5
figure 5figure 5

Genomic Sequencing in São Paulo State across Regional Health Departments and RT-PCR Test Positivity (March 1, 2020–June 5, 2021)

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Barberia, L.G., de P. Moreira, N., Kemp, B. et al. Evaluation of the effectiveness of surveillance policies to control the COVID-19 pandemic in São Paulo, Brazil. glob health res policy 7, 27 (2022). https://doi.org/10.1186/s41256-022-00260-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41256-022-00260-4

Keywords