Back

Optimized ITS/CITS models for intervention evaluation considering the nonlinear impact of covariates

Zhang, X.; Yin, R.; Pan, Y.; Zhong, W.; Kong, D.; Chen, W.

2023-03-29 public and global health
10.1101/2023.03.27.23287776 medRxiv
Show abstract

There is a lack of approaches to evaluate the effectiveness of interventions when there are nonlinear impacts of covariates to the outcome series. Based on the classic framework of ITS/CITS segmented regression, while considering autocorrelation of time series, we adopted a nonlinear dynamic modeling strategy (Hammerstein) to measure the nonlinear effects of covariates, and proposed four optimized models: ITS-A, CITS-A, ITS-HA, and CITS-HA. To compare the accuracy and precision in estimating the long-term impact of an intervention between the optimized and classic segmented models, we constructed a sequence generator to simulate the outcome series with actual characteristics. The relative error with respect to the true value was the accuracy indicator, and the width of the 95% CI and the truth value coverage rate of the corresponding 95% CI are the precision indicator for model assessments. The relative error of impact evaluation in the four optimized models was 4.49 percentage points lower than that in the classic models, specifically ITS-A (14.34%) and ITS-HA (21.47%) relative to ITS (26.66%), CITS-A (16.57%), and CITS-HA (17.94%) relative to CITS (21.59%). The width of the 95% CI of point estimate of long-term impacts in the optimized models was 0.1261, which was expanded by 58.71% compared with 0.0875 for the classic model. However, the optimized models covered the true value in all test scenarios, whereas the coverage rates of the classic ITS and CITS models were 73.33% and 83.33%, respectively. The optimized models are useful tools as they can assess the long-term impact of interventions with additional considerations for the nonlinear effects of covariates and allow for modeling of time-series autocorrelation and lag of intervention effects.

Matching journals

The top 6 journals account for 50% of the predicted probability mass.

1
PLOS ONE
5266 papers in training set
Top 5%
27.1%
2
Statistical Methods in Medical Research
11 papers in training set
Top 0.1%
7.4%
3
PLOS Computational Biology
1863 papers in training set
Top 6%
5.6%
4
Infectious Disease Modelling
54 papers in training set
Top 0.3%
4.9%
5
eLife
5828 papers in training set
Top 26%
4.6%
6
International Journal of Environmental Research and Public Health
128 papers in training set
Top 1%
3.6%
50% of probability mass above
7
BMC Medical Research Methodology
47 papers in training set
Top 0.3%
3.3%
8
Scientific Reports
3612 papers in training set
Top 33%
3.2%
9
Healthcare
17 papers in training set
Top 0.1%
2.4%
10
Applied Sciences
25 papers in training set
Top 0.2%
2.4%
11
Frontiers in Public Health
148 papers in training set
Top 3%
2.2%
12
Mathematical Biosciences and Engineering
23 papers in training set
Top 0.4%
2.2%
13
PeerJ
308 papers in training set
Top 7%
1.4%
14
Journal of Medical Internet Research
87 papers in training set
Top 2%
1.4%
15
JMIR Public Health and Surveillance
45 papers in training set
Top 1%
1.2%
16
BMC Public Health
158 papers in training set
Top 4%
1.2%
17
BMC Medicine
176 papers in training set
Top 4%
1.1%
18
Quantitative Biology
12 papers in training set
Top 0.2%
0.9%
19
Journal of Global Health
21 papers in training set
Top 0.9%
0.9%
20
The Innovation
13 papers in training set
Top 0.3%
0.9%
21
BMC Infectious Diseases
133 papers in training set
Top 4%
0.9%
22
IEEE Access
35 papers in training set
Top 1%
0.9%
23
PLOS Global Public Health
344 papers in training set
Top 8%
0.9%
24
Journal of Neural Engineering
221 papers in training set
Top 2%
0.9%
25
American Journal of Epidemiology
67 papers in training set
Top 1%
0.6%
26
National Science Review
21 papers in training set
Top 0.3%
0.6%
27
Expert Systems with Applications
11 papers in training set
Top 0.5%
0.6%
28
Royal Society Open Science
214 papers in training set
Top 7%
0.6%