Abstract
Cure rate models are mostly used to study data arising from cancer clinical trials. Its use in the context of infectious diseases has not been explored well. In 2008, Tournoud and Ecochard first proposed a mechanistic formulation of cure rate model in the context of infectious diseases with multiple exposures to infection. However, they assumed a simple Poisson distribution to capture the unobserved pathogens at each exposure time. In this paper, we propose a new cure rate model to study infectious diseases with discrete multiple exposures to infection. Our formulation captures both over-dispersion and under-dispersion with respect to the count on pathogens at each time of exposure. We also propose a new estimation method based on the expectation maximization algorithm to calculate the maximum likelihood estimates of the model parameters. We carry out a detailed Monte Carlo simulation study to demonstrate the performance of the proposed model and estimation algorithm. The flexibility of our proposed model also allows us to carry out a model discrimination. For this purpose, we use both likelihood ratio test and information-based criteria. Finally, we illustrate our proposed model using a recently collected data on COVID-19.
Keywords: Multiple exposures, Expectation Maximization algorithm, Nosocomial infection, HIV, COVID-19
1. Introduction
The study of models for survival or time-to-event data with a surviving fraction, known as cure rate models, have been extensively studied during the past few decades. Cure rate models have become more prevalent as new treatments for diseases cause a larger population of patients who are permanently cured of their disease. The first cure rate model was proposed by Boag (1949) and later revised by Berkson & Gage (1952). They proposed a two-component mixture model to analyze data where some subjects in the study were not susceptible to the event of interest. These subjects are called immunes, cured, or long-term survivors. Yakovlev et al. (1993) created a new formulation for mixture models to more effectively study cancer metastases. Tsodikov et al. (1998) further advanced the study of mixture models with the development of bounded cumulative hazard models. Other recent works of note include Davies et al. (2021), Pal (2021), Milienos (2022), Pal et al. (2022), Wang & Pal (2022), Pal et al. (2023), Pal & Aselisewine (2023) and Aselisewine & Pal (2023), amongst others. Interested readers may also look at Peng & Yu (2021) for a book-length account on mixture cure models. However, in the works previously mentioned, the models described primarily dealt with cancer metastasis and the spread of tumors in patients. Until recently, the application of these models in the context of infectious disease modeling had not been well researched. Some of the first work looking into the application of these models in the context of infectious diseases was done by Tournoud & Ecochard (2007), who studied a cure model with multiple discrete infection occasions. Specifically, the authors proposed a cure model where the number of pathogens affecting the patient, , at exposure time ( representing the time to initial exposure), was modeled using a Poisson random variable with mean . This allowed them to study mother to child transmission of HIV-1 virus and the spread of nosocomial infections. Although the Poisson distribution was used to capture the latent number of pathogens at exposure time , there was no justification provided for the suitability of the Poisson distribution, given that it cannot handle over- and under-dispersion that we commonly encounter with respect to the count in the number of pathogens. To advance their work, Tournoud & Ecochard (2008) again proposed a cure model with multiple infection occasions, but considered different distributions to model the number of pathogens affecting the patient at time . They considered modeling the number of pathogens using a compound Poisson distribution to consider inter-subject heterogeneity. The issue with the compound Poisson distribution is the difficulty in interpreting a distribution in which a discrete random variable is attained using the sum of continuous random variables. In order to overcome these drawbacks, we propose the use of the Conway-Maxwell Poisson (COM-Poisson) distribution to model the number of pathogens at each infection occasion , assuming multiple infection occasions. This results in a flexible model to study infectious diseases with multiple discrete exposures and is more realistic compared to the model studied by Tournoud & Ecochard (2007) and Tournoud & Ecochard (2008). Furthermore, if we consider the special case of just one exposure, i.e. , our model reduces to the COM-Poisson cure rate model of Rodrigues et al. (2009) and Balakrishnan & Pal (2016). To develop the likelihood inference, we do not rely on the numerical maximization of the log-likelihood function. Instead, motivated by the introduction of missing data arising from the set of censored observations, we develop the steps of the expectation maximization (EM) algorithm to calculate the maximum likelihood estimates (MLEs) of the model parameters.
The COM-Poisson distribution was first discussed in Conway & Maxwell (1962) to help solve problem related to queuing systems. Since its introduction, many authors have studied its properties including Shmueli et al. (2005), Boatwright et al. (2003), and more recently Li et al. (2020). The COM-Poisson is a generalized discrete distribution that allows for under- and over- dispersion of count data. As such, the COM-Poisson distribution allows for far more flexibility in modeling count data than other commonly used distributions. The Poisson, geometric, and Bernoulli distributions are all special cases of the COM-Poisson distribution. Rodrigues et al. (2009) were one of the first to explore the uses of the COM-Poisson distribution in the context of cure rate model. In the work of Rodrigues et al. (2009), the authors used the COM-Poisson distribution as a way to form a more flexible version of the unified cure rate model that was originally formulated by Yin & Ibrahim (2005). For other recent works on the COM-Poisson distribution in the context of cure rate models together with flexible modeling of lifetime data, interested readers may look at Balakrishnan & Pal (2013, 2015b), Pal & Balakrishnan (2017b), Pal et al. (2018), Wiangnak & Pal (2018), and Majakwara & Pal (2019), among others.
The rest of this paper is organized as follows. In Section 2, we introduce the COM-Poisson cure rate model in the context of infectious diseases with discrete multiple exposures to infection. In Section 3, we develop the estimation algorithm based on the EM algorithm to calculate the MLEs of the model parameters. In Section 4, we carry out an extensive Monte Carlo simulation study, where we present the results of both model fitting and model discrimination. To carry out the model discrimination, we use both likelihood ratio test and information-based criteria. In Section 5, we illustrate our proposed model using a recently collected data on COVID-19. Finally, in Section 6, we make some concluding remarks and discuss some potential future research work in the context of infectious diseases.
2. COM-Poisson cure rate model with discrete multiple exposures
Let represent the number of patients in the study. Let denote the multiple and successive moments of infections with denoting the initial moment of infection. At each moment of infection, let , for , denote the number of pathogens infecting the patient at time . Note that are unobservable variables and we assume it to follow a discrete distribution with probability mass function (pmf) . We assume the number of pathogens at each exposure time to be independent, which is along the lines of Tournoud & Ecochard (2008). It is important to note that we do not assume the distributions of to be identical for the patient. Rather, at each exposure time , we assume a suitable parameter of the distribution to depend on the exposure time. Let , for and , be the pathogen promotion time of the patient at time , in other words, the time taken by the pathogen to produce the event, which in the context of infectious diseases may represent the first biological sign of infection. For a given , we assume to be distributed with cumulative distribution function (cdf) , where is the associated vector of parameters and is the corresponding survival function. Since this model follows data with multiple exposures, we need to re-parameterize the time scale of infection on the original scale. Let , then, we can re-parameterize the cdf and survival function as follows:
| (1) |
and
| (2) |
Given that patients are exposed at different discrete time points and at each exposure time there are several competing pathogens, the time-to-event, which can be the first biological sign of infection or time to recovery from an infectious disease, can be defined as
| (3) |
where is such that
A patient is termed “immune” of an infection if there are no competing pathogens at each exposure time point, and its probability, termed as cure rate, is defined as
We will now introduce the COM-Poisson distribution as a means of modeling the number of competing pathogens at each discrete exposure time point. For this purpose, we will first introduce the COM-Poisson distribution. If a random variable follow a COM-Poisson distribution, then, its pmf is given by
where , and is the normalizing constant calculated by
From the above equation, we can see the cured fraction, in other words the part of the population that is not affected by the pathogen, denoted by , is given by
The COM-Poisson distribution has three special cases. When , then, , which results in the Poisson distribution with mean . As , which means the COM-Poisson distribution converges in distribution to the Bernoulli distribution with . When and , and the COM-Poisson reduces to a geometric distribution with parameter . However, if and , then does not converge. Therefore, the COM-Poisson distribution is undefined in this particular case. One advantage of the COM-Poisson distribution is that it allows for both under-dispersion and over-dispersion of data relative to the Poisson distribution. When , the data is under-dispersed relative to the Poisson distribution, whereas when , the data is over-dispersed relative to the Poisson distribution.
In this research, we will assume the number of competing pathogens to follow a COM-Poisson distribution with parameters and at exposure time , for . Note that the parameter represents the infection intensity at exposure time and hence carries biological interpretation. In a practical scenario, the infection intensity at a given exposure time will differ across patients. To capture this heterogeneity in patient population, we link to a set of covariates at each exposure time , for , using the log-linear link function , where is the corresponding vector of regression coefficients. Now, let us consider two exposure times, and , and derive the survival function of the random variable in (3), known as the population survival function or the long-term survival function.
Theorem 2.1 Given two discrete exposure times and , let and denote the number of pathogens at times and . Let and both follow COM-Poisson distribution with parameters and , respectively. Furthermore, let and denote the pathogen promotion time distribution at exposure times and , respectively, as described in (2). Then, the overall survival function of the variable in (3), denoted by , is given by
| (4) |
A proof of Theorem 2.1 is provided in the Appendix.
If we generalize the above survival function with multiple exposure times , then, we have
| (5) |
Note that in (5), if we just consider one exposure, then, , which reduces to the model proposed by Rodrigues et al. (2009) and Balakrishnan & Pal (2016). The density function corresponding to (5), known as the long-term density function, is given by
| (6) |
where is the density function associated with . Hence, the cure rate or cured proportion is given by
| (7) |
In Table 1, we present the long-term survival function and the cured proportion for the COM-Poisson cure rate model and its special cases with discrete multiple exposures. In Table 2, we present the corresponding long-term density functions.
Table 1:
Expressions of long-term survival function and cured portion for the COM-Poisson cure rate model and its special cases with discrete multiple exposures
| Model | ||
|---|---|---|
| COM-Poisson | ||
| Poisson | ||
| Bernoulli | ||
| Geometric |
Table 2:
Expressions of long-term density function for the COM-Poisson cure rate model and its special cases with discrete multiple exposures
| Model | |
|---|---|
| COM-Poisson | |
| Poisson | |
| Bernoulli | |
| Geometric |
3. Maximum likelihood estimation
We develop the EM algorithm to carry out the maximum likelihood estimation of model parameters; see Pal & Balakrishnan (2016, 2017a,c, 2018) and Treszoks & Pal (2022). First, let and denote the cdf of the entire population and the susceptible population, respectively. Furthermore, let denote the survival function of the susceptible population. Define to be an indicator variable which takes on the value of 0 if the patient is immuned and 1 if the patient is susceptible. As such, we have and . Furthermore, note that
and hence
Using the form of as in (5), we can get an expression for as
where is defined as in (7). Let denote the censoring indicator such that when , the actual time-to-event is observed and when the time-to-event is right censored. Let us define two sets, say, and as and . Note that for the set , the value of is unknown (since a right censored patient may be susceptible to the event of interest), and this introduces the missing data. Let denote the unknown parameter vector of our model. Then, the complete data likelihood function is given by
Given the above likelihood function, we can write the complete data log-likelihood function as
| (8) |
Now that we have an expression for the complete data log-likelihood function, we can begin discussion on the development of the EM algorithm; see McLachlan & Krishnan (2008). In the expectation step (E-step), we calculate the expectation of the complete log-likelihood function with respect to the distribution of the unobserved s, given the model parameters and the observed data. We should note here that are Bernoulli random variables and are linear in the complete data -likelihood function. As such, at the iteration step, we simply need to calculate , for , where denotes the current parameter value at the iteration of the EM algorithm. Hence, for the censored observation, we can calculate as
Therefore, in the E-step, we only replace in (8) with if the observation is censored. As done in McLachlan & Krishnan (2008), we will denote the conditional expectation of the complete data -likelihood function at the iteration as , where is the vector of values.
The next step in the EM algorithm is the maximization step (M-step). In this step, we maximize the function with respect to over the parameter space . In other words, we choose to be a value of such that
see Pal & Roy (2021, 2022, 2023). We continue to repeat this algorithmic process until some convergence criterion is satisfied, for example, , where is some pre-defined tolerance such as .
3.1. Expressions of the -function
We present the simplified expressions of the -functions for the COM-Poisson cure model and its special cases with discrete multiple exposures.
3.1.1. COM-Poisson cure rate model with discrete multiple exposures
The -function, , can be expressed as
where
3.1.2. Poisson cure rate model with discrete multiple exposures
The -function, , can be expressed as
where
3.1.3. Bernoulli cure rate model with discrete multiple exposures
The -function, , can be expressed as
where,
3.1.4. Geometric cure rate model with discrete multiple exposures
The -function can be expressed as
where
4. Simulation study
We shall now assume the pathogen promotion times to follow a Weibull distribution with probability density function given by
| (9) |
Thus, we now have . Note that one can also assume other parametric lifetime distributions here; see Balakrishnan & Pal (2012, 2015a,b). One can also model these promotion times assuming a semi-parametric framework or a completely parametric framework with respect to the pathogen promotion times; see Balakrishnan et al. (2016) and Balakrishnan et al. (2017).
4.1. Model Fitting
We now describe how to generate time-to-event data in the context of infectious diseases with multiple exposures. Using the generated data, we test the performance of the proposed EM algorithm through the calculated bias, root mean square (RMSE), and coverage probabilities of the asymptotic confidence intervals. For our simulation study, we consider the time to an outbreak of a nosocomial pulmonary infection since it easily incorporates a multiple exposure scenario; see Tournoud & Ecochard (2007). It is known that tracheal intubation and mechanical ventilation are risk factors for nosocomial pulmonary infections. Furthermore, exposures to infection are multiple, for instance, the initial infection can be during intubation itself and successive exposures can be during daily secretion aspirations. We generate the intubation duration, , from a Uniform(2, 30) distribution. We then generate random “time jumps” between each patient’s exposure points to simulate time passing between each moment of exposure. To incorporate covariates into our simulation study, we consider a scenario where the immunological status (, which can be good or poor) of patients influence the infection rate related to tracheal tube placement and the protocol used for aspirations (, which can be A or B) influence the daily infection occasions. Thus, we have and , where for patients with poor immunological status and = 1 otherwise. Similarly, for patients undergoing protocol A and = 0 otherwise. We consider different sample sizes, and , to study the behavior of the model under small and large sample sizes. We also consider two different choices of Weibull parameters for eqns. (1) and (2) as and (1.5, 3.5). For the choice of regression parameters, we consider . To generate the time-to-event, we carry out the following steps:
At each exposure time , we generate pathogens from the COM-Poisson distribution with parameters and , for a given choice of the shape parameter . We also consider the special cases of the COM-Poisson distribution.
At exposure time , if , we generate progression times from the Weibull distribution using eqn. (9). However, if , then, we let .
Let , which represents the time-to-event at exposure time . If , we let .
Define the final time-to-event, after taking into account all exposure times, as .
Let denote the random censoring time generated from an exponential distribution with a suitable rate to meet the desired censoring proportion. Furthermore, let denote the observed time-to-event. Then, if , we set . If , we set .
Let denote the right censoring indicator. Then, set , if , and set , if .
For our simulation study, we choose the censoring rate to be 0.10. To find an initial guess to start the iterative algorithm, we create an interval for each parameter by taking 15% deviation off the true value and then select a value at random from the created interval. In Tables 3 and 4, we present the model fitting results for the Bernoulli and Poisson cure rate models, respectively, with multiple exposures. We leave out the geometric model since the choice of the link function does not guarantee that , which is required for the geometric model, as we have discussed before. It is clear that our proposed EM algorithm can retrieve the true parameters values quite accurately. The bias, standard error (SE) and RMSE of the estimates are small. Furthermore, they all decrease with an increase in sample size, which is what one would expect. The 95% coverage probabilities are also close to the nominal level. In Table 5, we present the results for the COM-Poisson model with multiple exposures. Note that in this case the shape parameter has to be estimated in addition to other model parameters. For estimating the parameter , we employ a profile likelihood technique within the EM algorithm, which is done along the lines of Balakrishnan & Pal (2016). For this purpose, first, we select a set of admissible values of . Then, for each chosen value of , we run the EM algorithm to estimate the other model parameters and calculate the log-likelihood value at the MLEs. Finally, we select the MLE of as the value of that results in the highest log-likelihood value. From Table 5, it is clear that this profile likelihood approach performs well in estimating the parameter . The estimates of other model parameters are also close to the their true values. Once again, the coverage probabilities are close to the nominal level used.
Table 3:
Model fitting results for the Bernoulli cure rate model with multiple exposures.
| Parameter | Estimate | SE | Bias | RMSE | CP 95% | |
|---|---|---|---|---|---|---|
| 400 | 0.4770 | 0.3005 | −0.0230 | 0.2898 | 0.950 | |
| −1.0438 | 0.3191 | −0.0438 | 0.3225 | 0.940 | ||
| −2.9912 | 0.2890 | 0.0088 | 0.2619 | 0.940 | ||
| 2.0321 | 0.3336 | 0.0321 | 0.2695 | 0.970 | ||
| 2.5554 | 0.2095 | 0.0554 | 0.2213 | 0.935 | ||
| 2.4398 | 0.1608 | 0.0602 | 0.1457 | 0.965 | ||
| 200 | 0.5270 | 0.4168 | 0.0270 | 0.3982 | 0.940 | |
| −1.0379 | 0.4649 | −0.0379 | 0.4955 | 0.935 | ||
| −3.1321 | 0.4935 | −0.1321 | 0.7061 | 0.960 | ||
| 2.2151 | 0.5552 | 0.2151 | 0.7774 | 0.930 | ||
| 2.5889 | 0.2852 | 0.0889 | 0.3335 | 0.925 | ||
| 2.4983 | 0.2096 | 0.0017 | 0.1948 | 0.940 | ||
| 400 | 0.4155 | 0.4383 | −0.0845 | 0.4395 | 0.950 | |
| −1.0541 | 0.3935 | −0.0541 | 0.3331 | 0.975 | ||
| −2.9738 | 0.3831 | 0.0262 | 0.3973 | 0.930 | ||
| 2.9755 | 0.4174 | −0.0245 | 0.4588 | 0.915 | ||
| 1.5570 | 0.1274 | 0.0570 | 0.1359 | 0.965 | ||
| 3.3984 | 0.3799 | −0.1016 | 0.4136 | 0.905 | ||
| 200 | 0.4308 | 0.6067 | −0.0692 | 0.5680 | 0.935 | |
| −0.9745 | 0.5598 | 0.0255 | 0.5332 | 0.950 | ||
| −2.9882 | 0.5582 | 0.0118 | 0.4703 | 0.920 | ||
| 1.9906 | 0.6054 | −0.0094 | 0.5151 | 0.910 | ||
| 1.5788 | 0.1911 | 0.0788 | 0.2375 | 0.935 | ||
| 3.3074 | 0.5371 | −0.1916 | 0.5426 | 0.895 |
Table 4:
Model fitting results for the Poisson cure rate model with multiple exposures.
| Parameter | Estimate | SE | Bias | RMSE | CP 95% | |
|---|---|---|---|---|---|---|
| 400 | 0.5060 | 0.1262 | 0.0060 | 0.1239 | 0.955 | |
| −1.0137 | 0.1605 | −0.0137 | 0.1757 | 0.935 | ||
| −3.0621 | 0.4553 | −0.0621 | 0.4644 | 0.960 | ||
| 2.0614 | 0.4936 | 0.0614 | 0.5037 | 0.965 | ||
| 2.5282 | 0.1654 | 0.0282 | 0.1687 | 0.960 | ||
| 2.4936 | 0.1604 | −0.0064 | 0.1577 | 0.965 | ||
| 200 | 0.5110 | 0.1785 | 0.0110 | 0.1713 | 0.970 | |
| −1.0370 | 0.2303 | −0.0370 | 0.2326 | 0.965 | ||
| −3.0768 | 0.4916 | −0.0768 | 0.4923 | 0.965 | ||
| 2.0866 | 0.5459 | 0.0866 | 0.5317 | 0.955 | ||
| 2.5326 | 0.2329 | 0.0326 | 0.3536 | 0.945 | ||
| 2.5180 | 0.2264 | 0.0180 | 0.2318 | 0.930 | ||
| 400 | 0.5069 | 0.1867 | 0.0069 | 0.1818 | 0.960 | |
| −1.1014 | 0.1817 | −0.1014 | 0.1823 | 0.945 | ||
| −3.1269 | 0.6654 | −0.1269 | 0.6932 | 0.900 | ||
| 2.1127 | 0.6983 | 0.1127 | 0.7281 | 0.910 | ||
| 1.5155 | 0.1062 | 0.0155 | 0.1033 | 0.965 | ||
| 3.6233 | 0.4127 | 0.1233 | 0.4266 | 0.905 | ||
| 200 | 0.4729 | 0.2687 | −0.0281 | 0.2744 | 0.945 | |
| −1.0477 | 0.2688 | 0.0477 | 0.2653 | 0.965 | ||
| −3.0373 | 0.7598 | −0.0373 | 0.5923 | 0.920 | ||
| 2.0541 | 0.8183 | 0.0541 | 0.6590 | 0.915 | ||
| 1.5466 | 0.1579 | 0.0466 | 0.1769 | 0.930 | ||
| 3.4580 | 0.8309 | 0.0420 | 0.8945 | 0.905 |
Table 5:
Model fitting results for the COM-Poisson cure rate model with multiple exposures (to apply the profile likelihood, the set of values of is chosen as {1.6, 1.7, …, 2.4}).
| Parameter | Estimate | SE | Bias | RMSE | CP 95% | |
|---|---|---|---|---|---|---|
| 400 | 0.4644 | 0.2259 | −0.0356 | 0.2282 | 0.945 | |
| −1.0151 | 0.2345 | −0.0151 | 0.2344 | 0.940 | ||
| −3.0504 | 0.2121 | −0.0504 | 0.2175 | 0.960 | ||
| 2.0522 | 0.2177 | 0.0522 | 0.2233 | 0.960 | ||
| 2.5842 | 0.2575 | 0.0842 | 0.2703 | 0.965 | ||
| 2.5376 | 0.2569 | 0.0376 | 0.2590 | 0.955 | ||
| 1.8320 | – | −0.1680 | 0.8133 | – | ||
| 200 | 0.4554 | 0.5288 | −0.0446 | 0.5280 | 0.940 | |
| −1.1001 | 0.4805 | −0.1001 | 0.5149 | 0.950 | ||
| −3.0033 | 0.3293 | −0.0033 | 0.3277 | 0.960 | ||
| 1.9846 | 0.3507 | −0.0126 | 0.3492 | 0.960 | ||
| 2.6991 | 0.4356 | 0.1991 | 0.4770 | 0.925 | ||
| 2.5084 | 0.3260 | 0.0084 | 0.3345 | 0.920 | ||
| 1.7975 | – | −0.2025 | 0.8956 | – | ||
| 400 | 0.4470 | 0.3462 | −0.0630 | 0.3485 | 0.950 | |
| −1.0812 | 0.4155 | −0.0812 | 0.4213 | 0.945 | ||
| −3.0359 | 0.2481 | −0.0359 | 0.2494 | 0.910 | ||
| 2.0275 | 0.2792 | 0.0275 | 0.2791 | 0.920 | ||
| 1.5556 | 0.1629 | 0.0556 | 0.1714 | 0.945 | ||
| 3.6636 | 0.5117 | 0.1636 | 0.5348 | 0.950 | ||
| 2.1878 | – | 0.1878 | 0.8401 | – | ||
| 200 | 0.5433 | 0.5760 | 0.0433 | 0.5746 | 0.925 | |
| −1.1837 | 0.6957 | −0.1837 | 0.7579 | 0.945 | ||
| −2.9712 | 0.3775 | 0.0288 | 0.3766 | 0.900 | ||
| 1.9377 | 0.3555 | −0.0623 | 0.3591 | 0.915 | ||
| 1.5665 | 0.2647 | 0.0665 | 0.2716 | 0.935 | ||
| 3.5186 | 0.7116 | 0.0186 | 0.7082 | 0.940 | ||
| 1.7864 | – | −0.2136 | 0.9376 | – |
4.2. Model Discrimination
Due to the flexibility of the COM-Poisson cure rate model with discrete multiple exposures and its inclusion of several other multiple exposure cure rate models as special cases, we are in a position to select a simple multiple exposure cure rate model within the bigger family of COM-Poisson multiple exposure cure rate model that provides an adequate fit as the COM-Poisson multiple exposure model itself in many cases. This motivates us to explore the flexibility of the proposed multiple exposure COM-Poisson cure rate model to select a parsimonious cure rate model that provides an adequate fit to the given data. To this end, we carry out two different model discrimination studies, one using the likelihood ratio test and the other using the information-based criteria.
4.2.1. Likelihood ratio test
In this model discrimination study, we investigate the performance of the likelihood ratio test in testing the null hypothesis that the distribution of the number of pathogens at each exposure time can be described by one of the Bernoulli , Poisson , COM-Poisson , and COM-Poisson distributions versus the alternative hypothesis that the number of pathogens can be described by any other member of the COM-Poisson family besides the one already specified in the null hypothesis. The likelihood test statistic is defined as , where denotes the maximized log-likelihood function value under the null hypothesis and denotes the unrestricted maximized log-likelihood function value. Note that to calculate , we fit the multiple exposure COM-Poisson model for which the profile likelihood technique needs to be employed. For this simulation study, we consider the following three parameter settings: (i) Setting 1 considers 400 patients with parameters ; (ii) Setting 2 considers 400 patients with parameters ; and (iii) Setting 3 considers 200 patients with parameters . For each simulated data from a true model, we calculate the likelihood ratio test statistic of the fitted Bernoulli, Poisson, COM-Poisson , and COM-Poisson models versus the fitted COM-Poisson model. Based on 200 data sets for each true model and for each parameter setting, and using 10% level of significance, we report the observed significance levels (in bold) and observed power values of the likelihood ratio test in Table 6. These values are obtained by the rejection rates of the null hypotheses. From Table 6, it can be seen that the asymptotic null distribution of the likelihood ratio test statistic is reasonably approximated. When the true model is Bernoulli (or COM-Poisson ), the power to reject the COM-Poisson (or Bernoulli) is high. Thus, the likelihood ratio test can discriminate between the Bernoulli and COM-Poisson models. In this regard, note that the rejection rate is higher when the true model is COM-Poisson and the fitted model is Bernoulli. Now, when the true model is Poisson, the likelihood ratio test still possess adequate power to reject the Bernoulli model. However, when the true model is Bernoulli, the test has very low power to reject the Poisson model. Finally, the power of the likelihood ratio test to discriminate among COM-Poisson , Poisson, and COM-Poisson models vary from low to medium.
Table 6:
Observed levels and observed power values of the likelihood ratio test.
| Fitted model | True multiple exposure model | |||
|---|---|---|---|---|
| Setting 1 | ||||
| 0.100 | 0.315 | 0.465 | 0.765 | |
| 0.230 | 0.095 | 0.105 | 0.140 | |
| 0.425 | 0.390 | 0.100 | 0.095 | |
| 0.945 | 0.745 | 0.400 | 0.070 | |
| Setting 2 | ||||
| 0.115 | 0.250 | 0.400 | 0.695 | |
| 0.205 | 0.125 | 0.085 | 0.155 | |
| 0.435 | 0.350 | 0.160 | 0.105 | |
| 0.885 | 0.715 | 0.410 | 0.085 | |
| Setting 3 | ||||
| 0.145 | 0.225 | 0.380 | 0.680 | |
| 0.180 | 0.150 | 0.075 | 0.125 | |
| 0.375 | 0.355 | 0.170 | 0.090 | |
| 0.845 | 0.650 | 0.395 | 0.065 | |
4.2.2. Information-based criteria
In this model discrimination study, we investigate the performance of the Akaike information criterion (AIC) and the Bayesian information criterion (BIC) in choosing either the Bernoulli multiple exposure model, Poisson multiple exposure model, COM-Poisson multiple exposure model or COM-Poisson multiple exposure model, for a given true multiple exposure model. Our selected models cover both over-dispersed and under-dispersed models. We choose to look into the AIC and BIC since they are they two most widely used model selection criteria. The AIC is defined as , where is the maximized log-likelihood value of the given model and is the number of parameters of the fitted model. The BIC, on the other hand, is defined as . Similar to the AIC, is the maximized log-likelihood value of the given model, is the number of parameters of the fitted model, and is the sample size. In using the AIC and BIC, the preferred model is the one with the lowest AIC or BIC value.
For each generated true model, we fit all candidate models, i.e., Bernoulli , Poisson , COM-Poisson , and COM-Poisson , and allow AIC/BIC to select the best model. To generate the true model, we consider the same parameter settings as in the case of likelihood ratio test. Based on 200 generated data sets for each true model and for each parameter setting, we calculate the observed selection rates for both AIC and BIC, and report these values in Table 7. Note that the selection rates for BIC turned out to be the same as that for AIC, and, as such, are not reported. From the results in Table 7, it is clear that the model selection criteria performs well in selecting the correct model. When the true model is Bernoulli (or COM-Poisson ), the selection rate for COM-Poisson (or Bernoulli) is very low. This suggests that the AIC and BIC can distinctly discriminate between these two models. Thus, the decision reached by AIC/BIC is in agreement with that reached by likelihood ratio test earlier. A similar conclusion can also be drawn when discriminating between Bernoulli and COM-Poisson as well as between Bernoulli and Poisson models. However, the discrimination power of AIC and BIC among COM-Poisson , Poisson and COM-Poisson models appear to be weak. Note, in this regard, that when the true model is COM-Poisson , the selection rate for COM-Poisson is low. These observations suggest that it is worth exploring the flexibility of the COM-Poisson distribution to select a suitable distribution for the count on the pathogens at each exposure time. We note the advantage of using AIC/BIC in terms of speed. Unlike the method of model discrimination using likelihood ratio test, we do not need to estimate the shape parameter since we are only attempting to fit the candidate models for which the values of are specified. If we were to estimate the shape parameter , we would need to use a profile likelihood approach, which would drastically increase the computation time.
Table 7:
Observed selection rates based on AIC
| Fitted model | True multiple exposure model | |||
|---|---|---|---|---|
| Setting 1 | ||||
| 0.405 | 0.275 | 0.150 | 0.035 | |
| 0.310 | 0.410 | 0.315 | 0.105 | |
| 0.235 | 0.215 | 0.330 | 0.145 | |
| 0.050 | 0.100 | 0.205 | 0.715 | |
| Setting 2 | ||||
| 0.415 | 0.290 | 0.165 | 0.060 | |
| 0.320 | 0.425 | 0.320 | 0.110 | |
| 0.215 | 0.200 | 0.325 | 0.125 | |
| 0.050 | 0.085 | 0.190 | 0.705 | |
| Setting 3 | ||||
| 0.420 | 0.285 | 0.140 | 0.025 | |
| 0.300 | 0.400 | 0.295 | 0.140 | |
| 0.235 | 0.220 | 0.340 | 0.165 | |
| 0.045 | 0.095 | 0.225 | 0.670 | |
5. Real data application
We analyzed a data that can be found via the website Kaggle, which is a free-to-access online database repository that contains thousands of data sets created by researchers worldwide. The data was collected by the World Health Organization (WHO) in conjunction with John Hopkins University on December 31, 2019. This data tracks patients who have contracted the SARS-CoV-2, also known as COVID-19 or simply coronavirus, after visiting Wuhan City, Hubei Province of China, which is believed to the epicenter of the COVID-19 pandemic. This data set contains the patient data of people who have been in contact with people from Wuhan or someone who had recently visited Wuhan. The data set has information on variables such as country of origin, gender, age, date of symptom onset, if the patient died, and if the patient recovered. Most importantly, the data set contains the day when the patient started to be exposed to COVID-19 and when the exposure ended, which is crucial for our model. However, not all patients had this information. As such, we had to comb through the data to find patients who had the values we desired, so we could create a new data set with the information we required. We began by selecting patients who had a definitive exposure start date and exposure end date. This left us with 120 patients to study. We decided the event of interest we wanted to study would be the time to recovery. From these patients, we decided to study the effects of the covariates age and gender on the recovery time of the patients. Once we eliminated patients whose age and gender were not available, we were left with 95 patients whose starting exposure time, ending exposure time, age, and gender were recorded. Of these 95 patients, 15 of them had recovered from the disease and their date of recovery was also recorded. Figure 1 presents the Kaplan Meier (KM) estimates of the survival probability. It is clear that the KM curve levels off to a significant non-zero proportion, which indicates the presence of a cured sub-group. Hence, the proposed model is appropriate for this dataset.
Figure 1:

Kaplan Meier estimates of the survival probability
5.1. Data preparation for model
To begin, we identify our two covariates of interest as age and gender denoted and , respectively. We will treat gender as a binary covariate where if the patient is male (54.7%) and if the patient is female (45.3%). Next, we will let our covariate age be a categorical covariate. For this purpose, we divide the patients into 5 groups that were representative of the dispersion of the age. if the patient is between 0 and 24.5 years old (8.4%), if the patient is between 24.5 and 36.5 years old (23.2%), if the patient is between 36.5 and 48.5 years old (29.5%), if the patient is between 48.5 and 60.5 years old (25.3%), and if the patient is older than 60.5 years old (13.7%). Now that we have defined our covariates and their values, we can use the log-linear link function as . Since we have no evidence of heterogeneity of exposure intensity with respect to moment of exposure, we will assume is the same for each moment of exposure for each patient. Since the data records the number of days each patient was exposed to COVID-19, we will let the number of exposures be the number of days the patient was exposed. Therefore, the “time jump” between each moment of exposure will be 1. The average number of exposures is 6.24, with a minimum value of 1 and a maximum value of 29. Furthermore, we will let the value for the days until recovery, in other words the time to the event of interest, to be the number of days that have passed from the first day of exposure until the recovery date. The average time to recovery is 29.125 days, the minimum value is 22 days, and the maximum value is 40 days. If the recovery time of the patient is not recorded, the patient’s time to event is censored. The dataset has 85% censored observations. Next, to begin the iterative process of the EM algorithm, an initial guess of parameters is needed. To find the initial guess of the parameters in the Weibull distribution, we found the mean and variance of the recorded lifetimes. We then used the known expressions for the mean and variance of the Weibull distribution and solved for the progression time parameters. To get an initial guess for the regression coefficients, we performed a grid search using the observed likelihood function. For the purpose of the grid search, we assumed the data to follow the Poisson model. We then set the values for the lifetime parameters as constant. Finally, we calculated the log-likelihood values using the constant lifetime parameters, and different combinations of the regression coefficients with values ranging from [−5, 5]. Once we found the maximum log-likelihood value, we used those chosen parameters that resulted in the maximum log-likelihood value as the initial guess to begin the iterative process of the COM-Poisson model. We used these initial guesses and different values of to determine the correct model for this data. We selected values of ranging from 0 to 2, with jumps of 0.1, as well as the Bernoulli case .
5.2. Real data results
Figure 2 presents a plot of the maximized log-likelihood function values against the selected values of the COM-Poisson shape parameter for the real data. As we can clearly see, the values of the maximized log-likelihood function are very close to each other and almost indistinguishable. Furthermore, Table 8 shows some selected values of from the real data analysis along with the maximized log-likelihood, AIC, and BIC values. From Table 8, we can see there is very little difference between the models corresponding to different values of . Therefore, we can say that any model within the COM-Poisson family is adequate for this data. For the remainder of this section, we will assume the data follows the geometric model since it has the highest log-likelihood value and lowest AIC and BIC values. Under this assumption, Figure 3 presents the plots of estimated overall survival probabilities for different age groups and gender types. Note that for these plots we considered the number of exposures to be 6, which is the average number of exposures across all patients. Finally, in Table 9 we present the estimated cure probability for patients with different age groups and gender types, and considering the number of exposures to be 6. From both Figure 3 and Table 9 it is clear that for all age groups females tend to recover faster than males.
Figure 2:

Plot of the maximized log-likelihood value against the COM-Poisson shape parameter
Table 8:
AIC, BIC and maximized log-likelihood function values for different models
| Model | AIC | BIC | |
|---|---|---|---|
| COM-Poisson (geometric) | −85.7124 | 183.4247 | 198.7480 |
| COM-Poisson | −85.7175 | 183.4350 | 198.7583 |
| COM-Poisson (Poisson) | −85.7210 | 183.4420 | 198.7653 |
| COM-Poisson | −85.7252 | 183.4503 | 198.7736 |
| COM-Poisson (Bernoulli) | −85.7294 | 183.4588 | 198.7820 |
Figure 3:

Predicted overall survival probability for different age groups and stratified by gender
Table 9:
Estimated cure probability for different age groups (AG) and gender types
| Male | Female | Male | Female | Male | Female | Male | Female | Male | Female |
|---|---|---|---|---|---|---|---|---|---|
| 0.835 | 0.734 | 0.843 | 0.746 | 0.851 | 0.758 | 0.858 | 0.769 | 0.865 | 0.780 |
6. Conclusion and future work
In this paper, we propose a new cure rate model for infectious diseases with discrete multiple exposures. Our model can capture both over-dispersion and under-dispersion that we usually encounter when modeling the count on pathogens at each exposure time. Instead of selecting any arbitrary distribution to model the number of pathogens at each exposure time, our model provides an approach to statistically test for the suitability of a chosen distribution within the wider family of COM-Poisson. In our simulation study, the model discrimination results clearly show the importance of selecting the correct distribution for the number of pathogens. Our proposed estimation procedure, based on right censored data, works very well in retrieving the true parameter values. The bias, RMSE and standard error are small and they further decrease with an increase in sample size. The coverage probabilities are also reasonably close to the true nominal level used. As a potential future work, we can look at the process of elimination of pathogens at each exposure time and develop the corresponding inference. It will also be of interest to consider the unobserved number of pathogens at each exposure time as frailty variables, as done in Tournoud & Ecochard (2008), and use COM-Poisson as the frailty distributions. Another interesting future work is to assume a wider class of distributions for the pathogen promotion times, such as the generalized gamma distribution; see Pal et al. (2020). This will allow testing for the suitability of the commonly used distributions such as the Weibull, as considered in this paper. We are currently working on these and hope to report the findings in a future paper.
Acknowledgments
The author expresses his thanks to two anonymous reviewers for providing useful comments and suggestions which led to this improved version of the manuscript.
Funding
The research reported in this publication was supported by the National Institute Of General Medical Sciences of the National Institutes of Health under Award Number R15GM150091. The content is solely the responsibility of the author and does not necessarily represent the official views of the National Institutes of Health.
Appendix: Proof of Theorem 2.1
If we let
and
then, we know
Hence,
as desired.
Footnotes
Conflict of Interest
The author declares no potential conflict of interest.
Data Availability Statement
The real data is available on Kaggle.
References
- Aselisewine W, & Pal S (2023). On the integration of decision trees with mixture cure model. Statistics in Medicine, DOI: 10.1002/sim.9850. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Balakrishnan N, Barui S, & Milienos FS (2017). Proportional hazards under Conway–Maxwell-Poisson cure rate model and associated inference. Statistical Methods in Medical Research, 26(5), 2055–2077. [DOI] [PubMed] [Google Scholar]
- Balakrishnan N, Koutras MV, Milienos FS, & Pal S (2016). Piecewise linear approximations for cure rate models and associated inferential issues. Methodology and Computing in Applied Probability, 18(4), 937–966. [Google Scholar]
- Balakrishnan N, & Pal S (2012). EM algorithm-based likelihood estimation for some cure rate models. Journal of Statistical Theory and Practice, 6(4), 698–724. [Google Scholar]
- Balakrishnan N, & Pal S (2013). Lognormal lifetimes and likelihood-based inference for flexible cure rate models based on COM-Poisson family. Computational Statistics 8 Data Analysis, 67, 41–67. [Google Scholar]
- Balakrishnan N, & Pal S (2015a). An EM algorithm for the estimation of parameters of a flexible cure rate model with generalized gamma lifetime and model discrimination using likelihood-and information-based methods. Computational Statistics, 30(1), 151–189. [Google Scholar]
- Balakrishnan N, & Pal S (2015b). Likelihood inference for flexible cure rate models with gamma lifetimes. Communications in Statistics - Theory and Methods, 44(19), 4007–4048. [Google Scholar]
- Balakrishnan N, & Pal S (2016). Expectation maximization-based likelihood inference for flexible cure rate models with Weibull lifetimes. Statistical Methods in Medical Research, 25(4), 1535–1563. [DOI] [PubMed] [Google Scholar]
- Berkson J, & Gage RP (1952). Survival curve for cancer patients following treatment. Journal of the American Statistical Association, 47(259), 501–515. [Google Scholar]
- Boag JW (1949). Maximum likelihood estimates of the proportion of patients cured by cancer therapy. Journal of the Royal Statistical Society. Series B (Methodological), 11(1), 15–53. [Google Scholar]
- Boatwright P, Borle S, & Kadane JB (2003). A model of the joint distribution of purchase quantity and timing. Journal of the American Statistical Association, 98, 564–572. [Google Scholar]
- Conway RW, & Maxwell WL (1962). A queuing model with state dependent service rates. Journal of Industrial Engineering, 12(2), 132–136. [Google Scholar]
- Davies K, Pal S, & Siddiqua JA (2021). Stochastic EM algorithm for generalized exponential cure rate model and an empirical study. Journal of Applied Statistics, 48(12), 2112–2135. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Li B, Zhang H, & He J (2020). Some characterizations and properties of com-poisson random variables. Communications in Statistics - Theory and Methods, 49, 1311–1329. [Google Scholar]
- Majakwara J, & Pal S (2019). On some inferential issues for the destructive COM-Poisson-generalized gamma regression cure rate model. Communications in Statistics - Simulation and Computation, 48(10), 3118–3142. [Google Scholar]
- McLachlan GJ, & Krishnan T (2008). The EM algorithm and extensions (second ed.). Hoboken, New Jersey: John Wiley & Sons. [Google Scholar]
- Milienos FS (2022). On a reparameterization of a flexible family of cure models. Statistics in Medicine, 41, 4091–4111. [DOI] [PubMed] [Google Scholar]
- Pal S (2021). A simplified stochastic EM algorithm for cure rate model with negative binomial competing risks: an application to breast cancer data. Statistics in Medicine, 40(28), 6387–6409. [DOI] [PubMed] [Google Scholar]
- Pal S, & Aselisewine W (2023). A semi-parametric promotion time cure model with support vector machine. arXiv:2304.11815 (accepted in Annals of Applied Statistics). [Google Scholar]
- Pal S, & Balakrishnan N (2016). Destructive negative binomial cure rate model and EM-based likelihood inference under Weibull lifetime. Statistics 8 Probability Letters, 116, 9–20. [Google Scholar]
- Pal S, & Balakrishnan N (2017a). An EM type estimation procedure for the destructive exponentially weighted Poisson regression cure model under generalized gamma lifetime. Journal of Statistical Computation and Simulation, 87(6), 1107–1129. [Google Scholar]
- Pal S, & Balakrishnan N (2017b). Likelihood inference for COM-Poisson cure rate model with interval-censored data and Weibull lifetimes. Statistical Methods in Medical Research, 26(5), 2093–2113. [DOI] [PubMed] [Google Scholar]
- Pal S, & Balakrishnan N (2017c). Likelihood inference for the destructive exponentially weighted Poisson cure rate model with Weibull lifetime and an application to melanoma data. Computational Statistics, 32(2), 429–449. [Google Scholar]
- Pal S, & Balakrishnan N (2018). Expectation maximization algorithm for Box–Cox transformation cure rate model and assessment of model misspecification under Weibull lifetimes. IEEE Journal of Biomedical and Health Informatics, 22(3), 926–934. [DOI] [PubMed] [Google Scholar]
- Pal S, Barui S, Davies K, & Mishra N (2022). A stochastic version of the em algorithm for mixture cure model with exponentiated weibull family of lifetimes. Journal of Statistical Theory and Practice, 16(3), 48. [Google Scholar]
- Pal S, Majakwara J, & Balakrishnan N (2018). An EM algorithm for the destructive COM-Poisson regression cure rate model. Metrika, 81(2), 143–171. [Google Scholar]
- Pal S, Peng Y, & Aselisewine W (2023). A new approach to modeling the cure rate in the presence of interval censored data. Computational Statistics, 10.1007/s00180-023-01389-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pal S, & Roy S (2021). On the estimation of destructive cure rate model: a new study with exponentially weighted Poisson competing risks. Statistica Neerlandica, 75 (3), 324–342. [Google Scholar]
- Pal S, & Roy S (2022). A new non-linear conjugate gradient algorithm for destructive cure rate model and a simulation study: illustration with negative binomial competing risks. Communications in Statistics - Simulation and Computation, 51(11), 6866–6880. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pal S, & Roy S (2023). On the parameter estimation of Box-Cox transformation cure model. Statistics in Medicine, 42(15), 2600–2618. [DOI] [PubMed] [Google Scholar]
- Pal S, Yu H, Loucks ZD, & Harris IM (2020). Illustration of the flexibility of generalized gamma distribution in modeling right censored survival data: analysis of two cancer datasets. Annals of Data Science, 7(1), 77–90. [Google Scholar]
- Peng Y, & Yu B (2021). Cure Models: Methods, Applications and Implementation. Chapman and Hall/CRC. [Google Scholar]
- Rodrigues J, de Castro M, Cancho VG, & Balakrishnan N (2009). COM–Poisson cure rate survival models and an application to a cutaneous melanoma data. Journal of Statistical Planning and Inference, 139(10), 3605–3611. [Google Scholar]
- Shmueli G, Minka TP, Kadane JB, Borle S, & Boatwright P (2005). A useful distribution for fitting discrete data: revival of the Conway–Maxwell–Poisson distribution. Journal of the Royal Statistical Society: Series C (Applied Statistics), 54(1), 127–142. [Google Scholar]
- Tournoud M, & Ecochard R (2007). Application of the promotion time cure model with time-changing exposure to the study of HIV/AIDS and other infectious diseases. Statistics in Medicine, 26, 1008–1021. [DOI] [PubMed] [Google Scholar]
- Tournoud M, & Ecochard R (2008). Promotion time models with time-changing exposure and heterogeneity: application to infectious diseases. Biometrical Journal, 50, 395–407. [DOI] [PubMed] [Google Scholar]
- Treszoks J, & Pal S (2022). A destructive shifted Poisson cure model for interval censored data and an efficient estimation algorithm. Communications in Statistics-Simulation and Computation, DOI: 10.1080/03610918.2022.2067876. [DOI] [Google Scholar]
- Tsodikov AD, Lower M, & Yakovlev A (1998). A cure model with time-changing risk factor: an application to the analysis of secondary leukaemia. a report from the international database on hodgkin’s disease. Statistics in Medicine, 17, 27–40. [DOI] [PubMed] [Google Scholar]
- Wang P, & Pal S (2022). A two-way flexible generalized gamma transformation cure rate model. Statistics in Medicine, 41(13), 2427–2447. [DOI] [PubMed] [Google Scholar]
- Wiangnak P, & Pal S (2018). Gamma lifetimes and associated inference for interval-censored cure rate model with COM-Poisson competing cause. Communications in Statistics - Theory and Methods, 47(6), 1491–1509. [Google Scholar]
- Yakovlev AY, Tsodikov AD, & Bass L (1993). A stochastic model of hormesis. Mathematical Biosciences, 116(2), 197–219. [DOI] [PubMed] [Google Scholar]
- Yin G, & Ibrahim JG (2005). Cure rate models: a unified approach. Canadian Journal of Statistics, 33(4), 559–570. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The real data is available on Kaggle.
