Abstract
The unparalleled specificity and activity of therapeutic proteins has reshaped many aspects of modern clinical practice, and aggressive development of new protein drugs promises a continued revolution in disease therapy. As a result of their biological origins, however, therapeutic proteins present unique design challenges for the biomolecular engineer. For example, protein drugs are subject to immune surveillance within the patient's body; this anti-drug immune response can compromise therapeutic efficacy and even threaten patient safety. Thus, there is a growing demand for broadly applicable protein deimmunization strategies. We have recently developed optimization algorithms that integrate computational prediction of T-cell epitopes and bioinformatics-based assessment of the structural and functional consequences of epitope-deleting mutations. Here, we describe the first experimental validation of our deimmunization algorithms using Enterobacter cloacae P99 β-lactamase, a component of antibody-directed enzyme prodrug cancer therapies. Compared with wild-type or a previously deimmunized variant, our computationally optimized sequences exhibited significantly less in vitro binding to human type II major histocompatibility complex immune molecules. At the same time, our globally optimal design exhibited wild-type catalytic proficiency. We conclude that our deimmunization algorithms guide the protein engineer towards promising immunoevasive candidates and thereby have the potential to streamline biotherapeutic development.
Keywords: ADEPT, computational protein design, deimmunization, T-cell epitope, therapeutic protein
Introduction
Therapeutic proteins have proven to be exceptionally powerful drugs with the capacity to reshape disease therapy and clinical practice. The biopharmaceutical industry has capitalized on the molecular specificity of antibodies, the catalytic efficiency and selectivity of enzymes, and the precise regulatory properties of cytokines and hormones to produce a range of blockbuster biotherapeutics (Aggarwal, 2011). The success of numerous approved protein drugs has spurred further research and development efforts, yet proteins remain an underutilized reservoir of prospective therapeutic agents. One widely recognized hurdle to developing efficacious biotherapies is the fact that proteins, unlike small molecule drugs, are subject to immune surveillance within the patient's body. An immune response directed towards a protein therapeutic may manifest a spectrum of clinical complications including accelerated drug clearance, neutralization and loss of efficacy or allergic responses ranging from rare anaphylactic reactions to more common delayed, infusion-like reactions (Schellekens, 2002a,b; De Groot and Scott, 2007). Growing awareness of the risks stemming from biotherapeutic immunogenicity has prompted increased scrutiny from regulatory agencies and, as a result, greater interest on the part of biopharma in pre-emptively addressing this issue (Giezen et al., 2008; De Groot and Martin, 2009). While grafting-based humanization techniques are routinely implemented with therapeutic antibodies (Almagro and Fransson, 2008), more general deimmunization strategies are needed to effectively tap the full diversity of protein families that exhibit therapeutic potential.
At a fundamental level, an anti-protein immune response is governed by molecular recognition of immunogenic peptides, or epitopes, which are found within the protein's primary sequence (for a review see Trombetta and Mellman, 2005). Immune surveillance initiates with a patient's antigen-presenting cells internalizing a therapeutic protein and proteolytically processing it into small peptide fragments. Fragments that represent potential epitopes are loaded into the groove of cognate type II major histocompatibility complex (MHC II) proteins, and these complexes are trafficked to the cell surface for display to the extracellular environment. Once there, the MHC II-peptide complexes are free to interact with receptor proteins on the surface of T-cell lymphocytes, and true immunogenic epitopes are distinguished by their capacity to form ternary MHC II-peptide-T-cell receptor complexes. These peptide-mediated cell–cell interactions drive a complex signaling cascade resulting in maturation and proliferation of B-cell lymphocytes that ultimately secrete immunoglobulin molecules able to bind the offending therapeutic protein. This well-characterized pathway affords the opportunity to re-engineer a protein's immunogenic peptide sequences so as to disrupt interaction with MHC II and/or T-cell receptors. By successfully implementing such an ‘epitope deletion’ strategy, one can generate a deimmunized biotherapy.
Deimmunization by T-cell epitope deletion is, conceptually, a straightforward process, but in practice the path to a deimmunized protein is technically challenging and subject to practical limitations. The fundamental tasks are identification of target epitopes and subsequent selection of epitope-deleting mutations. Experimental identification of a protein's complete T-cell epitope profile requires specialized techniques, materials and an immense investment of time and resources (Malherbe, 2009). Therefore, a promising alternative leverages predictive computational tools to expedite T-cell epitope mapping (Wang et al., 2008; De Groot and Martin, 2009), and employs these same methods to assess, in silico, the extent to which a given mutation mitigates peptide immunogenicity (De Groot et al., 2005). But while the identification of key immunogenic epitopes and corresponding epitope-deleting mutations are requisite elements of protein deimmunization, they are not themselves sufficient to achieve this goal. By definition, an efficacious protein drug must retain its therapeutic function. This fact constrains deimmunizing mutations to those compatible with high level protein stability and activity. Thus, deimmunization by T-cell epitope deletion is an inherently complex, multi-objective optimization problem.
We have recently described a new computationally driven approach for protein deimmunization (Parker et al., 2010). Our method, Dynamic Programming for Deimmunizing Proteins (DP2), optimizes a target protein so as to reduce its immunogenicity, as assessed by T-cell epitope prediction, while simultaneously maintaining stability and activity, as assessed by sequence conservation or structure-based ΔΔG° prediction. DP2 integrates validated prediction tools into a powerful computational framework for therapeutic protein design and, in doing so, is the first mathematically formalized method for optimally solving the combined immunogenicity and stability/activity problem. The DP2 algorithm's rigorous mathematical structure guarantees identification of the best-scoring protein designs among the combinatorial set of possibilities. Our prior retrospective studies showed that DP2 can efficiently identify optimal sets of deimmunizing mutations that compare favorably with those found by extensive experimental efforts. Here, we leverage a therapeutically relevant protein to demonstrate the practical utility of the DP2 algorithm.
Antibody-directed enzyme prodrug therapies (ADEPT) are highly engineered chemotherapeutic regimens requiring carefully timed administration of multiple components (Schellmann et al., 2010). First, patients are given an antibody–enzyme fusion protein that localizes preferentially to cancer cells. Upon achieving high tumor-to-plasma ratios of the fusion protein, a relatively non-toxic prodrug is administered systemically. Subsequently, the prodrug is converted to a toxic agent via action of the fusion protein's enzymatic domain. Thus, ADEPT therapies are designed to generate toxic chemotherapeutics at the site of malignancy, potentially improving efficacy and reducing side effects. To ensure site-specific prodrug conversion, ADEPT has almost uniformly employed enzymes of non-human origin. The bacterial enzymes of most ADEPT systems have activities orthogonal to the human proteome, thereby minimizing nonspecific conversion of prodrug by the patient's endogenous biocatalysts. The use of bacterial enzymes, however, has manifested undesirable consequences stemming from the fact that proteins of non-human origin are predisposed towards high-level immunogenicity (Schellekens, 2002a,b). As with many other non-human therapeutic proteins, the development and testing of ADEPT technology has been plagued by immunogenicity-related complications (Bagshawe, 2009).
Here, we focus on the enzyme Enterobacter cloacae β-lactamase (P99βL), which has applications in ADEPT (Alderson et al., 2006). β-Lactamases are bacterial drug-resistance proteins that hydrolyze β-lactam antibiotics and have been co-opted as activators of various lactam-derivatized prodrugs. To mitigate immunogenicity-related risks, P99βL was previously subjected to a particularly rigorous experimental deimmunization effort (Harding et al., 2005). First, the full-length P99βL amino acid sequence was divided into a panel of 117 overlapping peptides, and each of these peptides was chemically synthesized. The immunogenicity of each peptide was then tested via proliferation assays using immune cells from 65 different human donors. The four native peptides that yielded the greatest immunostimulatory effect were then subjected to scanning alanine mutagenesis, which entailed the chemical synthesis of 55 new peptides, each containing a single alanine substitution. These 55 mutant peptides were analyzed for immunogenicity against a second panel of human immune cells from 66 donors. Those alanine substitutions that reduced the immunogenicity of the cognate peptide were subsequently engineered back into the full-length protein, and the expression, stability and activity of more than 16 protein variants were analyzed. Based on this exhaustive study, a single protein variant (the K21A/S324A double mutant) was deemed to have sufficient activity and stability to merit further study. Harding et al.'s isolation of the functionally enhanced K21A/S324A P99βL is a brilliant example of experimental T-cell epitope deletion, but the fact that this tour de force yielded only a single therapeutic candidate highlights the risks and uncertainty of such a monumental undertaking.
Using the P99βL as a model enzyme, we demonstrate the first experimental validation of our DP2 protein deimmunization algorithm. In stark contrast to conventional deimmunization strategies, our algorithm rapidly (in a matter of minutes) generated a multitude of protein designs predicted to have both reduced T-cell epitope content and high level activity and stability. Two of these designs were constructed and characterized, and the performance of these engineered proteins was benchmarked against both the wild-type P99βL and the previously deimmunized K21A/S324A double mutant. The results demonstrate that the DP2 algorithm generates high-performance biotherapeutic candidates with unprecedented speed and accuracy. While this experimental validation focuses on a single protein target, our methodology is general in nature and should be applicable to virtually any therapeutic protein of interest.
Methods
Computational methods
Given a wild-type amino acid sequence, our goal is to identify m-mutation variants that delete the greatest number of epitopes (reducing immunogenicity) while employing only conservative substitutions (maintaining stability and activity). This is a combinatorial optimization problem with
possible sets of mutated positions in an n amino acid protein and cm possible substitutions for those positions if each allows c conservative mutations. We have developed an efficient optimization method, DP2 (Parker et al., 2010), that integrates, in a modular fashion, methods to analyze the effects of mutations on stability and activity with methods to analyze their effects on immunogenicity. DP2 does not explicitly consider the exponential number of possibilities. Instead, it employs dynamic programming to efficiently, in polynomial time, identify the variants that are guaranteed to be optimal and near optimal with respect to reducing immunogenicity via conservative amino acid substitutions. Here we summarize the specific prediction methods and optimization approach employed for P99βL, and we refer the reader to Parker et al. (2010) for details, further discussion and retrospective assessment of the methods.
Conservative substitutions
We employ conservation statistics to determine position-specific mutations for consideration. Briefly, a multiple sequence alignment of homologs to the protein target is used to determine the amino acid frequencies at each position. The frequency of any given residue at a particular position is indicative of the substitution's evolutionary acceptability and is thus considered predictive of structural and functional significance. In order to account for over- or under-sampling of evolutionary diversity in the extant sequence record, we weight sequences according to similarity within a phylogenetic tree (Gerstein et al., 1994). We allow substitutions with a weighted frequency above a specified background level. To avoid possible non-additive effects from coupled amino acids, we filter the resulting variants to ensure structural separation of substitutions. As a complementary assessment of structural conservation, we also calculate FoldX ΔΔG°s (Guerois et al., 2002) for putative protein designs.
Epitope prediction
We use the well-established ProPred epitope predictor (Singh and Raghava, 2001) to identify putative epitopes in the wild-type protein and prospective designs (Fig. 1). ProPred has proven effective in several applications (Mustafa and Shaban, 2006; Dinglasan et al., 2007; Klyushnenkova et al., 2007) and was one of the two most accurate predictors in a recent comparative study (Wang et al., 2008). ProPred is derived from the ‘pocket profile’ method TEPITOPE (Sturniolo et al., 1999), which assesses peptides with position-specific scoring matrices based on binding affinity measurements of all 20 amino acids against each of the 9 pockets in the binding grooves of representative MHC II alleles. We consider the eight most common human alleles, deemed representative of a large majority of the population (Southwood et al., 1998): DRB1*0101, 0301, 0401, 0701, 0801, 1101, 1301 and 1501. Given a peptide and allele, we sum the frame-specific scores and compare the result to a threshold value, essentially establishing an expected false-positive rate (5% for the plans presented here). As a complementary assessment of immunogenicity, we retrospectively examined predicted binding of resulting variants according to SMM-align (Nielsen et al., 2007) and ensured that the predictions were consistent (data not shown).
Fig. 1.

Wild-type P99βL epitope scores. The P99βL structure (pdb ID: 1XX2, chain A) is rendered to show, at the first residue of each 9mer, the number of alleles (0–8) predicted to recognize that 9mer according to ProPred at a 5% threshold. Black backbone indicates an epitope score of 0, while highlighted sausage indicates an epitope score ranging from thin pale yellow (1) to thick bright red (8). Important residue side chains are rendered as colored sticks and labeled: our mutation sites = blue; Harding et al. mutation sites = green; key active site residues = magenta.
Optimization algorithm
DP2 employs a dynamic programming algorithm that is both computationally efficient and optimal with respect to the given predictive models (i.e., guaranteed to find the minimum-epitope variant using a specified number of mutations from a given set). Briefly, DP2 proceeds from N- to C-terminus, assessing the reduction in immunogenicity for each allowed substitution at the current position. New substitutions are compared against the best possible partial variants so far, relying on optimal substructure to consider only the nine residues at the tail of the partial variants. This approach assesses the entire complement of possible epitopes for a variant, thereby ensuring that a mutation to delete one epitope does not inadvertently introduce another. The dynamic programming approach also supports efficient identification of near-optimal variants, determined in order of epitope score by a tree search algorithm. To select variants for experimental study, we examine all variants with near-optimal epitope scores, assess them by the complementary prediction methods mentioned above, and ensure separation of mutations in both sequence (to target separate immunodominant regions) and structure (to avoid non-additive effects).
Experimental methods
Materials
Oligonucleotides (25 nmol scale, standard desalting) were purchased from Integrated DNA Technology (San Diego, CA, USA). Nitrocefin was purchased from Oxoid (Cambridge, UK). Human serum, human lysozyme and SYPRO Orange 5000× Protein Stain were purchased from Sigma (St Louis, MO, USA). MicroAmp® Fast Optical 0.1 ml 96-Well Plates and MicroAmp® Optical Adhesive Film were from Applied Biosystems (Bedford, MA, USA). Restriction enzymes and polymerase chain reaction (PCR) reagents were purchased from New England BioLabs (Ipswich, MA, USA). Growth media was purchased from Becton Dickinson (Franklin Lakes, NJ, USA). Plasmid purification kits and Ni-NTA resin were purchased from Qiagen (Valencia, CA, USA). PCR cleanup and gel extraction kits were from Zymo Research (Irvine, CA, USA). Peptides derived from P99βL were ordered from GenScript (Piscataway, NJ, USA), and were >85% pure. Biotinylated tracer peptides were purchased from 21st Century Biochemicals (Marlborough, MA, USA). HLA DR molecules were purchased from Benaroya Research Institute (Seattle, WA, USA), anti-HLA-DR antibody from BD Biosciences (San Diego, CA, USA) and DELFIA Eu-labeled Streptavidin was from PerkinElmer (Boston, MA, USA). Unless noted, all other chemicals and reagents were from Fisher Scientific (Pittsburgh, PA, USA).
Cloning, expression and purification
The wild-type P99βL gene was amplified from E. cloacae chromosomal DNA in whole cell lysates. The gene encoding the mature P99βL protein was appended with a 5′-sequence for the OmpA leader peptide and 3′-sequence encoding a GGGSAETVEHHHHHH affinity tag (Amin et al., 2004). The PCR amplicon was digested with NdeI and HindIII, purified with a PCR cleanup kit, ligated into similarly digested pET26b, and transformed into BL21(DE3) [F– ompT hsdSB (rB− mB−) gal dcm (DE3)]. Transformants were recovered for 1 h in SOC, plated on solid Luria-Bertani (LB) media containing 30 µg/ml kanamycin (LB-Kan), and clones were verified by DNA sequencing of their respective plasmids. Mutant genes were constructed by splice overlap extension PCR using the wild-type gene as template. Full length mutant genes were cloned into the pET26b vector and transformed as described above.
Five hundred milliliters cultures were grown with aeration in LB-Kan at 37°C using 2 L baffled flasks. Upon reaching an OD600 of ∼3.5, cultures were transferred to a 16°C shaker, equilibrated for 15 min and then induced with 1 mM IPTG. After 16 h of induction, protein was purified using the protocol described in the Epicentre® PeriPreps™ Periplasting Kit with slight modifications. Briefly, cells were pelleted at 8000 g for 10 min and resuspended in PeriPreps™ Periplasting Buffer containing 1.5 μg/ml human lysozyme. After 5 min, cells were quenched with ice-cold water, recovered on ice for 10 min, spun at 14,000 g for 10 min and the supernatant was reserved as the periplasmic fraction.
A 400 μl bed volume of Ni-NTA resin was washed with water and equilibrated with phosphate-buffered saline (PBS: 137 mM NaCl, 2.6 mM KCl, 10 mM Na2HPO4, 1.7 mM KH2PO4, pH 7.4). Clarified periplasmic fraction was flowed through the resin by gravity, the column was washed two times with 1 ml of PBS containing 20 mM imidazole, and the enzyme was eluted with 2 ml of PBS containing 200 mM imidazole. The elution fraction was dialyzed against three changes of 4 l PBS and purified protein was stored at 4°C prior to further analysis. The identities of all proteins were confirmed by mass spectrometry (Q-Star Pulsar I LC/MS), and purities were determined by reverse-phase high-performance liquid chromatography (HPLC) analysis (Agilent 1200 Series HPLC) on a Vydac 214TP 180 mm C4 column, eluted at 65°C with a 25–45% gradient of (90% acetonitrile/9.9% water/0.1% trifluoroacetic acid) in (99.9% water/0.1% trifluoroacetic acid) at a flow rate of 1 ml/min. All protein preparations were >95% pure (data not shown).
Kinetic studies
Nitrocefin substrate stock was prepared immediately prior to the experiments by suspending nitrocefin powder in dimethyl sulfoxide to a concentration of 20 mM. Triplicate assays were run in 96-well plate format at 27°C measuring absorbance at 490 nm (Molecular Devices SpectraMax 190 plate reader). Absorbance measurements were converted to micromolar product concentrations using the appropriate molar absorptivity (ɛm= 20,500 M−1 cm−1). The assay buffer was PBS, and each well contained a final enzyme concentration of 50 ng/ml, 0.04% BSA and nitrocefin at concentrations ranging from 10 to 500 µM. Initial reaction rates were plotted against substrate concentration, and kinetic parameters were determined by nonlinear regression using GraphPad Prism v.4 software (La Jolla, CA, USA).
Thermostability
Differential scanning fluorimetry was performed essentially as described (Niesen et al., 2007) using an ABI 7500 Fast Real-Time PCR System from Applied Biosystems. Proteins and SYPRO Orange were diluted in PBS. Final protein concentrations were 100 µg/ml and final dye concentrations were 5×. Twenty microliter reactions were performed in 12 replicates. The PCR gradient was run from 25–94°C with a 1 min equilibration at each degree centigrade. Fluorescence was quantified using the preset TAMRA parameters. Melting temperatures were determined by data analysis with the ‘DSF Analysis v3.0.xlsx’ Excel sheet (ftp://ftp.sgc.ox.ac.uk/pub/biophysics/) and GraphPad Prism v.4 software.
Plasma stability
Enzymes were diluted into human serum to a final concentration of 100 µg/ml. The serum–enzyme mixture was incubated at 37°C and nitrocefin kinetics were analyzed at various time points. For the kinetic assays, enzyme in serum was diluted 1000-fold in PBS and combined 1 : 1 with 400 µM nitrocefin to yield a final enzyme concentration of 50 ng/ml and a final nitrocefin concentration of 200 µM. Plates were read as described above, and specific activities were calculated from initial slopes.
MHC binding assays
MHC II binding competition assays were performed as described (Steere et al., 2006). Briefly, in 96-well plates, non-biotinylated test peptides over a range of concentrations (0.1–100 μM) competed for binding to purified human MHC II molecules (50 nM) against a biotinylated tracer peptide at a fixed concentration (0.1 µM) for 24 h at 37°C. The sequences of the tracer peptides are provided as supplemental materials. Peptide-MHC II complexes were then captured on 96-well plates coated with pan anti-HLA-DR antibody (L243). Plates were washed and incubated with Europium-labeled streptavidin for 1 h at room temperature. Europium activation buffer was added to each well, and plates were developed for 15–20 min at room temperature before reading on a time resolved fluorescence plate reader. All measurements were performed in triplicate. Binding assays were performed for four alleles: DRB1*0101, 0401, 0701 and 1501. Percent maximal tracer binding was plotted against test peptide concentration and IC50 values were determined by nonlinear regression using GraphPad Prism v.4 software. IC50 values and 95% confidence intervals are provided in Supplementary Table SI.
Results
Computational protein design
We applied DP2 to identify optimal and near-optimal variants of the wild-type P99βL (UniProtKB locus AMPC_ENTCL/32–381), which we describe with positions numbered according to the crystal structure (pdb: 1XX2, chain A). For epitope analysis, we employed ProPred (Singh and Raghava, 2001) at a 5% threshold. The initial epitope analysis predicts pervasive epitopes in P99βL: on the surface, in the core, and around the active site (Fig. 1). Conservative mutations were identified by analysis of Pfam 00144 homologs filtered for 35–90% sequence identity to wild-type. Position-specific weighted frequencies were derived from a phylogenetic tree generated with ClustalW (Thompson et al., 1994), and target sites were substituted with only those amino acids appearing at >5% weighted frequency.
DP2 identified A13D/I104T as the optimal two-mutation variant. A13D is predicted to eliminate binding by all five alleles that recognize wild-type 9mers overlapping residue 13 (Fig. 2a). I104T is predicted to eliminate all seven alleles binding one 9mer in the window around position 104 and three of the five alleles binding another overlapping 9mer (Fig. 2b). Categorization by allele reveals that A13D leaves no epitope on any allele and I104T deletes the epitopes for six of the eight alleles considered. DP2 selected this variant from a large and diverse set of allowable mutations. Interestingly, A13D deletes all epitopes without directly mutating any of the three predicted P1 anchors (L8, V11, V12). P1 anchor residues are hydrophobic amino acids that bind in the first pocket of the MHC II cleft and play a key role in immunogenic peptide recognition. In contrast to A13D, I104T mutates a P1 anchor, thereby eliminating all epitopes for that 9mer but only three of 5 epitopes starting at the preceding P1 anchor W101. The optimality of the DP2 algorithm guarantees that there is no single mutation that will eliminate all epitopes in the W101 to Y112 region of the protein. More generally, it guarantees that the combined A13D and I104T mutations delete more total epitopes than any other two-mutation combination applied across the entire protein.
Fig. 2.
Design of P99βL deimmunizing mutations. For the wild-type P99βL (amino acids on the top row along the x-axis), epitopes for each of the eight common MHC II alleles are indicated as solid black lines spanning the 9mers. Allowed substitutions, as determined by evolutionary conservation statistics, are listed below each of the wild-type residues. Mutations selected with the DP2 algorithm are boxed and highlighted in cyan: (A) A13D, (B) I104T, (C) T42D, and (D) L149N Those from Harding et al. are boxed and highlighted in green: (E) K21A, and (F) S324A. Epitopes that remain after the specified mutation are shown as cyan or green hatched lines, respectively. Note that the K21A mutation from Harding et al. is predicted to introduce two new epitopes: one for DRB1*0401 and one for 0101.
As described in the Methods, DP2 produced not only a global optimal design but also a ranked list of 254 near-optimal, two-mutation variants. These alternative high-scoring plans were considered further, and T42D/L149N was selected as a secondary experimental plan based on the fact that, compared with A13D/I104T, it targeted entirely different immunogenic regions of P99βL. T42D is predicted to delete the epitopes for four of six alleles recognizing cognate wild-type 9mers while L149N deletes epitopes for all four such alleles (Fig. 2c and d, respectively). While T42 is located in a loop on the surface, L149 is a largely buried residue adjacent to the active site position Y150 (Fig. 1). The active site is completely conserved among P99βL homologs. In addition, the ProPred analysis indicated that none of the active site residues serve as an anchor for epitopes of the eight MHC II alleles considered here. However, L149 is immediately adjacent to the active site and represents a predicted P1 anchor residue for several MHC II alleles. Family conservation statistics allow four different substitutions at position 149 (Fig. 2d), and asparagine is represented at a weighted frequency of 10%, compared with 33% for wild-type leucine.
We did not utilize the data of Harding et al. in our experiment planning, but for comparison we assess their K21A/S324A variant under our in silico metrics (Fig. 2e and f). Both K21A and S324A are allowed substitutions by conservation statistics, and K21A is predicted to eliminate three of four and two of four epitopes, respectively, on two overlapping 9mers. Adversely, K21A is also predicted to create two new epitopes, one for allele 0101 and one for 0401, both anchored by I16. As a result, the peptide containing K21A is predicted to remain immunogenic towards five of eight alleles, albeit a slightly different subset than the five that recognize the corresponding wild-type peptide. S324A is predicted to eliminate one epitope beginning at F322, but ProPred predicts that the mutant peptide will remain immunogenic to all four of the alleles that bind the original wild-type sequence. S324 is far from any of our sites in both sequence and structure; K21 is near our A13 target site in the primary sequence, but no predicted epitope overlaps both residues (Fig. 2a and e).
Cloning, expression and purification
Wild-type P99βL was cloned from E. cloacae, expressed in E. coli, and secreted to the periplasmic space using an N-terminal OmpA signal sequence. The final construct included a C-terminal GGGSAETVEHHHHHH affinity tag, which facilitated purification by immobilized metal affinity chromatography. Mutant P99βL constructs were created by splice overlap extension PCR using the wild-type construct as template. The constructs tested included K21A/S324A (Harding et al., 2005), A13D/I104T, T42D/L149N and the cognate single mutants of both DP2 designs.
Induction of protein expression was found to be optimal at a high OD600 (∼3.5) and at a low temperature (16°C). Initial studies with mid-log induction at 37°C yielded protein which had undergone his-tag degradation despite the use of protease inhibitors during purification (data not shown). Protein purification from optimized conditions yielded homogenous preparations of >95% purity (data not shown). This system allowed for robust and reproducible expression of P99βL enzymes, generally yielding between 8 and 40 mg protein per liter of culture after a 16 h induction.
Activity
The kinetics of the purified enzymes were analyzed using nitrocefin, a colorimetric β-lactam substrate. Results of the Michaelis–Menten kinetics analysis are provided in Table I. The parameters for the wild-type enzyme were in good agreement with prior reports (Bell and Pratt, 2002). The kinetics of the K21A/S324A double mutant benchmark, the only high-functioning construct detailed in prior deimmunization efforts (Harding et al., 2005), were statistically indistinguishable from the wild-type enzyme. The optimal DP2 design A13D/I104T also possessed wild-type kinetic parameters, and each of its component mutations yielded enzymes with wild-type activity. In contrast, the secondary T42D/L149N design exhibited a 3-fold decrease in kcat and 2-fold decrease in Km. Analysis of the corresponding individual point mutants suggested that the effects of the L149N mutation are dominant in the double mutant. In particular, both isolated mutations decreased kcat, but L149N yielded an 80% reduction as compared with only a 30% reduction for T42D. Likewise, the favorable Km reduction of the T42D/L149N double mutant was attributable solely to L149N, as the isolated T42D mutation manifested a disadvantageous 50% increase in Km relative to wild-type. These tradeoffs between kcat and Km resulted in similar nitrocefin specificity constants (kcat/Km) for T42D, L149N and the corresponding double mutant.
Table I.
P99βL kinetic parameters and apparent melting temperatures
| Enzyme | kcat (s−1) | Km (μM) | kcat/Km (s−1 μM−1) | Tm (°C) |
|---|---|---|---|---|
| Wild type | 190±10 | 33±5 | 5.7±0.2 | 56.04±00.02 |
| A13D, I104T | 190±10 | 32±4 | 5.8±0.1 | 48.74±00.03 |
| A13D | 200±10 | 34±4 | 5.9±0.1 | 56.31±00.02 |
| I104T | 190±10 | 32±5 | 5.9±0.2 | 49.23±00.03 |
| T42D, L149N | 58±4 | 19±2 | 3.1±0.1 | 50.48±00.03 |
| T42D | 130±10 | 48±3 | 2.7±0.1 | 55.35±00.03 |
| L149N | 36±9 | 15±1 | 2.3±0.3 | 51.87±00.02 |
| K21A, S324A | 220±20 | 38±4 | 5.7±0.1 | 56.06±00.03 |
Structural stability
The relative thermostabilities of the various protein designs were assessed by differential scanning fluorimetry (Niesen et al., 2007), and apparent Tm data are provided in Table I. As with the kinetic analysis, the stability of the K21A/S324A benchmark was identical to that of the wild-type enzyme. The optimal DP2 plan A13D/I104T exhibited a 7°C decrease in Tm, and analysis of the isolated point mutants traced the reduced stability to the I104T substitution. The secondary T42D/L149N design showed a similar 6°C decrease in stability, and analysis of the corresponding isolated point mutants indicated that the L149N substitution was the primary driver of this effect. While the decreased Tm values of the DP2 designs are notable compared with those of the wild-type and K21A/S324A proteins, inspection of the corresponding melting curves suggests that the two computationally designed variants exhibit negligibly small unfolded fractions at human body temperature (37°C, Supplementary Fig. S1), a point of particular relevance to therapeutic applications.
To obtain a more clinically relevant measure of the engineered proteins' stability, variants were diluted into human plasma at 37°C, and specific activity towards the nitrocefin substrate was monitored as a function of time (Fig. 3). The wild-type enzyme and the optimal A13D/I104T variant each retained ∼70% of their activity during extended incubation under biologically relevant conditions, although early time points indicate that the DP2 design is inactivated somewhat more quickly. The observed stability of the wild-type enzyme and the K21A/S324A variant are consistent with earlier studies (Harding et al., 2005), although notably, in our hands, the K21A/S324A variant was the single most stable protein. In contrast, the secondary DP2 design T42D/L149N exhibited a 60% decrease in activity by day 11. This compromised plasma stability appeared to result from a non-additive effect of the two mutations, as each of the corresponding point mutants was equally or more stable than the wild-type enzyme.
Fig. 3.
Plasma stability analysis. Enzymes were diluted into human serum at 100 µg/ml and incubated at 37°C. Specific activity with the nitrocefin substrate was quantified on days 0, 1, 3, 6 and 11. Values are normalized to 100% activity at time 0, and the dotted line indicates the lowest level of wild-type enzyme activity. Error bars represent SEM.
MHC II binding
MHC II binding assays were performed as a primary experimental measure of immunogenic potential for the wild-type and variant sequences. These assays represent a widely recognized means of validating computational predictions (Woodfolk, 2007; De Groot and Martin, 2009), and they are used here as a proxy for the success of epitope deletion. Peptides encompassing the predicted epitope sequences were synthesized and evaluated for their capacity to bind soluble DRB1*0101, 0401, 0701 and 1501 in a competition assay format. Peptide sequences and the IC50 values for each peptide/allele combination are provided in Fig. 4a and the fold-change in IC50 of engineered sequences versus wild-type are illustrated in Fig. 5. Peptides containing the wild-type A13 and I104 residues bound all four alleles with either moderate or high affinity, with the exception of I104 failing to bind DRB1*0701. Likewise, the L149 wild-type peptide bound with high affinity to all alleles. In contrast, the peptide containing wild-type T42 was a weak/non-binder of all alleles except DRB1*0101.
Fig. 4.
Peptide–MHC II binding affinities and predictive correlations. (a) Wild-type target residues and the corresponding deimmunizing mutations are noted in the top row. The sequence of the wild-type synthetic peptide used in the competition binding studies is shown below the corresponding positions, and target residues are identified in bold and underlined. IC50 values for human MHC II alleles DRB1*0101, 0401, 0701 and 1501 were determined by competition against control peptides. Strong binders are shown in dark blue (IC50 ≤ 10 μM), moderate binders in light blue (10 μM < IC50≤100 μM), and weak/non-binders in white (IC50> 100 μM). (b) ProPred prediction of peptide-MHC II binding at a 5% threshold indicated as (+), and predicted non-binders indicated as (−). Positive correlations between predictions and experimental observations are highlighted by dark shading (experimental binding threshold set at 100 μM).
Fig. 5.
Fold change in MHC II-binding affinity. The change in the MHC II-binding affinity of the engineered peptides is shown relative to their corresponding wild-type peptides. IC50 values were determined using an ELISA-based assay with soluble MHC alleles DRB1*0101 (closed black bar), 0401 (dark gray bar), 0701 (light gray bar) and 1501 (white bar). Negative values indicate that the engineered peptide exhibited a higher binding affinity than the wild-type peptide. Statistically significant changes (α = 0.05) are noted with an asterisk (*).
In general, DP2 mutations A13D and I104T significantly (α = 0.05) lowered MHC II binding affinities, with the exceptions of no change for DRB1*1501 and increased affinity of the I104T peptide for DRB1*0701. Peptides from the secondary DP2 design, containing mutations T42D and L149N, significantly lowered affinities across all alleles, with the exception of no change in binding of L149N to DRB1*0401 and 0701. Despite the substantial 18- and 48-fold decreased binding of the L149N peptide to alleles DRB1*0101 and 1501, respectively, its classification as a high-affinity binder across all alleles remained unchanged relative to the wild-type sequence. The two wild-type peptides containing either K21 or S324 are moderate to high-affinity ligands across all four MHC alleles tested. Notably, neither the K21A nor the S324A mutations from Harding et al. decreased MHC affinity for any allele, and in fact, these mutations generally increased binding affinity by a significant degree (α = 0.05). It should be noted that these mutations were selected based on reduced proliferation of human immune cells, which might be considered a gold standard for preclinical immunogenicity testing. That said, the blood donors used in the experimental mapping of the P99βL protein were not typed for MHC II allele status (Harding et al., 2005). Therefore it remains unknown exactly which alleles might have been represented, which might have been overrepresented, and which might have been completely absent from the donor cohorts.
To assess concordance of ProPred predictions with binding data, each peptide/allele combination was classified as either a true or false positive or as a true or false negative (Fig. 4b). With ProPred predictions set at a 5% threshold and binding set at IC50< 100 μM, the overall false-positive rate is 12.5% and false-negative rate 66%. The A13 and I104 peptides bound all alleles as predicted, with the exception of I104 binding to DRB1*0401. Binding predictions for mutations at these positions were borne out, with the exception of the A13D peptide, which bound DRB1*0701 and 1501 despite negative predictions. Notably, however, the IC50 for A13D binding DRB1*0701 was increased 60-fold to a value of 70 μM, and thus prediction of a deimmunzing effect may not be entirely unfounded. In general, predictions were confirmed for the wild-type T42 and L149 peptides; unexpectedly, however, the T42 peptide did not bind DRB1*0701 nor 1501. The T42D and L149N mutations were predicted to disrupt MHC II binding across all alleles tested. This correlated with the engineered T42D peptide evading binding to DRB1*0401, 0701 and 1501 in practice, but it was found to bind DRB1*0101 with high affinity. As noted above, the engineered L149N peptide proved to be a high-affinity binder with all alleles tested. With regard to the Harding et al. targets, though the K21 and S324 peptides and their alanine variants are not predicted to bind either DRB1*0701 or 1501, all bound. Thus, binding results, not ProPred predictions, suggest that peptides encompassing K21 and S324 are good targets for deletion of DRB1*0701 and 1501 epitopes, and it is possible that adjacent mutations predicted to disrupt binding to other alleles (Fig. 2e and f) might fortuitously mitigate DRB1*0701 and 1501 binding. Regardless, it is apparent that alanine substitutions do not adequately disrupt interaction with these two MHC II alleles. Finally, predictions of S324 binding to DRB1*0101 and 0401 and K21 binding to 0401 were positively confirmed, and as predicted, both of the respective alanine mutants bound DRB1*0101 and 0401.
Discussion
The literature provides numerous examples of protein deimmunization via T-cell epitope deletion. For example, experimental identification and subsequent disruption of T-cell epitopes has produced less immunogenic variants of staphylokinase (Warmerdam et al., 2002), erythropoietin (Tangri et al., 2005), factor VIII (Jones et al., 2005) and P99βL (Harding et al., 2005). Experimental characterization of a protein's T-cell epitope profile is, however, expensive in terms of both time and resources. Furthermore, identification of mutations that simultaneously deimmunize and preserve function is inherently complex. While both computational epitope prediction and stability evaluation tools are routinely employed by protein engineers (Polizzi et al., 2006; Koren et al., 2007; Jochens et al., 2010; Cantor et al., 2011; Moise et al., 2012), to date such tools have not been integrated to solve the multi-objective immunogenicity and stability/activity problem.
Here, we describe the first experimental application of our recently developed DP2 deimmunization methodology (Parker et al., 2010). In the interest of benchmarking our results against previous experimental efforts (Harding et al., 2005), we chose P99βL as a model system. Our objective was the efficient design and construction of enzyme variants exhibiting good catalytic proficiency, high-level stability and reduced epitope content. We applied the DP2 algorithm to the P99βL target and selected two protein designs: the globally optimal double mutant A13D/I104T and the secondary T42D/L149N design. To more clearly define the resulting structure–activity relationships, all four corresponding single mutants were also produced.
In each of the double mutant DP2 designs, a hydrophobic T-cell epitope anchor residue was targeted for mutation (I104T and L149N, respectively). The I104T substitution caused a 7°C decrease in apparent melting temperature, and the L149N substitution a 4°C decrease. In the case of the T42D/L149N design, the loss of thermostability correlated with a significant reduction in stability during long-term incubation in human plasma. The native L149 is close-packed (∼10% solvent accessible surface area) at the center of a relatively hydrophobic pocket ringed by G116, P118, L119, W142, P295 and L293. Thus, the decreased stability of the double mutant might be rationalized in part by unfavorable energetics resulting from substitution of a highly polar asparagine into this nonpolar environment. It should be emphasized, however, that decreased serum stability was only observed in the context of the T42D/L149N double mutant, suggesting a cooperative destabilizing effect of the two mutations. In contrast, the globally optimal DP2 design A13D/I104T exhibited 11-day plasma stability similar to wild-type P99βL, although its initial rate of inactivation may be somewhat faster than wild-type.
Notably, the K21A/S324A benchmark variant exhibited the highest level stability of any protein tested. In retrospect, this outcome is not unexpected as the DP2 algorithm predicts that both mutations are allowed by conservation analysis. More importantly, and as described in the introduction, this particular variant was the single best protein generated during an extensive and costly deimmunization effort that experimentally tested a large number of designs prior to focusing efforts on the most promising enzyme, K21A/S324A. Given this context, it bears noting that the DP2 designs tested here were the only two computational designs that were experimentally evaluated. Thus, we conclude that there is likely a beneficial tradeoff between moderately decreased protein stability, as observed with our designs, yet radically reduced time/effort to generate deimmunized candidates, via DP2. Certainly, it would be desirable to incorporate more accurate models of protein stability into the deimmunization algorithm, and ongoing efforts are indeed driving the continued evolution of our computational methods (Parker et al., 2011, 2012).
In contrast to the relatively low functional ‘hit rate’ of trial and error deimmunization methodologies, both DP2 designs retained comparatively high catalytic activity. In particular, the activity of the optimal A13D/I104T design was indistinguishable from wild-type, as were the activities of the corresponding individual mutants. Our secondary T42D/L149N design exhibited a 3-fold reduction in kcat, and experiments with the constituent point mutants traced this effect to the L149N substitution. Inspection of the enzyme's crystal structure shows that L149 is located immediately adjacent to Y150, a central residue in the charge relay system that deprotonates the S64 nucleophile (Goldberg et al., 2003) (Fig. 1). In general, active sites and buried hydrophobic residues have a low tolerance for mutation (Guo et al., 2004). Therefore, the reduced activity of T42D/L149N is not entirely surprising. Nonetheless, this variant accelerates nitrocefin hydrolysis by more than 106-fold relative to the uncatalyzed reaction (uncatalyzed pseudo-first order rate constant ≈4 × 10−5 s−1, Osipovitch unpublished results), and from a purely biochemical stand point, T42D/L149N is a very respectable catalyst. Overall, the fact that designs containing the hydrophobic-to-polar substitutions L149N, adjacent to a key active site residue, and I104T, a completely buried residue, retained reasonable levels of activity underscores our algorithm's capacity for identifying deimmunizing mutations that are non-intuitive yet high-functioning. Such an outcome can only be guaranteed by integrated optimization of immunogenicity and stability/activity.
While catalytic proficiency and structural stability were important design constraints for our engineered enzymes, we ultimately sought variants having reduced T-cell epitope content. As an immunological measure of performance, we employed quantitative MHC II-peptide binding assays, and we set a relatively stringent requirement that peptide-MHC II IC50 values should be increased above 100 μM for a mutation to qualify as ‘fully deimmunizing’. By this metric, our DP2 designs significantly outperformed both the wild-type enzyme and the previously generated K21A/S324A double mutant (Harding et al., 2005). In particular, our optimal A13D/I104T mutations successfully eliminated binding of the cognate peptides to the DRB1*0101 and 0401 alleles, and we speculate that the full-length variant protein would benefit from reduced immunogenicity in human patients.
It is worth noting that while the A13D mutation significantly decreased the binding affinity of its cognate peptide for the DRB1*0701 allele, the I104T mutation increased DRB1*0701 binding affinity. In the latter case, we emphasize that the wild-type I104 peptide itself is a moderate binder of this allele, and therefore the I104T mutation did not introduce a new epitope, but rather simply failed to eliminate a putative epitope that was already present in the wild-type sequence. On a global scale, failure to delete a single epitope for one MHC II allele does not preclude a successful deimmunization outcome, i.e. reduction or prevention of anti-drug antibodies, provided deletion of other epitopes lowers immunogenicity below a biologically relevant threshold (Yeung et al., 2004; Harding et al., 2005). Moreover, and importantly, the DP2 algorithm does not include a quantitative predictor of peptide–MHC II binding affinity, but rather the algorithm assesses binding in a binary yes/no fashion based on a user-supplied false positive rate (5% in this case). Thus, the algorithm accurately predicted the fact that the I104T mutation would not eliminate binding to the DRB1*0701 allele (Fig. 4b), and consequently the relative affinities of the wild-type and mutant 104 peptides were irrelevant to the optimization calculations. In the future, quantitative predictors of peptide–MHC II binding affinity could be incorporated into the deimmunization algorithm, thereby accounting for relative changes in binding and rendering the methods less sensitive to threshold effects.
In examining the immunological performance of the secondary DP2 design, it was found that the T42D and L149N mutations failed to completely eliminate MHC II binding as per our stringent threshold of IC50> 100 μM. However, the T42D mutation decreased the affinity of its cognate peptides for all four MHC II alleles, and the L149N mutation significantly decreased peptide binding affinity for two of four alleles. Notably, the L149 containing wild-type peptide exhibited the highest binding affinity of any tested peptide for alleles DRB1*0101 and 1501, and the second highest binding affinity towards alleles DRB1*0401 and 0701. The L149-containing peptide may therefore represent a highly immunogenic epitope, and mitigating the binding affinity of this peptide could ultimately prove important for clinical applications. Indeed, Harding et al. had also identified L149 as a potentially productive target site for deimmunization, but their stability analyses on crude enzyme preparations suggested that alanine substitution at this site resulted in unacceptably low stability (80% reduction by their measures) (Harding et al., 2005). To effectively target this immunogenic region while avoiding inadvertent introduction of new epitopes, DP2 selected the less conservative but functional L149N substitution, which, while failing to eliminate MHC II binding of cognate peptide, proved to reduce binding affinity to the DRB1*0101 and 1501 alleles by 18-fold and 50-fold, respectively. It remains to be seen whether or not these significantly decreased affinities are sufficiently disruptive to inhibit T-cell stimulation.
Conclusion
The underlying premise of the DP2 algorithm represents a paradigm shift for biotherapeutic deimmunization strategies. It formalizes the deimmunization problem and combines epitope prediction and stability estimation within a powerful computational framework for therapeutic protein design. DP2 and more advanced implementations (Parker et al., 2011, 2012) are the first and, currently, only computational tools with the capacity to simultaneously optimize protein sequences for both low immunogenicity and high stability and activity. In contrast to serial analysis of immunogenicity then stability, the integrated nature and mathematical correctness of our dynamic programming algorithm guarantees identification of optimal protein designs with respect to the predictors. Moreover, DP2 finds secondary variants in rank order, allowing for the elucidation of alternative molecular solutions and trends among high-scoring plans. In stark contrast to laborious trial-and-error deimmunization strategies, our methodology benefits from unprecedented speed and robust efficacy, as shown by the enhanced performance of both P99βL designs tested in this work. Importantly, the modular nature of DP2 allows easy extensibility to new state-of-the-art predictors, and the continuing evolution of prediction tools will only enhance the algorithm's functionality as opposed to driving its obsolescence. Because our algorithms are applicable to virtually any protein sequence, we anticipate that they will find broad utility in the growing field of therapeutic protein development.
Supplementary data
Supplementary data are available at PEDS online.
Acknowledgements
The authors would like to thank Dr Yingda Xu for assistance with mass spectral analysis of protein samples.
Funding
This work was supported by the National Institutes of Health [1 R01 GM 989771–01 to C.B.K. and K.E.G. and P20R R01 8787 to K.E.G.], the National Science Foundation [IIS-1017231 to C.B.K.] and the Neukom Institute for Computational Science [CompX Faculty Award to C.B.K. and K.E.G.].
References
- Aggarwal S. Nat. Biotechnol. 2011;29:1083–1089. doi: 10.1038/nbt.2060. [DOI] [PubMed] [Google Scholar]
- Alderson R.F., Toki B.E., Roberge M, et al. Bioconjug. Chem. 2006;17:410–418. doi: 10.1021/bc0503521. [DOI] [PubMed] [Google Scholar]
- Almagro J.C., Fransson J. Front. Biosci. 2008;13:1619–1633. doi: 10.2741/2786. [DOI] [PubMed] [Google Scholar]
- Amin N., Liu A.D., Ramer S., Aehle W., Meijer D., Metin M., Wong S., Gualfetti P., Schellenberger V. Protein Eng. Des. Sel. 2004;17:787–793. doi: 10.1093/protein/gzh091. [DOI] [PubMed] [Google Scholar]
- Bagshawe K.D. Curr. Drug Targets. 2009;10:152–157. doi: 10.2174/138945009787354520. [DOI] [PubMed] [Google Scholar]
- Bell J.H., Pratt R.F. Biochemistry. 2002;41:4329–4338. doi: 10.1021/bi012096v. [DOI] [PubMed] [Google Scholar]
- Cantor J.R., Yoo T.H., Dixit A., Iverson B.L., Forsthuber T.G., Georgiou G. Proc. Natil Acad. Sci. USA. 2011;108:1272–1277. doi: 10.1073/pnas.1014739108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- De Groot A.S., Knopp P.M., Martin W. Dev. Biol. (Basel) 2005;122:171–194. [PubMed] [Google Scholar]
- De Groot A.S., Martin W. Clin. Immunol. 2009;131:189–201. doi: 10.1016/j.clim.2009.01.009. [DOI] [PubMed] [Google Scholar]
- De Groot A.S., Scott D.W. Trends Immunol. 2007;28:482–490. doi: 10.1016/j.it.2007.07.011. [DOI] [PubMed] [Google Scholar]
- Dinglasan R., Kalume D., Kanzok S., Ghosh A., Muratova O., Pandey A., Jacobs-Lorena M. Proc Natl Acad Sci USA. 2007;104:13461–13466. doi: 10.1073/pnas.0702239104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gerstein M., Sonnhammer E., Chothia C. J. Mol. Biol. 1994;236:1067–1078. doi: 10.1016/0022-2836(94)90012-4. [DOI] [PubMed] [Google Scholar]
- Giezen T.J., Mantel-Teeuwisse A.K., Straus S.M.J.M., Schellekens H., Leufkens H.G.M., Egberts A.C.G. JAMA. 2008;300:1887–1896. doi: 10.1001/jama.300.16.1887. [DOI] [PubMed] [Google Scholar]
- Goldberg S.D., Iannuccilli W., Nguyen T., Ju J.Y., Cornish V.W. Protein Sci. 2003;12:1633–1645. doi: 10.1110/ps.0302903. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Guerois R., Nielsen J.E., Serrano L. J. Mol. Biol. 2002;320:369–387. doi: 10.1016/S0022-2836(02)00442-4. [DOI] [PubMed] [Google Scholar]
- Guo H.H., Choe J., Loeb L.A. Proc. Natl Acad. Sci.USA. 2004;101:9205–9210. doi: 10.1073/pnas.0403255101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Harding F.A., Liu A.D., Stickler M., et al. Mol. Cancer Ther. 2005;4:1791–1800. doi: 10.1158/1535-7163.MCT-05-0189. [DOI] [PubMed] [Google Scholar]
- Jochens H., Aerts D., Bornscheuer U.T. Protein Eng. Des. Sel. 2010;23:903–909. doi: 10.1093/protein/gzq071. [DOI] [PubMed] [Google Scholar]
- Jones T.D., Phillips W.J., Smith B.J., Bamford C.A., Nayee P.D., Baglin T.P., Gaston J.S.H., Baker M.P. J. Thromb. Haemost. 2005;3:991–1000. doi: 10.1111/j.1538-7836.2005.01309.x. [DOI] [PubMed] [Google Scholar]
- Klyushnenkova E., Kouiavskaia D., Kodak J., Vandenbark A., Alexander R. Prostate. 2007;67:1019–1028. doi: 10.1002/pros.20575. [DOI] [PubMed] [Google Scholar]
- Koren E., De Groot A.S., Jawa V., et al. Clin. Immunol. 2007;124:26–32. doi: 10.1016/j.clim.2007.03.544. [DOI] [PubMed] [Google Scholar]
- Malherbe L. Ann. Allergy Asthma Immunol. 2009;103:76–79. doi: 10.1016/S1081-1206(10)60147-0. [DOI] [PubMed] [Google Scholar]
- Moise L., Song C., Martin W.D., Tassone R., De Groot A.S., Scott D.W. Clin. Immunol. 2012;142:320–331. doi: 10.1016/j.clim.2011.11.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mustafa A., Shaban F. Tuberculosis (Edinb) 2006;86:115–124. doi: 10.1016/j.tube.2005.05.001. [DOI] [PubMed] [Google Scholar]
- Nielsen M., Lundegaard C., Lund O. BMC Bioinformatics. 2007;8:238. doi: 10.1186/1471-2105-8-238. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Niesen F.H., Berglund H., Vedadi M. Nat. Protoc. 2007;2:2212–2221. doi: 10.1038/nprot.2007.321. [DOI] [PubMed] [Google Scholar]
- Parker A.S., Griswold K.E., Bailey-Kellogg C. J. Bioinform. Comput. Biol. 2011;9:207–229. doi: 10.1142/s0219720011005471. [DOI] [PubMed] [Google Scholar]
- Parker A.S., Griswold K.E., Bailey-Kellogg C. Lect. Notes Comput. Sci. 2012;7262:184–198. [Google Scholar]
- Parker A.S., Zheng W., Griswold K.E., Bailey-Kellogg C. BMC Bioinformatics. 2010;11:180. doi: 10.1186/1471-2105-11-180. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Polizzi K.M., Chaparro-Riggers J.F., Vazquez-Figueroa E., Bommarius A.S. Biotechnol. J. 2006;1:531–536. doi: 10.1002/biot.200600029. [DOI] [PubMed] [Google Scholar]
- Schellekens H. Nat. Rev. Drug Discov. 2002a;1:457–462. doi: 10.1038/nrd818. [DOI] [PubMed] [Google Scholar]
- Schellekens H. Clin. Ther. 2002b;24:1720–1740. doi: 10.1016/s0149-2918(02)80075-3. [DOI] [PubMed] [Google Scholar]
- Schellmann N., Deckert P.M., Bachran D., Fuchs H., Bachran C. Mini Rev. Med. Chem. 2010;10:887–904. doi: 10.2174/138955710792007196. [DOI] [PubMed] [Google Scholar]
- Singh H., Raghava G.P.S. Bioinformatics. 2001;17:1236–1237. doi: 10.1093/bioinformatics/17.12.1236. [DOI] [PubMed] [Google Scholar]
- Southwood S., Sidney J., Kondo A., et al. J. Immunol. 1998;160:3363–3373. [PubMed] [Google Scholar]
- Steere A.C., Klitz W., Drouin E.E., Falk B.A., Kwok W.W., Nepom G.T., Baxter-Lowe L.A., et al. J. Exp. Med. 2006;203:961–971. doi: 10.1084/jem.20052471. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sturniolo T., Bono E., Ding J., et al. Nat. Biotechnol. 1999;17:555–561. doi: 10.1038/9858. [DOI] [PubMed] [Google Scholar]
- Tangri S., Mothe B.R., Eisenbraun J., et al. J. Immunol. 2005;174:3187–3196. doi: 10.4049/jimmunol.174.6.3187. [DOI] [PubMed] [Google Scholar]
- Thompson J.D., Higgins D.G., Gibson T.J. Nucleic Acids Res. 1994;22:4673–4680. doi: 10.1093/nar/22.22.4673. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Trombetta E.S., Mellman I. Annu. Rev. Immunol. 2005;23:975–1028. doi: 10.1146/annurev.immunol.22.012703.104538. [DOI] [PubMed] [Google Scholar]
- Wang P., Sidney J., Dow C., Mothe B., Sette A., Peters B. PLoS Comput. Biol. 2008;4:e1000048. doi: 10.1371/journal.pcbi.1000048. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Warmerdam P.A.M., Vanderlick K., Vandervoort P., De Smedt H., Plaisance S., De Maeyer M., Collen D. J. Immunol. 2002;168:155–161. doi: 10.4049/jimmunol.168.1.155. [DOI] [PubMed] [Google Scholar]
- Woodfolk J.A. J. Allergy Clin. Immunol. 2007;119:280–294. doi: 10.1016/j.jaci.2006.11.008. [DOI] [PubMed] [Google Scholar]
- Yeung V.P., Chang J., Miller J., Barnett C., Stickler M., Harding F.A. J. Immunol. 2004;172:6658–6665. doi: 10.4049/jimmunol.172.11.6658. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.




