Figure 2.
Embeddings outperformed MSA-based predictions. Comparison of performance between bindPredictML175 using multiple sequence alignments (MSAs) and the method introduced here, bindEmbed21DL, using only embeddings from ProtT528. We also compare using binding annotations from BioLiP9 or the PDB31. bindEmbed21DL (embeddings-only) clearly outperformed bindPredictML17 (MSA + BioLiP) by 13 percentage points (F1 = 47 ± 2% vs. F1 = 34 ± 2%). We used annotations from BioLiP9 to assess the performance for both methods. Although bindPredictML17 had been trained on annotations from PDB31 for enzymes and PDIdb57 for DNA-binding proteins, it reached higher performance (lighter shaded colors vs. lightest shaded colors) for BioLiP annotations. Error bars indicate 95% CIs.
