AI Model Predicts Molecular Interactions at Scale
Biology

AI Model Predicts Molecular Interactions at Scale

Trained on 3.2 trillion tokens, Bonbon reveals emergent biological capabilities and discovers novel drug candidates across nine disease targets.

By Priya Sharma
Published:
Email this Article
AI Model Predicts Molecular Interactions at Scale
Predictive accuracy and throughput. (a) Binding affinity prediction (Pearson rr) on CASP16, FEP+4, and OpenFE. (b) MF-PCBA AUPR. (c) MF-PCBA enrichment factor across thresholds. (d) LIT-PCBA-AF3 enrichment factor at 1%. (e) Inference throughput: pairs evaluated per hour on a single H100, compared to co-folding and docking methods. Adi Mashiach / arXiv

Proteins and small molecules interact in complex ways that researchers can now predict much faster using a newly developed artificial intelligence system called Bonbon. Trained on approximately 3.2 trillion tokens of paired protein and ligand sequences, this transformer-based model discovers hidden biological rules without requiring structural 3D coordinates or task-specific supervision during pretraining.

How a Data-Heavy Scaling Regime Unlocks Hidden Interaction Rules

To overcome the inherent information sparsity of paired biological interaction data, the model was built using a parameter-to-token ratio of 1:2,000, which is significantly more data-heavy than standard natural language models. Controlled scaling experiments across six model sizes, ranging from 42 million to 1.6 billion parameters, revealed that pretraining loss decreases smoothly with computing power while complex biological capabilities appear suddenly at the largest scale. As described in the study published on arXiv, the 1.6 billion parameter configuration crosses a critical threshold where high-level interaction features abruptly emerge.

What Are the Three Hierarchical Levels of Resolution Discovered by the Model?

From a single shared representation space, the system exhibits three distinct zero-shot emergent capabilities that operate at different levels of biological resolution. At the functional level, it predicts the mechanism of action across six classes, accurately distinguishing between agonists and antagonists on the same receptor. At the residue level, attention weights correlate linearly with ligand proximity, allowing the software to pinpoint binding sites even on challenging targets like G protein-coupled receptors and transporters that lack well-defined cavities. At the bond level, dense representations distinguish between covalent and non-covalent engagement and successfully localize reactive residues.

Figure 1: Capability emergence at scale. Controlled scaling experiment across six model scales (42M, 315M, 800M, 1B, 1.3B, 1.6B parameters) under identical conditions except parameter count. Panels (b) to (e) use log FLOPs as the x-axis. (a) UMAP projections (visualization only) of frozen interaction representations at each scale, colored by mechanism-of-action class. (b) Pretraining loss vs. training FLOPs. (c) Six-class mechanism-of-action macro precision from a parameter-free signature, mean over ten evaluation splits. (d) Zero-shot orthosteric vs. allosteric AUROC on 6,032 OOD complexes. Morgan fingerprint baseline shown dashed. (e) Zero-shot covalent vs. non-covalent AUROC on the OOD complexes in which neither class carries a detectable electrophilic warhead. All capability evaluations use parameter-free signatures derived from frozen representations and applied unchanged across scales.
Capability emergence at scale. Controlled scaling experiment across six model scales (42M, 315M, 800M, 1B, 1.3B, 1.6B parameters) under identical conditions except parameter count. Panels (b) to (e) use log FLOPs as the x-axis. (a) UMAP projections (visualization only) of frozen interaction representations at each scale, colored by mechanism-of-action class. (b) Pretraining loss vs. training FLOPs. (c) Six-class mechanism-of-action macro precision from a parameter-free signature, mean over ten evaluation splits. (d) Zero-shot orthosteric vs. allosteric AUROC on 6,032 OOD complexes. Morgan fingerprint baseline shown dashed. (e) Zero-shot covalent vs. non-covalent AUROC on the OOD complexes in which neither class carries a detectable electrophilic warhead. All capability evaluations use parameter-free signatures derived from frozen representations and applied unchanged across scales. Credit: Adi Mashiach / arXiv

How Fast Is the New System Compared to Traditional Methods?

Beyond theoretical capabilities, these frozen representations transfer directly to standard computational benchmarks for binary binding and affinity prediction. When processing molecular pairs on a single NVIDIA H100 graphics processing unit, the system operates at speeds up to 42,500 pairs per second with cached representations, making it approximately five orders of magnitude faster than traditional co-folding or physics-based simulation tools.

What Were the Results of Wet-Lab Validations Across Nine Disease Targets?

To test real-world utility, the authors evaluated compounds generated de novo against nine diverse disease targets spanning seven protein families, including targets completely absent from the training data. Prospective biochemical assays confirmed active inhibitors for all nine targets, yielding dose-response hit rates and identifying novel chemical structures with low Tanimoto similarity to known drugs. These findings demonstrate that large-scale sequence models can extract the functional grammar of molecular interactions directly from unlabeled biological data.

The study was posted to the arXiv preprint server on November 10, 2026.

Fact Checked

This article has been fact checked for accuracy, with information verified against reputable sources. Learn more about us and our editorial process.

Last reviewed on .

Article history

  • Latest version

Reference(s)

  1. Mashiach, Adi. “Emergent Biological Capabilities in a Foundation Model for Molecular Interactions.” arXiv.org <http://arxiv.org/abs/2611.14504v1>.

Cite this page:

Sharma, Priya. “AI Model Predicts Molecular Interactions at Scale.” BioScience. BioScience ISSN 2521-5760, 11 November 2026. <https://www.bioscience.com.pk/en/subject/biology/emergent-biological-capabilities-in-a-foundation-model-for-molecular-interactions>. Sharma, P. (2026, November 11). “AI Model Predicts Molecular Interactions at Scale.” BioScience. ISSN 2521-5760. Retrieved November 11, 2026 from https://www.bioscience.com.pk/en/subject/biology/emergent-biological-capabilities-in-a-foundation-model-for-molecular-interactions Sharma, Priya. “AI Model Predicts Molecular Interactions at Scale.” BioScience. ISSN 2521-5760. https://www.bioscience.com.pk/en/subject/biology/emergent-biological-capabilities-in-a-foundation-model-for-molecular-interactions (accessed November 11, 2026).
End of the article