AI Agents Outperform Expert Chemists at Predicting Molecular Binding Poses
Biology

AI Agents Outperform Expert Chemists at Predicting Molecular Binding Poses

New benchmarks reveal human experts score near random chance on complex protein-ligand structures, while language model agents achieve up to 74 percent accuracy.

By Hassan Raza
Published:
Email this Article
AI Agents Outperform Expert Chemists at Predicting Molecular Binding Poses
GRPO training dynamics for PyriteReasoner (A) Train accuracy for four ablations across training steps (error bars are ±SEM) (B) Post-AF3 per-pair accuracy for four ablations across training steps in comparison with human experts (C) Post-AF3 per-pair accuracy for only the PyriteRep w/o 3D coordinates ablation, split by whether MM-GBSA picks incorrect pose. (D) Post-AF3 per-pair accuracy for only the PyriteRep w/o 3D coordinates ablation, split by whether Mogul # Unusual Torsions picks incorrect pose. Bottom Rows Example reasoning outputs from PyriteRep w/o 3D coordinates ablation over the course GRPO steps. Megha Srivastava et al. / arXiv

Predicting how small drug molecules bind to target proteins remains a central bottleneck in drug discovery, and new tests reveal that even expert human chemists struggle to identify the most accurate atomic binding poses. Modern artificial intelligence cofolding models can rapidly generate thousands of plausible 3D binding configurations, but sorting through these high-quality candidates to find the true structure presents a severe challenge. Traditional physics-based scoring functions often fail in these refined evaluation spaces, sometimes actively opposing true molecular stability.

To address this evaluation gap, a research team introduced a specialized pairwise benchmark featuring 1,500 distinct pose pairs across 285 protein and ligand structures. The study, published on the arXiv preprint server by Megha Srivastava and colleagues at Stanford University and Genesis Molecular AI, examines whether advanced language model agents can successfully interpret complex molecular geometry and computational chemistry signals.

Why Expert Chemists Perform Near Random Chance on Pose Ranking

When five expert chemists with an average of more than 10 years of experience in computer-aided drug discovery evaluated the benchmark pairs, their accuracy hovered around 42 to 45 percent, performing below or near random chance. The human evaluators frequently relied on standard physics metrics like MM-GBSA binding energy, which estimates thermodynamic stability. However, because the generated poses all represent high-quality candidates, lower energy scores proved anti-correlated with actual correctness.

Figure 1: Interface for human expert annotations on our pairwise pose ranking benchmark Pyrite (ground truth crystal shown only for paper visualization). The example shows two predicted poses of a potential small-molecule inhibitor of the autotaxin protein (Protein Data Bank 7G63), with toggle control for 2D contact map and interactive 3D and overlay views. Experts are asked to select which pose is closer to the crystallographic binding mode (selecting 1-5), write factors in favor of both pose A and B, and describe their reasoning on how they weigh these factors for pose selection. Annotators are also provided MM-GBSA scores and the # of unusual torsions using Mogul for each pose.
Interface for human expert annotations on our pairwise pose ranking benchmark Pyrite (ground truth crystal shown only for paper visualization). The example shows two predicted poses of a potential small-molecule inhibitor of the autotaxin protein (Protein Data Bank 7G63), with toggle control for 2D contact map and interactive 3D and overlay views. Experts are asked to select which pose is closer to the crystallographic binding mode (selecting 1-5), write factors in favor of both pose A and B, and describe their reasoning on how they weigh these factors for pose selection. Annotators are also provided MM-GBSA scores and the # of unusual torsions using Mogul for each pose. Credit: Megha Srivastava et al. / arXiv

The authors suggest that cofolding models produce subtle geometric differences that defy traditional intuition. While human inter-annotator agreement reached 77 percent, conventional chemical heuristics frequently misled the experts when distinguishing between highly refined structural decoys.

How Structured Repositories and Language Agents Change the Equation

To test automated solutions, the researchers developed PyriteRep, a structured data format containing 29 features that describe molecular geometry, atomic interactions, and torsional strain. Feeding this structured data into language models substantially improved performance compared to raw 3D coordinates alone.

Figure 3: Human experts vs. models performance on post-AF3 curated split. (A) Accuracy for experts and a subset of ranking methods, split by Easy and Hard pairs. Error bars are 95% CIs. (B) Average accuracy across experts and two PyriteReasoner agents grouped by factors driving the reasoning for a given pair selection. (C) Rate at which experts and and two PyriteReasoner agents reference protein-family and domain knowledge in their reasoning output.
Human experts vs. models performance on post-AF3 curated split. (A) Accuracy for experts and a subset of ranking methods, split by Easy and Hard pairs. Error bars are 95% CIs. (B) Average accuracy across experts and two PyriteReasoner agents grouped by factors driving the reasoning for a given pair selection. (C) Rate at which experts and and two PyriteReasoner agents reference protein-family and domain knowledge in their reasoning output. Credit: Megha Srivastava et al. / arXiv

The team created two primary AI agents. The first, PyriteReasoner, directly compares pose pairs through explicit text-based reasoning, achieving up to 67 percent accuracy. The second, PyriteFeaturizer, acts as a coding agent that writes Python scripts to discover predictive structural features for a simple logistic regression classifier. Combined with reinforcement learning via Group Relative Policy Optimization, the featurizer approach reached up to 74 percent accuracy on evaluation splits.

What This Means for Future Computational Drug Discovery

The findings indicate that large language models excel when used to discover structural features and write quantitative code rather than making isolated text judgments. By avoiding the cognitive biases that trip up human experts, these automated agents offer a promising pathway toward reliable pose ranking. The authors note that closing the remaining accuracy gap will require larger training sets and broader testing across diverse generative frameworks to ensure these ranking pipelines translate smoothly into real-world therapeutic development.

The study was posted to the arXiv preprint server on November 10, 2026.

Fact Checked

This article has been fact checked for accuracy, with information verified against reputable sources. Learn more about us and our editorial process.

Last reviewed on .

Article history

  • Latest version

Reference(s)

  1. Srivastava, Megha. “Pyrite: Building and Benchmarking Protein-Ligand Pose Ranking Agents.” arXiv.org <http://arxiv.org/abs/2611.14511v1>.

Cite this page:

Raza, Hassan. “AI Agents Outperform Expert Chemists at Predicting Molecular Binding Poses.” BioScience. BioScience ISSN 2521-5760, 11 November 2026. <https://www.bioscience.com.pk/en/subject/biology/pyrite-building-and-benchmarking-protein-ligand-pose-ranking-agents>. Raza, H. (2026, November 11). “AI Agents Outperform Expert Chemists at Predicting Molecular Binding Poses.” BioScience. ISSN 2521-5760. Retrieved November 11, 2026 from https://www.bioscience.com.pk/en/subject/biology/pyrite-building-and-benchmarking-protein-ligand-pose-ranking-agents Raza, Hassan. “AI Agents Outperform Expert Chemists at Predicting Molecular Binding Poses.” BioScience. ISSN 2521-5760. https://www.bioscience.com.pk/en/subject/biology/pyrite-building-and-benchmarking-protein-ligand-pose-ranking-agents (accessed November 11, 2026).
End of the article