Research

Learning the language of life

Just as a revolution has occurred in natural language models from unsupervised representation learning on large corpuses of text, biomolecular foundation models trained on protein sequences and structures have emerged as a workhorse technology in molecular machine learning. The lab trains biological foundation models, and builds on them for predicting molecular properties ranging from structural dynamics to high-level function.

Unsupervised learning on proteins leads to rich representations.

Specifically, we are focused on accessible and efficient use of these foundation models. We have developed methods for parameter-efficient fine-tuning of protein langauge models, and consistently scaling model representations via reverse distillation.

Reverse distillation of language model embeddings.

The lab is currently pursuing advances in multi-modal foundation models, and seeks to develop new methods for pre-training and fine-tuning these models to address diverse biomolecular tasks.

Related publications

Modeling dynamic allostery

Nearly all proteins exhibit some dynamic behavior, adopting an ensemble of structures rather than a single, fixed structure. These dynamics can offer hints to their function, as a shift in conformation often indicates a change in functional state. Specifically, our lab is interested in allosterically mediated interactions, where binding at an off-target site (red, below) induces a conformational change that allows or accelerates binding at a primary site (blue, below).

Cartoon schematic of allosterically induced binding.

We’ve developed methods for sequence- and structure-based prediction of allosteric networks in proteins, where we can identify subsets of residues that exhibit correlated motion. The lab is working on developing methods to predict binding-induced conformational change, and to improve prediction of protein interactions by conditioning on conformational ensembles and allosteric modulators.

Allosteric network and communities constructed from predicted correlations in KRAS residue dynamics.

Related publications

Predicting molecular interactions

Interactions are the fundamental unit of cellular function. Nearly all molecular function is mediated through protein interactions, yet protein interaction networks remain incomplete and methods for interaction prediction struggle to generalize broadly.

Schematic of MINT, predicting PPI directly in a language model.

We specialize in developing machine learning methods for high-throughput and accurate protein interaction prediction, and have found success using protein language models and other unsupervised representation methods for this task. Towards this end, we have developed interpretable deep learning models and interaction language models that directly build interaction into the pre-training stage. We aim to push the frontier of these models in terms of throughput, interpretability, and accuracy.

Cartoon of different interaction networks in different tissues.

Interaction networks are not necessarily the same in every tissue or cell type. The proteins present, and the interactions they participate in, can vary with cellular context. The lab is currently interested in combining sequence-based interaction predictions with tissue- and cell-type information to distinguish shared interactions from context-specific ones, and to better understand how cellular functions differ across diverse cellular settings.

Related publications

Investigating function in diverse organisms

The vast majority of known functional data exists in human and a few of the best-studied model organisms. We have previously shown that models trained on human PPIs enable prediction of interactions in non-model species, and we have developed a multi-stage workflow for detecting clusters of related functional proteins in diverse species. We are broadly interested in developing new methods for remote homology detection, molecular function annotation, and interaction network alignment and clustering.

Bar chart comparing interaction counts across twelve organisms from BioGRID 2010 to 2023.

We are currently seeking to expand the coverage of systems function in non-model organisms with the Philharmonic Atlas, and to partner with biologists for deep-dive investigations into discovering new molecular function using our lab’s tools. We are particularly interested in studying membrane receptors, signaling pathways, and host-symbiont or host-pathogen interactions.

Sam with a coral P. damicornis

Related publications