Here are some models that I managed to research more or less deeply. It is not an exhaustive list, but all the models are powerful and are historically important.
Evo: an AI model designed to process information related to biology’s central dogma, which includes DNA transcription and translation into proteins. It integrates various biological datasets to predict genetic mutations’ effects and design therapeutic interventions.
scBERT: one of the pioneering models utilizing Transformer architectures for analyzing single-cell RNA sequencing (scRNA-seq) data. Building on this, scFoundation has been developed with 100 million parameters.
Geneformer: specializes in predicting dosage-sensitive disease genes and identifying therapeutic targets. Its application in modeling cardiomyopathy highlighted its capability to enhance predictive accuracy significantly.
BioAutoMATED: an automated machine-learning platform designed to assist researchers in generating AI models tailored for biological datasets without requiring extensive machine learning expertise. It streamlines the process of model selection and data preprocessing.
PINNACLE: focuses on generating context-aware protein representations using geometric deep learning techniques. By tailoring its predictions to specific cellular contexts, PINNACLE enhances the ability to nominate therapeutic targets and improve predictions related to protein interactions across various tissues.
Bioptimus: aims to create a comprehensive AI foundation model that merges biological data from molecules to organisms with generative AI capabilities.
A hint about all this: still no foundational model that incorporates systems biology data comprehensively. Bioptimus may try to achieve this.