The drug discovery pipeline is a notoriously arduous, time-consuming, and expensive process. It often takes over a decade and billions of dollars to bring a new drug to market [6]. This challenging landscape has spurred the exploration of computational approaches to accelerate and improve the efficiency of drug development. Machine learning (ML) and, increasingly, quantum machine learning (QML) are emerging as powerful tools, offering the potential to revolutionize various stages of the drug discovery process [10, 19]. This review will explore the current state of the art, highlighting key applications, emerging trends, and future directions in the application of ML and QML to drug discovery, focusing on the generation of novel molecules, prediction of drug-target interactions, drug repurposing, and the mitigation of challenges such as data scarcity and interpretability. This field is rapidly evolving, with new methods and applications constantly emerging, promising to reshape the future of medicine.

Generative Models for Drug Design

One of the most promising applications of ML in drug discovery is the de novo design of drug molecules. Generative models are trained on existing datasets of known drugs and can then create novel molecules with desired properties [4, 19]. These models offer the potential to explore vast chemical spaces and identify promising drug candidates more efficiently than traditional methods [12].

Energy-based generative models, such as the one developed in [1], are designed for target-specific drug discovery. TagMol, the proposed model, generates molecules with binding affinity scores comparable to real molecules. The study also highlights the advantage of using GAT-based models over GCN baselines for faster and better learning. Similarly, [4] proposes the use of various QML techniques, including generative adversarial networks (GANs), to generate small drug molecules.

Variational autoencoders (VAEs) are another popular approach for drug design. These models learn a latent representation of molecular structures and can generate new molecules by sampling from this latent space [11, 18]. However, as highlighted in [11], near-term quantum computers have limitations that hinder the representation learning in high-dimensional spaces. The authors present a scalable quantum generative autoencoder (SQ-VAE) for simultaneously reconstructing and sampling drug molecules, and a corresponding vanilla variant (SQ-AE) for better reconstruction. The results suggest that quantum computing advantages can be achieved for normalized low-dimension molecules, and that high-dimension molecules generated from quantum generative autoencoders have better drug properties within the same learning period. A hybrid quantum-classical deep learning model tailored for binding affinity prediction in drug discovery shows a 6% improvement in prediction accuracy relative to existing classical models, as well as a significantly more stable convergence performance [9]. Moreover, the work in [18] built a compact discrete variational autoencoder (DVAE) with a Restricted Boltzmann Machine (RBM) of reduced size in its latent layer, which could fit a state-of-the-art D-Wave quantum annealer and generate novel chemical structures with medicinal chemistry and synthetic accessibility properties.

Conditional diversity networks offer another approach to drug design. These networks can generate potential drug molecules from a prototype, which is especially valuable in drug discovery where researchers often start from a molecule with some of the desired properties [36].

Predicting Drug-Target Interactions

Identifying drug-target interactions (DTIs) is a critical step in drug discovery. Accurate prediction of these interactions can significantly reduce the time and cost associated with identifying lead compounds [5, 15, 16, 27, 28, 29].

Several studies have explored the use of deep learning models for DTI prediction [5, 16, 28, 29, 30]. DrugMAN, developed in [5], integrates heterogeneous information from multiple biological networks using a mutual attention network. This approach allows the model to capture complex relationships between drugs and targets, leading to improved prediction performance. The study in [16] proposes a method for predicting drug-target binding affinity using deep learning models, using a modified GRU and GNN to extract features from the drug-target protein sequences and the drug molecule map, respectively, to obtain their feature vectors. Another approach, presented in [27], incorporates 3D protein structure features for drug target affinity prediction using GraphPrint. The model generates graph representations for protein 3D structures using amino acid residue location coordinates and combines them with drug graph representation and traditional features to jointly learn drug target affinity, demonstrating that 3D protein structure-based features provide information complementary to traditional features. A cross-field information fusion strategy is employed in [28] to acquire local and global protein information, proposing the siamese drug-target interaction SiamDTI prediction method.

Knowledge graphs and knowledge graph embedding (KGE) models have also shown promise in DTI prediction [15, 21]. In [15], a causal intervention-based confidence measure assesses the triplet score to improve the accuracy of the DTI prediction model. The study in [21] proposes an inductive RGCN for learning informative relation embeddings, even in the few-shot learning regime, which can be applied on the drug-repurposing knowledge graph (DRKG) for discovering drugs for Covid-19. Another study [29] proposes a self-attention-based multi-view representation learning approach for modeling drug-target interactions, achieving competitive prediction performance and offering biologically plausible drug-target interaction interpretations. Furthermore, the study in [30] proposes a convolutional neural network for EEG-mediated DTI prediction, which allows the identification of similarities in the mechanisms of action and effects of psychotropic drugs.

Drug Repurposing

Drug repurposing, the process of identifying new uses for existing drugs, offers a faster and more cost-effective approach to drug discovery compared to de novo drug development [3, 13, 20, 21, 24, 31, 37, 39]. By leveraging existing safety and efficacy data, drug repurposing can significantly accelerate the drug development process [13].

Several studies have explored the use of ML and AI for drug repurposing. NeuroCADR, a novel system for drug repurposing, uses a multi-pronged approach consisting of k-nearest neighbor algorithms (KNN), random forest classification, and decision trees [13]. The system identified novel drug candidates for epilepsy. In [20], a Knowledge Graph-based Machine Learning framework for explainably predicting Drugs Treating Diseases (KGML-xDTD) is proposed, which can achieve state-of-the-art performance in both predictions of drug repurposing and recapitulation of human-curated drug MOA paths. In the context of the COVID-19 pandemic, [37] proposes Dr-COVID, a graph neural network (GNN) based drug repurposing model. The model constructs a four-layered heterogeneous graph to model the complex interactions between drugs, diseases, genes, and anatomies. The study in [31] proposes a multi-agent framework to enhance the drug repurposing process using state-of-the-art machine learning techniques and knowledge integration. Similarly, [39] develops a semi-supervised drug embedding that incorporates two sources of information: (1) underlying chemical grammar that is inferred from chemical structures of drugs and drug-like molecules (unsupervised), and (2) hierarchical relations that are encoded in an expert-crafted hierarchy of approved drugs (supervised).

Self-supervised learning can also be applied to drug repurposing to address label sparsity [24]. The study in [24] proposes a multi-task self-supervised learning framework for computational drug repositioning, which tackles label sparsity by learning a better drug representation. The framework uses data augmentation strategies and contrast learning to mine the internal relationships of the original drug features and a multi-input decoding network to improve the reconstruction ability of the autoencoder model.

Addressing Challenges in Drug Discovery with ML/QML

While ML and QML offer significant promise for drug discovery, several challenges need to be addressed to fully realize their potential. These include data scarcity, the need for interpretability, and the development of methods for handling novel compounds.

Data Scarcity and Cold Start Problems

The availability of high-quality, labeled data is often a limiting factor in ML applications, particularly in drug discovery [24, 25]. Many drug discovery tasks, such as predicting drug-target interactions or drug responses, suffer from data scarcity, making it difficult to train robust and accurate models [8, 24].

To address this challenge, several approaches have been developed. Self-supervised learning techniques can be used to learn representations from unlabeled data, which can then be used to improve the performance of supervised models [24, 26]. Transfer learning, where knowledge learned from related tasks is transferred to the target task, can also be effective [8]. For instance, [8] proposes using transfer learning from chemical-chemical interaction (CCI) and protein-protein interaction (PPI) task to drug-target interaction task to solve the cold start problem. The representation learned by CCI and PPI tasks can be transferred smoothly to the drug-target interaction task due to the similar nature of the tasks. The study in [25] discusses the performance of classical and quantum classifiers in QSAR prediction and attempts to demonstrate the quantum advantages in the generalization power of the quantum classifier under conditions of limited data availability.

Interpretability

Many ML models, particularly deep learning models, are often considered "black boxes," making it difficult to understand why they make certain predictions [2, 17]. This lack of interpretability can be a major barrier to the adoption of ML in drug discovery, as it can be challenging to trust and validate the predictions made by these models.

Explainable artificial intelligence (XAI) techniques are being developed to address this challenge [17]. XAI methods aim to provide insights into the decision-making process of ML models, making them more transparent and understandable. The study in [17] provides a comprehensive overview of the current state-of-the-art in XAI for drug discovery, including various XAI methods, their application in drug discovery, and the challenges and limitations of XAI techniques in drug discovery. The study in [29] proposes a self-attention-based multi-view representation learning approach for modeling drug-target interactions that offer biologically plausible drug-target interaction interpretations. The KGML-xDTD framework in [20] provides KG-path explanations for drug repurposing predictions by leveraging the combination of prediction outcomes and existing biological knowledge and publications.

Handling Novel Structures

Many ML models struggle to generalize to novel chemical structures or biological targets that are not well-represented in the training data [21, 28]. This is particularly problematic in drug discovery, where researchers are often interested in identifying novel drug candidates or targeting previously unexplored proteins.

Several strategies are being explored to address this challenge. Graph neural networks (GNNs), which are designed to handle graph-structured data, are particularly well-suited for modeling molecular structures [21, 26, 27]. The study in [21] proposes an inductive RGCN for learning informative relation embeddings, even in the few-shot learning regime. The cross-field information fusion strategy in [28] is employed to acquire local and global protein information.

Quantum Machine Learning: A New Frontier

Quantum computing offers the potential to overcome some of the limitations of classical ML, particularly in handling complex data and performing computationally intensive tasks [4, 6, 10, 11]. QML algorithms can potentially accelerate drug discovery by enabling more accurate simulations, faster molecular property predictions, and the efficient exploration of chemical space [4, 6, 10].

Several studies have explored the application of QML to drug discovery [4, 9, 10, 11, 18, 25]. For example, [4] proposes a suite of QML techniques to generate small drug molecules, classify binding pockets in proteins, and generate large drug molecules. The study in [10] discusses the theoretical foundations of quantum machine learning, including data encoding, variational quantum circuits, and hybrid quantum-classical approaches. The study in [11] presents a scalable quantum generative autoencoder (SQ-VAE) for simultaneously reconstructing and sampling drug molecules. The study in [18] built a compact discrete variational autoencoder (DVAE) with a Restricted Boltzmann Machine (RBM) of reduced size in its latent layer, which could fit a state-of-the-art D-Wave quantum annealer and generate novel chemical structures with medicinal chemistry and synthetic accessibility properties. The study in [9] introduces a novel hybrid quantum-classical deep learning model tailored for binding affinity prediction in drug discovery. The study in [25] discusses the performance of classical and quantum classifiers in QSAR prediction.

Hybrid quantum-classical approaches, which combine the strengths of both quantum and classical computing, are particularly promising [9, 10, 18]. These approaches can leverage quantum computers for specific tasks, such as molecular simulations, while using classical computers for other aspects of the drug discovery pipeline.

Future Directions

The application of ML and QML to drug discovery is still in its early stages, and significant opportunities remain for future research and development. Several key areas warrant further investigation:

The ongoing convergence of quantum computing and artificial intelligence has the potential to revolutionize the field of drug discovery, leading to faster, cheaper, and more effective treatments for a wide range of diseases [6, 19]. While challenges remain, the rapid pace of innovation in both ML and QML suggests that these technologies will play an increasingly important role in the future of medicine.

==================================================

References