HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Towards a Better Model with Dual Transformer for Drug Response Prediction

Kun Li; Jia Wu; Bo Du; Sergey V. Petoukhov; Huiting Xu; Zheman Xiao; Wenbin Hu

Towards a Better Model with Dual Transformer for Drug Response Prediction

Abstract

GNN-based methods have achieved excellent results as a mainstream task in drug response prediction tasks in recent years. Traditional GNN methods use only the atoms in a drug molecule as nodes to obtain the representation of the molecular graph through node information passing, whereas the method using the transformer can only extract information about the nodes. However, the covalent bonding and chirality of a drug molecule have a great influence on the pharmacological properties of the molecule, and these information are implied in the chemical bonds formed by the edges between the atoms. In addition, CNN methods for modelling cell lines genomics sequences can only perceive local rather than global information about the sequence. In order to solve the above problems, we propose the decoupled dual transformer structure with edge embedded for drug respond prediction (TransEDRP), which is used for the representation of cell line genomics and drug respectively. For the drug branch, we encoded the chemical bond information within the molecule as the embedding of the edge in the molecular graph, extracted the global structural and biochemical information of the drug molecule using graph transformer. For the branch of cell lines genomics, we use the multi-headed attention mechanism to globally represent the genomics sequence. Finally, the drug and genomics branches are fused to predict IC50 values through the transformer layer and the fully connected layer, which two branches are different modalities. Extensive experiments have shown that our method is better than the current mainstream approach in all evaluation indicators.

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
drug-response-prediction-on-gdscv2-1TransEDRP
Pearson correlation coefficient (PCC): 0.93807
mRMSE: 0.0229

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Towards a Better Model with Dual Transformer for Drug Response Prediction | Papers | HyperAI