Knowledge-Design: Pushing the Limit of Protein Design via Knowledge Refinement

20 May 2023  ยท  Zhangyang Gao, Cheng Tan, Stan Z. Li ยท

Recent studies have shown competitive performance in protein design that aims to find the amino acid sequence folding into the desired structure. However, most of them disregard the importance of predictive confidence, fail to cover the vast protein space, and do not incorporate common protein knowledge. After witnessing the great success of pretrained models on diverse protein-related tasks and the fact that recovery is highly correlated with confidence, we wonder whether this knowledge can push the limits of protein design further. As a solution, we propose a knowledge-aware module that refines low-quality residues. We also introduce a memory-retrieval mechanism to save more than 50\% of the training time. We extensively evaluate our proposed method on the CATH, TS50, and TS500 datasets and our results show that our Knowledge-Design method outperforms the previous PiFold method by approximately 9\% on the CATH dataset. Specifically, Knowledge-Design is the first method that achieves 60+\% recovery on CATH, TS50 and TS500 benchmarks. We also provide additional analysis to demonstrate the effectiveness of our proposed method. The code will be publicly available.

PDF Abstract

Datasets


  Add Datasets introduced or used in this paper

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Protein Design CATH 4.2 ProteinMPNN Sequence Recovery %(All) 45.96 # 3
Perplexity 4.61 # 3
Protein Design CATH 4.2 StructGNN Sequence Recovery %(All) 35.91 # 7
Perplexity 6.4 # 7
Protein Design CATH 4.2 Knowledge-Design Sequence Recovery %(All) 60.77 # 1
Perplexity 3.46 # 1
Protein Design CATH 4.2 PiFold Sequence Recovery %(All) 51.66 # 2
Perplexity 4.55 # 2
Protein Design CATH 4.2 AlphaDesign Sequence Recovery %(All) 41.31 # 4
Perplexity 6.3 # 6
Protein Design CATH 4.2 GVP Sequence Recovery %(All) 39.47 # 5
Perplexity 5.36 # 4
Protein Design CATH 4.2 GCA Sequence Recovery %(All) 37.64 # 6
Perplexity 6.05 # 5
Protein Design CATH 4.2 GraphTrans Sequence Recovery %(All) 35.82 # 8
Perplexity 6.63 # 8
Protein Design CATH 4.3 ESM-IF Sequence Recovery %(All) 38.3 # 2
Perplexity 6.44 # 2
Protein Design CATH 4.3 GVP-large Sequence Recovery %(All) 39.2 # 1
Perplexity 6.17 # 1
Word Sense Disambiguation TS50 SPIN Sequence Recovery %(All) 30.3 # 1

Methods