SaProtHub/Model-BetaLactamase-650M

Base model: westlake-repl/SaProt_650M_AF2

Task type: protein-level regression

Label is the experimentally tested fitness score which records the scaled mutation effect for each mutant.

Dataset: SaProtHub/Dataset-Beta_Lactamase-PEER

Model input type: Amino acid sequence

Performance (on test set): 0.906 Spearman's ρ

LoRA config:

• r: 8
• lora_dropout: 0.1
• lora_alpha: 8
• target_modules: ["query", "key", "value", "intermediate.dense", "output.dense"]
• modules_to_save: ["classifier"]

Training config:

• optimizer:
  • class: AdamW
  • betas: (0.9, 0.98)
  • weight_decay: 0.01
• learning rate: 1e-4
• epoch: 200
• batch size: 64
• precision: 16-mixed