|
--- |
|
license: mit |
|
language: |
|
- rna |
|
- dna |
|
|
|
tags: |
|
- Genomic-Language-Modeling |
|
- OmniGenome Foundation Model |
|
--- |
|
|
|
# Multi-species Foundation Model for Universal RNA and DNA Downstream Tasks |
|
|
|
# Notes |
|
We are keep updating the checkpoints, the current checkpoint is trained for 0.85 epoch. |
|
|
|
## Training Examples |
|
Refer to GitHub [https://github.com/yangheng95/OmniGenome](https://github.com/yangheng95/OmniGenome) |
|
|
|
## Usage |
|
This model is available for replacing genomic foundation models such as CDSBERT, Nucleotide Transformers, DNABERT2, etc. |
|
``` |
|
from transformers import AutoModel |
|
model = AutoModel.from_pretrained("yangheng/OmniGenome-52M", trust_remote_code=True) |
|
``` |
|
|
|
## Subtasks |
|
- Secondary structure prediction |
|
- Genome Sequence Classification |
|
- Genome Sequence Regression |
|
- Single Nucleotide Repair |
|
- Genome Masked Language Modeling |
|
- etc. |
|
|
|
Part of the codes are adapted from ESM2. |
|
|
