monsoon-nlp/protein-matryoshka-embeddings

Sentence Similarity • Updated Jul 19 • 29 • 5

Note Faster embeddings for proteins from UniProt: see blog post/explainer https://huggingface.co/blog/monsoon-nlp/proteins-matryoshka-embeddings

monsoon-nlp/eyegazer-vit-binary

Updated Nov 4, 2023 • 31 • 1

Note Retinopathy classifier

monsoon-nlp/tinyllama-mixpretrain-quinoa-sciphi

Text Generation • Updated Apr 22 • 13

Note TinyLLaMA-1.1B continued pretraining on 50% quinoa proteins + 50% simulated science textbooks

monsoon-nlp/tinyllama-mixpretrain-uniprottune

Updated Apr 22 • 5

Note tinyllama-mixpretrain-quinoa-sciphi LoRA, using finetuning split minus maize/corn/Zea

monsoon-nlp/llama3-dnapretrain-kaniwa

Updated Apr 26

Note TBD: long context LLaMA 3 LoRA finetuning on 16 MM nucleotides of the Kañiwa genome