Text Generation
Transformers
PyTorch
Safetensors
English
stripedhyena
custom_code
Zymrael commited on
Commit
14c6bf7
1 Parent(s): 8b401ae

chore: update readme

Browse files
Files changed (1) hide show
  1. README.md +16 -1
README.md CHANGED
@@ -40,4 +40,19 @@ StripedHyena-Nous 7B uses this prompt format:
40
 
41
  To use StripedHyena outside of the playground, you will need to install custom kernels. Please follow the instructions from the [standalone repository](https://github.com/togethercomputer/stripedhyena).
42
 
43
- StripedHyena is a mixed precision model. Make sure to keep your `poles` and `residues` in `float32` precision, especially for longer prompts or training.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
40
 
41
  To use StripedHyena outside of the playground, you will need to install custom kernels. Please follow the instructions from the [standalone repository](https://github.com/togethercomputer/stripedhyena).
42
 
43
+ StripedHyena is a mixed precision model. Make sure to keep your `poles` and `residues` in `float32` precision, especially for longer prompts or training.
44
+
45
+
46
+ ## Cite
47
+
48
+ If you have found the pretrained models or architecture useful for you research or application, consider citing:
49
+ ```
50
+ @software{stripedhyena,
51
+ title = {{StripedHyena: Moving Beyond Transformers with Hybrid Signal Processing Models}},
52
+ author = { Poli, Michael and Wang, Jue and Massaroli, Stefano and Nguyen, Eric and Thomas, Armin},
53
+ month = 12,
54
+ year = 2023,
55
+ url = { https://github.com/togethercomputer/stripedhyena },
56
+ doi = { 10.57967/hf/1595 },
57
+ }
58
+ ```