chore: update readme
Browse files
README.md
CHANGED
@@ -40,4 +40,19 @@ StripedHyena-Nous 7B uses this prompt format:
|
|
40 |
|
41 |
To use StripedHyena outside of the playground, you will need to install custom kernels. Please follow the instructions from the [standalone repository](https://github.com/togethercomputer/stripedhyena).
|
42 |
|
43 |
-
StripedHyena is a mixed precision model. Make sure to keep your `poles` and `residues` in `float32` precision, especially for longer prompts or training.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
40 |
|
41 |
To use StripedHyena outside of the playground, you will need to install custom kernels. Please follow the instructions from the [standalone repository](https://github.com/togethercomputer/stripedhyena).
|
42 |
|
43 |
+
StripedHyena is a mixed precision model. Make sure to keep your `poles` and `residues` in `float32` precision, especially for longer prompts or training.
|
44 |
+
|
45 |
+
|
46 |
+
## Cite
|
47 |
+
|
48 |
+
If you have found the pretrained models or architecture useful for you research or application, consider citing:
|
49 |
+
```
|
50 |
+
@software{stripedhyena,
|
51 |
+
title = {{StripedHyena: Moving Beyond Transformers with Hybrid Signal Processing Models}},
|
52 |
+
author = { Poli, Michael and Wang, Jue and Massaroli, Stefano and Nguyen, Eric and Thomas, Armin},
|
53 |
+
month = 12,
|
54 |
+
year = 2023,
|
55 |
+
url = { https://github.com/togethercomputer/stripedhyena },
|
56 |
+
doi = { 10.57967/hf/1595 },
|
57 |
+
}
|
58 |
+
```
|