namespace-Pt
commited on
Commit
•
b381730
1
Parent(s):
30f7733
Upload folder using huggingface_hub
Browse files
README.md
CHANGED
@@ -6,7 +6,7 @@ pipeline_tag: text-generation
|
|
6 |
<div align="center">
|
7 |
<h1>UltraGist for Llama-2-7b-chat</h1>
|
8 |
|
9 |
-
[<a href="https://github.com/namespace-Pt/UltraGist">Github</a>]
|
10 |
</div>
|
11 |
|
12 |
UltraGist is a context compression method can **flexibly**, **effectively**, and **efficiently** to handle various context lengths and compression ratios. We apply UltraGist on [Llama-2-7b-chat](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf).
|
@@ -64,7 +64,3 @@ with torch.no_grad():
|
|
64 |
print(f"Memory: {compressed_memory[0][0].shape}")
|
65 |
print("*"*20)
|
66 |
```
|
67 |
-
|
68 |
-
## Citation
|
69 |
-
```
|
70 |
-
```
|
|
|
6 |
<div align="center">
|
7 |
<h1>UltraGist for Llama-2-7b-chat</h1>
|
8 |
|
9 |
+
[<a href="https://arxiv.org/abs/2405.16635">Paper</a>] [<a href="https://github.com/namespace-Pt/UltraGist">Github</a>]
|
10 |
</div>
|
11 |
|
12 |
UltraGist is a context compression method can **flexibly**, **effectively**, and **efficiently** to handle various context lengths and compression ratios. We apply UltraGist on [Llama-2-7b-chat](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf).
|
|
|
64 |
print(f"Memory: {compressed_memory[0][0].shape}")
|
65 |
print("*"*20)
|
66 |
```
|
|
|
|
|
|
|
|