Update README.md
Browse files
README.md
CHANGED
@@ -31,6 +31,10 @@ mask = inputs['attention_mask']
|
|
31 |
embeddings = ((full_embeddings * mask.unsqueeze(-1)).sum(1) / mask.sum(-1).unsqueeze(-1))
|
32 |
```
|
33 |
|
|
|
|
|
|
|
|
|
34 |
|
35 |
---
|
36 |
license: mit
|
|
|
31 |
embeddings = ((full_embeddings * mask.unsqueeze(-1)).sum(1) / mask.sum(-1).unsqueeze(-1))
|
32 |
```
|
33 |
|
34 |
+
## Decoder
|
35 |
+
|
36 |
+
There is also a [decoder model](https://huggingface.co/entropy/roberta_zinc_decoder) trained to reconstruct
|
37 |
+
inputs from embeddings
|
38 |
|
39 |
---
|
40 |
license: mit
|