entropy commited on
Commit
28cdfdb
1 Parent(s): a36eb3f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -31,6 +31,10 @@ mask = inputs['attention_mask']
31
  embeddings = ((full_embeddings * mask.unsqueeze(-1)).sum(1) / mask.sum(-1).unsqueeze(-1))
32
  ```
33
 
 
 
 
 
34
 
35
  ---
36
  license: mit
 
31
  embeddings = ((full_embeddings * mask.unsqueeze(-1)).sum(1) / mask.sum(-1).unsqueeze(-1))
32
  ```
33
 
34
+ ## Decoder
35
+
36
+ There is also a [decoder model](https://huggingface.co/entropy/roberta_zinc_decoder) trained to reconstruct
37
+ inputs from embeddings
38
 
39
  ---
40
  license: mit