add experimental embedding SAEs
#4
by
Aric
- opened
SAEs on the raw embedding vectors (not including the sqrt(d_model) scaling that happens inside the model fwd pass).
Not trained on BOS, PAD, EOS and any token that didn't occur in the training data.
Aric
changed pull request status to
open
ArthurConmyGDM
changed pull request status to
merged