Multi-Layer SAEs with Tuned Lens and Transformers - a tim-lawson Collection

tim-lawson 's Collections

Multi-Layer SAEs

Multi-Layer SAEs with Tuned Lens

Multi-Layer SAEs with Transformers

Multi-Layer SAEs with Tuned Lens and Transformers

Single-Layer SAEs

Single-Layer SAEs with Transformers

Multi-Layer SAEs with Tuned Lens and Transformers

updated Dec 3, 2024

Single SAEs trained on the residual stream activation vectors from every layer simultaneously using tuned lenses, including the transformers.