Update README.md
Browse files
README.md
CHANGED
|
@@ -1,5 +1,3 @@
|
|
| 1 |
-
Pruned Orthogonalized Llama 3
|
| 2 |
-
|
| 3 |
This repository contains a pruned and orthogonalized version of the Llama 3 8B model. The model was created by leveraging the pruning method described in the [PruneGPT](https://github.com/nyunAI/PruneGPT) repository to remove unimportant layers from the original Llama 3 8B model. Additionally, the model components were subjected to Orthogonal Activation Steering (OAS), also known as "abliteration", to mitigate refusals and improve versatility for various scenarios.
|
| 4 |
|
| 5 |
## Model Description
|
|
|
|
|
|
|
|
|
|
| 1 |
This repository contains a pruned and orthogonalized version of the Llama 3 8B model. The model was created by leveraging the pruning method described in the [PruneGPT](https://github.com/nyunAI/PruneGPT) repository to remove unimportant layers from the original Llama 3 8B model. Additionally, the model components were subjected to Orthogonal Activation Steering (OAS), also known as "abliteration", to mitigate refusals and improve versatility for various scenarios.
|
| 2 |
|
| 3 |
## Model Description
|