File size: 987 Bytes
2386c87 7e1e7d9 2386c87 c5666f6 2386c87 c5666f6 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
---
---
## Gemma-Generic-7b
This repository contains a fine-tuned version of the Gemma model, which is part of the GemMoE (Gemma Mixture of Experts) family of models. For more information about GemMoE, please refer to the official documentation [https://huggingface.co/Crystalcareai/GemMoE-Beta-1].
## Model Details
- **Dataset**: This model was fine-tuned on 3 epochs of the Chat-Error/wizard_alpaca_dolly_orca dataset.
- **Architecture**: The fine-tuned model inherits the lean and efficient architecture of the base Gemma model, making it suitable for a wide range of applications with limited computational resources.
## Usage
You can use this fine-tuned model like any other HuggingFace model. Simply load it using the `from_pretrained` method:
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("huggingface-username/gemma-fine-tuned")
tokenizer = AutoTokenizer.from_pretrained("huggingface-username/gemma-fine-tuned") |