README.md

library_name: transformers
---

# ibleducation/ibl-fordham-7b
ibleducation/ibl-fordham-7b is a model finetuned on top of openchat/openchat_3.5

This model is finetuned to answer questions about fordham university.


  

## Model Details

- **Developed by:** [IBL Education](https://ibl.ai)
- **Model type:** [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1)
- **Base Model:** [OpenChat 3.5](https://huggingface.co/openchat/openchat_3.5)
- **Language:** English
- **Finetuned from weights:** [OpenChat 3.5](https://huggingface.co/openchat/openchat_3.5)
- **Finetuned on data:**
  - [ibleducation/fordham-university](https://huggingface.co/datasets/ibleducation/fordham-university)
- **Model License:** Apache 2.0
- **Epochs**: 7
## How to Use ibl-fordham-7b Model from Python Code (HuggingFace transformers) ##

### Install the necessary packages

Requires: [transformers](https://pypi.org/project/transformers/) 4.35.0 or later, and [accelerate](https://pypi.org/project/accelerate/) 0.23.0 or later.

```shell
pip install transformers==4.35.0
pip install accelerate==0.23.0
```
### You can then try the following example code

```python
from transformers import AutoModelForCausalLM, AutoTokenizer
import transformers
import torch

model_id = "ibleducation/ibl-fordham-7b"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
  model_id,
  device_map="auto",
)
pipeline = transformers.pipeline(
    "text-generation",
    model=model,
    tokenizer=tokenizer,
)
prompt = "<s>What programmes are offered at fordham university?</s>"

response = pipeline(prompt)
print(response['generated_text'])
```
**Important** - Use the prompt template below for ibl-fordham-7b:
```
<s>{prompt}</s>
```