metadata

license: apache-2.0
library_name: transformers
datasets:
  - ibleducation/fordham-university
language:
  - en

ibleducation/ibl-fordham-7b

ibleducation/ibl-fordham-7b is a model finetuned on top of openchat/openchat_3.5

This model is finetuned to answer questions about fordham university.

Model Details

Developed by: IBL Education
Model type: Mistral-7B-v0.1
Base Model: OpenChat 3.5
Language: English
Finetuned from weights: OpenChat 3.5
Finetuned on data:
- ibleducation/fordham-university
Model License: Apache 2.0
Epochs: 7

How to Use ibl-fordham-7b Model from Python Code (HuggingFace transformers)

Install the necessary packages

Requires: transformers 4.35.0 or later, and accelerate 0.23.0 or later.

pip install transformers==4.35.0
pip install accelerate==0.23.0

You can then try the following example code

from transformers import AutoModelForCausalLM, AutoTokenizer
import transformers
import torch

model_id = "ibleducation/ibl-fordham-7b"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
  model_id,
  device_map="auto",
)
pipeline = transformers.pipeline(
    "text-generation",
    model=model,
    tokenizer=tokenizer,
)
prompt = "<s>What programmes are offered at fordham university?</s>"

response = pipeline(prompt)
print(response['generated_text'])

Important - Use the prompt template below for ibl-fordham-7b:

<s>{prompt}</s>