sunbaby/BrainCog-8B-0.1-Instruct

Model Information

BrainCog is developed by BrainCog group.

Current version is BrainCog-8B-0.1-Instruct.

Use with transformers

import torch
import transformers

model_id = "sunbaby/BrainCog-8B-0.1-Instruct"
pipeline = transformers.pipeline(
    "text-generation",
    model=model_id,
    model_kwargs={
      "torch_dtype": torch.bfloat16
    },
    device_map="auto",
)
messages = [
    {"role": "system", "content": "You are a useful chatbot or assistant to help people."},
    {"role": "user", "content": "How are you?"},
]
outputs = pipeline(
    messages,
    max_new_tokens=2048,
)
print(outputs[0]["generated_text"][-1])

Responsibility

The output of the model is uncontrollable, and its output does not represent our opinion