README.md · yhavinga/Boreas-7B-chat-v1-GGUF at main

metadata

license: apache-2.0
datasets:
  - yhavinga/mc4_nl_cleaned
  - yhavinga/nedd_wiki_news
  - teknium/OpenHermes-2.5
  - euirim/goodwiki
  - philschmid/flanv2
tags:
  - finetuned
language:
  - nl
  - en
  - de
  - fr
  - es

Model Summary

See Boreas-7B-chat for more info. This repository contains several quantized models and their associated model cards for ollama. Click on 'files' to get a sense of the file sizes.

You can download a single GGUF file with the Huggingface Web UI widgets for quantized files. The Modelcard for ollama can be downloaded from the 'files' section.

Then:

ollama create Boreas-7B-chat-q6_k -f Modelfile_Q6_K
ollama run Boreas-7B-chat-q6_k

Enjoy!