apepkuss79's picture
Update README.md
36a2a10 verified
metadata
license: other
license_name: writer-open-model-license
license_link: https://writer.com/legal/open-model-license/
pipeline_tag: text-generation
base_model: Writer/Palmyra-Fin-70B-32K
model_creator: InternLM
model_name: Palmyra-Fin-70B-32K
quantized_by: Second State Inc.
language:
  - en

Palmyra-Fin-70B-32K-GGUF

Original Model

Writer/Palmyra-Fin-70B-32K

Run with Gaianet

Prompt template:

prompt template: llama-3-chat

Context size:

chat_ctx_size: 32000

Run with GaiaNet:

Quantized with llama.cpp b3499