Upload folder using huggingface_hub

README.md

@@ -0,0 +1,82 @@
+---
+language:
+- en
+pipeline_tag: text-generation
+tags:
+- fireplace
+- valiant
+- valiant-labs
+- llama
+- llama-3
+- llama-3-instruct
+- llama-3-instruct-70b
+- 70b
+- function-calling
+- conversational
+- chat
+- instruct
+model_type: llama
+license: llama3
+---
+
+
+![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/64f267a8a4f79a118e0fcc89/qg49GOlx8zogDOrMTnb89.jpeg)
+
+
+Fireplace is a function-calling model for Llama 3 70b Instruct.
+  - combines function-calling abilities with a high-performance, versatile chat model
+  - function-calling utilizing the Llama 3 Instruct format
+
+This version of Fireplace, like our previous [Fireplace-13b](https://huggingface.co/ValiantLabs/Fireplace-13b) and [Fireplace-34b](https://huggingface.co/ValiantLabs/Fireplace-34b) models, focuses on combining chat-instruct and function-calling only.
+
+**We're working now on Fireplace 2 for Llama 3**, which will include function calling as one of **several enhanced technical skills**.
+
+## Version
+
+This is the **2024-05-09** release of Fireplace for Llama 3 70b.
+
+We're excited to bring additional releases for Fireplace and other models in our Build Tools lineup to Llama 3 soon!
+
+## Prompting Guide
+Fireplace uses the [Llama 3 Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct) prompt format:
+
+<|begin_of_text|><|start_header_id|>system<|end_header_id|>{{ system_prompt }}<|eot_id|><|start_header_id|>user<|end_header_id|>{{ user_msg_1 }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>{{ model_answer_1 }}<|eot_id|>
+
+Example input for function calling:
+
+<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\n You are Fireplace, an expert code assistant with access to the following functions. Use them if required - { "name": "calculate_tip", "description": "Calculate the tip amount for a bill", "parameters": { "type": "object", "properties": { "bill_amount": { "type": "number", "description": "The total amount of the bill" }, "tip_percentage": { "type": "number", "description": "The percentage of tip to be given" } }, "required": [ "bill_amount", "tip_percentage" ] } } { "name": "check_website_availability", "description": "Check the availability of a website", "parameters": { "type": "object", "properties": { "url": { "type": "string", "description": "The URL of the website" } }, "required": [ "url" ] } } <|eot_id|><|start_header_id|>user<|end_header_id|>\n\nHi, I need help with calculating a tip. My bill is $100 and I want to leave a 30% tip. <|eot_id|><|start_header_id|>assistant<|end_header_id|>
+
+For assistant handling of function responses, deliver them in a new user message:
+
+<|start_header_id|>user<|end_header_id|>\n\n FUNCTION RESPONSE: {"status": "success", "message": "Email has been sent successfully"} <|eot_id|>
+
+## WARNING: text-generation-webui
+
+When using Llama 3 Instruct models (including Fireplace) with [text-generation-webui](https://github.com/oobabooga/text-generation-webui/tree/main) note that a current bug in webui can result in incorrect reading of the model's ending tokens, causing unfinished outputs and incorrect structure.
+
+For a [temporary workaround](https://github.com/oobabooga/text-generation-webui/issues/5885) if you encounter this issue, edit Fireplace's tokenizer_config file as indicated:
+
+from "eos_token": "<|end_of_text|>",
+
+to "eos_token": "<|eot_id|>",
+
+## The Model
+Fireplace is built on top of Llama 3 70b Instruct, the highest performance open-source model currently available.
+
+This version of Fireplace uses the [glaiveai/glaive-function-calling-v2](https://huggingface.co/datasets/glaiveai/glaive-function-calling-v2) dataset converted to Llama 3 Instruct format.
+
+
+
+![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/63444f2687964b331809eb55/VCJ8Fmefd8cdVhXSSxJiD.jpeg)
+
+
+Fireplace is created by [Valiant Labs.](http://valiantlabs.ca/)
+
+[Check out our HuggingFace page for Shining Valiant 2 and our other models!](https://huggingface.co/ValiantLabs)
+
+[Follow us on X for updates on our models!](https://twitter.com/valiant_labs)
+
+We care about open source.
+For everyone to use.
+
+We encourage others to finetune further from our models.

config.json

@@ -0,0 +1,28 @@
+{
+  "_name_or_path": "ValiantLabs/Llama3-70B-Fireplace",
+  "architectures": [
+    "LlamaForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 128000,
+  "eos_token_id": 128001,
+  "hidden_act": "silu",
+  "hidden_size": 8192,
+  "initializer_range": 0.02,
+  "intermediate_size": 28672,
+  "max_position_embeddings": 8192,
+  "model_type": "llama",
+  "num_attention_heads": 64,
+  "num_hidden_layers": 80,
+  "num_key_value_heads": 8,
+  "pretraining_tp": 1,
+  "rms_norm_eps": 1e-05,
+  "rope_scaling": null,
+  "rope_theta": 500000.0,
+  "tie_word_embeddings": false,
+  "torch_dtype": "float32",
+  "transformers_version": "4.40.2",
+  "use_cache": true,
+  "vocab_size": 128256
+}

generation_config.json

@@ -0,0 +1,12 @@
+{
+  "bos_token_id": 128000,
+  "do_sample": true,
+  "eos_token_id": [
+    128001,
+    128009
+  ],
+  "max_length": 4096,
+  "temperature": 0.6,
+  "top_p": 0.9,
+  "transformers_version": "4.40.2"
+}

model-00001-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9c6d17f5c41655a1d100291f48c10c4ee0ef4dfde7f43e803a75c3fe6cea6ee8
+size 4806672984

model-00002-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4d9f3852a4373a626afd4318470233750b7f6b209c1abb17a0d89e3c432f1d72
+size 4362142864

model-00003-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:411140ca5cbf59b7b5d5e4fcd2c50dde397f9afb2ecec8dea7d45656ab059f82
+size 4362142864

model-00004-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4bc40ab5371153aad5fee70e97fbb8138a277c40dc1fb37a52c824abd1c076f5
+size 4966188864

model-00005-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:257b88a3644b18a63e28fc4f753417651b7652a4962ee54984b164aad569e454
+size 4362142864

model-00006-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:08e7e546972f62620dde14bdc1bd1e04f3b92d8011c2ccdd43d15659a01b8c58
+size 4362142864

model-00007-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4293d04082aed9a8c63891013a7bf112de8a5e3d3e432437fea76f709a5b17e1
+size 4966188864

model-00008-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:da11aef3c350fdf082983ed67a89b0b4d9612e7f3540f0f7aee18991fd6f6c11
+size 4362142864

model-00009-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6ab589e858c8cc158a4205f7d035742137de28b6e59c2cbaf8b58f5d125c3634
+size 4362142880

model-00010-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2b4899074c7b3f20604164e138117c8145261079170c2f85973076049ae9ba0b
+size 4966188880

model-00011-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e6bab25b0d60dfd482e968213514c13b7e58858c52defb31e8779177fc8d7e44
+size 4362142872

model-00012-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:27cd75bcd554010f8a0ffe1d5d2c642e591dbba8157d6835dbeacf42a415323a
+size 4362142872

model-00013-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:10ada43ceb39556249692cffa79fec4b5d33d9b300999eac2ac5c0580c9bbbca
+size 4966188880

model-00014-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a383e4482df4f32ea61c33aab66448d8179153a6ce0c03b8030c668853f92d53
+size 4362142872

model-00015-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:99467a67d62078eb8ac6f1d2278dac5ee3ba8480568dac94b11a5afc4db65096
+size 4362142872

model-00016-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:786d8174314f2657ceb4d30d9aed63b7b2038078bf195a622e4802c6d58febf6
+size 4966188880

model-00017-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:440340e8e98975f54d6016054e68d0777e74efe546152941379179b59e7ab789
+size 4362142872

model-00018-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c49192981e715aeec3f1d381cf0bdc96d3a121871481b43a2ed533881e629c7a
+size 4362142872

model-00019-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1dd26cf4a6bf0dd3f7e959d1f711c79cce2110de1e087e7bc1a1ccb34ba555fc
+size 4966188880

model-00020-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0d9b630cd1a4f4e90fe70c0b1d22a365e702d71ceed3f1e871881cc55a3f7c66
+size 4362142872

model-00021-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:440c6a3abde7ca4d43232a87811568c06a162b3ea6b12cd72b9773bf8e0631e1
+size 4362142872

model-00022-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c55269c30442089c333c988461cc8062dbc87ce73b12096e43f290dd20daa0f6
+size 4966188880

model-00023-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:67a2cb2a26cdd89b1e858b42eec9dd9917fce9ae97cba2c0b79b7394309cd51f
+size 4362142872

model-00024-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b764dc6d5c59f2e1ca2a3b55632c1ffb212cd8f17b6a8780fb94c34090fde9b2
+size 4362142872

model-00025-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:33ccc4f1df8e2fcef2257f00dbdbcb93fdf99f6f4e1bf2e8b87d264f5dd6f08d
+size 4966188880

model-00026-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b290364047708e426f4fc0311d93679803b06a90d7b53f8242caebed76b48673
+size 4362142872

model-00027-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0cfdc0bc262cdef0b10bb1b48788fda30f8110d158180d0a796f0fbf8f6ceae3
+size 4362142872

model-00028-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3febd7211d28e46f8850f46ede5445ca2249064e6d2f7a632688c007b1260076
+size 4966188880

model-00029-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:885f6b7bbb2b4d38a82a65c4d86163d6d76620be7cb176afd002c1132df21860
+size 4362142872

model-00030-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ad591ca680309d43befc86df8cdb6ce5cd5e8fdb9689893699b5ddcf854ccd1f
+size 4362142872

model-00031-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cb656e624ee3b1f17dfbb788776213d92aea27b7d8fa6a64eec5db4a8032b098
+size 4966188880

model-00032-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7a1c264d729969eb3d558cd11323c8dc686eedd47e75a0f8c73f760c6df5a28a
+size 4362142872

model-00033-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fad3c812064b7db1098a53d53a9a3bc045b10356dcebe3db1dcdf8a72c4fe1ca
+size 4362142872

model-00034-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bde459af916352760f4ac6c363f9e06fb936e97c9ebc7e995732e673730dcbd6
+size 4966188880

model-00035-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3a3a5c9b2d7291b6beb11d6af6a612491dffdb498e564808ea3b50c4934c37da
+size 4362142872

model-00036-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3148d65db271703dce9145c1eb876b17d84e39fa053ea65c3940516e06699d62
+size 4362142872

model-00037-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:36d7a26572f967981a22b34fd537100f47a6e7e5cd688973cfbf33422ab24186
+size 4966188880

model-00038-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:94aa4cf3850affc11058bcf166f02c4a2db4c32b58e330c9e90aa3a0dbc38c51
+size 4362142872

model-00039-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9fc7412aade63dc2e138092ca77d3f781fe9243ad9960321043daf691fafdd9a
+size 4362142872

model-00040-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d9160ad0f68dd7bb8e78def5886f524fe6cbb3089f479d1210af065f45f085f1
+size 4966188880

model-00041-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b99a019a39e38fba084ee12bff939c02f6fddede1a3372c84bfdd4e1489dc9d6
+size 4362142872

model-00042-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d5b975b86fe569ab55ce53e0971453ed23ce9982672571a835ce8e284705c43a
+size 4362142872

model-00043-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1648405ac00137f5e5c5561898e40adb38782a22d4efdd0c9c383003fbbc1a6f
+size 4966188880

model-00044-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2c7dea3edab71880791349012f2a16292d4857c2c5f156beb0e3c53fd4a68df5
+size 4362142872

model-00045-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:074b9285b591568a3dfe61826cf500339bcbe242728273e9c1b7203e413f9144
+size 4362142872

model-00046-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f118beb828b7989aa74d3f664cc8eab354a7bc11ee76acb06805e727a702d439
+size 4966188880

model-00047-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1239040e198c368dd9b1f7d5fd7ae1d0d2ff20561ee42cb44159cb72b1fd41a4
+size 4362142872