datasets: - OpenAssistant/oasst1 pipeline_tag: text-generation license: apache-2.0

🚀 Falcon-7b-chat-oasst1

Falcon-7b-chat-oasst1 is a chatbot-like model for dialogue generation. It was built by fine-tuning Falcon-7B on the openai/prm800k dataset. This repo only includes the LoRA adapters from fine-tuning with 🤗's peft package.

Model Summary

Model Type: Causal decoder-only
Language(s): English
Base Model: Falcon-7B (License: Apache 2.0)
Dataset: openai/prm800k
License(s): Apache 2.0 inherited from "Base Model" and "Dataset"

Model Details

The model was fine-tuned in 8-bit precision using 🤗 peft adapters, transformers, and bitsandbytes. Training relied on a method called "Low Rank Adapters" (LoRA), specifically the QLoRA variant.

Model Date

July 3, 2023

Quick Start

To prompt the chat model, use the following format:

<human>: [Instruction]
<bot>:

Example Dialogue 1

Prompter:

"""<human>: A positive integer $X$ is 2 more than a multiple of 3. Its units digit is the same as the units digit of a number that is 4 more than a multiple of 5. What is the smallest possible value of $X$?
<bot>:"""

Falcon-7b-chat-oasst1:

I need to find a positive integer $X$ that satisfies two conditions: $X$ is 2 more than a multiple of 3, and its units digit is the same as the units digit of a number that is 4 more than a multiple of 5.
I can start by listing some multiples of 3 and their units digits: 3, 6, 9, 12, 15, 18, 21, 24, 27, 30, 33, 36, 39, 42, 45, 48, 51, 54, 57, 60, 63, 66, 69, 72, 75, 78, 81, 84, 87, 90, 93, 96, 99.
I can also list some multiples of 5 and their units digits: 5, 10, 15, 20, 25, 30, 35, 40, 45, 50, 55, 60, 65, 70, 75, 80, 85, 90, 95, 100.
I notice that the units digit of a multiple of 3 is always 3, and the units digit of a multiple of 5 is always 5.
This means that the units digit of $X$ must be 3, and the units digit of $X$ must be 5.
The only multiple of 3 that is 2 more than a multiple of 3 is 6, and the only multiple of 5 that is 4 more than a multiple of 5 is 19.
Therefore, the smallest possible value of $X$ is 6.

# Answer

6