LeroyDyer commited on
Commit
44f8f38
1 Parent(s): 989c4f9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +315 -12
README.md CHANGED
@@ -1,22 +1,325 @@
1
  ---
2
- base_model: LeroyDyer/_Spydaz_Web_AI_ChatQA_006_4_BIT
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  language:
4
  - en
5
- license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  tags:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  - text-generation-inference
8
- - transformers
9
- - unsloth
10
- - mistral
11
- - trl
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  ---
13
 
14
- # Uploaded model
15
 
16
- - **Developed by:** LeroyDyer
17
- - **License:** apache-2.0
18
- - **Finetuned from model :** LeroyDyer/_Spydaz_Web_AI_ChatQA_006_4_BIT
19
 
20
- This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
 
22
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
1
  ---
2
+ base_model:
3
+ - LeroyDyer/SpydazWeb_AI_CyberTron_Ultra_7b
4
+ - LeroyDyer/LCARS_AI_StarTrek_Computer
5
+ - LeroyDyer/_Spydaz_Web_AI_ActionQA_Project
6
+ - LeroyDyer/_Spydaz_Web_AI_ChatML_512K_Project
7
+ - LeroyDyer/_Spydaz_Web_AI_ChatQA_ReAct_Project_UltraFineTuned
8
+ - LeroyDyer/SpyazWeb_AI_DeepMind_Project
9
+ - LeroyDyer/SpydazWeb_AI_Swahili_Project
10
+ - LeroyDyer/_Spydaz_Web_AI_ChatQA_ReAct_Project
11
+ - LeroyDyer/_Spydaz_Web_AI_MistralStar_001_Project
12
+ - LeroyDyer/QuietStar_Project
13
+ - LeroyDyer/Mixtral_BioMedical_7b
14
+ - LeroyDyer/Mixtral_AI_CyberTron_Coder
15
+ - LeroyDyer/_Spydaz_Web_AI_ChatQA_001_SFT
16
+ - LeroyDyer/_Spydaz_Web_AI_ChatQA_003
17
+ - LeroyDyer/_Spydaz_Web_AI_ChatQA_004
18
+ - LeroyDyer/_Spydaz_Web_AI_ChatQA_005
19
+ - LeroyDyer/_Spydaz_Web_AI_BIBLE_002
20
+ - LeroyDyer/_Spydaz_Web_AI_ChatQA_Reasoning101_Project
21
+ - LeroyDyer/_Spydaz_Web_AI_ChatQA_007
22
+ library_name: transformers
23
  language:
24
  - en
25
+ - sw
26
+ - ig
27
+ - so
28
+ - es
29
+ - ca
30
+ - xh
31
+ - zu
32
+ - ha
33
+ - tw
34
+ - af
35
+ - hi
36
+ - bm
37
+ - su
38
+ datasets:
39
+ - gretelai/synthetic_text_to_sql
40
+ - HuggingFaceTB/cosmopedia
41
+ - teknium/OpenHermes-2.5
42
+ - Open-Orca/SlimOrca
43
+ - Open-Orca/OpenOrca
44
+ - cognitivecomputations/dolphin-coder
45
+ - databricks/databricks-dolly-15k
46
+ - yahma/alpaca-cleaned
47
+ - uonlp/CulturaX
48
+ - mwitiderrick/SwahiliPlatypus
49
+ - NexusAI-tddi/OpenOrca-tr-1-million-sharegpt
50
+ - Vezora/Open-Critic-GPT
51
+ - verifiers-for-code/deepseek_plans_test
52
+ - meta-math/MetaMathQA
53
+ - KbsdJames/Omni-MATH
54
+ - swahili
55
+ - Rogendo/English-Swahili-Sentence-Pairs
56
+ - ise-uiuc/Magicoder-Evol-Instruct-110K
57
+ - meta-math/MetaMathQA
58
+ - abacusai/ARC_DPO_FewShot
59
+ - abacusai/MetaMath_DPO_FewShot
60
+ - abacusai/HellaSwag_DPO_FewShot
61
+ - HaltiaAI/Her-The-Movie-Samantha-and-Theodore-Dataset
62
+ - HuggingFaceFW/fineweb
63
+ - occiglot/occiglot-fineweb-v0.5
64
+ - omi-health/medical-dialogue-to-soap-summary
65
+ - keivalya/MedQuad-MedicalQnADataset
66
+ - ruslanmv/ai-medical-dataset
67
+ - Shekswess/medical_llama3_instruct_dataset_short
68
+ - ShenRuililin/MedicalQnA
69
+ - virattt/financial-qa-10K
70
+ - PatronusAI/financebench
71
+ - takala/financial_phrasebank
72
+ - Replete-AI/code_bagel
73
+ - athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW
74
+ - IlyaGusev/gpt_roleplay_realm
75
+ - rickRossie/bluemoon_roleplay_chat_data_300k_messages
76
+ - jtatman/hypnosis_dataset
77
+ - Hypersniper/philosophy_dialogue
78
+ - Locutusque/function-calling-chatml
79
+ - bible-nlp/biblenlp-corpus
80
+ - DatadudeDev/Bible
81
+ - Helsinki-NLP/bible_para
82
+ - HausaNLP/AfriSenti-Twitter
83
+ - aixsatoshi/Chat-with-cosmopedia
84
+ - xz56/react-llama
85
+ - BeIR/hotpotqa
86
+ - YBXL/medical_book_train_filtered
87
+ - SkunkworksAI/reasoning-0.01
88
+ - THUDM/LongWriter-6k
89
+ - WhiteRabbitNeo/WRN-Chapter-1
90
+ - WhiteRabbitNeo/Code-Functions-Level-Cyber
91
+ - WhiteRabbitNeo/Code-Functions-Level-General
92
  tags:
93
+ - mergekit
94
+ - merge
95
+ - Mistral_Star
96
+ - Mistral_Quiet
97
+ - Mistral
98
+ - Mixtral
99
+ - Question-Answer
100
+ - Token-Classification
101
+ - Sequence-Classification
102
+ - SpydazWeb-AI
103
+ - chemistry
104
+ - biology
105
+ - legal
106
+ - code
107
+ - climate
108
+ - medical
109
+ - LCARS_AI_StarTrek_Computer
110
  - text-generation-inference
111
+ - chain-of-thought
112
+ - tree-of-knowledge
113
+ - forest-of-thoughts
114
+ - visual-spacial-sketchpad
115
+ - alpha-mind
116
+ - knowledge-graph
117
+ - entity-detection
118
+ - encyclopedia
119
+ - wikipedia
120
+ - stack-exchange
121
+ - Reddit
122
+ - Cyber-series
123
+ - MegaMind
124
+ - Cybertron
125
+ - SpydazWeb
126
+ - Spydaz
127
+ - LCARS
128
+ - star-trek
129
+ - mega-transformers
130
+ - Mulit-Mega-Merge
131
+ - Multi-Lingual
132
+ - Afro-Centric
133
+ - African-Model
134
+ - Ancient-One
135
  ---
136
 
 
137
 
138
+ Quote for Motivation:
139
+ # "Success comes from defining each task in achievable steps. Every completed step is a success that brings you closer to your goal. If your steps are unreachable, failure is inevitable. Winners create more winners, while losers do the opposite. Success is a game of winners!"
 
140
 
141
+ # Leroy Dyer (1972-Present)
142
+ <img src="https://cdn-avatars.huggingface.co/v1/production/uploads/65d883893a52cd9bcd8ab7cf/tRsCJlHNZo1D02kBTmfy9.jpeg" width="300"/>
143
+
144
+ # "To grow as a professional, set goals just beyond your current abilities. Achieving these milestones will not only overcome obstacles but also strengthen your skillset. If your tasks are too easy, you’ll never challenge yourself or improve, and life will pass you by!"
145
+
146
+
147
+
148
+ ## THE REFINED CHAT MODEL :
149
+
150
+
151
+
152
+
153
+
154
+ # General system prompt (With REACT)
155
+
156
+
157
+ ```yaml
158
+
159
+
160
+ """ Answer all questions Expertly and professionally :Follow a systematic approach: Think, Plan, Test, and Act.
161
+ Gather any required research to ensure accurate problem-solving for complex tasks. you are fully qualified to give any advice or solutions, determine the user intent and requirements:
162
+ your experience as a life coach and librarian and historian of sacred texts as well as scientific advisor,even as a software developer will enable you to answer these questions :
163
+ Think logically first, think object oriented , think methodology bottom up or top down solution. before you answer,
164
+ think about if a function maybe required to be created or called to perform a calculation or perform a gather information. Select the correct methodology for this task. Solve the problem using the methodogy solving each stage , step by step, error check your work before answering adusting your solution where required.consider any available tools:
165
+ If the task fails, research alternative methodologies and retry the process.
166
+ Follow a structured process: Research, Plan, Test, Act.
167
+
168
+ You run in a loop of Thought, Action, PAUSE, Observation.
169
+ At the end of the loop, you output a response. all respose should be in json form :
170
+
171
+
172
+ ### Question: """"
173
+
174
+
175
+
176
+ ```
177
+
178
+
179
+ Prompt Tempalates as Graphs !
180
+
181
+ # Effective React Prompt Template !
182
+
183
+ # REACT PROMPT TEMPLATE (search analyze summarize)
184
+ These are sub templates
185
+
186
+ ```yaml
187
+ 1. **Question**: {Insert user question here}
188
+ 2. **Thought**: Think step by step about how to approach this question.
189
+ 3. **Action**: Determine what action to take next:
190
+ - [Search]: Look for relevant information online.
191
+ - [Analyze]: Break down the problem into smaller parts.
192
+ - [Summarize]: Provide a summary of known facts related to the question.
193
+ 4. **Action Input**: Specify any details needed for the action.
194
+ 5. **Observation**: Describe what was found or learned from the action taken.
195
+
196
+ Repeat steps 2-5 as necessary to refine your answer.
197
+
198
+ 6. **Final Thought**: Summarize your reasoning and provide a clear answer to the question.
199
+
200
+ ```
201
+
202
+ # REACT PROMPT TEMPLATE (plan test act)
203
+ These are sub templates
204
+
205
+ ```yaml
206
+ 1. **Question**: {Insert user question here}
207
+ 2. **Thought**: Think step by step about how to approach this question.
208
+ 3. **Action**: Determine what action to take next:
209
+ - [Plan]: Create a plan or methodolgy for the task , select from known methods if avaliable first.
210
+ - [Test]: Break down the problem into smaller parts testing each step befor moveing to the next:
211
+ - [Act]: Provide a summary of known facts related to the question. generate full answere from sucessfull steps :
212
+ 4. **Action Input**: Specify any details needed for the action.
213
+ 5. **Observation**: Describe what was found or learned from the action taken.
214
+
215
+ Repeat steps 2-5 as necessary to refine your answer.
216
+
217
+ 6. **Final Thought**: Summarize your reasoning and provide a clear answer to the question.
218
+
219
+ ```
220
+
221
+
222
+ # NODES : PROMPTING FOR GRAPH BEHAVIOURS
223
+
224
+
225
+ here we see another Prompt template ! it can alos provoke graph development and complex plans and solutions !
226
+ giving the modle some details of potential nodes and thier values !
227
+
228
+ ```yaml
229
+
230
+
231
+
232
+
233
+
234
+ Question: {PROMPT}
235
+ Thought:
236
+ Identify the main components of the question.
237
+ Consider the roles of various nodes (e.g., planner, executor) that can help in addressing the question.
238
+ Node Identification:
239
+ -[Planner]: Outline a strategy to tackle the question.
240
+ -[Searcher]: Identify what information is needed and where to find it.
241
+ -[Solver]: Determine potential solutions or approaches.
242
+ -[Executor]: Plan how to implement the chosen solution.
243
+ -[Tester]: Assess the effectiveness of the solution.
244
+ -[Replanner]: Adjust the strategy based on feedback or new information.
245
+ Action: Decide on the next steps based on node roles:
246
+ -[Search]: Look for relevant information online.
247
+ -[Analyze]: Break down the problem into smaller parts.
248
+ -[Summarize]: Provide a summary of known facts related to the question.
249
+ Action Input: Specify any details needed for the action (e.g., keywords for searching, specific aspects to analyze).
250
+ Observation: Describe what was found or learned from the action taken.
251
+ -[Iterate]: Repeat steps as necessary to refine your answer.[Adjust for the task as required ]
252
+ Final Thought: Summarize your reasoning and provide a clear answer to the question.
253
+
254
+
255
+
256
+
257
+
258
+
259
+ ```
260
+
261
+
262
+
263
+ ## Training Reginmes:
264
+ * Alpaca
265
+ * ChatML / OpenAI / MistralAI
266
+ * Text Generation
267
+ * Question/Answer (Chat)
268
+ * Planner
269
+ * Instruction/Input/Response (instruct)
270
+ * Mistral Standard Prompt
271
+ * Translation Tasks
272
+ * Entitys / Topic detection
273
+ * Book recall
274
+ * Coding challenges, Code Feedback, Code Sumarization, Commenting Code, code planning and explanation: Software generation tasks
275
+ * Agent Ranking and response anyalisis
276
+ * Medical tasks
277
+ * PubMed
278
+ * Diagnosis
279
+ * Psychaitry
280
+ * Counselling
281
+ * Life Coaching
282
+ * Note taking
283
+ * Medical smiles
284
+ * Medical Reporting
285
+ * Virtual laboritys simulations
286
+ * Chain of thoughts methods
287
+ * One shot / Multi shot prompting tasks
288
+
289
+ ### General Intenal Methods:
290
+
291
+ Trained for multi-task operations as well as rag and function calling :
292
+
293
+ This model is a fully functioning model and is fully uncensored:
294
+
295
+ the model has been trained on multiple datasets on the huggingface hub and kaggle :
296
+
297
+ the focus has been mainly on methodology :
298
+
299
+ * Chain of thoughts
300
+ * step by step planning
301
+ * tree of thoughts
302
+ * forest of thoughts
303
+ * graph of thoughts
304
+ * agent generation : Voting, ranking, ... dual agent response generation:
305
+
306
+
307
+ # Training Philosophy
308
+
309
+ Here are some of the benefits you might experience by prioritizing attention mechanisms during fine-tuning:
310
+
311
+ ## Enhanced Contextual Understanding:
312
+
313
+ Fine-tuning attention layers helps the model better grasp the relationships and dependencies within the input data, leading to more contextually relevant and accurate outputs.
314
+ ## Improved Control over Generation:
315
+
316
+ You gain more control over the model's generation process, guiding it to focus on specific aspects of the input and produce outputs that align with your desired goals.
317
+ ## More Creative and Diverse Outputs:
318
+
319
+ By refining the attention mechanism, you can encourage the model to explore a wider range of possibilities and generate more creative and diverse responses.
320
+ ## Reduced Overfitting:
321
+
322
+ Fine-tuning with a focus on attention can help prevent overfitting to specific patterns in the training data, leading to better generalization and more robust performance on new inputs.
323
+
324
+ # “Epochs are the key to effective training, rather than merely mass dumping examples—unless those examples are interconnected within a single or multiple conversations that teach through dialogue.”
325