|
--- |
|
license: apache-2.0 |
|
datasets: |
|
- Steelskull/Aether |
|
Model: |
|
- Mistral-7B-Instruct-v0.2 |
|
pipeline_tag: text-generation |
|
tags: |
|
- not-for-all-audiences |
|
--- |
|
|
|
|
|
<!DOCTYPE html> |
|
<style> |
|
body { |
|
font-family: 'Quicksand', sans-serif; |
|
background: linear-gradient(135deg, #2E3440 0%, #1A202C 100%); |
|
color: #D8DEE9; |
|
margin: 0; |
|
padding: 0; |
|
font-size: 16px; |
|
} |
|
.container { |
|
width: 80%; |
|
max-width: 800px; |
|
margin: 20px auto; |
|
background-color: rgba(255, 255, 255, 0.02); |
|
padding: 20px; |
|
border-radius: 12px; |
|
box-shadow: 0 4px 10px rgba(0, 0, 0, 0.2); |
|
backdrop-filter: blur(10px); |
|
border: 1px solid rgba(255, 255, 255, 0.1); |
|
} |
|
.header h1 { |
|
font-size: 28px; |
|
color: #ECEFF4; |
|
margin: 0 0 20px 0; |
|
text-shadow: 2px 2px 4px rgba(0, 0, 0, 0.3); |
|
} |
|
.info img { |
|
width: 100%; |
|
border-radius: 10px; |
|
margin-bottom: 15px; |
|
} |
|
a { |
|
color: #88C0D0; |
|
text-decoration: none; |
|
} |
|
a:hover { |
|
color: #A3BE8C; |
|
} |
|
a::before { |
|
content: ''; |
|
position: absolute; |
|
width: 100%; |
|
height: 2px; |
|
bottom: -5px; |
|
left: 0; |
|
background-color: #A3BE8C; |
|
visibility: hidden; |
|
transform: scaleX(0); |
|
transition: all 0.3s ease-in-out; |
|
} |
|
a:hover::before { |
|
visibility: visible; |
|
transform: scaleX(1); |
|
} |
|
.button { |
|
display: inline-block; |
|
background-color: #5E81AC; |
|
color: #E5E9F0; |
|
padding: 10px 20px; |
|
border-radius: 5px; |
|
cursor: pointer; |
|
text-decoration: none; |
|
} |
|
.button:hover { |
|
background-color: #81A1C1; |
|
} |
|
</style> |
|
<html lang="en"> |
|
<head> |
|
<meta charset="UTF-8"> |
|
<meta name="viewport" content="width=device-width, initial-scale=1.0"> |
|
<title>Data Card</title> |
|
<link href="https://fonts.googleapis.com/css2?family=Quicksand:wght@400;500;600&display=swap" rel="stylesheet"> |
|
</head> |
|
<body> |
|
<div class="container"> |
|
<div class="header"> |
|
<h1>Aethora-7B-V1</h1> |
|
</div> |
|
<div class="info"> |
|
<img src="https://cdn-uploads.huggingface.co/production/uploads/64545af5ec40bbbd01242ca6/c0--_3VtlhfpJrmT7XBPV.png"> |
|
<p><strong>Creator:</strong> <a href="https://huggingface.co/Steelskull" target="_blank">SteelSkull</a></p> |
|
<p><strong>About Aethora:</strong> Trained on 2 Full Epochs of Aethora-7b-V1 using Aether-V1.9 Dataset, Aethora is a model trained specifically for general use with a focus in RP/Story based on the 2.5mil row (around 1 billion tokens) Aether dataset.</p> |
|
<p><strong>Model Quants:</strong> Quants provided by: [N/A] .</p> |
|
<p><strong>Model Sources:</strong></p> |
|
<ul> |
|
<li>Developed & Funded by: <a href="https://huggingface.co/Steelskull">Steelskull</a></li> |
|
<li>Finetuned from model: <a href="https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2">Mistral-7B-Instruct-v0.2</a></li> |
|
<li>Finetuning Repository: <a href="https://huggingface.co/datasets/TheSkullery/Aether-V1.9">Aether Dataset</a></li> |
|
<li>Model type: BF16</li> |
|
<li>License: A2</li> |
|
</ul> |
|
<p><strong>Finetune Information:</strong></p> |
|
<ul> |
|
<li>Hardware Type: H100 x1</li> |
|
<li>Hours Used: 60-Hrs</li> |
|
<li>Cloud Provider: <a href="https://www.runpod.io">Runpod.io</a></li> |
|
<li>Compute Region: US-IL</li> |
|
</ul> |
|
<p><strong>Dataset Information:</strong></p> |
|
<ul> |
|
<li>Version v1.9: Fixed an error where 'system' and 'tools' records were not being carried over to the final dataframe. Added an 'origins' record for dataset sources.</li> |
|
<li>Version 1.8.5: Removed missing conversations or starting messages that are empty, and selectively omitted certain phrases for coherence and relevance.</li> |
|
</ul> |
|
<p><strong>Datasets Used:</strong></p> |
|
<ul> |
|
<li>grimulkan/bluemoon_Karen_cleaned</li> |
|
<li>Doctor-Shotgun/no-robots-sharegpt</li> |
|
<li>Locutusque/Hercules-v3.0</li> |
|
<li>jondurbin/airoboros-3.2</li> |
|
<li>openerotica/freedom-rp</li> |
|
<li>teknium/OpenHermes-2.5</li> |
|
<li>Doctor-Shotgun/capybara-sharegpt</li> |
|
<li>KaraKaraWitch/PIPPA-ShareGPT-formatted</li> |
|
<li>Locutusque/bagel-clean-v0.3-shuffled</li> |
|
<li>Locutusque/hyperion-v3.0</li> |
|
</ul> |
|
<p><strong>Dataset Summary (Processed / Removed):</strong></p> |
|
<ul> |
|
<li>Total Objects Removed: <strong>209074</strong></li> |
|
<li>Deduplication Stats: Starting row count: 4738917, Final row count: 2673175, Rows removed: <strong>2065742</strong></li> |
|
</ul> |
|
</div> |
|
</div> |
|
</body> |
|
</html> |
