ScarletAce
/

LLaMA3-8B-RoLoRA

Model card Files Files and versions Community

LLaMA3-8B-RoLoRA / boolq,piqa,hellaswag,winogrande,arc_easy,arc_challenge,openbookqa_W4_A4_GPTQ.log

ScarletAce's picture

Upload folder using huggingface_hub

53a2780 verified 4 months ago

history blame contribute delete

922 Bytes

	\| Tasks \|Version\|Filter\|n-shot\| Metric \|Value \| \|Stderr\|
	\|-------------\|------:\|------\|-----:\|--------\|-----:\|---\|-----:\|
	\|openbookqa \| 1\|none \| 0\|acc \|0.2400\|± \|0.0191\|
	\| \| \|none \| 0\|acc_norm\|0.3680\|± \|0.0216\|
	\|arc_challenge\| 1\|none \| 0\|acc \|0.3387\|± \|0.0138\|
	\| \| \|none \| 0\|acc_norm\|0.3823\|± \|0.0142\|
	\|arc_easy \| 1\|none \| 0\|acc \|0.6456\|± \|0.0098\|
	\| \| \|none \| 0\|acc_norm\|0.6031\|± \|0.0100\|
	\|winogrande \| 1\|none \| 0\|acc \|0.6022\|± \|0.0138\|
	\|hellaswag \| 1\|none \| 0\|acc \|0.4808\|± \|0.0050\|
	\| \| \|none \| 0\|acc_norm\|0.6669\|± \|0.0047\|
	\|piqa \| 1\|none \| 0\|acc \|0.7029\|± \|0.0107\|
	\| \| \|none \| 0\|acc_norm\|0.7111\|± \|0.0106\|
	\|boolq \| 2\|none \| 0\|acc \|0.6324\|± \|0.0084\|