ScarletAce
/

LLaMA2-7B-RoLoRA

Model card Files Files and versions Community

LLaMA2-7B-RoLoRA / boolq,piqa,hellaswag,winogrande,arc_easy,arc_challenge,openbookqa_FP16.log

ScarletAce's picture

Upload folder using huggingface_hub

26d4600 verified 5 months ago

history blame contribute delete

922 Bytes

	\| Tasks \|Version\|Filter\|n-shot\| Metric \|Value \| \|Stderr\|
	\|-------------\|------:\|------\|-----:\|--------\|-----:\|---\|-----:\|
	\|openbookqa \| 1\|none \| 0\|acc \|0.3180\|± \|0.0208\|
	\| \| \|none \| 0\|acc_norm\|0.4420\|± \|0.0222\|
	\|arc_challenge\| 1\|none \| 0\|acc \|0.4522\|± \|0.0145\|
	\| \| \|none \| 0\|acc_norm\|0.4684\|± \|0.0146\|
	\|arc_easy \| 1\|none \| 0\|acc \|0.7668\|± \|0.0087\|
	\| \| \|none \| 0\|acc_norm\|0.7538\|± \|0.0088\|
	\|winogrande \| 1\|none \| 0\|acc \|0.6985\|± \|0.0129\|
	\|hellaswag \| 1\|none \| 0\|acc \|0.5780\|± \|0.0049\|
	\| \| \|none \| 0\|acc_norm\|0.7669\|± \|0.0042\|
	\|piqa \| 1\|none \| 0\|acc \|0.7807\|± \|0.0097\|
	\| \| \|none \| 0\|acc_norm\|0.7938\|± \|0.0094\|
	\|boolq \| 2\|none \| 0\|acc \|0.7774\|± \|0.0073\|