Hugging Face's logo

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
Back to feed
julien-c 
posted an update 1 day ago
Post
2886
After some heated discussion 🔥, we clarify our intent re. storage limits on the Hub

TL;DR:
- public storage is free, and (unless blatant abuse) unlimited. We do ask that you consider upgrading to PRO and/or Enterprise Hub if possible
- private storage is paid above a significant free tier (1TB if you have a paid account, 100GB otherwise)

docs: https://huggingface.co/docs/hub/storage-limits

We optimize our infrastructure continuously to scale our storage for the coming years of growth in Machine learning, to the benefit of the community 🔥

cc: @reach-vb @pierric @victor and the HF team
nyuuzyou

Finally, a happy ending

bartowski

This makes perfect sense, average users definitely don't need to be uploading that much stuff privately, great for testing but if it's not worth releasing publicly it's not worth storing on servers for free :)

Great update !

reach-vb
•
edited 1 day ago

btw we’ll continue to support the community via our grants programme, you can read more about it here: https://huggingface.co/docs/hub/storage-limits

image.png

Araki

Once the new rules go live, what will happen to the accounts that already have private repos exceeding the 100GB mark?

·
pierric

For existing users/orgs, the limits come on top of the storage already used 🤗

prithivMLmods

I really like this 🤗 .

benjamin-paine

image.png

JoPmt

Amazing!!!

agentlans

I was about to delete some of my models and datasets to save space. What a relief.

John6666

Anyway, as a way for users to deal with this, it seems that if we are unsure, we should just leave it as Public.
We should only use Private for things that are truly private or for work in progress.
Thank you for your generous treatment.😊

Perhaps HF doesn't really want to draw a line either, but there is no other way to counter malicious intent.
If it is Private, it is more difficult to grasp the actual usage situation than with Public, even if there is large-scale abuse or an attack on the site. The bigger and more famous the site becomes, the more inevitable it becomes.

AngelBottomless

I have some questions - what does "quota" mean? Is it equal to "free available space"?
So, if we have 13TB/1TB quota, then 12TB will be billed/ or, 13TB/14TB quota, then 12TB is billed (for pro)?
Also, if it's the case, will quota be shrinked?

·
John6666
•
edited about 8 hours ago

https://huggingface.co/posts/julien-c/388331843225875#675892fdd351ccd8731b07a2
This is from the side, but since the previous data set seems to be practically uncountable, I'll leave it as is, but I think your (community) case would fall within the scope of this. I hope it does.😓
Also, it looks like there are some additional details about fees and other information on the fees page.

John6666

Note:

General comments and requests for Hugging Face are generally collected in the following Posts or HF Discord. I'll take this opportunity to introduce them.
https://huggingface.co/posts/victor/964839563451127#6759a4aa2071844de6ae2832
https://discuss.huggingface.co/t/join-the-hugging-face-discord/11263/19

nroggendorff

W update

mhenrichsen

Totally unreleated, but please take this shit down.
https://huggingface.co/nesaorg/benchmark_v0

173M downloads. It's spam for their crypto scam.
@pierric @victor @reach-vb @julien-c

Duskfallcrew

Yea i'll DEF consider if my budget can handle it do Enterprise for at least E&D - right now i'm juggling several small income things (none of which can really be classified as a business) and being that i don't really have a job it'll be depending on how i juggle stuff.

In this post