Zerogpu disk space limits?

Spaces
1

I am trying to create a xlarge zerogpu space for a fairly large (22B / ~80 GiB) model. Unfortunately, I seem to be running out of disk space during the tensor packing step. I attempted to purchase more storage, only to find that this is not possible anymore for new spaces.

Is there any way to load such a large model using zerogpu now? If not, is it possible with paid spaces? I actually couldn’t find any documentation stating whether paid spaces provide more ephemeral disk space.

@meganariley

1 Like
2

It seems like GPU space can sometimes offer quite a large amount of disk capacity?: Using GPU Spaces
But yeah it’s not for Zero GPU Space…

3

@John6666 Thanks, I looked at that table and somehow did not see “disk”. It’s good to know that is an option at least. But still, this definitely lowers the utility of zerogpu if there is no way around it. I’m working on a quantization to see if that will fit…

1 Like