BABYLLM
Collection
The baby-LLM is the future of LLM. • 2 items • Updated
• 1
It's a super tiny llama3 model.
It has 0.247B parameters.
It is pretrained on the fineweb-edu dataset.(10B)
I hope I can make it beter and better.
If you see it, please give me a like. Thanks.
More info will be added later.