Nanotron Research

community

AI & ML interests

Large scale distributed AI model training, model parallelisation, low-level GPU acceleration, make GPUs go brrrrr

Recent Activity

eliebak submitted a paper about 1 month ago

SonicMoE: Accelerating MoE with IO and Tile-aware Optimizations

thomwolf authored a paper 3 months ago

Robot Learning: A Tutorial

lvwerra authored a paper 3 months ago

BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution

View all activity

nanotron 's datasets 15

nanotron/book

Updated Jul 30, 2025 • 110 • 5

nanotron/ultrascale-playbook-data

Updated Mar 12, 2025 • 849 • 7

nanotron/picotron_bench

Viewer • Updated Dec 17, 2024 • 740 • 369 • 2

nanotron/minipile_100_samples

Viewer • Updated Jul 10, 2024 • 100 • 1.78k • 2

nanotron/llama3-1024-passkey-retrieval-eval

Viewer • Updated Jul 4, 2024 • 12.6k • 21 • 2

nanotron/llama3-16k-passkey-retrieval-finetuning

Viewer • Updated Jun 20, 2024 • 77.3k • 11 • 1

nanotron/llama3-16k-passkey-retrieval-eval

Viewer • Updated Jun 19, 2024 • 712 • 34 • 1

nanotron/llama3_needle_16k_finetuning

Viewer • Updated Jun 15, 2024 • 3.57k • 5 • 1

nanotron/needle_32k_eval_dataset

Viewer • Updated May 29, 2024 • 1.79k • 7 • 2

nanotron/needle_32k_finetuning_dataset

Viewer • Updated May 16, 2024 • 35.5k • 70 • 1

nanotron/needle_in_a_hay_stack_finetuning_dataset

Viewer • Updated May 14, 2024 • 21 • 8

nanotron/needle_in_a_hay_stack_eval_dataset

Viewer • Updated May 14, 2024 • 1 • 9 • 1

nanotron/needle_in_a_hay_stack_finetune_dataset

Viewer • Updated May 3, 2024 • 12.6k • 9 • 2

nanotron/simple_needle_in_a_hay_stack

Viewer • Updated Apr 24, 2024 • 12.6k • 29 • 1

nanotron/the-pile-for-doremi

Updated Feb 20, 2024 • 2