kshitijthakkar/qwen3.5-moe-0.87B-d0.8B
Image-Text-to-Text • 1B • Updated
• 136
Qwen3.5 Dense-to-MoE Weight Transfer
Qwen3.5 MoE models from dual-source weight transfer (dense backbone + 35B-A3B experts). Hybrid DeltaNet + GQA attention.
-
-
kshitijthakkar/qwen3.5-moe-2.3B-d2B
Image-Text-to-Text • 3B • Updated • 73 -
kshitijthakkar/qwen3.5-moe-4.7B-d4B
Image-Text-to-Text • 5B • Updated • 82 -
kshitijthakkar/qwen3.5-tiny-test
Image-Text-to-Text • 0.1B • Updated • 286 -
kshitijthakkar/qwen3.5-from-scratch-tiny
2B • Updated • 73 -
kshitijthakkar/qwen3.5-0.8b-moe-from-scratch
3B • Updated • 57