hmar-heritage-org/dolma-pretrain
Viewer • Updated • 89.6k • 22
None defined yet.
The Hmar Heritage Foundation is an independent community initiative dedicated to building open-access digital infrastructure, machine learning models, and cultural archives for the Hmar language. Our mission is to ensure that indigenous and regional languages of Northeast India are preserved, accurately categorized, and represented as first-class citizens in modern computational systems.
| Resource | Type | Description | Link |
|---|---|---|---|
| Dolma | Model | Foundational BERT Masked Language Model (MLM) adapted for Hmar (110M params, 89.6k sentences, PPL 6.68). | Model Card |
| Dolma Explorer | Space | Interactive inference web demo for masked word prediction and contextual analysis powered by ZeroGPU. | Demo Space |
| hmaraniam | Space | Deterministic language identification engine distinguishing Hmar from English and sibling Zo languages using 45,000+ unigrams. | Hmaraniam Space |
We curate and maintain standardized, open-access datasets on Hugging Face:
| Dataset | Scope / Tokens | Description | Link |
|---|---|---|---|
dolma-pretrain |
89,605 sentences (~2.4M words) | Curated multi-register corpus for transformer language model pretraining. | hmar-heritage-org/dolma-pretrain |
unigrams |
45,000+ unigrams | Frequency-weighted vocabulary with normalized and exact diacritic counts. | hmar-heritage-org/unigrams |
zo-cognates |
Upcoming upload | Comparative wordlists across Kuki-Chin / Zo varieties for dialect boundary analysis (staging). | hmar-heritage-org/zo-cognates |
zo-bible |
Parallel scripture chapters | Parallel Biblical text corpora across regional Zo varieties and orthographies. | hmar-heritage-org/zo-bible |
corpus-archive |
Archival documents & books | Digitized public domain books, cultural essays, and linguistic documents. | hmar-heritage-org/corpus-archive |
culture-dump |
Upcoming upload | Customary clan genealogies, cultural terminology, and community records (staging). | hmar-heritage-org/culture-dump |
hmingtluon |
Cultural naming registry | Traditional Hmar names, etymology, and clan-specific naming conventions. | hmar-heritage-org/hmingtluon |
numeral-words |
Number words & counting | Full mathematical, cardinal, and ordinal numbering system in Hmar. | hmar-heritage-org/numeral-words |
wordlist |
Core vocabulary | Standardized headwords and dictionary lexical definitions. | hmar-heritage-org/wordlist |
hmaraniam GitHub: https://github.com/hmar-heritage-org/hmaraniamhmaraniam PyPI: https://pypi.org/project/hmaraniam/hmr | Glottolog: hmar1241daiopch54@gmail.com