KRLabsOrg/lettucedect-v2-qwen-2b
Text Generation • 2B • Updated • 902 • 2
Adam Kovacs PRO
adaamko
AI & ML interests
Explainable AI, rule-based models, hallucination detection, fact-checking LLMs
Recent Activity
updated a model 3 days ago
KRLabsOrg/lettucedect-v2-qwen-2b updated a model 3 days ago
KRLabsOrg/lettucedect-v2-taxonomy-head updated a model 3 days ago
KRLabsOrg/lettucedect-v2-mmbert-baseOrganizations
updated 3
models 3 days ago
upvoted an article 7 days ago
Article
A 0.6B model at #2 on MTEB(Law)
Hanno-Labs
• • 5 liked a
model 7 days ago
upvoted an article 9 days ago
Article
Lattice: an 8 MB static retriever that embeds Wikipedia in 7 minutes
erikkaum
• • 19 updated a
dataset 9 days ago
replied to their post 10 days ago
the parquet (what load_dataset serves) is canonical — 2,015 rows at 50.3%, the verified split that annotations/REPORT.md describes. The root JSONLs are an earlier, pre-verification generation; they're now moved to legacy/ to avoid confustion. The usage snippet tag is fixed too. Thanks for noticing :)
posted an update 10 days ago
Post
108
🥬 LettuceDetect v2 — span-level hallucination detection for code, tool output, and structured documents.
Hallucination detectors are trained on document QA, but agents ground their answers in source code, tool output and markdown. On code-agent answers, existing detectors reach 0.17 span-F1 and even 550B zero-shot judges at most 0.22.
We built a unified span-level benchmark — 74,285 newly constructed examples (145K+ with RAGTruth and 14-language PsiloQA folded in), every span typed and character-labeled — and trained two detectors on it:
🤖 KRLabsOrg/lettucedect-v2-qwen-2b — generative, typed spans + explanations in one pass, 32K context, **0.689 span-F1** (0.60 on code-agent)
⚡ KRLabsOrg/lettucedect-v2-mmbert-base — 307M multilingual encoder for high-throughput setups
🏷️ KRLabsOrg/lettucedect-v2-taxonomy-head — types the spans of any binary detector
It also reaches the best reported English PsiloQA IoU (0.724) and 81.8 RAGTruth example-F1, so specializing on code didn't cost general RAG performance.
📚 Dataset: KRLabsOrg/lettucedetect-code-hallucination
📄 Paper: https://arxiv.org/abs/2607.00895
The models are now integrated natively into vLLM Semantic Router — joint blog post on how it works: https://vllm-sr.ai/blog/lettucedetect-v2-generative-hallucination-detection
Hallucination detectors are trained on document QA, but agents ground their answers in source code, tool output and markdown. On code-agent answers, existing detectors reach 0.17 span-F1 and even 550B zero-shot judges at most 0.22.
We built a unified span-level benchmark — 74,285 newly constructed examples (145K+ with RAGTruth and 14-language PsiloQA folded in), every span typed and character-labeled — and trained two detectors on it:
🤖 KRLabsOrg/lettucedect-v2-qwen-2b — generative, typed spans + explanations in one pass, 32K context, **0.689 span-F1** (0.60 on code-agent)
⚡ KRLabsOrg/lettucedect-v2-mmbert-base — 307M multilingual encoder for high-throughput setups
🏷️ KRLabsOrg/lettucedect-v2-taxonomy-head — types the spans of any binary detector
It also reaches the best reported English PsiloQA IoU (0.724) and 81.8 RAGTruth example-F1, so specializing on code didn't cost general RAG performance.
📚 Dataset: KRLabsOrg/lettucedetect-code-hallucination
📄 Paper: https://arxiv.org/abs/2607.00895
The models are now integrated natively into vLLM Semantic Router — joint blog post on how it works: https://vllm-sr.ai/blog/lettucedetect-v2-generative-hallucination-detection
- 3 replies
updated a
collection 11 days ago
upvoted a paper 11 days ago
liked a
model 17 days ago
upvoted an article 18 days ago
Article
LettucePrevent - Real-Time Prevention of Factual Hallucinations in RAG
lebe1
• • 9 liked a
model 18 days ago
updated 6
models 25 days ago
KRLabsOrg/lettucedect-610m-eurobert-pl-v1
Token Classification • 0.6B • Updated • 91
KRLabsOrg/lettucedect-610m-eurobert-it-v1
Token Classification • 0.6B • Updated • 127
KRLabsOrg/lettucedect-610m-eurobert-fr-v1
Token Classification • 0.6B • Updated • 234 • 1
KRLabsOrg/lettucedect-610m-eurobert-es-v1
Token Classification • 0.6B • Updated • 40
KRLabsOrg/lettucedect-610m-eurobert-de-v1
Token Classification • 0.6B • Updated • 402 • 1
KRLabsOrg/lettucedect-610m-eurobert-cn-v1
Token Classification • 0.6B • Updated • 56 • 1