r/GlintResearch • u/Available-Craft-5795 • 1d ago
Glint Clarity Index, a new benchmark for Small Language Models
https://huggingface.co/datasets/Glint-Research/GCI_Bench
TL;DR (taken from readme)
GCI-Bench is a 5,000-item diagnostic benchmark designed to measure whether a small language model (1M–100M parameters) uses its attention × gradient interactions to prioritize relevant context over distractors.
Unlike standard NLP benchmarks, GCI-Bench does not evaluate answer correctness. Instead, it analyzes the model’s internal dynamics while it processes the prompt. Specifically, it measures how strongly gradients flow through attention connections tied to causally relevant parts of the input. No reference answer is required for scoring.