πŸ€– Limite 1B Violetto: A 1-Billion-Parameter Math Solver

Italian startup Paradigma trained a dense 1-billion-parameter transformer from scratch: fewer than 300 billion curated tokens in 6 weeks, context up to 131,072 tokens. Not a chatbot: the input is a problem, the output is a solution. On AIME 2026 β€” 94.01%, on BeyondAIME β€” 74.25%.

🌍 The model is tens of times smaller than competitors at the same level, with 1–3 orders of magnitude less compute: an argument in favor of speedrun pretraining and data curation instead of scale. The β€œsolver + Limite Value Model” combination is a block for best-of-n and RL.

πŸ‘€ Weights are open on Hugging Face (Apache 2.0): a local olympiad math solver β€” ~2 GB of weights, ~7.5 GB VRAM. Runs via a vLLM plugin on Linux with NVIDIA. The prompt must be a math problem: ordinary questions are reinterpreted as mathematical.

Source 1: https://paradigma.inc/blog/limite-1b-violetto/ Source 2: https://huggingface.co/paradigma-inc/limite-1b-violetto