Microsoft has potentially made a breakthrough with small language models (SLMs) after the recent development of a new reasoning technique dubbed rStar-Math. For context, the technique enhances the capabilities of SLMs, allowing them to compete or even surpass the math reasoning capability of OpenAI's o1 reasoning model — without distillation from superior models.
According to the research paper published on arXiv.org:
