What you need to know
- Microsoft recently published a new blog post highlighting its efforts toward teaching small language models how to reason.
- It unveiled Orca 2, a small language model demonstrating strong reasoning abilities by imitating the step-by-step reasoning traces of more capable LLMs like ChatGPT and Copilot.
- According to benchmarks, Orca 2 sports advanced performance capabilities compared to other LLMS when put to the test to handle complex tasks.
- Microsoft intends to train smaller language models using LLMs, ultimately expanding their capabilities.
