Russian mathematician Yurii Nesterov was recently awarded the Gauss Prize for outstanding mathematical contributions for his “groundbreaking work” on optimisation. The award cited his work on gradient descent methods – and in particular, the “efficiency gains [they] provide to AI technologies”.
Everyone using large language model (LLM) chatbots such as ChatGPT, Claude and Gemini – for any purpose – depends on Nesterov’s methods. They may speak like humans and be personified with names, but under the bonnet, LLMs are computer programs that work via optimisation of billions of parameters known as neural networks for their similarity to how brains function.
