One of the breakthroughs of DeepSeek's open source AI models is that they can be run locally using relatively inexpensive hardware, like the Raspberry Pi.
As it turns out, the DeepSeek V3 and R1 models can even be run on Moore Threads GPUs developed in China, reports ITHome. If true, this is a major achievement for DeepSeek, the hardware designer, and China as this potentially opens new doors for Moore Threads and reduces reliance of DeepSeek and China on Nvidia hardware.
Moore Threads reportedly says it had successfully deployed the DeepSeek-R1-Distill-Qwen-7B distilled model on its own MTT S80 client graphics card and MTT S4000 datacenter-grade graphics cards. The company used the Ollama lightweight framework that enables users to run large language models directly on their MacOS, Linux, and Windows machines as well as an optimized inference engine to achieve 'high' performance.
