Not content with unleashing two of the world's most influential AI tools so far in ChatGPT and Dall-E, OpenAI this week turned its attention to a new frontier (AI-generated video) with its new model called Sora. While big questions remain, it might even be the most impressive of the lot.
How does it work?
OpenAI's research paper says that Sora is both a "diffusion model" (like Dall-E) and a "transformer" (like ChatGPT). This means it can predict sequences or patterns (in this case, video) based on vast quantities of training data. What we don't yet know is exactly what training data was used, which is a fairly big unanswered question.
