Luma AI Ray3 Modify: This new AI works with real cameras and actors to reimagine scenes, instead of starting from text

Luma AI Ray3 Modify being used to transform a man wielding an icescraper into a barbarian warrior wielding an axe in a desolate cityscape.

Generative video typically starts from a text prompt, but one AI company is launching a hybrid workflow that uses both real cameras and real actors enhanced with artificial intelligence. Luma AI Ray3 Modify is an AI video generator that relies on real human performances, but then uses AI to create fantasy characters, add special effects, change the lighting, and more.

Announced on December 18, Ray3 Modify is designed to work around one of the biggest struggles of generative AI video: getting accurate human motion and emotion. Text-based generative video AI typically struggles with complex movements (as this hilarious video of an AI gymnast demonstrates).