Runway Gen-3 Can Make AI Videos of ‘Photorealistic Humans’

A bald man with a short beard is shown from the shoulders up against a neutral background. He has his mouth open wide as if he is speaking or singing. He is wearing a light-colored shirt.
Generated by Runway’s Gen-3 Alpha.

The race for AI video is really beginning to heat up with a slew of models suddenly being released and Runway, which has been releasing models longer than most, has just dropped its latest model Gen-3 Alpha.

Describing the model as a “new frontier for high-fidelity, controllable video generation”, Runway has shared a series of impressive videos made by its new model which are about as good as any AI video out there.

“Gen-3 Alpha is the first of an upcoming series of models trained by Runway on a new infrastructure built for large-scale multimodal training. It is a major improvement in fidelity, consistency, and motion over Gen-2, and a step towards building General World Models,” says Runway.

The General World Models the company speaks of is a long-term ambitious project for AI to understand the visual world and all of its dynamics so it can build an internal representation of an environment.

What is Gen-3 Alpha?

Gen-3 Alpha is the underlying model that will power Runway’s text-to-video, image-to-video, and text-to-image tools as well as control tools like Motion Brush, Advanced Camera Controls, and Director Mode.

It was trained on videos and images by an “in-house research team that oversees all of our training” with a spokesperson adding “we use curated, internal datasets to train our models.”

Gen-3 Alpa will have a “new set of safeguards” and Content Credentials (C2PA) provenance standards.

Users will be able to customize Gen-3 models for style and consistent characters. Speaking of humans, Runway also notes that “Gen-3 Alpha excels at generating expressive human characters with a wide range of actions, gestures, and emotions, unlocking new storytelling opportunities.”

Gen-3 Alpha will be released this week and will be available to Runway subscribers, members of the Creative Partners Program, and Enterprise users.