YouTube announced significant enhancements to its Shorts platform at its "Made on YouTube" live event on Tuesday, introducing new generative AI tools designed for content creators. The updates include a custom version of Google's text-to-video generative AI model, Veo 3, alongside a new remixing feature and an "Edit with AI" capability.
The integrated custom version, branded Veo 3 Fast, generates video outputs at 480p with reduced latency, according to YouTube. This iteration also marks the first time users can create video clips with accompanying sound. The initial rollout of these features is targeting users in the United States, the United Kingdom, Canada, Australia, and New Zealand, with YouTube indicating plans for expanded functionality to additional regions at a later date.
Further capabilities for Shorts using Veo technology include the application of motion from an existing video to a still image, allowing for animations such as making a person in a static photo perform a dance. This is achieved through technology that captures and transfers movement between subjects. Additionally, creators will gain the ability to apply various stylistic filters, such as pop art or origami, and to integrate objects like characters or props into their videos using text descriptions. These expanded Veo functionalities are slated for release in the coming months.
A new remixing tool permits creators to convert dialogue from eligible videos into soundtracks for other Shorts. Dina Berrada, YouTube's Director of Product, Shorts and Generative AI Creation, stated in a blog post that this feature utilizes Google's AI music model, Lyria 2, and will enable creators to customize the mood of the generated song with options like "chill," "danceable," or "fun." YouTube plans to test this tool soon, with a broader rollout to U.S. creators expected in the coming weeks.
The "Edit with AI" feature is designed to streamline the creation process by transforming raw footage from a camera roll into initial video drafts. This tool identifies and arranges optimal moments, adds music and transitions, and can integrate a responsive voiceover in either English or Hindi. YouTube stated that the feature aims to provide creators with a foundational starting point for their Shorts content. Experimentation with "Edit with AI" is currently underway on Shorts and within the YouTube Create app, with expansion to select markets anticipated in the coming weeks.
