5 months ago
42
- Last updated November 8, 2024
- In AI News
ReCapture, as it is named, can take any existing video and recreate it with enhanced angles and cinematic camera motion.
Google released ReCapture, its generative video camera controls for user-provided videos, on Friday. Hugging Face’s ML growth lead, Ahsen Khaliq, took to X to announce this feature using masked video fine-tuning.
Google presents ReCapture
Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuning pic.twitter.com/5qT386e5K0
Nataniel Ruiz, a senior research scientist at Google and others posted this launch on Hugging Face the same day. The company introduced ReCapture as an innovative method that transforms user-provided videos and creates new, dynamic camera perspectives.
Unlike prior advancements, which were limited to generating videos, ReCapture can recreate any existing video with enhanced angles and cinematic camera motion, retaining the original scene’s movements.
This update is steps ahead of what other text-to-video generation tools are creating. This enters an entirely new field of video-to-video generation. This breakthrough means users can view their footage from entirely new, realistic vantage points without needing to shoot from multiple angles.
ReCapture works in two stages. First, it creates a rough ‘anchor’ video with a new camera perspective using multiview diffusion models or depth-based point cloud rendering. Next, it applies a special ‘masked video fine-tuning technique’ to enhance the anchor video, making it clear and consistent over time. This process results in a smooth, re-angled video that can even generate unseen parts of a scene.
As reported by AIM earlier, multiple people and companies are experimenting with AI video generation by using tools like Midjourney, RunwayML, Soundful, ElevenLabs, ChatGPT, and CapCut. ReCapture could change the way people use such tools.
Even in the field of generative video games, which will see an immense boom in 2025, the integration of such tools could completely change the game.
A step ahead of video editing, ReCapture sets a whole new standard for video realism, taking it miles ahead of existing models. It showcases how AI is enhancing not just the creation but also the reimagination of visual content. This development could redefine the use of video in media production, allowing for creative storytelling and enhanced user engagement.
Sanjana Gupta
An information designer who loves to learn about and try new developments in the field of tech and AI. She likes to spend her spare time reading and exploring absurdism in literature.
8th Nov 2024
Meet 30+ top CDOs, ITDMs & AI Leaders.
Upcoming Large format Conference
India's Biggest Developers Summit
February 5 – 7, 2025 | Nimhans Convention Center, Bangalore
Download the easiest way to
stay informed
Subscribe to The Belamy: Our Weekly Newsletter
Biggest AI stories, delivered to your inbox every week.
Rising 2025 | DE&I in Tech & AI Summit
Mar 20 and 21, 2025 | 📍 J N Tata Auditorium, Bengaluru
Data Engineering Summit 2024
May 30 and 31, 2024 | 📍 Bangalore, India
February 5 – 7, 2025 | Nimhans Convention Center, Bangalore
MachineCon GCC Summit 2024
June 28 2024 | 📍Bangalore, India
September 25-27, 2024 | 📍Bangalore, India
25 July 2025 | 583 Park Avenue, New York
Our Discord Community for AI Ecosystem, In collaboration with NVIDIA.
World's Biggest Media & Analyst firm specializing in AI
AIM publishes every day, and we believe in quality over quantity, honesty over spin. We offer a wide variety of branding and targeting options to make it easy for you to propagate your brand.
AIM Brand Solutions, a marketing division within AIM, specializes in creating diverse content such as documentaries, public artworks, podcasts, videos, articles, and more to effectively tell compelling stories.
ADaSci Corporate training program on Generative AI provides a unique opportunity to empower, retain and advance your talent
With MachineHack you can not only find qualified developers with hiring challenges but can also engage the developer community and your internal workforce by hosting hackathons.
Conduct Customized Online Assessments on our Powerful Cloud-based Platform, Secured with Best-in-class Proctoring
AIM Research produces a series of annual reports on AI & Data Science covering every aspect of the industry. Request Customised Reports & AIM Surveys for a study on topics of your interest.
Immerse yourself in AI and business conferences tailored to your role, designed to elevate your performance and empower you to accomplish your organization’s vital objectives.
© Analytics India Magazine Pvt Ltd & AIM Media House LLC 2024
