INFORMAZIONI SU QUESTO EPISODIO
🤗 Upvotes: 41 | cs.CV
Authors:
Lei Cao, Yu Liu, Wenhua Liao, Peng Zhang, Fei Wang, Hao Zhang, Jiajun Le, Daiguo Zhou, Jian Luan, Jiayi Ma
Title:
WorldCast: World-Consistent Character Video Generation with Large-Angle Camera Control
Arxiv:
http://arxiv.org/abs/2610.33135v1
Abstract:
Precise camera control is essential for cinematic character video generation, yet existing methods struggle to follow large-angle trajectories with combined rotation, translation, and radius variation from arbitrary initial azimuths. Such viewpoint changes also reveal character regions unseen in the initial frame, causing geometric distortions, appearance degradation, and identity drift. To systematically study these coupled challenges, we introduce CLACT, a large-scale Character-centric dataset and benchmark covering diverse Large-Angle Camera Trajectories, with accurate camera geometry and multi-view character observations for training and evaluation. We further propose WorldCast, a framework for world-consistent character video generation under diverse large-angle camera motions. Specifically, we back-project the initial frame into a 3D point cloud using estimated depth, align the point-cloud scale with the target camera trajectory, and render it along the trajectory to obtain explicit geometric guidance and coverage masks. To complement the incomplete character information, we introduce Geometry-Aligned Memory Attention (GAMA). Using relative camera poses estimated jointly from the initial frame and multi-view character anchors, we express anchor and target-view geometry in a common coordinate frame. GAMA uses this geometric alignment to guide the retrieval and injection of view-relevant character features during generation. Evaluations across diverse large-angle camera trajectories demonstrate accurate trajectory following while preserving character geometry, appearance, and identity.
IN QUESTO EPISODIO
TRASCRIZIONE 🔗
00:00:03,000 --> 00:00:05,520
Evan: Welcome to the Daily Paper Cast.
2
00:00:05,568 --> 00:00:14,278
Ashley: Today, we're covering a paper from the Hugging Face daily paper list of October 27, 2026, with 41 upvotes.
3
00:00:14,328 --> 00:00:21,728
Evan: The paper is titled 'WorldCast: World-Consistent Character Video Generation with Large-Angle Camera Control.'
4
00:00:21,792 --> 00:00:27,682
Ashley: The first two authors are Lei Cao and Yu Liu, with Peng Zhang as the corresponding author.
5
0…