longxiang-ai/awesome-video-diffusions
longxiang-ai/awesome-video-diffusions has 46 GitHub stars and 4 forks. Star changes are not measured yet. Last checked 2026-11-14 00:46 UTC. Last push 2026-11-09.
できること
- Unified CLI (main.py): Single entry point with init, search, suggest, export-bib, readme subcommands
- Interactive Config Wizard: Guided setup for keywords, domains, time range, and API keys via python main.py init
- Custom Search Keywords: Configure keywords for title, abstract, or both; with arXiv domain filtering (cs.CV, cs.AI, cs.MM, etc.)
- Time Range Filtering: Relative periods (30d, 6m, 1y, 2y) or absolute date ranges (YYYY-MM-DD to YYYY-MM-DD)
計測したスター増加
- 24時間
- 履歴を収集中
- 7日間
- 履歴を収集中
- 15日間
- 履歴を収集中
- 1か月
- 履歴を収集中
期間ごとの純増数です。期間は重複しており、日別の値ではありません。未計測の値は空欄です。スター数は注目度の指標であり、品質の保証ではありません。
概要
A curated and auto-updated collection of video diffusion / video generation papers from arXiv, covering text-to-video, image-to-video, controllable generation, world models, video editing, and 16+ research categories.
学習README.md
オリジナルAwesome Video Diffusions 
A curated list of latest research papers, projects and resources related to Video Diffusion Models and Video Generation. Content is automatically updated daily.
🗺️ Explore the Paper Atlas: an interactive paper map, monthly trends, topic network, co-author network and author rankings of every tracked paper.
Last Update: 2026-11-09 04:54:37
📰 Latest Updates
🗺️ [2026-09-30] Paper Atlas on GitHub Pages
- New interactive site built from all daily snapshots, rebuilt after every update
🔧 [2026-08-08] Resilient Scheduled Updates
- Temporary arXiv rate limits, server errors, and timeouts now preserve the latest valid data and finish with a warning
- Added stable search exit codes, atomic publication, strict JSON validation, and fallback to any valid historical snapshot
🔎 [2026-08-08] Broader and More Accurate Video Indexing
- Expanded coverage to 1,000 relevant papers across diffusion, flow matching, autoregressive generation, world models, editing, enhancement, and audio-video generation
- Added broader arXiv domains, local relevance filtering, and boundary-aware category matching for acronyms such as DiT, T2V, I2V, and V2V
🚀 [2026-02] Project Launched — v1.0
Adapted from awesome-gaussians framework for tracking video diffusion research
Unified CLI: Single entry point
python main.pywith subcommands:init,search,suggest,export-bib,readmeInteractive Configuration Wizard: Run
python main.py initto set up keywords, domains, time range, and API keys step-by-stepCustom Time Range Filtering: Support relative periods (
6m,1y,2y) and absolute date rangesSmart Link Extraction: Automatically extracts and classifies GitHub, project page, dataset, video, demo, and HuggingFace links from paper abstracts
BibTeX Export: Fetch BibTeX from arXiv and export to
.bibfiles with category/date filtersLLM Keyword Suggestion: Paste a few paper titles or arXiv IDs, and an LLM automatically generates optimized search keywords
arXiv Domain Filtering: Restrict searches to specific arXiv categories (e.g.,
cs.CV,cs.AI,cs.MM)16 Research Categories: Comprehensive taxonomy covering T2V, I2V, video editing, controllable generation, world models, and more
View detailed updates: News.md 📋
Categories
- 3D-aware Video Generation (52 papers) - Video generation with 3D awareness, multi-view consistency, and 4D content creation
- Applications (194 papers) - Domain-specific applications of video diffusion models
- Architecture & Efficiency (394 papers) - Architectural innovations (DiT, UNet), flow matching, and training/inference efficiency
- Audio & Multi-modal (63 papers) - Audio-driven and multi-modal conditioned video generation
- Controllable Generation (316 papers) - Controllable video generation with motion, camera, pose, or layout guidance
- Human & Character Animation (55 papers) - Human-centric video generation including talking heads, dance, and character animation
- Image-to-Video Generation (90 papers) - Methods for animating still images into videos
- Long Video Generation (243 papers) - Generating temporally consistent long-form videos beyond short clips
- Personalization & Customization (155 papers) - Personalized video generation with custom subjects, identities, or styles
- Physical Understanding (283 papers) - Physics-aware video generation and dynamics modeling
- Surveys & Benchmarks (323 papers) - Survey papers, benchmarks, and evaluation metrics for video generation
- Text-to-Video Generation (140 papers) - Foundation models and methods for generating videos from text prompts
- Video Editing (91 papers) - Diffusion-based video editing, style transfer, and manipulation
- Video Inpainting & Completion (25 papers) - Video inpainting, completion, outpainting, and temporal prediction
- Video Super-Resolution & Enhancement (179 papers) - Video quality improvement, upscaling, restoration, and frame interpolation
- World Models & Simulation (233 papers) - Video generation as world simulators and interactive environment generation
Table of Contents
Categorized Papers
3D-aware Video Generation
Showing the latest 50 out of 52 papers
- Video-Coder: Reinforcing Agentic Coding for Video Generation
Authors: Chaoyang Wang, Sicheng Gao, Junan Hu, Kunyang Li, Dongyang Chen, Yiyang Zhou, Huaxiu Yao, Yong Jae Lee, Radu Timofte, Yuzhang Shang
Links:
Keywords: controllable, dynamic 3d, dynamics, interactive, temporal consistency, video generation - LucidLyra: Feed-Forward Generative 3D Scene Reconstruction and Joint Understanding via Multi-Task Distillation
Authors: Oliver Hahn, Rodrigo Marcuzzi, Sangeetha Grama Srinivasan, Alessandro Burzio, Sherwin Bahmani, Jiahui Huang, Stefan Roth, Shengyu Huang, Qunjie Zhou, Laura Leal-Taixé
Links:
Keywords: diffusion model, distillation, dynamic 3d, novel view, physical, robotics, simulation, video diffusion - Hierarchical Diffusion for Camera-controlled Autoregressive Video Generation
Authors: Kaihua Chen, Yiming Gong, Deva Ramanan, Tarasha Khurana
Links:
Keywords: autoregressive, autoregressive video, camera control, denoising, long video, novel view, video generation - GroundControl: Satellite-Conditioned Multi-View Diffusion for Reconstruction-Free Novel View Synthesis
Authors: Akshay Krishnan, Matias Turkulainen, Jamie Wynn, Zawar Qureshi, Mohamed Sayed, Guillermo Garcia-Hernando, Sara Vicente, James Hays, Michael Firman, Daniyar Turmukhambetov
Links:|
Keywords: diffusion model, layout, novel view, video diffusion - SyncVid: World-Equivariant Diffusion for Synchronized Video Generation
Authors: Farhad G. Zanjani, Animesh Karnewar, Fatih Porikli, Amirhossein Habibian
Links:|
Keywords: camera control, diffusion model, video diffusion, video generation, view-consistent - AudioLift: Audio-Driven Single Image to Full-Head Gaussian Avatar via Multi-view Video Generation
Authors: Zhuoyuan Jiang, Weijie Lyu, Xiaoyuan Wang, Tiancheng Shen, Ming-Hsuan Yang
Links:
Keywords: audio-driven, audio-driven avatar, avatar, multi-view video, multi-view video generation, talking avatar, video generation - Learning the 4D World through Point Trajectory Forecasting
Authors: Byungwoo Jeon, Sunghwan Hong, Dohyeon Kim, Jonghoon Lee, Jungwoo Park, Inhee Lee, Doosan Baek, Jinil Kim, Taehyun Lim, Hanbyul Joo, Marc Pollefeys, Saining Xie, Jinwoo Shin
Links:
Keywords: 3d-aware, 4d generation, benchmark, camera-conditioned, evaluation, multi-view video, physical, point trajectory, simulation, trajectory, video generation, world model - Mise-en-Video: Fine-Grained 3D Control for Multi-Shot Video Generation
Authors: Yingshuang Zou, Xiaoyu Shi, Yawen Luo, Ziang Li, Qinghe Wang, Mengfei Li, Chengfeng Zhao, Xintao Wang, Pengfei Wan, Kun Gai, Yuan Liu
Links:
Keywords: 3d-aware, controllable, evaluation, layout, text to video, text-to-video, video generation - HORIA: 4D Human and Object Reconstruction from a Monocular Video with Interaction-Aware Re-Rendering
Authors: Hyeongjin Nam, Taeryung Lee, Daniel Sungho Jung, Kyoung Mu Lee
Links:
Keywords: novel view, text to video, text-to-video, video diffusion - Holo4D: Holistic 4D Reconstruction as Geometric Control for Video Diffusion
Authors: Yushi Lan, Zeren Jiang, Koichi Namekata, Xingang Pan, Chuanxia Zheng, Andrea Vedaldi
Links:
Keywords: camera control, camera trajectory, diffusion model, novel view, trajectory, video diffusion
Applications
Showing the latest 50 out of 194 papers
- Emo-LiveSync: Real-Time Universal Lip Synchronization with Explicit Emotion Control
Authors: Sangjoon Yu, Seungeun Lee, JoonHeyok Shin, Ji-Su Kang
Links:
Keywords: efficient, film, portrait animation, video generation - GuidedWAM: Training-Free Energy Guidance for World Action Models in Autonomous Driving
Authors: Xiyan Su, Finn Rasmus Schäfer, Hojun Lim, Frank Diermeyer, Johannes Betz, Markus Lienkamp
Links:
Keywords: autonomous driving, driving, visual world model, world model - ReactWorld: Structuring Interaction Responses for Embodied Video Generation
Authors: Hanwei Liu, Huijia Zhang, Hanzhang Wang, Guangyu Liu, Hanbei Zhan, Linjie Hu, Bin Xiao, Xuan Zhou, Dong Zhang
Links:
Keywords: dynamics, embodied, video generation - HIVE-Diff: High Frame Rate HDR Video Reconstruction from a Single LDR Frame and Events
Authors: Caixin Wang, Qingrui Wang, Jie Zhang, Ralph Etienne-Cummings
Links:
Keywords: autonomous driving, distillation, driving, video diffusion - Synthetic Realities: Evaluating Human Ability to Distinguish AIGenerated Videos from Real Footage
Authors: Danyal Sarfraz, Raja Mubashar Karim, KwanMyung Kim
Links:
Keywords: evaluation, film, image to video, image-to-video, outpainting, text to video, text-to-video, video outpainting, video synthesis - FilmTogether: Cinematic Video Generation from Low-Cost Inputs
Authors: Shiying Zhang, Xiaobin Hu, Qianchi Zhang, Jiaqi Zhao, Xiaoda Yang, Bo Yin, Shuicheng Yan
Links:
Keywords: cinematic, identity, layout, video editing, video generation - MotorSense: A Video-EMG Dataset of Motoric Representations for Action Understanding
Authors: Eadom Dessalene, Michael Maynord, Amir-Hossein Shahidzadeh, Botao He, Yasamin Tabatabaee, Ruoshi Liu, Ruohan Gao, Paul Pu Liang, Yiannis Aloimonos
Links:
Keywords: diffusion model, embodied, video diffusion - LucidLyra: Feed-Forward Generative 3D Scene Reconstruction and Joint Understanding via Multi-Task Distillation
Authors: Oliver Hahn, Rodrigo Marcuzzi, Sangeetha Grama Srinivasan, Alessandro Burzio, Sherwin Bahmani, Jiahui Huang, Stefan Roth, Shengyu Huang, Qunjie Zhou, Laura Leal-Taixé
Links:
Keywords: diffusion model, distillation, dynamic 3d, novel view, physical, robotics, simulation, video diffusion - Wizard: Manipulate Any World in Real Time via Agentic Control
Authors: Yuzhe Wu, Zijun Lin, Yeying Jin
Links:
Keywords: controllable, game, interactive, simulation, video generation, world model, world simulation - Video Generation Meets Agent Harness: Agentic Video Generation, Agentic World Modeling and Recursive Self-Improvement
Authors: Liaoyuan Fan, Yuhao Zheng, Dongxing Mao, Hangyu Ran, Siyuan Hu, Weijia Mao, Rui Zhao, Weijia Wu, Guian Fang, Yanzhe Chen, Zeyu Zhu, Yuxin Jiang, Yiren Song, Yuchao Gu, Junchao Yi, Qi Hu, Dan Kong, Alex Jinpeng Wang, Kevin Qinghong Lin, Mike Zheng Shou, Wei Liu
Links:
Keywords: action-conditioned, controllable, evaluation, game, interactive, video generation
Architecture & Efficiency
Showing the latest 50 out of 394 papers
- Emo-LiveSync: Real-Time Universal Lip Synchronization with Explicit Emotion Control
Authors: Sangjoon Yu, Seungeun Lee, JoonHeyok Shin, Ji-Su Kang
Links:
Keywords: efficient, film, portrait animation, video generation - UniRGBA: Unifying RGB and Alpha in Pretrained Video Diffusion Models
Authors: Lei Xu, Zhuo Li, Yongyi Jin, Aoyu Wang
Links:
Keywords: benchmark, dit, style, text to video, text-to-video, video diffusion - InstaGen: Group-Shared Importance Sampling for Fast Video Generation
Authors: Kislay Aditya Oj, Kumar Krishna Agrawal, Sri Surya Varma Datla, Aditya Desai
Links:
Keywords: architecture, efficient, sparse attention, t2v, video generation - Towards Practical 20 kbps Generative Video Compression via Adaptive Tokenization and Entropy Modeling
Authors: Jiancheng Zhao, Jixiang Luo, Haibin Huang, Chi Zhang, Xuelong Li
Links:
Keywords: autoregressive, video tokenizer - Training-Free Predictive Spatio-Temporal Token Pruning for Few-Step Autoregressive Video Diffusion
Authors: Jia Li, Xurui Peng, Xing Wang, Hayden Kwok-Hay So
Links:
Keywords: autoregressive, autoregressive video, denoising, distillation, efficient, trajectory, video diffusion, video generation - Householder Motion Embedding: Noise Modulation for Motion-Controllable Video Generation
Authors: Tao Jun Lin, Jinhong Ni, Ruyi Zha, Yifu Wang, Xibin Song, Pan Ji, Hongdong Li
Links:
Keywords: architecture, controllable, efficient, motion control, video diffusion, video generation - VA-TDM: A Unified View for Improving Few-Step Diffusion Models by Velocity Adversarial Distillation
Authors: Yihong Luo, Tianyu Pang, Tianyang Hu
Links:
Keywords: denoising, distillation, efficient, flow matching, text to video, text-to-video, trajectory, video generation - NextGAN: Towards Simple and Scalable GAN Training for Image and Video Generation
Authors: Xinhao Lou, Dongye Xie, Peng Sun, Chenyi Zhuang, Kaicheng Yu, Tao Lin
Links:|
Keywords: dit, text to video, text-to-video, video generation - TouchéWorld tech report : Towards Online Unified Camera--Hand Exploration in Generative Worlds
Authors: Jiaao Yu, Yanjian Zhang, Haoyang Jiang, Guillaume Wisniewski, Nadi Tomeh, Shijie Jia
Links:
Keywords: distillation, efficient, gesture, video world model, world model - DecoupAttn: Decoupled Sparse Attention for Training-Free Acceleration of Video Diffusion
Authors: Yanjin Li, Bingbing Qiu, Qiang Huang, Rui Qian, Yanfeng Li, Jian Wang, Xiaoying Tang, Mingda Zhang
Links:
Keywords: acceleration, denoising, sparse attention, video diffusion
Audio & Multi-modal
Showing the latest 50 out of 63 papers
- TaoMate-HD: Progressive-Resolution Autoregressive Audio-Video Generation
Authors: Qijun Gan, Chenwei Zhang, Xinyang Li, Meiguang Jin, Junfeng Ma, Shen Qiu
Links:|
Keywords: audio-video generation, autoregressive, denoising, distillation, streaming, trajectory, video generation - OmniOPD: Stable On-Policy Distillation for Joint Audio-Video Generation
Authors: Zihao Fan, Xin Lu, Jie Huang, Hexin Zhang, Xueyang Fu, Zheng-Jun Zha
Links:
Keywords: audio-video generation, distillation, joint audio-video, video generation - CAST-Bench: Tracing Every Sound to Its Source in Multi-Shot Audio-Video Generation
Authors: Yucong Liu, Qi Tian, Shuyuan Tu, Kaihang Pan, Weijie Kong, Chao Pan
Links:|
Keywords: audio-video generation, benchmark, evaluation, identity, sound, video generation - VibeVideoBench: Evaluating Multimodal Agents on Code-Driven Video Generation
Authors: Muxi Diao, Wenbin Xu, Lele Yang, Xuyang Ma, Yuzhe Chen, Jiankang Chen, Kaiyu Jiang, Changyi Liu, Haoyu Zhang, Hongyi Fu, Jianxiong Wang, Tianke Zhang, Haonan Fan, Yingxin Li, Bingyi Li, Xu Wang, Xuanyu Zheng, Bin Wen, Tingting Gao, Han Li, Wentao Zhang, Weiran Xu, Kongming Liang, Zhanyu Ma
Links:
Keywords: benchmark, evaluation, game, sound, video generation - AudioLift: Audio-Driven Single Image to Full-Head Gaussian Avatar via Multi-view Video Generation
Authors: Zhuoyuan Jiang, Weijie Lyu, Xiaoyuan Wang, Tiancheng Shen, Ming-Hsuan Yang
Links:
Keywords: audio-driven, audio-driven avatar, avatar, multi-view video, multi-view video generation, talking avatar, video generation - AVC-Reward: Event-Centric Audio-Video Consistency Evaluation
Authors: Yuruo Wu, Kaihang Pan, Kai Shen, Jiacheng Li, Shuyuan Tu, Jisheng Dang, Li Tuoyu, Juncheng Li, Siliang Tang
Links:|
Keywords: audio-video generation, benchmark, evaluation, joint audio-video, video generation - Kandinsky S2V 1.0: Audio-Driven Avatar Video Generation
Authors: Nikolay Semenov, Artem Riabinin, Sergey Bassenko, Anna Averchenkova, Julia Agafonova, Anastasia Aliaskina, Kirill Kozlov, Lev Novitskiy, Nikita Samsonov, Nikolai Gerasimenko, Denis Dimitrov
Links:
Keywords: architecture, audio-driven, audio-driven avatar, avatar, benchmark, controllable, evaluation, gesture, human animation, human evaluation, long-form, speech-to-video, video generation - Simplifying and Improving On-Policy Distillation for Few-Step Diffusion
Authors: Jiawei Zhang, Ziyu Wan, Nanye Ma, Long Zhao, Dong Chen, Hongyu Liu, Qifeng Chen, Dongdong Chen
Links:
Keywords: audio-video generation, distillation, joint audio-video, video generation, video synthesis - Structured Stateful Relational Scripts with a High-Quality Dataset for Multi-Shot Audio-Visual Video Generation
Authors: Chen Zhao, Lehan Shen, Qilong Huang, Hongyu Li, Zhuoliang Kang, Xiaoming Wei, Jian Yang, Ying Tai
Links:|
|
Keywords: audio-visual generation, identity, sound, video generation - CatPortrait: Taming Video Generative Models for Portrait Animation via In-context Conditioning
Authors: Ziqi Ni, Zhou Fang, Shijian Wang, Rui Li, Yi Zhou
Links:
Keywords: audio-driven, controllable, image to video, image-to-video, portrait animation, video generation
Controllable Generation
Showing the latest 50 out of 316 papers
- Video-Coder: Reinforcing Agentic Coding for Video Generation
Authors: Chaoyang Wang, Sicheng Gao, Junan Hu, Kunyang Li, Dongyang Chen, Yiyang Zhou, Huaxiu Yao, Yong Jae Lee, Radu Timofte, Yuzhang Shang
Links:
Keywords: controllable, dynamic 3d, dynamics, interactive, temporal consistency, video generation - Trajectory Forcing: Exploiting Diffusion Trajectories for Autoregressive Long Video Generation
Authors: Bohan Wang, Shuo Chen, Yunzhi Li, Zhaozheng Chen, Junzhe Zhang, Hanwang Zhang
Links:
Keywords: autoregressive, benchmark, denoising, diffusion model, long video, streaming, trajectory, video diffusion, video generation - MotionCore: A Latent Neural Simulator for Video Generation with Rigid-Body Dynamics
Authors: Zheng Wang, Zhengwei Gong, Yuanzhi Liang, Chi Zhang
Links:
Keywords: body motion, controllable, diffusion model, dynamics, identity, physical, physical consistency, trajectory, video diffusion, video generation - Decoding spatial and semantic information from large-scale visual cortical activity for natural-movie reconstruction
Authors: Yukai Huang, Haoyu Albert Wang, Jiawei Zhang, Jialun Ma, Jiayao Ding, Yiran Lin, Xingyu Chen, Ziqi Gao, Yuguo Yu
Links:
Keywords: diffusion model, dynamics, identity, layout, video diffusion - EgoGeneralist: Unifying Egocentric Action-Video Tasks through Video-Native Modeling
Authors: Yanlin Jin, Bowen Yang, Cheng Zhang, Yifan Yang, Zhe Li, Jianfei Cai, Kai Zhu
Links:
Keywords: action-conditioned, dynamics, human motion, video generation - Training-Free Predictive Spatio-Temporal Token Pruning for Few-Step Autoregressive Video Diffusion
Authors: Jia Li, Xurui Peng, Xing Wang, Hayden Kwok-Hay So
Links:
Keywords: autoregressive, autoregressive video, denoising, distillation, efficient, trajectory, video diffusion, video generation - Householder Motion Embedding: Noise Modulation for Motion-Controllable Video Generation
Authors: Tao Jun Lin, Jinhong Ni, Ruyi Zha, Yifu Wang, Xibin Song, Pan Ji, Hongdong Li
Links:
Keywords: architecture, controllable, efficient, motion control, video diffusion, video generation - VA-TDM: A Unified View for Improving Few-Step Diffusion Models by Velocity Adversarial Distillation
Authors: Yihong Luo, Tianyu Pang, Tianyang Hu
Links:
Keywords: denoising, distillation, efficient, flow matching, text to video, text-to-video, trajectory, video generation - Chronos: Sequential Identity-Preserving Video Generation by Temporal Anchoring
Authors: Mengqi Huang, Wenchuan Wang, Zhendong Mao, Yijing Tu, Zhike Liu, Luoni Wang, Ning Tong, Xiaoxiao Sheng, Tianyu Huang, Xuecheng Qi, Yongdong Zhang
Links:
Keywords: evaluation, identity, identity-preserving, keyframe, reference-guided, video generation - Route Anything: A Study of Model and Policy Routing for General-Purpose AI Systems
Authors: Pengfei Zhou, Yixing Ma, Hexin Wang, Weidong Tang, Zhenglin Wan, Wangbo Zhao, Yang You
Links:
Keywords: trajectory, video generation
Human & Character Animation
Showing the latest 50 out of 55 papers
- Emo-LiveSync: Real-Time Universal Lip Synchronization with Explicit Emotion Control
Authors: Sangjoon Yu, Seungeun Lee, JoonHeyok Shin, Ji-Su Kang
Links:
Keywords: efficient, film, portrait animation, video generation - MotionCore: A Latent Neural Simulator for Video Generation with Rigid-Body Dynamics
Authors: Zheng Wang, Zhengwei Gong, Yuanzhi Liang, Chi Zhang
Links:
Keywords: body motion, controllable, diffusion model, dynamics, identity, physical, physical consistency, trajectory, video diffusion, video generation - EgoGeneralist: Unifying Egocentric Action-Video Tasks through Video-Native Modeling
Authors: Yanlin Jin, Bowen Yang, Cheng Zhang, Yifan Yang, Zhe Li, Jianfei Cai, Kai Zhu
Links:
Keywords: action-conditioned, dynamics, human motion, video generation - EmoReward: Self-Evolving Reward Calibration for Emotional Video Generation RL
Authors: Mingzhe Zheng, Yue Wu, Jing Tan, Chang Zou, Dengyang Jiang, Zeyue Tian, Xuanhua He, Ryan Xu, Yunyang Ge, Sihui Ji, Yunlong Lin, Kaihang Pan, Hongru Yan, Sixiang Chen, Dianyi Wang, Julian Zhang, Weijie Kong, Changlin Li, Lanqing Guo, Zhao Zhong, Qifeng Chen, Harry Yang
Links:
Keywords: body motion, evaluation, video generation - TouchéWorld tech report : Towards Online Unified Camera--Hand Exploration in Generative Worlds
Authors: Jiaao Yu, Yanjian Zhang, Haoyang Jiang, Guillaume Wisniewski, Nadi Tomeh, Shijie Jia
Links:
Keywords: distillation, efficient, gesture, video world model, world model - DualCast: Dual-Image Conditioned Diffusion Transformers for Digital Human E-Commerce Video Generation
Authors: Lifan Jiang, Yibo Zhao, Senlin Cheng, Bolei Xu, Xiaobo Li, Can Ye, Dehai Zhao, Deng Cai, Boxi Wu
Links:
Keywords: digital human, dit, identity, style, video generation - Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On
Authors: Seungyong Lee, Suhyeok Jang, Minyoung Kim, Jinwoo Shin
Links:
Keywords: dynamics, video synthesis, virtual try-on - TaoMate-FVSR: Audio-Guided Facial Video Restoration
Authors: Xinyang Li, Zeran Xu, Jingna Sun, Qijun Gan, Chenwei Zhang, Meiguang Jin, Junfeng Ma
Links:
Keywords: diffusion transformer, identity, talking head, temporal consistency, video diffusion, video diffusion transformer, video restoration - Regional Anchor Routing for Multi-Object Motion Transfer
Authors: Yuze Li, Fuchen Long, Xinlong Sun, Cheng Yan, Xinyu Zhang, Xi Chen
Links:
Keywords: denoising, diffusion transformer, efficient, motion transfer, video diffusion, video diffusion transformer - ViT-H: Generative Video-To-Humanoid Control with Motion Tracking Feedback
Authors: Zimo He, Tianyi Bian, Zizhong Yang, Hongjie Li, Nan Jiang, Jieming Cui, Baoxiong Jia, Yizhou Wang, Siyuan Huang, Yixin Zhu
Links:
Keywords: autoregressive, diffusion model, human motion
Image-to-Video Generation
Showing the latest 50 out of 90 papers
- PathoS2VD: From 2D Histopathology to Pseudo Z-Stack Representations
Authors: Jiamu Wang, Keunho Byeon, Ji-Uk Kim, Jin Tae Kwak, Heounjeong Go
Links:|
Keywords: diffusion model, i2v, image to video, image-to-video, physical - Synthetic Realities: Evaluating Human Ability to Distinguish AIGenerated Videos from Real Footage
Authors: Danyal Sarfraz, Raja Mubashar Karim, KwanMyung Kim
Links:
Keywords: evaluation, film, image to video, image-to-video, outpainting, text to video, text-to-video, video outpainting, video synthesis - IMPACT: Image-Conditioned Motion with Physics-Aware Collision and Trajectory Guidance for Video Generation
Authors: Shiwei Yang, Yunlong Yu, Zhao Wang, Jungong Han
Links:|
Keywords: controllable, dynamics, image to video, image-to-video, physical, physical plausibility, physics, physics-aware, trajectory, video generation - GeoFlip Preview: Benchmarking Geometry-Sensitive Physics in Video Generation
Authors: Yuqi Li, Junming Liu, Bowen Hu, Ruize Niu, Huiran Duan, Ming-Hsuan Yang, Yingli Tian, Hao Wu
Links:
Keywords: benchmark, evaluation, image to video, image-to-video, physical, physical consistency, physics, simulation, video generation - MorphSIG: Subject-Driven Image Generation via Decoupled Anchoring and Feature Transport
Authors: Hailong Yan, Yongrui Zhang, Xiangtao Zhang, Le Zhang
Links:
Keywords: benchmark, denoising, identity, image to video, image-to-video, subject-driven - Edited Endpoints as Partial Goals for Image-to-Video Generation
Authors: Sihyun Kim, Sanghyun Jo, Kyungsu Kim
Links:|
Keywords: i2v, image to video, image-to-video, layout, video generation - Mix Forcing: Causal Pre-Training via Mixture Attention for Interactive World Models
Authors: Zelin Gao, Hao Ouyang, Jiapeng Zhu, Qiuyu Wang, Jingye Chen, Zichen Liu, Xing Zhu, Yujun Shen, Yinghao Xu
Links:|
Keywords: autoregressive, benchmark, camera control, diffusion model, distillation, image to video, image-to-video, interactive, video diffusion - AEON: Unifying Video and 3D World Models
Authors: Weiqi Zhang, Wenyuan Zhang, Yu-Shen Liu, Junsheng Zhou
Links:|
Keywords: distillation, dynamics, image-conditioned video, simulation, world simulation - Latent Bridge: From Video Latents to 3D Geometry via Feature Alignment
Authors: Shuai Zhang, Zhanpeng Ouyang, Zhengqing Chen, Ruohong Mei, Shaoyu Chen, Weiqiang Ren, Hui Sun, Qian Zhang, Wenyu Liu, Xinggang Wang
Links:|
Keywords: distillation, efficient, image to video, image-to-video, text to video, text-to-video, video generation - Code2Video-Compass: A Comprehensive Benchmark for General-Purpose Code-Based Video Generation across T2V, I2V, and V2V
Authors: Zhenghan Chen, Zekai Shao, Xin Lin, Leting Cheng, Siming Chen
Links:
Keywords: benchmark, controllable, creative, evaluation, i2v, image to video, image-to-video, t2v, text to video, text-to-video, v2v, video generation, video to video, video-to-video
Long Video Generation
Showing the latest 50 out of 243 papers
- Video-Coder: Reinforcing Agentic Coding for Video Generation
Authors: Chaoyang Wang, Sicheng Gao, Junan Hu, Kunyang Li, Dongyang Chen, Yiyang Zhou, Huaxiu Yao, Yong Jae Lee, Radu Timofte, Yuzhang Shang
Links:
Keywords: controllable, dynamic 3d, dynamics, interactive, temporal consistency, video generation - AR-Edit: Training-Free Autoregressive Video Editing without Inversion
Authors: Hovhannes Margaryan, Quentin Bammey, Christian Sandor, Vicky Kalogeiton
Links:
Keywords: autoregressive, autoregressive video, denoising, dynamics, identity, interactive, streaming, video diffusion, video editing - Trajectory Forcing: Exploiting Diffusion Trajectories for Autoregressive Long Video Generation
Authors: Bohan Wang, Shuo Chen, Yunzhi Li, Zhaozheng Chen, Junzhe Zhang, Hanwang Zhang
Links:
Keywords: autoregressive, benchmark, denoising, diffusion model, long video, streaming, trajectory, video diffusion, video generation - ManimCode: Learning Visual Self-Correction for Educational Animation
Authors: Zhengyang Liang, Lizi Liao
Links:
Keywords: long-form, video generation - Towards Practical 20 kbps Generative Video Compression via Adaptive Tokenization and Entropy Modeling
Authors: Jiancheng Zhao, Jixiang Luo, Haibin Huang, Chi Zhang, Xuelong Li
Links:
Keywords: autoregressive, video tokenizer - Training-Free Predictive Spatio-Temporal Token Pruning for Few-Step Autoregressive Video Diffusion
Authors: Jia Li, Xurui Peng, Xing Wang, Hayden Kwok-Hay So
Links:
Keywords: autoregressive, autoregressive video, denoising, distillation, efficient, trajectory, video diffusion, video generation - EvoWorld: Towards Out-of-Sight World Evolution in Generative Video Models
Authors: Yequan Bie, Dengyang Jiang, Zhixuan Chen, Xiaozhuan Liang, Haoxuan Che, Quande Liu, Xi Chen, Hao Chen
Links:
Keywords: autoregressive, autoregressive video - NanoKV: High-Ratio KV Cache Compression for Autoregressive Video Generation
Authors: Jiacheng Lu, Haoyi Zhu, Sipei Yi, Enze Xie, Cheng Zhuo, Yu Li
Links:
Keywords: autoregressive, autoregressive video, video generation - What Remains in Sight? Autoregressive Video Decoding as Representation-Guided Context Rewriting
Authors: Lixuan He, Jihyeon Je, Yang You, Leonidas Guibas
Links:
Keywords: autoregressive, autoregressive video, long video, text to video, text-to-video, video generation - TaoMate-HD: Progressive-Resolution Autoregressive Audio-Video Generation
Authors: Qijun Gan, Chenwei Zhang, Xinyang Li, Meiguang Jin, Junfeng Ma, Shen Qiu
Links:|
Keywords: audio-video generation, autoregressive, denoising, distillation, streaming, trajectory, video generation
Personalization & Customization
Showing the latest 50 out of 155 papers
- AR-Edit: Training-Free Autoregressive Video Editing without Inversion
Authors: Hovhannes Margaryan, Quentin Bammey, Christian Sandor, Vicky Kalogeiton
Links:
Keywords: autoregressive, autoregressive video, denoising, dynamics, identity, interactive, streaming, video diffusion, video editing - UniRGBA: Unifying RGB and Alpha in Pretrained Video Diffusion Models
Authors: Lei Xu, Zhuo Li, Yongyi Jin, Aoyu Wang
Links:
Keywords: benchmark, dit, style, text to video, text-to-video, video diffusion - MotionCore: A Latent Neural Simulator for Video Generation with Rigid-Body Dynamics
Authors: Zheng Wang, Zhengwei Gong, Yuanzhi Liang, Chi Zhang
Links:
Keywords: body motion, controllable, diffusion model, dynamics, identity, physical, physical consistency, trajectory, video diffusion, video generation - Decoding spatial and semantic information from large-scale visual cortical activity for natural-movie reconstruction
Authors: Yukai Huang, Haoyu Albert Wang, Jiawei Zhang, Jialun Ma, Jiayao Ding, Yiran Lin, Xingyu Chen, Ziqi Gao, Yuguo Yu
Links:
Keywords: diffusion model, dynamics, identity, layout, video diffusion - Guidance Is a Field, Not a Scalar: Interval-Integrated Classifier-Free Guidance for One-Step Video Generation
Authors: Zijie Meng, Xixin Cao
Links:|
Keywords: evaluation, identity, video generation - Chronos: Sequential Identity-Preserving Video Generation by Temporal Anchoring
Authors: Mengqi Huang, Wenchuan Wang, Zhendong Mao, Yijing Tu, Zhike Liu, Luoni Wang, Ning Tong, Xiaoxiao Sheng, Tianyu Huang, Xuecheng Qi, Yongdong Zhang
Links:
Keywords: evaluation, identity, identity-preserving, keyframe, reference-guided, video generation - DualCast: Dual-Image Conditioned Diffusion Transformers for Digital Human E-Commerce Video Generation
Authors: Lifan Jiang, Yibo Zhao, Senlin Cheng, Bolei Xu, Xiaobo Li, Can Ye, Dehai Zhao, Deng Cai, Boxi Wu
Links:
Keywords: digital human, dit, identity, style, video generation - TaoMate-FVSR: Audio-Guided Facial Video Restoration
Authors: Xinyang Li, Zeran Xu, Jingna Sun, Qijun Gan, Chenwei Zhang, Meiguang Jin, Junfeng Ma
Links:
Keywords: diffusion transformer, identity, talking head, temporal consistency, video diffusion, video diffusion transformer, video restoration - One Image Is Enough: Self-Generated Supervision for Personalizing Human Video Diffusion at Test Time
Authors: Sadman Rakib Pinon, Adamo Orsini, Yanis Falaki, Linlian Jiang, Jacob Kingi, Yang Wang, Xinxin Zuo
Links:|
Keywords: identity, personalization, video diffusion - Disen-Forcing: Disentangling Semantic Anchoring from Motion for Autoregressive Video Diffusion
Authors: Zhengyang Yu, Akio Hayakawa, Masato Ishii, Qingtao Yu, Xuesong Li, Takashi Shibuya, Yuki Mitsufuji, Jing Zhang
Links:
Keywords: autoregressive, autoregressive video, distillation, dynamics, style, video diffusion, video generation
Physical Understanding
Showing the latest 50 out of 283 papers
- Video-Coder: Reinforcing Agentic Coding for Video Generation
Authors: Chaoyang Wang, Sicheng Gao, Junan Hu, Kunyang Li, Dongyang Chen, Yiyang Zhou, Huaxiu Yao, Yong Jae Lee, Radu Timofte, Yuzhang Shang
Links:
Keywords: controllable, dynamic 3d, dynamics, interactive, temporal consistency, video generation - AR-Edit: Training-Free Autoregressive Video Editing without Inversion
Authors: Hovhannes Margaryan, Quentin Bammey, Christian Sandor, Vicky Kalogeiton
Links:
Keywords: autoregressive, autoregressive video, denoising, dynamics, identity, interactive, streaming, video diffusion, video editing - MotionCore: A Latent Neural Simulator for Video Generation with Rigid-Body Dynamics
Authors: Zheng Wang, Zhengwei Gong, Yuanzhi Liang, Chi Zhang
Links:
Keywords: body motion, controllable, diffusion model, dynamics, identity, physical, physical consistency, trajectory, video diffusion, video generation - Decoding spatial and semantic information from large-scale visual cortical activity for natural-movie reconstruction
Authors: Yukai Huang, Haoyu Albert Wang, Jiawei Zhang, Jialun Ma, Jiayao Ding, Yiran Lin, Xingyu Chen, Ziqi Gao, Yuguo Yu
Links:
Keywords: diffusion model, dynamics, identity, layout, video diffusion - EgoGeneralist: Unifying Egocentric Action-Video Tasks through Video-Native Modeling
Authors: Yanlin Jin, Bowen Yang, Cheng Zhang, Yifan Yang, Zhe Li, Jianfei Cai, Kai Zhu
Links:
Keywords: action-conditioned, dynamics, human motion, video generation - CoGenRec: A Unified Generative Framework for Complementary Vision Reconstruction
Authors: Yapeng Meng, Yuguo Chen, Xiangru Chen, Shaojun Xu, Xuezhen Wang, Lijian Wang, Zheyu Yang, Yihan Lin, Luping Shi, Rong Zhao
Links:|
Keywords: diffusion model, frame interpolation, physical, video deblurring, video diffusion - ReactWorld: Structuring Interaction Responses for Embodied Video Generation
Authors: Hanwei Liu, Huijia Zhang, Hanzhang Wang, Guangyu Liu, Hanbei Zhan, Linjie Hu, Bin Xiao, Xuan Zhou, Dong Zhang
Links:
Keywords: dynamics, embodied, video generation - PathoS2VD: From 2D Histopathology to Pseudo Z-Stack Representations
Authors: Jiamu Wang, Keunho Byeon, Ji-Uk Kim, Jin Tae Kwak, Heounjeong Go
Links:|
Keywords: diffusion model, i2v, image to video, image-to-video, physical - DreamX: Video Diffusion Model is a Universal Latent Action Learner
Authors: Jisoo Kim, Chaehyun Kim, Junsu Kim, Jiho Park, Seongchan Kim, Eunbeen Hong, Soowon Son, Fu-En Yang, Seungryong Kim
Links:
Keywords: diffusion model, dynamics, latent video, video diffusion - Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On
Authors: Seungyong Lee, Suhyeok Jang, Minyoung Kim, Jinwoo Shin
Links:
Keywords: dynamics, video synthesis, virtual try-on
Surveys & Benchmarks
Showing the latest 50 out of 323 papers
- Trajectory Forcing: Exploiting Diffusion Trajectories for Autoregressive Long Video Generation
Authors: Bohan Wang, Shuo Chen, Yunzhi Li, Zhaozheng Chen, Junzhe Zhang, Hanwang Zhang
Links:
Keywords: autoregressive, benchmark, denoising, diffusion model, long video, streaming, trajectory, video diffusion, video generation - UniRGBA: Unifying RGB and Alpha in Pretrained Video Diffusion Models
Authors: Lei Xu, Zhuo Li, Yongyi Jin, Aoyu Wang
Links:
Keywords: benchmark, dit, style, text to video, text-to-video, video diffusion - Guidance Is a Field, Not a Scalar: Interval-Integrated Classifier-Free Guidance for One-Step Video Generation
Authors: Zijie Meng, Xixin Cao
Links:|
Keywords: evaluation, identity, video generation - EmoReward: Self-Evolving Reward Calibration for Emotional Video Generation RL
Authors: Mingzhe Zheng, Yue Wu, Jing Tan, Chang Zou, Dengyang Jiang, Zeyue Tian, Xuanhua He, Ryan Xu, Yunyang Ge, Sihui Ji, Yunlong Lin, Kaihang Pan, Hongru Yan, Sixiang Chen, Dianyi Wang, Julian Zhang, Weijie Kong, Changlin Li, Lanqing Guo, Zhao Zhong, Qifeng Chen, Harry Yang
Links:
Keywords: body motion, evaluation, video generation - Grounding in the Dark: Text-Only Training for Zero-Shot Video Temporal Localization
Authors: Divyanshu Mishra, Sabine Sternig, Rakshith Shetty, Erhan Gundogdu
Links:
Keywords: benchmark, text to video, text-to-video - Chronos: Sequential Identity-Preserving Video Generation by Temporal Anchoring
Authors: Mengqi Huang, Wenchuan Wang, Zhendong Mao, Yijing Tu, Zhike Liu, Luoni Wang, Ning Tong, Xiaoxiao Sheng, Tianyu Huang, Xuecheng Qi, Yongdong Zhang
Links:
Keywords: evaluation, identity, identity-preserving, keyframe, reference-guided, video generation - Behind Video Generation: Observations and Insights on Multimodal Understanding from Kling
Authors: Kling Team, Dong Chen, Jialu Chen, Xinlong Chen, Yifan Dai, Haotian Dong, Binzong Geng, Yushuo Guan, Minghui Guo, Guanlin He, Guanxiao He, Jingyun Hua, Yanwei Huang, Yiyan Ji, Xueping Jia, Yizhuo Jia, Bozhou Li, Jiaze Li, Min Li, Shihao Li, Shujie Li, Shengyi Liao, Weihong Lin, Shiyuan Liu, Xinyu Liu, Siyang Mao, Xiaoru Qu, Dianmo Sheng, Yang Shi, Jiafu Tang, Longxiang Tang, Yuqi Tang, Chengzhuo Tong, Kuo Wang, Qixun Wang, Rui Wang, Tianduo Wang, Yuran Wang, Zekun Wang, Zihao Wang, Boyang Xia, Yifan Xu, Liu Yang, Zhenlong Yuan, Bohan Zeng, Mujin Zhang, Yuanxing Zhang, Zhicheng Zhang, Zhuoran Zhang, Yuanhong Zheng, Kun Gai, Chengru Song, Pengfei Wan
Links:
Keywords: controllable, dit, evaluation, video generation - Omni-Life: Benchmarking Omnimodal Real-Time AI Assistants in People's Daily Lives
Authors: Mengze Hong, Ziwei Shang, Di Liang, Zijian Li, Liang Zhu, Hongyu Shan, Robin Zhou, Minlong Peng, Zhiqiang Kou, Jia Wang, Di Jiang, Chen Jason Zhang
Links:
Keywords: benchmark, video synthesis - CAST-Bench: Tracing Every Sound to Its Source in Multi-Shot Audio-Video Generation
Authors: Yucong Liu, Qi Tian, Shuyuan Tu, Kaihang Pan, Weijie Kong, Chao Pan
Links:|
Keywords: audio-video generation, benchmark, evaluation, identity, sound, video generation - MoviEdit: Long-form Multi-Shot Video Editing Made Easy
Authors: Suhyeon Lee, Zhengang Li, Soo Ye Kim, Peihao Zhu, Jong Chul Ye, Chun-Hao Paul Huang, Duygu Ceylan, Yan Kang, Hyeonho Jeong
Links:|
Keywords: autoregressive, benchmark, evaluation, long-form, video editing
Text-to-Video Generation
Showing the latest 50 out of 140 papers
- UniRGBA: Unifying RGB and Alpha in Pretrained Video Diffusion Models
Authors: Lei Xu, Zhuo Li, Yongyi Jin, Aoyu Wang
Links:
Keywords: benchmark, dit, style, text to video, text-to-video, video diffusion - InstaGen: Group-Shared Importance Sampling for Fast Video Generation
Authors: Kislay Aditya Oj, Kumar Krishna Agrawal, Sri Surya Varma Datla, Aditya Desai
Links:
Keywords: architecture, efficient, sparse attention, t2v, video generation - VA-TDM: A Unified View for Improving Few-Step Diffusion Models by Velocity Adversarial Distillation
Authors: Yihong Luo, Tianyu Pang, Tianyang Hu
Links:
Keywords: denoising, distillation, efficient, flow matching, text to video, text-to-video, trajectory, video generation - NextGAN: Towards Simple and Scalable GAN Training for Image and Video Generation
Authors: Xinhao Lou, Dongye Xie, Peng Sun, Chenyi Zhuang, Kaicheng Yu, Tao Lin
Links:|
Keywords: dit, text to video, text-to-video, video generation - Grounding in the Dark: Text-Only Training for Zero-Shot Video Temporal Localization
Authors: Divyanshu Mishra, Sabine Sternig, Rakshith Shetty, Erhan Gundogdu
Links:
Keywords: benchmark, text to video, text-to-video - What Remains in Sight? Autoregressive Video Decoding as Representation-Guided Context Rewriting
Authors: Lixuan He, Jihyeon Je, Yang You, Leonidas Guibas
Links:
Keywords: autoregressive, autoregressive video, long video, text to video, text-to-video, video generation - Synthetic Realities: Evaluating Human Ability to Distinguish AIGenerated Videos from Real Footage
Authors: Danyal Sarfraz, Raja Mubashar Karim, KwanMyung Kim
Links:
Keywords: evaluation, film, image to video, image-to-video, outpainting, text to video, text-to-video, video outpainting, video synthesis - Wave Forcing: Towards Speed-of-Light Streaming Video Generation
Authors: Yijie Jin, Yuxuan Liu, Jiajun Xu, Ye Huang, Chuzhi Wang, Jiayang Li, Ruiyang Chen, Chenling Hong, Xu Wang, Zhijie Deng
Links:
Keywords: autoregressive, denoising, dit, long video, streaming, streaming video generation, t2v, video generation - Running a 20B Video Diffusion Transformer on Consumer Hardware: A Deployment and Measurement Report for MiniMax H3 on Apple Silicon
Authors: Zhenzhou, Shi, Yizhe, Shi
Links:
Keywords: diffusion transformer, dit, temporal consistency, text to video, text-to-video, video diffusion, video diffusion transformer - UniCaMo: Unified Camera and Motion Control for Video Diffusion Models
Authors: Long Vu, Tan Ngo, Animesh Karnewar, Amir Habibian, Binh-Son Hua, Hung Bui, Minh Hoai Nguyen, Phong Nguyen
Links:
Keywords: camera trajectory, controllable, motion control, text to video, text-to-video, trajectory, video diffusion, video generation
Video Editing
Showing the latest 50 out of 91 papers
- AR-Edit: Training-Free Autoregressive Video Editing without Inversion
Authors: Hovhannes Margaryan, Quentin Bammey, Christian Sandor, Vicky Kalogeiton
Links:
Keywords: autoregressive, autoregressive video, denoising, dynamics, identity, interactive, streaming, video diffusion, video editing - VideoEditor-MoE: Scaling Complex Video Editing with Mixture of Experts
Authors: Xiao Cao, Fuchen Long, Yansong Qu, Wen Xiao, Xin Zhang, Xinlong Sun, Xi Chen, Zhiyong Huang
Links:
Keywords: video editing - MoviEdit: Long-form Multi-Shot Video Editing Made Easy
Authors: Suhyeon Lee, Zhengang Li, Soo Ye Kim, Peihao Zhu, Jong Chul Ye, Chun-Hao Paul Huang, Duygu Ceylan, Yan Kang, Hyeonho Jeong
Links:|
Keywords: autoregressive, benchmark, evaluation, long-form, video editing - FilmTogether: Cinematic Video Generation from Low-Cost Inputs
Authors: Shiying Zhang, Xiaobin Hu, Qianchi Zhang, Jiaqi Zhao, Xiaoda Yang, Bo Yin, Shuicheng Yan
Links:
Keywords: cinematic, identity, layout, video editing, video generation - Multimodal Concert Video Editing: System Design and Exploratory Evaluation
Authors: Lennart Schiweck, Adrian Kempf, Michelle Retig, Moritz Feucht, Tim Mangliers, Benjamin Himpel
Links:
Keywords: architecture, evaluation, video editing - VidEdit3D: Flexible 3D Gaussian Editing with Video Diffusion
Authors: Yanming Yang, Chenxi Song, Tong Zhao, Juntao Xu, Wenhao Rao, Yiwen Chen, Yiwei Wang, Chi Zhang
Links:
Keywords: dynamics, trajectory, video diffusion, video editing - Demystifying Prompt Stealing Attacks against Synthetic Video
Authors: Junyan Huang, Sanskar Agmain, Chen Gong, Yan Pang, FNU Suya
Links:
Keywords: benchmark, customization, layout, trajectory, video to video, video-to-video - When Fine-Grained Credit Assignment Helps and Hurts: Multimodal Agentic Reinforcement Learning through Video Editing
Authors: Lei Zhao, Zongheng Cao, Xinyu Hu
Links:
Keywords: distillation, video editing - EditDistill: Is It Possible to Guide Video Editing with Image Editing?
Authors: Guojun Lei, Hong Li, Hongbing Yang, Lixue Gong, Chi Wang, Zheng Dong
Links:|
Keywords: controllable, denoising, diffusion model, flow matching, layout, trajectory, video diffusion, video editing - AnyGameRenderer: Entity-Consistent Generative Rendering Across Games and an Entity-Level Benchmark
Authors: Ruicong Liu, Liangyang Ouyang, Fengbo Lan, Zhixiang Wang, Kaipeng Zhang
Links:|
Keywords: benchmark, game, layout, video generation, video to video, video-to-video
Video Inpainting & Completion
- FloMo: 3D Scene Flow as a World Action Model Intermediate for Learning from Human Video
Authors: Jeremy Collins, Namra Patel, Ayush Agarwal, Shitij Govil, Animesh Garg
Links:
Keywords: video generation, video prediction - Future Representation Distillation for Imagination-free World Action Models
Authors: Jaehyeong Jo, Sangwon Jang, Sihyun Yu, Seonghyeon Ye, Yekyung Nah, Hojung Jung, Kimin Lee, Sung Ju Hwang
Links:
Keywords: denoising, diffusion model, distillation, video denoising, video diffusion, video prediction - Synthetic Realities: Evaluating Human Ability to Distinguish AIGenerated Videos from Real Footage
Authors: Danyal Sarfraz, Raja Mubashar Karim, KwanMyung Kim
Links:
Keywords: evaluation, film, image to video, image-to-video, outpainting, text to video, text-to-video, video outpainting, video synthesis - Recoverability-Aware Evaluation of Diffusion Video Inpainting and Object Removal
Authors: Yanliang Qi, Jiacheng Ding, Cong Guo, Peihua Mai
Links:
Keywords: evaluation, video diffusion, video inpainting - RynnWorld-Latent: A Cross-Embodiment World Model Conditioned on Universal Latent Actions
Authors: Haoyu Zhao, Yinzhou Tang, Zixuan Wang, Minghao Zhu, Dongchi Huang, Xingyue Zhao, Qin Zhao, Kehan Li, Siteng Huang, Xin Li, Zhenyu Zeng, Mingxiu Chen, Deli Zhao, Zhongyu Li
Links:
Keywords: controllable, dynamics, identity, simulation, video prediction, video world model, world model - What Does World Modeling Actually Improve in Robot Action Learning?
Authors: Hanwen Cui, Yuanyuan Li, Qing Guo, Zhida Zhang, Chao Chen, Xi Chen, Jie Cao
Links:
Keywords: architecture, diffusion transformer, dit, trajectory, video diffusion, video diffusion transformer, video prediction - TrackTok: Object-Centric Video Tokenization with Semantically Persistent Tokens
Authors: Nhi Pham, Christopher Wewer, Bernt Schiele, Jonas Fischer, Jan Eric Lenssen
Links:|
Keywords: efficient, frame prediction, latent video, video generation - Learning to Correct Geometry in Generated Videos
Authors: Weijie Lyu, Tiancheng Shen, Jason Li, Yujing Wang, Xiaoyuan Wang, Haobo Yuan, Yizhou Zhao, Ming-Hsuan Yang
Links:
Keywords: camera motion, image to video, image-to-video, trajectory, video inpainting, video to video, video-to-video - Perceive, Predict, and Plan: a Unified World Action Model for Egocentric Dexterous Manipulation
Authors: Zirui Wu, Chen Guo, Tianjian Jiang, Zeren Jiang, Zeming Li, Lingchen Yang, Longteng Duan, Ying Xue, Handi Yin, Shenyuan Gao, Martin R. Oswald, Jun Zhang, Ping Tan, Jie Song
Links:|
Keywords: action-conditioned, architecture, diffusion transformer, evaluation, video diffusion, video diffusion transformer, video generation, video prediction - PINT: A Unified Model with Shared Predictive Intent for Robot Manipulation
Authors: Xinyu Guo, Chao Jing, Li Yi, Xingyu Chen, Zhengxing Wu
Links:
Keywords: dynamics, embodied, video generation, video prediction
Video Super-Resolution & Enhancement
Showing the latest 50 out of 179 papers
- AR-Edit: Training-Free Autoregressive Video Editing without Inversion
Authors: Hovhannes Margaryan, Quentin Bammey, Christian Sandor, Vicky Kalogeiton
Links:
Keywords: autoregressive, autoregressive video, denoising, dynamics, identity, interactive, streaming, video diffusion, video editing - Trajectory Forcing: Exploiting Diffusion Trajectories for Autoregressive Long Video Generation
Authors: Bohan Wang, Shuo Chen, Yunzhi Li, Zhaozheng Chen, Junzhe Zhang, Hanwang Zhang
Links:
Keywords: autoregressive, benchmark, denoising, diffusion model, long video, streaming, trajectory, video diffusion, video generation - CoGenRec: A Unified Generative Framework for Complementary Vision Reconstruction
Authors: Yapeng Meng, Yuguo Chen, Xiangru Chen, Shaojun Xu, Xuezhen Wang, Lijian Wang, Zheyu Yang, Yihan Lin, Luping Shi, Rong Zhao
Links:|
Keywords: diffusion model, frame interpolation, physical, video deblurring, video diffusion - Training-Free Predictive Spatio-Temporal Token Pruning for Few-Step Autoregressive Video Diffusion
Authors: Jia Li, Xurui Peng, Xing Wang, Hayden Kwok-Hay So
Links:
Keywords: autoregressive, autoregressive video, denoising, distillation, efficient, trajectory, video diffusion, video generation - VA-TDM: A Unified View for Improving Few-Step Diffusion Models by Velocity Adversarial Distillation
Authors: Yihong Luo, Tianyu Pang, Tianyang Hu
Links:
Keywords: denoising, distillation, efficient, flow matching, text to video, text-to-video, trajectory, video generation - DecoupAttn: Decoupled Sparse Attention for Training-Free Acceleration of Video Diffusion
Authors: Yanjin Li, Bingbing Qiu, Qiang Huang, Rui Qian, Yanfeng Li, Jian Wang, Xiaoying Tang, Mingda Zhang
Links:
Keywords: acceleration, denoising, sparse attention, video diffusion - Future Representation Distillation for Imagination-free World Action Models
Authors: Jaehyeong Jo, Sangwon Jang, Sihyun Yu, Seonghyeon Ye, Yekyung Nah, Hojung Jung, Kimin Lee, Sung Ju Hwang
Links:
Keywords: denoising, diffusion model, distillation, video denoising, video diffusion, video prediction - TaoMate-HD: Progressive-Resolution Autoregressive Audio-Video Generation
Authors: Qijun Gan, Chenwei Zhang, Xinyang Li, Meiguang Jin, Junfeng Ma, Shen Qiu
Links:|
Keywords: audio-video generation, autoregressive, denoising, distillation, streaming, trajectory, video generation - TaoMate-FVSR: Audio-Guided Facial Video Restoration
Authors: Xinyang Li, Zeran Xu, Jingna Sun, Qijun Gan, Chenwei Zhang, Meiguang Jin, Junfeng Ma
Links:
Keywords: diffusion transformer, identity, talking head, temporal consistency, video diffusion, video diffusion transformer, video restoration - Generative diffusion in long-range correlated landscapes: Speciation cascade and the foam structure of the score
Authors: Jerome Garnier-Brun, Giulio Biroli, Marc Mézard, Jean-Philippe Bouchaud
Links:
Keywords: autoregressive, denoising, trajectory, video generation
World Models & Simulation
Showing the latest 50 out of 233 papers
- Video-Coder: Reinforcing Agentic Coding for Video Generation
Authors: Chaoyang Wang, Sicheng Gao, Junan Hu, Kunyang Li, Dongyang Chen, Yiyang Zhou, Huaxiu Yao, Yong Jae Lee, Radu Timofte, Yuzhang Shang
Links:
Keywords: controllable, dynamic 3d, dynamics, interactive, temporal consistency, video generation - AR-Edit: Training-Free Autoregressive Video Editing without Inversion
Authors: Hovhannes Margaryan, Quentin Bammey, Christian Sandor, Vicky Kalogeiton
Links:
Keywords: autoregressive, autoregressive video, denoising, dynamics, identity, interactive, streaming, video diffusion, video editing - EgoGeneralist: Unifying Egocentric Action-Video Tasks through Video-Native Modeling
Authors: Yanlin Jin, Bowen Yang, Cheng Zhang, Yifan Yang, Zhe Li, Jianfei Cai, Kai Zhu
Links:
Keywords: action-conditioned, dynamics, human motion, video generation - GuidedWAM: Training-Free Energy Guidance for World Action Models in Autonomous Driving
Authors: Xiyan Su, Finn Rasmus Schäfer, Hojun Lim, Frank Diermeyer, Johannes Betz, Markus Lienkamp
Links:
Keywords: autonomous driving, driving, visual world model, world model - TouchéWorld tech report : Towards Online Unified Camera--Hand Exploration in Generative Worlds
Authors: Jiaao Yu, Yanjian Zhang, Haoyang Jiang, Guillaume Wisniewski, Nadi Tomeh, Shijie Jia
Links:
Keywords: distillation, efficient, gesture, video world model, world model - Compression Forcing: Hierarchical History Tokenization Enables Flexible World Models
Authors: Siqiao Huang, Partha Kaushik, Michael Chen, Hengkai Pan, Kaiwen Geng, Omar Chehab, Fernando Moreno-Pino, Max Simchowitz
Links:
Keywords: dynamics, dynamics-aware, physical, video generation, world model - W2A: Distilling World Priors into Action Models for Real-Time Robotic Control
Authors: Xiaopeng Zhang, Yongjin Mu, Yueyang Weng, Chengzhi Zhao, Yanjie Li
Links:
Keywords: denoising, diffusion model, distillation, simulation, video diffusion - AgiWorld: An Agentic Video World Model for Building Persistent Worlds
Authors: Shaoheng Fang, Yiqun Mei, Hanwen Jiang, Xin Sun, Haitian Zheng, Hao Tan, Kalyan Sunkavalli, Georgios Pavlakos, Qixing Huang, Yiwei Hu
Links:
Keywords: camera motion, interactive, minute-long, video world model, world model - GeoFlip Preview: Benchmarking Geometry-Sensitive Physics in Video Generation
Authors: Yuqi Li, Junming Liu, Bowen Hu, Ruize Niu, Huiran Duan, Ming-Hsuan Yang, Yingli Tian, Hao Wu
Links:
Keywords: benchmark, evaluation, image to video, image-to-video, physical, physical consistency, physics, simulation, video generation - L3G-World: Real-Time Infinite World Generation with Latent 3D Gaussian Memory
Authors: Jinhyeok Choi, JoungBin Lee, Jongmin Lee, Minkyeong Jeon, Jiyoung Kim, Kaeun Han, Yoonjin Yoon, Seungryong Kim
Links:
Keywords: diffusion transformer, dit, efficient, interactive, latent video, video diffusion, video diffusion transformer
Classic Papers
Video Diffusion Models (NeurIPS 2022)
Authors: Jonathan Ho, Tim Salimans, Alexey Gritsenko, William Chan, Mohammad Norouzi, David J. Fleet
Keywords: Video Diffusion, Generative Model, Unconditional Video GenerationAlign your Latents: High-Resolution Video Synthesis with Latent Diffusion Models (CVPR 2023)
Authors: Andreas Blattmann, Robin Rombach, Huan Ling, Tim Dockhorn, Seung Wook Kim, Sanja Fidler, Karsten Kreis
Keywords: Latent Video Diffusion, Text-to-Video, High-ResolutionStable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets (2023)
Authors: Andreas Blattmann, Tim Dockhorn, Sumith Kulal, Daniel Menber, Maciej Kilian, Dominik Lorenz, et al.
Code: 🔗 GitHub
Keywords: Image-to-Video, Latent Video Diffusion, Large-Scale TrainingSora: Video Generation Models as World Simulators (OpenAI, 2024)
Authors: OpenAI
Keywords: Text-to-Video, World Simulator, Diffusion Transformer, Long VideoCogVideoX: Text-to-Video Diffusion Models with An Expert Transformer (2024)
Authors: Zhuoyi Yang, Jiayan Teng, Wendi Zheng, Ming Ding, Shiyu Huang, et al.
Code: 🔗 GitHub
Keywords: Text-to-Video, Diffusion Transformer, Expert Transformer
Open Source Projects
- CogVideo - Text-to-video generation with CogVideoX series models (Tsinghua & Zhipu AI)
- Open-Sora - Open-source Sora-like video generation framework
- Open-Sora-Plan - Reproducing Sora with an open-source plan
- HunyuanVideo - Tencent's large-scale video generation model
- Wan2.1 - Alibaba's open-source video generation model
- AnimateDiff - Animate personalized text-to-image models without specific tuning
- Stable Video Diffusion - Stability AI's video generation models
- ModelScope Text-to-Video - ModelScope text-to-video synthesis
Tutorials & Blogs
- Video Generation Models as World Simulators - OpenAI's Sora technical report
- A Survey on Video Diffusion Models - Comprehensive survey on video diffusion
- Diffusion Models: A Comprehensive Survey - Foundation knowledge on diffusion models
📋 Project Features
🛠️ Core Features
- Unified CLI (
main.py): Single entry point withinit,search,suggest,export-bib,readmesubcommands - Interactive Config Wizard: Guided setup for keywords, domains, time range, and API keys via
python main.py init - Custom Search Keywords: Configure keywords for title, abstract, or both; with arXiv domain filtering (
cs.CV,cs.AI,cs.MM, etc.) - Time Range Filtering: Relative periods (
30d,6m,1y,2y) or absolute date ranges (YYYY-MM-DDtoYYYY-MM-DD) - Smart Link Extraction: Auto-classifies URLs from abstracts into GitHub, project page, dataset, video, demo, HuggingFace links
- BibTeX Export: Fetch BibTeX from arXiv official API; export to
.bibfiles with category and date filters - LLM Keyword Suggestion: Input paper titles or arXiv IDs to auto-generate optimized search keywords via OpenAI-compatible API
- Automated Paper Collection: Daily automatic crawling with GitHub Actions
- Intelligent Classification: Auto-categorize papers into 16 topics (T2V, I2V, Video Editing, Controllable Generation, World Models, etc.)
🛠️ Technical Features
- Robust Error Handling: Multi-layer retry and fallback strategies ensure stable operation
- GitHub Actions Integration: Automated CI/CD workflows for daily updates
- Multi-type Link Badges: README entries display PDF, GitHub (with stars), Project, Dataset, Video, Demo, HuggingFace, and Citation badges
- Detailed Logging: Comprehensive logging for debugging and monitoring
- Cross-Platform: Support for Windows/Linux/macOS
📚 Data Output
- Paper JSON files (
data/papers_YYYY-MM-DD.json): Full paper metadata with title, authors, abstract, links, keywords, BibTeX - BibTeX files (
output/*.bib): Ready-to-use bibliography files for LaTeX - Auto-generated README: Categorized and formatted paper listings
🚀 Quick Start
1. Install Dependencies
pip install -r requirements.txt
2. Interactive Setup (Recommended)
python main.py init
This wizard walks you through:
- Setting search keywords (for title, abstract, or both)
- Selecting arXiv domains (e.g.,
cs.CV,cs.AI,cs.MM) - Configuring time range (relative like
6m/1y, or absolute dates) - Setting max results
- Optionally configuring an OpenAI-compatible API key for keyword suggestion
3. Search Papers
# Search with settings from user_config.json
python main.py search
# Override: fetch 200 papers from the last 6 months, include BibTeX
python main.py search --max-results 200 --recent 6m --bibtex
# Search with absolute date range
python main.py search --date-from 2024-01-01 --date-to 2025-01-01
# Include citation counts from Semantic Scholar
python main.py search --citations
4. Export BibTeX
# Export all papers from the latest data file
python main.py export-bib --output output/references.bib
# Export only "Text-to-Video Generation" papers
python main.py export-bib --category "Text-to-Video Generation" --output output/t2v.bib
# Export papers from a specific date range
python main.py export-bib --date-from 2024-06-01 --date-to 2025-01-01 --output output/recent.bib
5. LLM Keyword Suggestion
# Generate keywords from paper titles
python main.py suggest --titles "Video Diffusion Models" "Stable Video Diffusion"
# Generate from arXiv IDs (auto-fetches titles)
python main.py suggest --arxiv-ids 2204.03458 2311.15127
# Auto-write suggested keywords to config
python main.py suggest --titles "Sora" "CogVideoX" --apply
# Use a custom API endpoint (e.g., DeepSeek)
python main.py suggest --titles "Paper Title" --base-url https://api.deepseek.com/v1 --api-key sk-xxx --model deepseek-chat
6. Generate README
# Basic README
python main.py readme
# Include latest papers section and abstracts
python main.py readme --show-latest --show-abstracts
Configuration File
All settings are stored in data/user_config.json:
{
"search": {
"keywords": {
"both_abstract_and_title": ["video diffusion", "video generation", "text-to-video", "video-to-video"],
"abstract_only": ["diffusion-based video generation", "flow-based video generation"],
"title_only": ["world foundation model", "world simulator", "video tokenizer"]
},
"domains": ["cs.CV", "cs.AI", "cs.MM", "cs.LG", "cs.RO", "cs.GR", "eess.IV"],
"time_range": {
"mode": "relative",
"relative": "1y"
},
"max_results": 1000
},
"api_keys": {
"openai_api_key": "",
"openai_base_url": "https://api.openai.com/v1",
"openai_model": "gpt-4o-mini"
}
}
Contribution Guidelines
Feel free to submit Pull Requests to improve this list! Please follow these formats:
- Paper entry format:
**[Paper Title](link)** - Brief description - Project entry format:
[Project Name](link) - Project description
License
関連プロジェクトを探す
sindresorhus/awesome
😎 あらゆる興味深いトピックに関する Awesome リスト [注意: 既存のプルリクエストに追いつけるまで、プルリクエストは一時的に無効になっています]
536,478 スターEbookFoundation/free-programming-books
:books: 無料で入手できるプログラミングの書籍
401,556 スターnilbuild/developer-roadmap
開発者のキャリア成長を支える、インタラクティブなロードマップ、ガイド、その他の教育コンテンツ。
371,967 スターvinta/awesome-python
「Python で X をしたい。どのツールを使えばいい?」に答える決定版リスト。
334,580 スター