About Me

I am an Applied Scientist at Amazon Prime Video. I earned my Ph.D. in Computer Science from Penn State University (2022–2026), advised by Prof. Abhinav Verma, and my M.S. (2022) and B.S. (2019) from USTB, advised by Prof. Xu-Cheng Yin.

My current research centers on Causal World Modeling, MLLM Agent Post-Training & Self-Evolution, and also Judge.

After nearly a decade in computer vision, I have grown most curious about a different question: how agents can model open-ended, creative tasks, capturing human taste and, ultimately, modeling how human society itself evolves. I believe the next frontier is not perceiving the world more accurately, but reasoning about what people find valuable and worth creating.

Publications

Video/Image Generation

What Happens Next? Next Scene Prediction with a Unified Video Model
Xinjie Li, Zhimin Chen, Rui Zhao, Florian Schiffers, Zhenyu Liao, Vimal Bhat
HiGen @ CVPR 2026 Oral, 2026
Co-Speech Gesture Video Generation with Implicit Motion-Audio Entanglement
Xinjie Li, Ziyi Chen, Xinlu Yu, Iek-Heng Chu, Peng Chang, Jing Xiao
CVPR, 2025
Are Conditional Latent Diffusion Models Effective for Image Restoration?
Yunchen Yuan, Junyuan Xiao, Xinjie Li
Arxiv Preprint, 2024
DiffBody: Human Body Restoration by Imagining with Generative Diffusion Prior
Yiming Zhang, Lionel Z. WANG, Sizhuo Ma, Xinjie Li, Jian Ren, Zhihang Zhong, Jian Wang
ICCP, 2025
SD-GAN: Semantic Decomposition for Face Image Synthesis with Discrete Attribute
Kangneng Zhou, Xiaobin Zhu, Daiheng Zhou, Kai Lee, Xinjie Li, Xu-Cheng Yin
ACM MM, 2022

Video Understanding

CI w/o TN: Context Injection without Task Name for Procedure Planning
Xinjie Li
Arxiv Preprint, 2024
Repetitive Action Counting with Motion Feature Learning
Xinjie Li, Huijuan Xu
WACV, 2024
MEID: Mixture-of-Experts with Internal Distillation for Long-Tailed Video Recognition
Xinjie Li, Huijuan Xu
AAAI Oral, 2023

AI4Science

RetroMoE: A Mixture-of-Experts Latent Translation Framework for Single-step Retrosynthesis
Xinjie Li, Abhinav Verma
IJCAI, 2025
Sub-Clustering for Class Distance Recalculation in Long-Tailed Drug Discovery
Yujia Su*, Xinjie Li*, Lionel Z. Wang
Arxiv Preprint, 2025
Modeling Inverse Ellipsometry Problem via Flow Matching with a Large-Scale Dataset
Yiming Ma*, Jianzhi Teng*, Xinjie Li*, Xin Sun, Zhiyong Wang, Yuzhou Song, Lionel Z. Wang, Bin Chen
Arxiv Preprint, 2024

Others

DANet: Dynamic Attention to Spoof Patterns for Face Anti-Spoofing
Chun-Yu Sun, Song-Lu Chen, Xinjie Li, Feng Chen, Xu-Cheng Yin
ICPR, 2022
Semantic Bilinear Pooling for Fine-Grained Recognition
Xinjie Li, Chun Yang, Song-Lu Chen, Chao Zhu, Xu-Cheng Yin
ICPR, 2020
Stereo CenterNet based 3D Object Detection for Autonomous Driving
Yuguang Shi, Yu Guo, Zhenqiang Mi, Xinjie Li
Neurocomputing

Internships

Applied Scientist Intern · Amazon Prime Video
Unified Video Understanding & Generation Model — Large-Scale Pretraining, SFT, RL
Output: One paper accepted at CVPRW 2026
Seattle, WA · May 2025 – Jan 2026
Research Scientist Intern · PAII Inc.
Co-speech Gesture Video Generation
Output: One paper accepted at CVPR 2025, one under review at ECCV 2026
Palo Alto, CA · May 2024 – Mar 2025
Research Intern · Snap Research
ControlNet-based Human Image Restoration
Aug 2023 – Mar 2024
MLE Intern · Meituan Inc.
Vision Transformer and Video Semantic Segmentation
Beijing, China · May 2021 – Aug 2021

Services

Conference Reviewer / Program Committee Member
NeurIPS 2024–2026 BMVC 2026 ECCV 2024, 2026 ACL ARR 2026 CVPR 2023–2026 ICLR 2025, 2026 AAAI 2023–2026 ICCV 2025 ICML 2025 IJCAI 2025 ACM MM 2022–2024 WACV 2023

Teaching

  • CMPSC/Math 455 Introduction to Numerical Analysis I · Spring 2026 & 2025
  • CMPEN/EE 454 Fundamentals of Computer Vision · Fall 2025 & 2024
  • CMPSC 448 Machine Learning and Algorithmic AI · Spring 2024
  • CMPSC 131 Programming and Computation I: Fundamentals (Python) · Fall 2023