Xinjie Li

Penn State University
State College
Pennsylvania

About Me

I am a Ph.D. student in the CSE Department at Pennsylvania State University-University Park since the 2022 Fall, under the supervisor of Prof. Abhinav Verma. I received my Master's and Bachelor's Degrees from the University of Science and Technology Beijing in 2022 and 2019, respectively. Back then, my supervisor was Prof. Xu-Cheng Yin.

I am interested in Computer Vision and AI for Science. My current work focuses on Human-centered Video Generation. My previous research topics include Retrosynthesis, Video Understanding, and Metric Learning. I am also interested in Program Synthesis, Neuro-symbolic Learning and Reinforcement Learning.

Please refer to my resume for more details.

Experience

Research Intern | Snap Inc.
Topic: ControlNet based Human Image Restoration
Mentor: Dr. Jian Wang
Time: Aug 2023 - March 2024

Research Intern | Meituan Inc.
Topic: Vision Transformer and Video Semantic Segmentation
Mentor: XiangXiang Chu
Time: May 2021 - Aug 2021

Publications

Video Understanding

CI w/o TN: Context Injection without Task Name for Procedure Planning
Xinjie Li
Arxiv Preprint, 2024
[Arxiv]

Repetitive Action Counting with Motion Feature Learning
Xinjie Li, Huijuan Xu
WACV, 2024
[Paper] [Supp]

MEID: Mixture-of-Experts with Internal Distillation for Long-Tailed Video Recognition
Xinjie Li, Huijuan Xu
AAAI Oral, 2023
[Paper] [Supp] [Code]

Image Generation

DiffBody: Human Body Restoration by Imagining with Generative Diffusion Prior
Yiming Zhang, Zhe Wang, Xinjie Li, Yunchen Yuan, Chengsong Zhang, Xiao Sun, Zhihang Zhong, Jian Wang
Arxiv Preprint, 2024
[Arxiv]

SD-GAN: Semantic Decomposition for Face Image Synthesis with Discrete Attribute
Kangneng Zhou, Xiaobin Zhu, Daiheng Zhou, Kai Lee, Xinjie Li, Xu-Cheng Yin
ACM MM, 2022
[Paper] [Arxiv] [Code]

AI4Science

EllipBench: A Large-scale Benchmark for Machine-learning based Ellipsometry Modeling
Yiming Ma*, Xinjie Li*, Xin Sun, Zhiyong Wang, Lionel Z. Wang
Arxiv Preprint, 2024
[Arxiv] [Code]

Others

DANet: Dynamic Attention to Spoof Patterns for Face Anti-Spoofing
Chun-Yu Sun, Song-Lu Chen, Xinjie Li, Feng Chen, Xu-Cheng Yin
ICPR, 2022
[Paper]

Semantic Bilinear Pooling for Fine-Grained Recognition
Xinjie Li, Chun Yang, Song-Lu Chen, Chao Zhu, Xu-Cheng Yin
ICPR, 2020
[Paper] [Arxiv]

Stereo CenterNet based 3D Object Detection for Autonomous Driving
Yuguang Shi, Yu Guo, Zhenqiang Mi, Xinjie Li
Neurocomputing
[Paper] [Arxiv]

Services

  • Conference Reviewer/Program Committee Member
     IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) - 2023, 2024
     European Conference on Computer Vision (ECCV) - 2024
     AAAI Conference on Artificial Intelligence (AAAI) - 2023, 2024, 2025
     ACM International Conference on Multimedia (ACM MM) - 2022, 2023, 2024
     IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) - 2023
     Annual Conference on Neural Information Processing Systems (NeurIPS) - 2024