Short Bio
Hi! I am a senior undergraduate at University of Chinese Academy of Sciences . Previously, I explored mutilmodal learning as a visiting student in GeWu-Lab, supervised by Prof. Di Hu.
I am currently interning at Shanghai AI Laboratory, focusing on video generation. I am excited to explore audio-driven image animation, supervised by Dr. Yanan Sun and Dr. Yanhong Zeng.
My research interest primarily includes Video Generation, Mutilmodal Learning and AI for Science.
🔥 News
- 2024.11:  🎉🎉 I win the National Scholarship and First-class Scholarship!
- 2024.07:  🎉🎉 One paper is accepted by ECCV2024.
Publications
Stepping Stones: A Progressive Training Strategy for Audio-Visual Semantic Segmentation
Juncheng Ma, Peiwen Sun, Yaoting Wang, Di Hu
ECCV 2024 | arXiv | Code | Project | PDF | Supplementary
Rethink audio-visual semantic segmentatoin from a new perspective, with a progressive two-stage training strategy proposed to enhance the capability of audio-visual alignment .
Experiences
Research Intern, Shanghai AI Laboratory, Shanghai, China, 2024.7-present
Research on video generation especially audio-driven image animation.
Supervised by Dr. Yanan Sun and Dr. Yanhong Zeng
Visiting Student, Renmin University of China, Beijing, China, 2023.10-2024.3
Research on multimodal learning especially audio-visual segmentation, aiming to segment sound sources within a video according to its corresponding audio.
One paper Stepping-Stones is accepted by ECCV2024.
Supervised by Prof. Di Hu
Honors and Awards
- 2024, National Scholarship, Ministry of Education.
- 2024, First-class Scholarship.
Educations
- 2021.09 - present, Undergraduate, University of Chinese Academy of Sciences.