Short Bio

Hi! I am a senior undergraduate at University of Chinese Academy of Sciences . Previously, I explored mutilmodal learning as a visiting student in GeWu-Lab, supervised by Prof. Di Hu.

I am currently interning at Shanghai AI Laboratory, focusing on video generation. I am excited to explore audio-driven image animation, supervised by Dr. Yanan Sun and Dr. Yanhong Zeng.

My research interest primarily includes Video Generation, Mutilmodal Learning and AI for Science.

🔥 News

  • 2024.11:  🎉🎉 I win the National Scholarship and First-class Scholarship!
  • 2024.07:  🎉🎉 One paper is accepted by ECCV2024.

Publications

sym

Stepping Stones: A Progressive Training Strategy for Audio-Visual Semantic Segmentation

Juncheng Ma, Peiwen Sun, Yaoting Wang, Di Hu

ECCV 2024 | arXiv | Code | Project | PDF | Supplementary

Rethink audio-visual semantic segmentatoin from a new perspective, with a progressive two-stage training strategy proposed to enhance the capability of audio-visual alignment .

Experiences

sym

Research Intern, Shanghai AI Laboratory, Shanghai, China, 2024.7-present

Research on video generation especially audio-driven image animation.

Supervised by Dr. Yanan Sun and Dr. Yanhong Zeng

sym

Visiting Student, Renmin University of China, Beijing, China, 2023.10-2024.3

Research on multimodal learning especially audio-visual segmentation, aiming to segment sound sources within a video according to its corresponding audio.

One paper Stepping-Stones is accepted by ECCV2024.

Supervised by Prof. Di Hu

Honors and Awards

  • 2024, National Scholarship, Ministry of Education.
  • 2024, First-class Scholarship.

Educations

  • 2021.09 - present, Undergraduate, University of Chinese Academy of Sciences.