▼ 2023

[2023-09-21]. Happy to share the latest work collaborated with Xinyu Zhou (周欣宇) ❤. We study the potential of building a unified spoken-dialogue system based on large language models, thus enabling AI chatbots to “think how to respond” and “think how to speak” at the same time!

Xinyu Zhou, Delong Chen, Yudong Chen
🎙 Towards Joint Modeling of Dialogue Response and Speech Synthesis based on Large Language Model
International Conference on Natural Language and Speech Processing (ICNLSP) 2023. [arxiv] [github]

[2023-07-18]. Our Diffusion-Conductor is awarded as Best Paper in AAAI 2023 Inaugural Summer Symposium Series - AI x Metaverse! The GAN-based Virtual Conductor proposed in my bachelor thesis is now upgraded to its diffusion-based version!

Zhuoran Zhao, Jinbin Bai, Delong Chen, Debang Wang, Yubo Pan
🎶 Taming Diffusion Models for Music-driven Conducting Motion Generation
In AAAI 2023 Inaugural Summer Symposium Series - AI x Metaverse, 2023 (Best Paper). [arxiv] [github]

[2023-06-30]. Excited to share my latest work done during my internship at Xiaobing.AI – Polite Flamingo! During visual instruction tuning of multi-modal LLM, we introduced a multi-modal response rewriter to address the degeneration of response politness, which is a typical instance of the “multi-modal alignment tax”. Many thanks my great mentors Baoyuan Wang (王宝元) and Jianfeng Liu (刘剑锋) at Xiaobing.AI, and Wenliang Dai (戴文亮) at HKUST!

Delong Chen, Jianfeng Liu, Wenliang Dai, Baoyuan Wang
🦩 Visual Instruction Tuning with Polite Flamingo
[arxiv] [github] [Demo]

[2023-06-19]. We annonce RemoteCLIP, the first vision-language foundation model for remote sensing. RemoteCLIP outperform previous image-text retrieval SoTA by 9.14% mean recall on RSICD dataset and by 8.92% on RSICD dataset. For zero-shot classification, our RemoteCLIP outperform CLIP baseline by up to 6.39% average accuracy on 12 downstream datasets. This is a team work with many brilliant grad students at AIM Group, thanks Zhangqingyun Guan (管张青云), Xiaocong Zhou (周晓聪), Jiale Zhu (朱佳乐), and Wenwen Cai (蔡雯雯)!

Fan Liu, Delong Chen (joint first author), Zhangqingyun Guan, Xiaocong Zhou, Jiale Zhu, Jun Zhou
🛰️ RemoteCLIP: Vision-Language Pretraining for Remote Sensing
[arxiv] [github]

[2023-04-22]. Our paper of Ensemble Learning with Multi-Order Statistics (ELMOS) is accepted by IJCAI-23 as oral presentation! Our proposed model achieves SoTA few-shot classification accuracy on CUB dataset, miniImageNet, tiredImageNet, and CIFAR-FS dataset.

Sai Yang, Fan Liu, Delong Chen, Jun Zhou
🔍 Few-shot Classification via Ensemble Learning with Multi-Order Statistics
In Proceedings of the 32nd IJCAI, 2023 (oral). [arxiv]

[2023-03-11]. Our works on the Multi-modal E-Commerce Products (MEP-3M) dataset, previously awarded as IJCAI 2021 LTDL Best Dataset Paper, is now extended and published at Pattern Recognition.

Fan Liu, Delong Chen (joint first author), Xiaoyu Du, Ruizhuo Gao, Feng Xu
🎁 MEP-3M: A large-scale multi-modal E-commerce product dataset
Pattern Recognition, 2023.

▶ 2022

[2022-07-08]. Our survey paper on Deep Learning Based Single Sample Per Person (SSPP) face recognition is now published in Artificial Intelligence Review (IF=12.0).

Fan Liu, Delong Chen (joint first author), Fei Wang, Zewen Li, Feng Xu
🤖 Deep learning based single sample face recognition: a survey
Artificial Intelligence Review, 2022

[2022-06-29]. My bachelor graduation thesis “Music-driven Conducting Motion Generation based on Motion Decomposition and Self-supervised Cross-modal Perceptual Loss” 《基于动态频域分解与跨模态感知的乐队指挥动作生成系统》, previously awarded as Outstanding Graduation Thesis of HHU (河海大学优秀毕业论文), is now awarded as the First Class of Outstanding Graduation Thesis of Jiangsu Province (江苏省优秀毕业论文一等奖) !

[2022-06-23]. Our work on ProtoCILP is done at Megvii Technology. We developed a prototype-based approach for improved vision language pretraining, which achieved an +5.81% ImageNet linear probing improvement and an +2.01% ImageNet zero-shot classification improvement compared to CLIP.

Delong Chen, Zhao Wu, Fan Liu, Zaiquan Yang, Yixiang Huang, Yiping Bao, Erjin Zhou
📍 ProtoCILP: Prototypical Contrastive Language Image Pretraining
arXiv preprint, 2022. [arxiv] [github]

[2022-03-10]. Our paper on Music-Driven Conducting Motion Generation is accepted by CCF-B journal JCST. The ConductorMotion100 dataset has been made public as a track of The 1st Prospective Cup Meta-Intelligent Data Challenge（首届国际“远见杯”元智能数据挑战大赛）hold by Jiangsu Computer Society（江苏省计算机学会）.

Fan Liu, Delong Chen (✉), Ruizhi Zhou, Sai Yang, Feng Xu
🎵 Self-Supervised Music Motion Synchronization Learning for Music-Driven Conducting Motion Generation
In Journal of Computer Science and Technology (JCST), 2022. [github] [video]

▶ 2021

[2021-09-22]. I begin to work at MEGVII Technology (旷视研究院) as a research intern with Yiping Bao (鲍一平) and Zhao Wu (吴曌).

[2021-08-21]. I received a Best Demo Award from IEEE ICME'21, a Best Dataset Paper Award from IJCAI'21 LTDL workshop, and a Best Presentation Award from IEEE BDAI'21.

Delong Chen, Fan Liu, Zewen Li, Feng Xu
🎵 VirtualConductor: Music-driven Conducting Video Generation System
In IEEE International Conference on Multimedia and Expo (ICME) 2021 (Best Demo Award). [arxiv] [video]

Delong Chen, Fan Liu, Xiaoyu Du, Ruizhuo Gao, Feng Xu
🎁 MEP-3M: A Large-scale Multi-modal E-Commerce Products Dataset
In IJCAI 2021 Workshop on Long-Tailed Distribution Learning (LTDL@IJCAI'21) (Best Dataset Paper Award).

Delong Chen, Fan Liu, Zheqi Zhang, Xiaomin Lu, Zewen Li
🌊 Significant Wave Height Prediction based on Wavelet Graph Neural Network
In 2021 IEEE 4th International Conference on Big Data and Artificial Intelligence (Best Presentation). [arxiv]

[1999-03-19]. I was born in Shunde, Guangdong（广东，顺德）, a beautiful city with a lot of delicious food.