Principal Researcher
Tencent
Email: winfred.sun at gmail dot com
Github: https://github.com/X-ing
|
Xing SUN, Ph.D. Principal Researcher Tencent Email: winfred.sun at gmail dot com Github: https://github.com/X-ing |
Xing Sun (孙星) is currently a Principal researcher and Team Manager in Tencent YoutuLab. He received his Ph.D. degree fromThe University of Hong Kong in 2016, under the supervision of Prof. Edmund Y. Lam in Imaging Systems Laboratory, and Dr. Nelson Yung in Laboratory for Intelligent Transportation Systems Research. He received his B.S. degree at Nanjing University of Science and Technology in Jun. 2012. He finished my bachelor dissertation in Lehrstuhl für Hochfrequenztechnik from Technische Universität München in Spring, 2012.
Large Language Model (LLM)
including Supervised Fine-Tuning (SFT), Reinforcement learning from human feedback (RLHF), Retrieval Augmented Generation (RAG) for LLMs, LLM Agents etc
Multimodal Large Language Model (MLLM)
including Multimodal Instruction Tuning (M-IT), Multimodal In-Context Learning (M-ICL), Multimodal Chain of Thought (M-CoT), and LLM-Aided Visual Reasoning (LAVR) etc
(* Corresponding + Equal contribution)
Preprint58. A Survey on multimodal large language models
Shukang Yin, Chaoyou Fu, Sirui Zhao, Ke Li, Xing Sun, Tong Xu, Enhong Chen
Arxiv Tech Report, 2023.
57. MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models
Chaoyou Fu, Peixian Chen, Yunhang Shen, Yulei Qin, Mengdan Zhang, Xu Lin, Jinrui Yang, Xiawu Zheng, Ke Li, Xing Sun, Yunsheng Wu, Rongrong Ji
Arxiv Tech Report, 2023.
Benchmark Website
56. Towards Robust Text Retrieval with Progressive Learning
Tong Wu, Yulei Qin, Enwei Zhang, Zihan Xu, Yuting Gao, Ke Li and Xing Sun*
Arxiv Tech Report, 2023.
Model is available!
55. A Challenger to gpt-4v? early explorations of gemini in visual expertise
Chaoyou Fu, Renrui Zhang, Haojia Lin, Zihan Wang, Timin Gao, Yongdong Luo, Yubo Huang, Zhengye Zhang, Longtian Qiu, Gaoxiang Ye, Yunhang Shen, Mengdan Zhang, Peixian Chen, Sirui Zhao, Xiawu Zheng, Shaohui Lin, Deqiang Jiang, Di Yin, Peng Gao, Ke Li, Xing Sun, Rongrong Ji
Arxiv Tech Report, 2023.
Project
54. Memochat: Tuning llms to use memos for consistent long-range open-domain conversation
Junru Lu, Siyu An, Mingbao Lin, Gabriele Pergola, Yulan He, Di Yin, Xing Sun and Yunsheng Wu
Arxiv Tech Report, 2023.
53. FIPO: Free-form Instruction-oriented Prompt Optimization with Preference Dataset and Modular Fine-tuning Schema
Junru Lu, Siyu An, Min Zhang, Yulan He, Di Yin and Xing Sun
Arxiv Tech Report, 2024.
52. Woodpecker: Hallucination correction for multimodal large language models
Shukang Yin, Chaoyou Fu, Sirui Zhao, Tong Xu, Hao Wang, Dianbo Sui, Yunhang Shen, Ke Li, Xing Sun, Enhong Chen
Arxiv Tech Report, 2023.
Code is available!
202451. RMNet: Equivalently Removing Residual Connection from Networks
Fanxu Meng, Hao Cheng, Jiaxin Zhuang, Ke Li, and Xing Sun*
Arxiv Tech Report, 2021.
Code is available!
50. Multi-dataset Detection with Transformers
Bo Ke, Ruizhi Qiao, Xing Sun
International Journal of Computer Vision (IJCV), 2024.
49. Turning a CLIP Model into a Scene Text Spotter
Wenwen Yu, Yuliang Liu, Xingkui Zhu, Haoyu Cao, Xing Sun, Xiang Bai
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024.
48. HRVDA: High-Resolution Visual Document Assistant
Chaohu Liu, Kun Yin, Haoyu Cao, Xinghua Jiang, Xin Li, Yinsong Liu, Deqiang Jiang, Xing Sun, Linli Xu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
47. Enhancing Visual Document Understanding with Contrastive Learning in Large Visual-Language Models
Xin Li, Yunfei Wu, Xinghua Jiang, Zhihao Guo, Mingming Gong, Haoyu Cao, Yinsong Liu, Deqiang Jiang, Xing Sun
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
46. Aligning and Prompting Everything All at Once for Universal Visual Perception
Yunhang Shen, Chaoyou Fu, Peixian Chen, Mengdan Zhang, Ke Li, Xing Sun, Yunsheng Wu, Shaohui Lin, Rongrong Ji
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
45. A General and Efficient Training for Transformer via Token Expansion
Wenxuan Huang, Yunhang Shen, Jiao Xie, Baochang Zhang, Gaoqi He, Ke Li, Xing Sun, Shaohui Lin
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
44. SPD-DDPM: Denoising Diffusion Probabilistic Models in the Symmetric Positive Definite Space
Yunchen Li, Zhou Yu, Gaoqi He, Yunhang Shen, Ke Li, Xing Sun, Shaohui Lin
The AAAI Conference on Artificial Intelligence (AAAI), 2024.
43. SoftCLIP: Softer Cross-modal Alignment Makes CLIP Stronger
Yuting Gao, Jinfeng Liu, Zihan Xu, Tong Wu, Wei Liu, Jie Yang, Ke Li, Xing Sun
The AAAI Conference on Artificial Intelligence (AAAI), 2024.
42. Grab What You Need: Rethinking Complex Table Structure Recognition with Flexible Components Deliberation
Hao Liu, Xin Li, Mingming Gong, Bing Liu, Yunfei Wu, Deqiang Jiang, Yinsong Liu, Xing Sun
The AAAI Conference on Artificial Intelligence (AAAI), 2024.
41. Visual Hallucination Elevates Speech Recognition
Fang Zhang, Yongxin Zhu, Xiangxiang Wang, Huang Chen, Xing Sun, Linli Xu
The AAAI Conference on Artificial Intelligence (AAAI), 2024.
202340. Sinkhorn Distance Minimization for Knowledge Distillation
Xiao Cui, Yulei Qin, Yuting Gao, Enwei Zhang, Zihan Xu, Tong Wu, Ke Li, Xing Sun, Wengang Zhou, Houqiang Li
International Conference on Computational Linguistics (COLING), 2024.
39. Co-Salient Object Detection with Co-Representation Purification
Ziyue Zhu, Zhao Zhang, Zheng Lin, Xing Sun, Ming-Ming Cheng
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023.
Code is available!
38. CAPro: Webly Supervised Learning with Cross-modality Aligned Prototypes
Yulei Qin, Xingyu Chen, Yunhang Shen, Chaoyou Fu, Yun Gu, Ke Li, Xing Sun, Rongrong Ji
Conference on Neural Information Processing Systems (NeurIPS), 2023.
Code is available!
37. Span-level aspect-based sentiment analysis via table filling
Mao Zhang, Yongxin Zhu, Zhen Liu, Zhimin Bao, Yunfei Wu, Xing Sun, Linli Xu
Annual Meeting of the Association for Computational Linguistics (ACL), 2023.
36. Attention Where It Matters: Rethinking Visual Document Understanding with Selective Region Concentration
Haoyu Cao, Changcun Bao, Chaohu Liu, Huang Chen, Kun Yin, Hao Liu, Yinsong Liu, Deqiang Jiang, and Xing Sun*
International Conference on Computer Vision (ICCV), 2023.
35. D3G:Exploring Gaussian Prior for Temporal Sentence Grounding with Glance Annotation
Hanjun Li, Xiujun Shu, Sunan He, Ruizhi Qiao, Wei Wen, Taian Guo, Bei Gan, and Xing Sun*
International Conference on Computer Vision (ICCV), 2023.
34. Coarse-to-Fine: Learning Compact Discriminative Representation for Single-Stage Image Retrieval
Yunquan Zhu, Xinkai Gao, Bo Ke, Ruizhi Qiao and Xing Sun*
International Conference on Computer Vision (ICCV), 2023.
33. Reciprocal Normalization for Domain Adaptation
Zhiyong Huang, Kekai Sheng, Ke Li, Jian Liang, Taiping Yao, Weiming Dong, Dengwen Zhou, and Xing Sun*
Pattern Recognition (PR), 2023.
202232. Mitigating Memorization of Noisy Labels via Regularization between Representations
Hao Cheng, Zhaowei Zhu, Xing Sun and Yang Liu
International Conference on Learning Representations (ICLR), 2023.
31. Contextual Non-Local Alignment over Full-Scale Representation for Text-Based Person Search
Chenyang Gao, Guanyu Cai, Xinyang Jiang, Feng Zheng, Jun Zhang, Yifei Gong and Xing Sun*
IEEE Transactions on Image Processing (TIP), 2022.
Ranked #1 on Text based Person Retrieval on CUHK-PEDES！
Code is available!
