张宇,副教授,博导
本科和硕士毕业于西安电子科技大学通信工程专业,博士毕业于新加坡南洋理工大学计算机工程专业。曾在新加坡高级数字科学中心(ADSC, University of Illinois)及新加坡生物资讯研究所(BII, A*STAR)就职,目前是东南大学计算机学院PALM实验室成员。主要研究方向为计算机视觉和机器学习,包括大规模图像识别、细粒度图像识别、多标签图像识别、行为图像/视频分析、3D姿态识别、OCR检测与识别等领域,并在多个计算机视觉顶级会议及期刊CVPR、ECCV、TPAMI、IJCV、TIP、PR等发表过论文。荣获江苏省双创博士、东南大学紫金青年学者称号。目前担任江苏省计算机学会青年工作委员会副主任和《Frontiers of Computer Science》青年编委。主持、参与二十余项国家级、省部级、横向合作项目。长期与国内外知名机构保持密切合作,包括:美国UIUC大学、美国Intel实验室、加拿大Alberta大学、澳洲Monash大学、新加坡NTU、新加坡ASTAR研究所、阿里达摩院、腾讯优图实验室等,有各种交流机会。
每年有多个硕士、博士、博士后、科研助理名额,欢迎申请和报考!
E-mail: zhang_yu at seu dot edu dot cn
联系地址:南京市江宁区东南大学计算机学院532。
Demos of our works:
1. Age estimation: 年龄识别demo.mp4
2. Hand action recognition: 手势行为识别.mp4
3. Face detection and recognition:人脸识别.mp4
Projects:
6.面向不充分信息的神经网络模型研究,科技部重点研发项目。(参与)
5.机器人视觉仿真平台。(主持)
4.机动车安全技术检验之智能审核系统审核模块。(主持)
3.多源不确定数据挖掘方法与技术,科技部重点研发项目。(参与)
2. 基于视觉的智能无人货柜中人机交互技术的研究,江苏省双创博士。(主持)
1. 基于深度骨架模型的多模态多视角3D手势识别的研究, 国家自然科学青年基金。(主持)
Selected paper:
11.Xu Yang, Zhangzikang Li, Haiyang Xu, Hanwang Zhang, Qinghao Ye, Chenliang Li, Ming Yan, Yu Zhang, Fei Huang, Songfang Huang, Learning Trajectory-Word Alignments for Video-Language Tasks,ICCV, 2023. (CCF A 推荐论文)
10.Xu Yang, Jiawei Peng, Zihua Wang, Haiyang Xu, Qinghao Ye, Chenliang Li, Ming Yan, Fei Huang, Zhangzikang Li, Yu Zhang, Transforming Visual Scene Graphs to Image Captions, ACL, 2023.(CCF A 推荐论文)
9. X. Geng, R. Zheng, J. Lv, and Y. Zhang. Multilabel Ranking with Inconsistent Rankers. IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI), 2021.(CCF A 推荐论文)
8. X. Geng, X. Qian, Z. Huo, and Y. Zhang. Head Pose Estimation Based on Multivariate Label Distribution. IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI), 2020.(CCF A 推荐论文)
7.Y. Gao, Y. Zhang, X. Geng, Label Enhancement for Label Distribution Learning via Prior Knowledge, In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI'20), Yokohama, Japan, 2020.(CCF A 推荐论文)
6.Y. Liu, N. Xu, Y. Zhang, X. Geng, Label Distribution for Learning with Noisy Labels, In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI'20), Yokohama, Japan, 2020.(CCF A 推荐论文)
5. Chi Xu, Lakshmi Narasimhan Govindarajan, Yu Zhang, Li Cheng, Lie-X: Depth Image Based Articulated Object Pose Estimation, Tracking, and Action Recognition on Lie Groups, International Journal of Computer Vision, 2017, pp. 1-25.(CCF A 推荐论文)
4. Yu Zhang, Li Cheng, Jianxin Wu, Jianfei Cai, Minh N. Do, and Jiangbo Lu, Action Recognition in Still Images with Minimum Annotation Efforts, IEEE Transactions on Image Processing, 2016.(CCF A 推荐论文)
3. Yu Zhang, Jianxin Wu, Jianfei Cai,Compact Representation of High-Dimensional Feature Vectors for Large-Scale Image Recognition and Retrieval, IEEE Transactions on Image Processing, 2016.(CCF A 推荐论文)
2. Yu Zhang, Xiu-Shen Wei, Jianxin Wu, Jianfei Cai, Jiangbo Lu, Viet-Anh Nguyen, Minh N. Do, Weakly Supervised Fine-Grained Categorization with Part-Based Image Representation, IEEE Transactions on Image Processing, 2016.(CCF A 推荐论文)
1. Yu Zhang, Jianxin Wu, Jianfei Cai, Weiyao Lin, Flexible Image Similarity Computation Using Hyper-Spatial Matching, IEEE Transactions on Image Processing, 2014.(CCF A 推荐论文)
Journal paper list:
32. Jiale Chang, Zhengxiao Zhou, Siya Mi, Yu Zhang, Radio frequency fingerprint recognition method based on prior information, Computers and Electrical Engineering, 2024.
31. Yu Zhang, Zhengjie Chen, Tianyu Xu, Junjie Zhao, Siya Mi, Xin Geng, Min-Ling Zhang, Temporal Segment Dropout for Human Action Video Recognition, Pattern Recognition, 2024.
30. Yu Zhang, Sichen Cao, Siya Mi, Yali Bian, Learning sample representativeness for class‑imbalanced multi‑label classifcation, Pattern Analysis and Applications, 2024.
29. Zhengjie Chen, Yu Zhang, Siya Mi, Assisting Multimodal Named Entity Recognition by cross-modal auxiliary tasks, Pattern Recognition Letters, 2023.
28. Jiale Chang, Yanhui Wang, Siya Mi, Yu Zhang, MVL-Tra: Multi-View LFM Signal Source Classification Using Transformer, Computers and Electrical Engineering, 2023.
27. Wei Xiong, Haoliang Liu, Siya Mi and Yu Zhang, Asymmetric Bi-Encoder for Image-text Retrieval, Multimedia Systems, 2023.
26. Yu Zhang, Fan Lin, Siya Mi, Yali Bian, Self-label correction for image classification with noisy labels, Pattern Analysis and Applications, 2023.
25. Yu Zhang, Junjie Zhao, Zhengjie Chen, Siya Mi, Hongyuan Zhu, and Xin Geng, A Closer Look at Video Sampling for Sequential Action Recognition, IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2023.
24. 张宇,徐天宇,米思娅,基于标记分布的视频动作质量评估,中国图象图形学报,2023.
23. Zihan Chen, Hongyuan Zhu, Hao Cheng, Siya Mi, Yu Zhang, Xin Geng, LPCL: Localized Prominence Contrastive Learning for Self-Supervised Dense Visual Pre-training, Pattern Recognition, 2022.
22. Haoyu Ma, Ningning Lu, Junjun Mei, Tao Guan, Yu Zhang, Xin Geng, Label Distribution Learning for Scene Text Detection, Frontiers of Computer Science (FCS), 2022.
21. Liu, Haoliang; Xiong, Wei; Zhang, Yu, YOLO-CORE: Contour Regression for Efficient Instance Segmentation, Machine Intelligence Research, 2022.
20. Yu Zhang, Zihua Wang, Jingyang Zhou, Siya Mi, Person Video Alignment with Human Pose Registration, Frontiers of Computer Science (FCS), 2022.
19. Yu Zhang, Wei Xiong, Siya Mi, Learning time-aware features for action quality assessment, Pattern Recognition Letters, 158, 2022, 104-110.
18. Siya Mi, Youwei An, Yu Zhang, A content-independent method for LFM signal source identification, AEU - International Journal of Electronics and Communications, 143, 2022.
17. Hongsheng Xu, Zihan Chen, Yu Zhang, Xin Geng, Siya Mi, Zhihong Yang, Weakly Supervised Temporal Action Localization with Proxy Metric Modeling, Frontiers of Computer Science (FCS), 2021.
16. Siya Mi, Yu Zhang, Pose-Guided Action Recognition in Static Images using Lie-Group, Applied Intelligence, 2021.
15. 张宇,温光照,米思娅,张敏灵,耿新, 基于深度学习的二维人体姿态估计综述,软件学报,2021.
14. X. Geng, R. Zheng, J. Lv, and Y. Zhang. Multilabel Ranking with Inconsistent Rankers. IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI), 2021, in press.
13. Yu Zhang, Xinyu Shi, Siya Mi, Xu Yang, Image captioning with transformer and knowledge graph, Pattern Recognition Letters, 143, 2021, 43-49.
12. X. Geng, X. Qian, Z. Huo, and Y. Zhang. Head Pose Estimation Based on Multivariate Label Distribution. IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI), 2020, in press.
11. Yu Zhang, Siya Mi, Jianxin Wu, Xin Geng, Simultaneous 3D hand detection and pose estimation using single depth images, Pattern Recognition Letters, 140, 2020, 43-48.
10. Yu Zhang, Yin Wang, Xu-Ying Liu, Siya Mi, Min-Ling Zhang, Large-Scale Multi-Label Classification using Unknown Streaming Images, Pattern Recognition, 99, 2020.
9. H. Zhang, Y. Zhang, and X. Geng. Practical Age Estimation Using Deep Label Distribution Learning. Frontiers of Computer Science (FCS), 2020, in press.
8. Huiying Zhang, Xin Geng, Yu Zhang, Fanyong Cheng, Recurrent age estimation, Pattern Recognition Letters, 2019, 125: 271-277.
7. Chi Xu, Lakshmi Narasimhan Govindarajan, Yu Zhang, Li Cheng, Lie-X: Depth Image Based Articulated Object Pose Estimation, Tracking, and Action Recognition on Lie Groups, International Journal of Computer Vision, 2017, pp. 1-25.
6. Yu Zhang, Li Cheng, Jianxin Wu, Jianfei Cai, Minh N. Do, and Jiangbo Lu, Action Recognition in Still Images with Minimum Annotation Efforts, IEEE Transactions on Image Processing, 2016.
5. Yu Zhang, Jianxin Wu, Jianfei Cai,Compact Representation of High-Dimensional Feature Vectors for Large-Scale Image Recognition and Retrieval, IEEE Transactions on Image Processing, 2016.
4. Yu Zhang, Xiu-Shen Wei, Jianxin Wu, Jianfei Cai, Jiangbo Lu, Viet-Anh Nguyen, Minh N. Do, Weakly Supervised Fine-Grained Categorization with Part-Based Image Representation, IEEE Transactions on Image Processing, 2016.
3. Jianxin Wu, Yu Zhang, Weiyao Lin, Good Practices for Learning to Recognize Actions using FV and VLAD, IEEE Transactions on Cybernetics, 2015.
2. Yu Zhang, Jianxin Wu, Jianfei Cai, Weiyao Lin, Flexible Image Similarity Computation Using Hyper-Spatial Matching, IEEE Transactions on Image Processing, 2014.
1. Yu Zhang, Zhaoyang Lu, Jing Li, Fabric defect classification using radial basis function network, Pattern Recognition Letters, 2010.
Conference paper list:
17.Yihang Meng, Hao Cheng, Zihua Wang, Hongyuan Zhu, Xiuxian Lao, and Yu Zhang, Efficient Multi-modal Human-centric Contrastive Pre-training with A Pseudo Body-structured Prior, PRCV, 2024.
16.Xu Yang, Zhangzikang Li, Haiyang Xu, Hanwang Zhang, Qinghao Ye, Chenliang Li, Ming Yan, Yu Zhang, Fei Huang, Songfang Huang, Learning Trajectory-Word Alignments for Video-Language Tasks,ICCV, 2023.
15.Xu Yang, Jiawei Peng, Zihua Wang, Haiyang Xu, Qinghao Ye, Chenliang Li, Ming Yan, Fei Huang, Zhangzikang Li, Yu Zhang, Transforming Visual Scene Graphs to Image Captions, ACL, 2023.
14.Xinyu Shi, Dong Wei, Yu Zhang, Donghuan Lu, Munan Ning, Jiashun Chen, Kai Ma, and Yefeng Zheng, Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation, ECCV, 2022.
13.Jiashun Chen, Donghuan Lu, Yu Zhang, Dong Wei, Munan Ning, Xinyu Shi, Zhe Xu, and Yefeng Zheng, Deformer: Towards Displacement Field Learning for Unsupervised Medical Image Registration, International Conference on Medical Imaging Computing and Computer Assisted Intervention (MICCAI), Singapore, 2022.
12.Zhou, Y., Bai, S., Zhou, T., Zhang, Y., Fu, H., 2022. Delving into Local Features for Open-Set Domain Adaptation in Fundus Image Analysis. International Conference on Medical Imaging Computing and Computer Assisted Intervention (MICCAI), Singapore, 2022.
11.Junjie Zhao, Donghuan Lu, Kai Ma, Yu Zhang, Yefeng Zheng, Deep Image Clustering with Category-Style Representation, ECCV 2020, in press.
10.Y. Gao, Y. Zhang, X. Geng, Label Enhancement for Label Distribution Learning via Prior Knowledge, In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI'20), Yokohama, Japan, 2020, in press.
9.Y. Liu, N. Xu, Y. Zhang, X. Geng, Label Distribution for Learning with Noisy Labels, In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI'20), Yokohama, Japan, 2020, in press.
8. Haiping Lu, Jianxin Wu, Yu Zhang, Learning Compact Binary Codes from Higher-Order Tensors via Free-Form Reshaping and Binarized Multilinear PCA, IJCNN 2016.
7. Hao Yang, Joey Tianyi Zhou, Yu Zhang, Bin-Bin Gao, Jianxin Wu, Jianfei Cai, Exploit Bounding Box Annotations for Multi-label Object Recognition, CVPR 2016.
6. Tianyi Zhang, Yu Zhang, Jianfei Cai, Alex Kot, Efficient Object Feature Selection for Action Recognition, ICASSP, 2016.
5. Yu Zhang, Jianxin Wu, Jianfei Cai, Weakly Supervised Fine-Grained Image Categorization by Object Selection, Third Workshop on Fine-Grained Visual Categorization (FGVC3), CVPRW 2015.
4. Yu Zhang, Jianxin Wu, Jianfei Cai, Compact Representation for Image Classification: To Choose or to Compress? CVPR 2014.
3. Jianxin Wu, Yu Zhang, Weiyao Lin, Towards Good Practices for Action Video Encoding, CVPR 2014
2. Yu Zhang, Jianxin Wu, Weiyao Lin, Exclusive Visual Descriptor Quantization, ACCV 2012.
1. Yu Zhang, Zhaoyang Lu, Jing Li, Fabric defect detection and classification using gabor filters and gaussian mixture model, ACCV 2010.
Misc:
2. Xiaowei Zhang, Chi Xu, Yu Zhang, Tingshao Zhu, Li Cheng, Multivariate Regression with Grossly Corrupted Observations: A Robust Approach and its Applications, arXiv: 1701.02892v1.
1. Yu Zhang, Chi Xu, Li Cheng, Learning to Search on Manifolds for 3D Pose Estimation of Articulated Objects, arXiv: 1612.00596.
Services:
青年AE for:
- Frontiers of Computer Science
SPC for:
- ECAI 2020
Reviewers for:
- ICCV, CVPR, ECCV, ACCV, AAAI, IJCAI, ECML
- Transactions on image processing
- Transactions on neural networks and learning systems
- Pattern recognition
- ...