Books and Chapters

SORTED BY YEAR: 2015 2014 2012 2011 2010

2015

2014

JiaLibook2014

2012

2011

2010

  • Yonghong Tian, Shuqiang Jiang, Tiejun Huang, Wen Gao. Semantic Image Classification and Annotation. Book Chapter in Semantic Mining Technologies for Multimedia Databases (Edited by Tao, Xu, and Li), IGI Global, 2009, 384-412.
  • Shuqiang Jiang, Yonghong Tian, Qingming Huang, Tiejun Huang, Wen Gao. Content-Based Video Semantic Analysis. Book Chapter in Semantic Mining Technologies for Multimedia Databases (Edited by Tao, Xu, and Li), IGI Global, 2009, 234-258.

International Conferences

SORTED BY YEAR:

2023 2022 2021 2020 2019 2018 2017 2016 2015 2014 2013 2012 2011 2010 2009 2008 2007 2006 2005 2004 2003 2002 2001

2023

  • Yangru Huang, Peixi Peng*, Yifan Zhao, Yunpeng Zhai, Haoran Xu and Yonghong Tian*, Simoun: Synergizing Interactive Motion-appearance Understanding for Vision-based Reinforcement Learning, 2023 IEEE/CVF International Conference on Computer Vision (ICCV).
  • Yunpeng Zhai, Peixi Peng*, Yifan Zhao, Yangru Huang and Yonghong Tian*, Stabilizing Visual Reinforcement Learning via Asymmetric Interactive Cooperation, 2023 IEEE/CVF International Conference on Computer Vision (ICCV).
  • Dongkai Wang, Shiliang Zhang*, Yaowei Wang, Yonghong Tian, Tiejun Huang, Wen Gao, HumVis: Human-Centric Visual Analysis System, 31th ACM Int’l Conf. Multimedia, October 29-November 3, 2023, Ottawa, ON, Canada.
  • Wenrui Li, Xi-Le Zhao, Zhengyu Ma*, Xingtao Wang, Xiaopeng Fan*, Yonghong Tian, Motion-Decoupled Spiking Transformer for Audio-Visual Zero-Shot Learning, 31th ACM Int’l Conf. Multimedia, October 29-November 3, 2023, Ottawa, ON, Canada.
  • Xinzi Cao, Xiawu Zheng, Yunhang Shen, Ke Li, Jie Chen, Yutong Lu, Yonghong Tian, LocLoc: Low-level Cues and Local-area Guides for Weakly Supervised Object Localization, 31th ACM Int’l Conf. Multimedia, October 29-November 3, 2023, Ottawa, ON, Canada.
  • Jianyang Zhai, Xiawu Zheng, Changdong Wang, Hui Li, Yonghong Tian, Knowledge Prompt-tuning for Sequential Recommendation, 31th ACM Int’l Conf. Multimedia, October 29-November 3, 2023, Ottawa, ON, Canada.
  • Quanmin Liang, Xiawu Zheng, Kai Huang, Yan Zhang, Jie Chen, Yonghong Tian, Event-Diffusion: Event-Based Image Reconstruction and Restoration with Diffusion Models, 31th ACM Int’l Conf. Multimedia, October 29-November 3, 2023, Ottawa, ON, Canada.
  • Zeyin Song, Yifan Zhao, Yujun Shi, Peixi Peng, Li Yuan, Yonghong Tian*, Learning with Fantasy: Semantic-Aware Virtual Contrastive Constraint for Few-Shot Class-Incremental Learning. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  • Yanqi Chen, Zhaofei Yu, Wei Fang, Zhengyu Ma, Xiawu Zheng, Yonghong Tian*, A Unified Framework of Soft Threshold Pruning, The Eleventh International Conference on Learning Representations, May 2023.
  • Zhaokun Zhou, Yuesheng Zhu, Chao He, Yaowei Wang, Shuicheng Yan, Yonghong Tian, Li Yuan*, Spikformer: When Spiking Neural Network Meets Transformer, The Eleventh International Conference on Learning Representations, May 2023.
  • Liwei Huang, Zhengyu Ma*, Liutao Yu, Huihui Zhou, Yonghong Tian*, Deep Spiking Neural Networks with High Representation Similarity Model Visual Pathways of Macaque and Mouse, the Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI-23), Washington, DC, USA, Feb 7-14, 2023. ORAL

2022

  • Yangru Huang, Peixi Peng*, Yonghong Tian*, Spectrum Random Masking for Generalization in Image-based Reinforcement Learning, Thirty-sixth Conference on Neural Information Processing Systems, New Orleans, USA, Nov. 28 2022~Dec. 9, 2022. SpotLight
  • Yatian Pang, Wenxiao Wang, Francis Tay, Wei Liu, Yonghong Tian, Li Yuan*, Masked Autoencoders for Point Cloud Self-supervised Learning, 17th European Conference on Computer Vision 2022, LNCS 13662, 604–621, Tel Aviv, Israel, October 23–27, 2022.
  • Yanqi Chen, Zhaofei Yu, Wei Fang, Zhengyu Ma, Tiejun Huang, Yonghong Tian*, State Transition of Dendritic Spines Improves Learning of Sparse Spiking Neural Networks, Proc. International Conference on Machine Learning, 2022.
  • Jianing Li, Xiao Wang, Lin Zhu, Jia Li, Tiejun Huang, Yonghong Tian*, Retinomorphic Object Detection in Asynchronous Visual Streams, Proceedings of AAAI2022, ORAL
  • Lin Zhu, Xiao Wang, Yi Chang, Jianing Li, Tiejun Huang, Yonghong Tian*, Event-based Video Reconstruction via Potential-assisted Spiking Neural Network, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  • Xiawu Zheng, Xiang Fei, Lei Zhang, Chenglin Wu, Fei Chao, Jianzhuang Liu, Wei Zeng, Yonghong Tian, Rongrong Ji, Neural Architecture Search with Representation Mutual Information, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). ORAL
  • Yunshan Zhong, Mingbao Lin, Gongrui Nan, Jianzhuang Liu, Baochang Zhang, Yonghong Tian, Rongrong Ji, IntraQ: Learning Synthetic Images with Intra-Class Heterogeneity for Zero-Shot Network Quantization, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  • Qinqin Zhou, Kekai Sheng, Xiawu Zheng, Ke Li, Xing Sun, Yonghong Tian, Jie Chen, Rongrong Ji, Training-free Transformer Architecture Search, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  • Yuntong Ye, Changfeng Yu, Yi Chang, Lin Zhu, Xi-Le Zhao, Luxin Yan, Yonghong Tian, Unsupervised Deraining: Where Contrastive Learning Meets Self-similarity, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  • Xuhui Yang, Yaowei Wang, Ke Chen, Yong Xu, Yonghong Tian, Fine-Grained Object Classification via Self-Supervised Pose Alignment, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  • Yixuan Wang, Jianing Li, Lin Zhu, Xijie Xiang, Tiejun Huang, Yonghong Tian*, Learning stereo depth estimation with bio-inspired spike cameras, IEEE International Conference on Multimedia and Expo 2022, 2022.
  • Xijie Xiang, Jianing Li, Lin Zhu, Yonghong Tian*, Tiejun Huang, Temporal Up-sampling for Asynchronous Events, IEEE International Conference on Multimedia and Expo 2022, 2022.

2021

  • Xiao Wang, Xiujun Shu, Zhipeng Zhang, Bo Jiang, Yaowei Wang, Yonghong Tian, Feng Wu, Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmark, Proc. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  • Yajing Zheng, Lingxiao Zheng, Zhaofei Yu, Boxin Shi, Yonghong Tian, Tiejun Huang, High-speed Image Reconstruction through Short-term Plasticity for Spiking Cameras, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  • Yanqi Chen, Zhaofei Yu, Wei Fang, Tiejun Huang, Yonghong Tian*, Pruning of Deep Spiking Neural Networks through Gradient Rewiring, the 30th International Joint Conference on Artificial Intelligence (IJCAI-21).
  • Jianhao Ding, Zhaofei Yu, Yonghong Tian*, Tiejun Huang, Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networks, the 30th International Joint Conference on Artificial Intelligence (IJCAI-21).
  • Mengjun Cheng, Zishang Kong, Guoli Song, Yonghong Tian, Yongsheng Liang, Jie Chen, Learnable Oriented-Derivative Network for Polyp Segmentation, 24th International Conference Medical Image Computing and Computer Assisted Interventions, 2021.
  • Daxin Gu, Jia Li*, Yu Zhang*, Yonghong Tian, How to Learn a Domain-Adaptive Event Simulator? 29th ACM Int’l Conf. Multimedia.
  • Yixiong Zou, Shanghang Zhang, Jianpeng Yu, Yonghong Tian*, José M. F. Moura, Revisiting Mid-Level Patterns for Cross-Domain Few-Shot Recognition, 29th ACM Int’l Conf. Multimedia.
  • Yixiong Zou, Shanghang Zhang, Guangyao Chen, Yonghong Tian*, Kurt Keutzer, José M. F. Moura, Annotation-Efficient Untrimmed Video Action Recognition, 29th ACM Int’l Conf. Multimedia.
  • Zhaodong Kang, Jianing Li, Lin Zhu, Yonghong Tian*, Retinomorphic Sensing: A Novel Paradigm for Future Multimedia Computing, 29th ACM Int’l Conf. Multimedia.
  • Lin Zhu, Jianing Li, Xiao Wang, Tiejun Huang and Yonghong Tian*, NeuSpike-Net: High Speed Video Reconstruction via Bio-inspired Neuromorphic Cameras, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).
  • Wei Fang, Zhaofei Yu, Yanqi Chen, Timothée Masquelier, Tiejun Huang and Yonghong Tian*, Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networks, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).
  • Jiajian Zhao, Yifan Zhao, Jia Li*, Ke Yan and Yonghong Tian, Heterogeneous Relational Complement for Vehicle Re-identification, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).
  • Guangyao Chen, Peixi Peng*, Li Ma, Jia Li, Lin Du and Yonghong Tian*, Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domain, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).
  • Zihan Xu, Mingbao Lin, Jianzhuang Liu, Jie Chen, Ling Shao, Yue Gao, Yonghong Tian, Rongrong Ji*, ReCU: Reviving the Dead Weights in Binary Neural Networks, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).
  • Gongjie Zhang, Kaiwen Cui, Rongliang Wu, Shijian Lu and Yonghong Tian, PNPDet: Efficient Few-shot Detection without Forgetting via Plug-and-Play Sub-networks, IEEE Winter Conference on Applications of Computer Vision (WACV 2021), 2021.
  • Li Ma, Peixi Peng, Peiyin Xing, Yaowei Wang and Yonghong Tian*, Reducing Image Compression Artifacts for Deep Neural Networks, 2021 Data Compression Conf.
  • Ivan Bajic, Weisi Lin, Yonghong Tian, Collaborative Intelligence: Challenges and Opportunities, Int’l Conf. Acoustics, Speech, & Signal Processing (ICASSP), 2021.
  • Peiyin Xing, Xiaofei Liu, Peixi Peng, Tiejun Huang, Yonghong Tian*, Allocating DNN Layers Computation Between Front-End Devices and the Cloud Server for Video Big Data Processing, Proc. Int’l Conf. Acoustics, Speech, & Signal Processing (ICASSP), 2021.

2020

  • Zhaoyi Yan, Yemin Shi, Yaowei Wang, Mingkui Tan, Zheyang Li, Wenming Tan, Yonghong Tian*, Towards Accurate Low Bit-width Quantization with Multiple Phase Adaptations, Proc. 31th AAAI Conf., 2020.
  • Lin Zhu, Siwei Dong, Jianing Li, Tiejun Huang, Yonghong Tian*, Retina-like Visual Image Reconstruction via Spiking Neural Model, Proc. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). ORAL. Introduction
  • Yunpeng Zhai, Shijian Lu, Qixiang Ye, Xuebo Shan, Jie Chen, Rongrong Ji, Yonghong Tian*, AD-Cluster: Augmented Discriminative Clustering for Domain Adaptive Person Re-identification, Proc. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  • Mingbao Lin, Rongrong Ji, Yuxin Zhang, Baochang Zhang, Yongjian Wu, Yonghong Tian, Channel Pruning via Automatic Structure Search,  Intl Joint Conf. Artificial Intelligence., 673-679.
  • Mingbao Lin, Rongrong Ji, Yan Wang, Yichen Zhang, Baochang Zhang, Yonghong Tian, Ling Shao, HRank: Filter Pruning using High-Rank Feature Map, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). ORAL
  • Xiawu Zheng, Rongrong Ji, Qiang Wang, Qixiang Ye, Zhenguo Li, Yonghong Tian, Qi Tian, Rethinking Performance Estimation in Neural Architecture Search, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  • Zhongyi Huang, Yao Ding, GuoliSong, Lin Wang, Ruizhe Geng, Hongliang He, Shan Du, Xia Liu, Yonghong Tian, Yongsheng Liang, S. Kevin Zhou, Jie Chen, BCData: A Large-Scale Dataset and Benchmark for Cell Detection and Counting, 23th International Conference Medical Image Computing and Computer Assisted Interventions, 2020, 289-298.
  • Guangyao Chen, Limeng Qiao, Yemin Shi, Peixi Peng, Jia Li, Tiejun Huang, Shiliang Pu, Yonghong Tian*, Learning Open Set Network with Discriminative Reciprocal Points, 14th European Conf. Computer Vision, 2020, 507-522. Spotlight
  • Yunpeng Zhai, Qixiang Ye, Shijian Lu, Mengxi Jia, Rongrong Ji, Yonghong Tian*, Multiple Expert Brainstorming for Domain Adaptive Person Re-identification, 14th European Conf. Computer Vision, 2020, 594–611.
  • Feifei Ding, Peixi Peng, Yangru Huang, Mengyue Geng, Yonghong Tian*, Masked Face Recognition with Latent Part Detection, 28th ACM Int’l Conf. Multimedia, Oct 2020, 2281–2289.
  • Zeyuan Wang, Yifan Zhao, Jia Li*Yonghong Tian, Cooperative Bi-path Metric for Few-shot Learning, 28th ACM Int’l Conf. Multimedia, Oct 2020, 1524–1532.
  • Peixi Peng, Yonghong Tian*, Yangru Huang, Xiangqian Wang, Huilong An, Discriminative Spatial Feature Learning for Person Re-Identification, 28th ACM Int’l Conf. Multimedia, Oct 2020, 274–283. ORAL
  • Yixiong Zou, Shanghang Zhang, Ke Chen, Yonghong Tian*, Yaowei Wang, José M. F. Moura, Compositional Few-Shot Recognition with Primitive Discovery and Enhancing, 28th ACM Int’l Conf. Multimedia, Oct 2020, 274–283. ORAL
  • Mengyue Geng, Peixi Peng, Yangru Huang, Yonghong Tian*, Masked Face Recognition with Generative Data Augmentation and Domain Constrained Ranking, Proc. 28th ACM Int’l Conf. Multimedia, Oct 2020, 2246–2254.
  • Xin Wang, Wenwu Zhu, Yonghong Tian, Wen Gao, Multimedia Intelligence: When Multimedia Meets Artificial Intelligence, 28th ACM Int’l Conf. Multimedia, Oct 2020, 4775–4776.
  • Sheng Li, Tingting Jiang, Tiejun Huang, Yonghong Tian, Global Co-occurrence Feature Learning and Active Coordinate System Conversion for Skeleton-based Action Recognition, IEEE Winter Conference on Applications of Computer Vision (WACV 2020), 2020, 575-583.
  • Peiyin Xing, Peixi Peng*, Yongsheng Liang, Tiejun Huang, Yonghong Tian*, Binary Representation and High Efficient Compression of 3D CNN Features for Action Recognition, 2019 Data Compression Conf., 572-572.
  • Quan Zhang, Yemin Shi, Lechun Zhang, Yaowei Wang, Yonghong Tian*, Learning Compact Networks via Similarity-Aware Channel Pruning, 2020 IEEE Conf. Multimedia Information Processing and Retrieval (MIPR), 2020, 145-148.
  • Lechun Zhang, Guangyao Chen, Yemin Shi, Quan Zhang, Mingkui Tan, Yaowei Wang, Yonghong Tian, Tiejun Huang, Anonymous Model Pruning for Compressing Deep Neural Networks, 2020 IEEE Conf. Multimedia Information Processing and Retrieval (MIPR), 2020, 157-160.
  • Lihui Su, YaoWei Wang, Yonghong Tian, R-SiamNet: ROI-Align Pooling Baesd Siamese Network for Object Tracking, 2020 IEEE Conf. Multimedia Information Processing and Retrieval (MIPR), 2020, 19-24.
  • Peiyin Xing, Yaowei Wang, Peixi Peng*, Yonghong Tian*, Tiejun Huang, End-Edge-Cloud Collaborative System: A Video Big Data Processing and Analysis Architecture, 2020 IEEE Conf. Multimedia Information Processing and Retrieval (MIPR), 2020, 233-236
  • Zhaoyi Yan, Peiyin Xing, Yaowei Wang, Yonghong Tian, Prune it Yourself: Automated Pruning by Multiple Level Sensitivity, 2020 IEEE Conf. Multimedia Information Processing and Retrieval (MIPR), 2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

Demos

  • eHealth:

eHealth_clip1

Can you imagine a pad should know your heart rate only with a camera watching you? 

  • SmartCam:

SmartCam-1_clip1

SmartCams can help building and managing a “smart city”. It commands crimes no place to hide, therefore making our city a sweet home, safe and steady. 

  • SmartTV:

SmartTV_clip1

Efficient coding and intelligent recognizing in surveillance video.

Research Projects

Smart TV

Recent representative results are briefly described as follows:

1)   SalAd: Saliency-driven video advertising system

smarttv1

2)   Cloud computing and smart TV are listed as the two most important emerging technologies in the recent years. By seamlessly integrating the emerging cloud computing and smart TV, the new multimedia service platform is able to trigger the next round of revolution in the fields of digital home services, consequently opening up a whole new world for the entire TV industry and interactive media industry. To address this challenge, this project focuses on key technologies and applications of multimedia cloud services and smart TV clients for three terminals (including TV, Tablet PC and mobile phones).

easytv1  easytv2

3)   All these studies can offer important avenues for the multimedia academic community and have great potential of commercial values in digital TV, content and entertainment industries.

c-detector

4)   VLabler: Sequence multi-labeling system for video annotation.

vlabler

5)   Obj!CSM: Object segmentation system based on complementary saliency maps.

obj-csm

6)    C-VideoAdvisor: Video advertisement automatic association system.

Cva

 

SmartCam

This project puts its main focus on the challenging research issues and key technologies about multi-camera cooperated object detection, tracking, and event analysis on large-scale surveillance video data. Overall, the long-term objective of this project is to provide key technologies and solutions for the next-generation intelligent video surveillance systems and applications.

Recent representative results are briefly described as follows:

1) Object detection and tracking

obj_dt  obj_dt2

2) Event detection

ed1 ed2

 

3) Multi-view human detection

multi_view

 

4) ESur: Event detection system on surveillance videos

esur

 

5) XSur: surveillance object localization and tracking system

xsur

 

6) Fire and smoke detection for forest and city videos

fireandsmoke1   fireandsmoke2

7) BVPMeasure: Automatic Webcam-based Human Heart Rate Measurements

bvp

 

SuperCompressor

In this project, our objective is to develop a series of high efficient video coding models and methods for surveillance applications. Our coding methods are designed by using the special characteristics of surveillance videos to achieve higher coding performance compared with the existing coding standards which are developed for coding generic videos.

Recent representative results are briefly described as follows:

1) BDC: Background-difference-based coding

We proposed an efficient solution called background-difference-based coding (BDC). BDC follows the traditional hybrid coding framework, but utilizes the original input frames to generate and encode the periodically updated background frame. After that, it calculates the difference frames by subtracting the reconstructed background frame from the input frames, and then codes these difference frames into the code stream.

bdc

2) AVS Transcoder: A fast and performance-maintained transcoding system

  •  High-efficiency: 2~10 times of H.264 HP
  •  Low transcoding complexity: About 5% of the state-of-the-art encoder

avs

Journals

SORTED BY YEAR:

2023 2022 2021 2020 2019 2018 2017 2016 2015 2014 2013 2012 2011 2010 2009 2006 2005 2004 2003 2002 2001

2023

  • Yichen Zhang, Gan He, Xiaofei Liu , J.J. Johannes Hjort, Alexander Kozlov, Yutao He, Shen-jian Zhang, Lei Ma , Jeanette Kotaleski, Yonghong Tian, Sten Grillner, Tiejun Huang, Kai Du*, A GPU-based computational framework that bridges Neuron simulation and Artificial Intelligence, Nature Communications, 14, Article number: 5798 (2023).
  • Wei Fang, Yanqi Chen, Jianhao Ding, Zhaofei Yu, Timothée Masquelier, Ding Chen, Liwei Huang, Huihui Zhou, Guoqi Li*, Yonghong Tian*, SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligence, Science Advances. Accepted at 2023.8.31
  • Zhongrui Zhao, Long Xu*, Xiaoshuai Zhu, Xinze Zhang, Sixuan Liu, Xin Huang*, Zhixiang Ren, and Yonghong Tian*, A Large-Scale Dataset of Three-Dimensional Solar Magnetic Fields Extrapolated by Nonlinear Force-Free Method, Nature Scientific Data, 10, Article number: 178 (2023).
  • Dianze Li, Jianing Li*, Yonghong Tian*, SODFormer: Streaming Object Detection with Transformer Using Events and Frames, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023 Jul 21.
  • Munan Ning, Donghuan Lu, Yujia Xie, Dongdong Chen, Dong Wei, Yefeng Zheng, Yonghong Tian, Shuicheng Yan, Li Yuan, MADAv2: Advanced Multi-Anchor Based Active Domain Adaptation Segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023 Jul 11.
  • Man Yao, Guangshe Zhao, Hengyu Zhang, Yifan Hu, Lei Deng, Yonghong Tian, Bo Xu, and Guoqi Li, Attention Spiking Neural Networks, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023 Jan 23.
  • Yifan Zhao, Jia Li*, Yu Zhang, Yonghong Tian, From Pose to Part: Weakly-Supervised Pose Evolution for Human Part Segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022 May 6. 1109/TPAMI.2022.3174529
  • Mingbao Lin, Yuxin Zhang, Yuchao Li, Bohong Chen, Fei Chao, Shen Li, Yonghong Tian, Rongrong Ji*, 1xN Pattern for Pruning Convolutional Neural Networks, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022 Jul 30.
  • Zhiyi Tian, Lei Cui*, Chenhan Zhang, Shuaishuai Tan, Shui Yu, and Yonghong Tian, The Role of Class Information in Model Inversion Attacks against Image Deep Learning Classifiers, IEEE Transactions on Dependable and Secure Computing, 15 Aug, 2023
  • Sizhu Han, Huihui Zhou, Yonghong Tian, Yixuan Ku*, Early top-down control of internal selection induced by retrospective cues in visual working memory: advantage of peripheral over central cues, Progress in Neurobiology, Vol 230, November 2023, 102521.
  • Jie Chen, Zhiwei Nie, Yu Wang, Kai Wang, Fan Xu, Z. Hu, B. Zheng, Z. Wang, Guoli Song, J. Zhang, J. Fu, X. Huang, Z. Wang, Zhixiang Ren, Q. Wang, D. Li, D. Wei, Bin Zhou*, Chao Yang*, Yonghong Tian*, Running ahead of evolution – AI based simulation for predicting future high-risk SARS-CoV-2 variants, Int’l J. High Perf. Comput. Appl. (ACM Gordon Bell Special Prize Finalist for HPC-Based COVID-19 Research), published online July 29, 2023.
  • Yunpeng Zhai, Peixi Peng*, Mengxi Jia, Shiyong Li, Weiqiang Chen, Xuesong Gao, Yonghong Tian*, Population-Based Evolutionary Gaming for Unsupervised Person Re-identification, International Journal of Computer Vision, 131, pages 1–25 (2023).
  • Yifan Zhao, Tong Zhang, Jia Li*, Yonghong Tian, Dual Adaptive Representation Alignment for Cross-Domain Few-Shot Learning, IEEE Transactions on Pattern Analysis and Machine Intelligence, 03 May 2023. 10.1109/TPAMI.2023.3272697.
  • Liwen Zhu, Peixi Peng*, Zongqing Lu, Yonghong Tian*, MetaVIM: Meta Variationally Intrinsic Motivated Reinforcement Learning for Decentralized Traffic Signal Control, IEEE Transactions on Knowledge and Data Engineering, Jan 4, 2023.
  • Pengchong Qiao, Han Li, Guoli Song, Hu Han, Zhiqiang Gao, Yonghong Tian, Yongsheng Liang, Xi Li, S. Kevin Zhou, and Jie Chen, Semi-supervised CT lesion segmentation using uncertainty-based data pairing and SwapMix, IEEE Transactions on Medical Imaging, 42(5), May 2023, 1546-1562.
  • Wendong Zheng, Putian Zhao, Gang Chen, Huihui Zhou, Yonghong Tian, A Hybrid Spiking Neurons Embedded LSTM Network for Multivariate Time Series Learning under Concept-drift Environment, IEEE Transactions on Knowledge and Data Engineering, 35(7), July 2022, 6561-6574.
  • Xiao Wang, Xiujun Shu, Shiliang Zhang, Yaowei Wang*, Yonghong Tian, Feng Wu, MFGNet: Dynamic Modality-Aware Filter Generation for RGB-T Tracking, IEEE Transactions on Multimedia, May 11 2022
  • Tiejun Huang, Yajing Zheng, Zhaofei Yu*, Rui Chen, Yuan Li, Ruiqin Xiong, Lei Ma, Junwei Zhao, Siwei Dong, Lin Zhu, Jianing Li, Shanshan Jia, Yihua Fu, Boxin Shi, Si Wu, Yonghong Tian, 1000× Faster Camera and Machine Vision with Ordinary Devices, Engineering, Available online 12 April 2022.
  • Yuxin Zhang, Mingbao Lin, Chia-Wen Lin, Jie Chen, Yongjian Wu, Yonghong Tian, Rongrong Ji*, Carrying out CNN Channel Pruning in a White Box, IEEE Transactions on Neural Networks and Learning Systems. 14 Feb 2022, 10.1109/TNNLS.2022.3147269
  • Shaojie Li, Mingbao Lin, Yan Wang, Yongjian Wu, Yonghong Tian, Ling Shao, Rongrong Ji*, Distilling a Powerful Student Model via Online Knowledge Distillation, IEEE Transactions on Neural Networks and Learning Systems. 07 March 2022, 10.1109/TNNLS.2022.3152732
  • Lin Zhu, Siwei Dong, Jianing Li, Tiejun Huang, Yonghong Tian*, Ultra-high Temporal Resolution Visual Reconstruction from a Fovea-like Spike Camera via Spiking Neuron Mode IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023 Jan 12, 45(1), 1233 – 1249. 10.1109/TPAMI.2022.3146140
  • Youneng Bao, Fanyang Meng, Chao Li, Siwei Ma, Yonghong Tian, Yongsheng Liang*, Nonlinear Transforms in Learned Image Compression from a Communication Perspective, IEEE Transactions on Circuits and Systems for Video Technology, , 33(4), 1922-1936, Apr 2023.
  • Jianing Li, Yihua Fu, Siwei Dong, Zhaofei Yu, Tiejun Huang, and Yonghong Tian*, Asynchronous Spatiotemporal Spike Metric for Event Cameras, IEEE Transactions on Neural Networks and Learning Systems, 34(4), 1742-1753, Apr 2023, 10.1109/TNNLS.2021.3061122
  • Li Ma, Peixi Peng, Guangyao Chen, Yifan Zhao, Siwei Dong, Yonghong Tian *, Picking Up Quantization Steps for Compressed Image Classification, IEEE Transactions on Circuits and Systems for Video Technology, 33(4), 1884-1898, Apr 2023.
  • Xijie Xiang, Lin Zhu, Jianing Li, Yixuan Wang, Tiejun Huang*, Yonghong Tian*, Learning Super-Resolution Reconstruction for High Temporal Resolution Spike Stream, IEEE Transactions on Circuits and Systems for Video Technology, 2023, 33(1), 16-29.

2022

  • Tao Wei, Yonghong Tian, Yaowei Wang, Yun Liang, Chang Wen Chen, Optimized separable convolution: Yet another efficient convolution operator, AI Open, Volume 3, 2022, Pages 162-171.
  • Yijie Zhao, Kendrick N. Kay, Yonghong Tian, Yixuan Ku*, Sensory recruitment revisited: Ipsilateral V1 involved in visual working memory, Cerebral Cortex, 32(7), 1 April 2022, 1470–1479. doi: 10.1093/cercor/bhab300.
  • Lin Zhu, Siwei Dong, Jianing Li, Tiejun Huang, Yonghong Tian*, Ultra-high Temporal Resolution Visual Reconstruction from a Fovea-like Spike Camera via Spiking Neuron Mode IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022 Jan 12. 10.1109/TPAMI.2022.3146140
  • Yifan Zhao, Jia L*, Yu Zhang, Yonghong Tian, From Pose to Part: Weakly-Supervised Pose Evolution for Human Part Segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022 May 6.1109/TPAMI.2022.3174529
  • Mingbao Lin, Rongrong Ji*, Xiaoshuai Sun, Baochang Zhang, Feiyue Huang, Yonghong Tian, Dacheng Tao, Fast Class-wise Updating for Online Hashing, IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(5), May 2022, 2453-2467. 1109/TPAMI.2020.3042193
  • Guangyao Chen, Peixi Peng, Xiangqian Wang, Yonghong Tian*, Adversarial Reciprocal Points Learning for Open Set Recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, 10.1109/TPAMI.2021.3106743.
  • Wendong Zheng, Putian Zhao, Gang Chen*, Huihui Zhou, Yonghong Tian, A Hybrid Spiking Neurons Embedded LSTM Network for Multivariate Time Series Learning under Concept-drift Environment, IEEE Transactions on Knowledge and Data Engineering, May 22, 2022.
  • Xiao Wang, Xiujun Shu, Shiliang Zhang, Yaowei Wang*, Yonghong Tian, Feng Wu, MFGNet: Dynamic Modality-Aware Filter Generation for RGB-T Tracking, IEEE Transactions on Multimedia.
  • Tiejun Huang, Yajing Zheng, Zhaofei Yu*, Rui Chen, Yuan Li, Ruiqin Xiong, Lei Ma, Junwei Zhao, Siwei Dong, Lin Zhu, Jianing Li, Shanshan Jia, Yihua Fu, Boxin Shi, Si Wu, Yonghong Tian, 1000× Faster Camera and Machine Vision with Ordinary Devices, Engineering, Available online 12 April 2022.
  • Jianing Li, Jia Li*, Lin Zhu, Xijie Xiang, Tiejun Huang, Yonghong Tian*, Asynchronous Spatio-Temporal Memory Network for Continuous Event-Based Object Detection, IEEE Transactions on Image Processing, 31, Apr 2022, 2975-2987. 10.1109/TIP.2022.3162962
  • Chong Zhang, Zongxian Li, Jingjing Liu, Peixi Peng, Qixiang Ye, Shijian Lu, Tiejun Huang, and Yonghong Tian*, Self-Guided Adaptation: Progressive Representation Alignment for Domain Adaptive Object Detection, IEEE Transactions on Multimedia, 24(5), 2246-2258. 10.1109/TMM.2021.3078141
  • Xijie Xiang, Lin Zhu, Jianing Li, Yixuan Wang, Tiejun Huang*, Yonghong Tian* Learning Super-Resolution Reconstruction for High Temporal Resolution Spike Stream, IEEE Transactions on Circuits and Systems for Video Technology
  • Jianing Li, Yihua Fu, Siwei Dong, Zhaofei Yu, Tiejun Huang, and Yonghong Tian*, Asynchronous Spatiotemporal Spike Metric for Event Cameras, IEEE Transactions on Neural Networks and Learning Systems, 10.1109/TNNLS.2021.3061122
  • Mingbao Lin, Rongrong Ji, Shaojie Li, Qixiang Ye, Yonghong Tian, Jianzhuang Liu, Qi Tian, Filter Sketch for Network Pruning, IEEE Transactions on Neural Networks and Learning Systems. 1109/TNNLS.2021.3084206
  • Xiao Wang, Jin Tang, Bin Luo, Yaowei Wang*, Yonghong Tian, Feng Wu*, Tracking by Joint Local and Global Search: A Target-aware Attention based Approach, IEEE Transactions on Neural Networks and Learning Systems. 10.1109/TNNLS.2021.3083933
  • Yuxin Zhang, Mingbao Lin, Chia-Wen Lin, Jie Chen, Yongjian Wu, Yonghong Tian, Rongrong Ji*, Carrying out CNN Channel Pruning in a White Box, IEEE Transactions on Neural Networks and Learning Systems.
  • Shaojie Li, Mingbao Lin, Yan Wang, Yongjian Wu, Yonghong Tian, Ling Shao, Rongrong Ji*, Distilling a Powerful Student Model via Online Knowledge Distillation, IEEE Transactions on Neural Networks and Learning Systems. 10.1109/TNNLS.2022.3152732
  • Shanshan Jia, Zhaofei Yu, Arno Onken, Yonghong Tian, Tiejun Huang, Jian K. Liu*, Neural System Identification with Spike-triggered Non-negative Matrix Factorization, IEEE Transactions on Cybernetics, 2020 Nov 1. DOI: 10.1109/TCYB.2020.3042513
  • Lihui Su, Wenyao Wang, Kaiwen Sheng, Xiaofei Liu, Kai Du, Yonghong Tian* and Lei Ma*, SNAP-Tracker, a model free deep learning tool for animal behavioral tracking, Frontiers in Behavioral Neuroscience, 6:759943. doi: 10.3389/fnbeh.2022.759943 Mar. 4, 2022.
  • Qi Yan*, Yajing Zheng*, Shanshan Jia, Yichen Zhang, Zhaofei Yu*, Feng Chen, Yonghong Tian, Tiejun Huang, Jian K. Liu*, Revealing Fine Structures of the Retinal Receptive Field by Deep Learning Network, IEEE Transactions on Cybernetics, 52(1), Jan 2022, 39-50. 10.1109/TCYB.2020.2972983
  • 朱林,田永鸿*,仿视网膜传感器视觉重建算法研究综述,中国科学 信息科学
  • 陈光耀,彭佩玺,田永鸿*,紧致化神经网络的鲁棒性分析,中国科学:技术科学

2021

  • Yifan Zhao, Jia Li*, Xiaowu Chen, Yonghong Tian, Part-guided Relational Transformers for Fine-grained Visual Recognition, IEEE Transactions on Image Processing, Dec. 2021, 30, 9470-9481.
  • Yifan Zhao, Jia Li*, Yu Zhang, Yafei Song and Yonghong Tian, Ordinal Multi-task Part Segmentation with Recurrent Prior Generation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 43(5), May 2021: 1636-1648. doi: 10.1109/TPAMI.2019.2953854.
  • Yijie Zhao, Kendrick N. Kay, Yonghong Tian, Yixuan Ku*, Sensory recruitment revisited: Ipsilateral V1 involved in visual working memory, Cerebral Cortex
  • Chong Zhang, Zongxian Li, Jingjing Liu, Peixi Peng, Qixiang Ye, Shijian Lu, Tiejun Huang, and Yonghong Tian*, Self-Guided Adaptation: Progressive Representation Alignment for Domain Adaptive Object Detection, IEEE Transactions on Multimedia,1109/TMM.2021.3078141
  • Jianing Li, Yihua Fu, Siwei Dong, Zhaofei Yu, Tiejun Huang, and Yonghong Tian*, Asynchronous Spatiotemporal Spike Metric for Event Cameras, IEEE Transactions on Neural Networks and Learning Systems, 10.1109/TNNLS.2021.3061122
  • Mingbao Lin, Rongrong Ji*, Shaojie Li, Qixiang Ye, Yonghong Tian, Jianzhuang Liu, Qi Tian, Filter Sketch for Network Pruning, IEEE Transactions on Neural Networks and Learning Systems. 1109/TNNLS.2021.3084206
  • Xiao Wang, Jin Tang, Bin Luo, Yaowei Wang*, Yonghong Tian, Feng Wu*, Tracking by Joint Local and Global Search: A Target-aware Attention based Approach, IEEE Transactions on Neural Networks and Learning Systems. 10.1109/TNNLS.2021.3083933
  • Xiao Wang, Zhe Chen, Jin Tang, Bin Luo, Yaowei Wang*, Yonghong Tian, Feng Wu*, Dynamic Attention guided Multi-Trajectory Analysis for Single Object Tracking, IEEE Transactions on Circuits and Systems for Video Technology. DOI: 10.1109/TCSVT.2021.3056684
  • Wen Gao, Siwei Ma, Lingyu Duan, Yonghong Tian*, Peiying Xing, Yaowei Wang, Shanshe Wang, Huizhu Jia, Tiejun Huang, Digital Retina: A Way to Make the City Brain More Efficient by Visual Coding, IEEE Transactions on Circuits and Systems for Video Technology. 10.1109/TCSVT.2021.3104305
  • Shanshan Jia, Zhaofei Yu, Arno Onken, Yonghong Tian, Tiejun Huang, Jian K. Liu*, Neural System Identification with Spike-triggered Non-negative Matrix Factorization, IEEE Transactions on Cybernetics, 2020 Nov 1. DOI: 10.1109/TCYB.2020.3042513
  • Qi Yan**, Yajing Zheng**, Shanshan Jia, Yichen Zhang, Zhaofei Yu*, Feng Chen, Yonghong Tian, Tiejun Huang, Jian K. Liu*, Revealing Fine Structures of the Retinal Receptive Field by Deep Learning Network, IEEE Transactions on Cybernetics, 1109/TCYB.2020.2972983
  • Xiawu Zheng, Rongrong Ji*, Qiang Wang, Yuhang Chen, Baochang Zhang, Qixiang Ye, Jie Chen, Feiyue Huang, Yonghong Tian, MIGO-NAS: Towards Fast and Generalizable Neural Architecture Search, IEEE Transactions on Pattern Analysis and Machine Intelligence, 43(9), 2021, 2936-2952. 1109/TPAMI.2021.3065138
  • Jia Li*, Jinming Su, Changqun Xia*, Mingcan Ma, and Yonghong Tian, Salient Object Detection with Purificatory Mechanism and Structural Similarity Loss, IEEE Transactions on Image Processing, 30(7), 6855 – 6868.
  • Lin Zhu, Siwei Dong, Tiejun Huang, and Yonghong Tian*, Hybrid Coding of Spatiotemporal Spike Data for a Bio-inspired Camera, IEEE Transactions on Circuits and Systems for Video Technology, 31(7), 2021, 2837-2851.
  • Yi Chang, Luxin Yan*, Bingling Chen, Sheng Zhong, Yonghong Tian, Hyperspectral Image Restoration: Where Does the Low-Rank Property Exist, IEEE Transactions on Geoscience and Remote Sensing, 59(8), Aug. 2021, 6869-6884. 10.1109/TGRS.2020.3024623.
  • 李家宁,田永鸿*,神经形态视觉传感器的研究进展及应用综述,计算机学报, 44(6), 1259-1288。
  • 赵耀,田永鸿,党建武,付树军,王恒友,万军,安高云,杜卓然,廖理心,韦世奎*, 面向智慧城市的交通视频结构化分析前沿进展, 26(6), 2021, 1227-1253.

2020

  • Youyang Qu, Shui Yu, Wanlei Zhou, and Yonghong Tian*, GAN-Driven Personalized Spatial-Temporal Private Data Sharing in Cyber-Physical Social Systems, IEEE Transactions on Network Science and Engineering, 7(4), Oct.-Dec. 2020, 2576-2586.
  • Lin Zhu, Xiurong Jiang, Jianing Li, Yuanhong Hao, and Yonghong Tian*, Motion-aware Structured Matrix Factorization for Foreground Detection in Complex Scenes, ACM Transactions on Multimedia Computing Communications and Applications, 16, 4, Article 123 (December 2020), 23 pages.
  • Yixiong Zou, Yemin Shi, Daochen Shi, Yaowei Wang, Yongsheng Liang and Yonghong Tian*, Adaptation-Oriented Feature Projection for One-shot Action Recognition, IEEE Transactions on Multimedia, 22(12), Dec. 2020, 3166-3179.
  • Weiqing Min, Wen-Huang Cheng, Yonghong Tian, Abdulmotaleb El Saddik, Zi Huang, Urban Multimedia Computing: Emerging Methods in Multimedia Computing for Urban Data Analysis and Applications, IEEE Multimedia, 27(3), Sep 2020, 8-11.
  • Kui Fu, Jia Li*, Yu Zhang, Hongze Shen, and Yonghong Tian, Model-guided Multi-path Knowledge Aggregation for Aerial Saliency Prediction, IEEE Transactions on Image Processing, 29(6), 7117-7127, Jun 2020. 10.1109/TIP.2020.2998977
  • Yonghong Tian*, Cees G. M. Snoek, Jingdong Wang, Zhu Liu, Rainer Lienhart, Susanne Boll, Guest Editorial: Multimedia Computing with Interpretable Machine Learning, IEEE Transactions on Multimedia, 22(7), Jul 2020, pp. 1661-1666.
  • Yu Shu, Yemin Shi, Yaowei Wang, Tiejun Huang, Yonghong Tian*, P-ODN: Prototype-based Open Deep Network for Open Set Recognition, Scientific Reports, 2020, 10, article number: 7146.
  • Zhaofei Yu, Jian K. Liu*, Shanshan Jia, Yichen Zhang, Yajing Zheng, Yonghong Tian, Tiejun Huang, Towards the Next Generation of Retinal Neuroprosthesis: Visual Computation with Spikes, Engineering, Volume 6, Issue 4, April 2020, 449-461.
  • Yichen Zhang, Shanshan Jia, Yajing Zheng, Zhaofei Yu*, Yonghong Tian, Siwei Ma, Tiejun Huang, Jian K. Liu*, Reconstruction of Natural Visual Scenes from Neural Spikes with Deep Neural Networks, Neural Networks, Volume 125, May 2020, Pages 19-30.
  • Yajing Zheng, Shanshan Jia, Zhaofei Yu*, Tiejun Huang, Jian K. Liu, Yonghong Tian*, Probabilistic Inference of Binary Markov Random Fields in Spiking Neural Networks through Mean-field Approximation, Neural Networks, Volume 126, June 2020, Pages 42-51.
  • Lin Ding, Yonghong Tian*, Hongfei Fan, Changhuai Chen, and Tiejun Huang, Joint Coding of Local and Global Deep Features in Videos for Visual Search, IEEE Transactions on Image Processing, 29(1), 3734-3749, Jan 15, 2020. (WOS:000510750900064)
  • Jia Li, Jinming Su, Changqun Xia and Yonghong Tian, Distortion-adaptive Salient Object Detection in 360° Omnidirectional Images, Journal of Selected Topics in Signal Processing, 4(1), 38-48, Jan 2020. DOI: 10.1109/JSTSP.2019.2957982..

2019

  • Li Ma, Yonghong Tian*, Peiyin Xing, Tiejun Huang, Residual-Based Post-processing for HEVC, IEEE Multimedia, 26(4), 67-79, Oct-Dec. 2019. (WOS:000510707800007)
  • Xueqing Zhao, Xin Shi, Bo Yang, Quanli Gao, Zhaofei Yu*, Jian K Liu, Yonghong Tian*, Tiejun Huang, Skeleton-Based 3D Object Retrieval Using Retina-Like Feature Descriptor, IEEE Access, Volume: 7,157341 – 157352, Sep.2019. (WOS:000510442000002)
  • Siwei Dong, Zhichao Bi, Yonghong Tian* and Tiejun Huang, Spike Coding for Dynamic Vision Sensor in Intelligent Driving, IEEE Internet of Things Journal, 6(1), Feb 2019, 60-71. (WOS:000459709500007) (EI20184105916767)
  • Yonghong Tian*, Lan Wei, Shijian Lu, Tiejun Huang, Free- view gait recognition. PLoS ONE 14(4): e0214389, Apr 2019. (WOS:000464696100008)
  • Jia Li*, PengCheng Yuan, Daxin Gu, Yonghong Tian*, Hierarchical Deep Co-segmentation of Primary Objects in Aerial Videos, IEEE Multimedia, 26(3), JUL-SEP 2019, 9-18. (WOS:000484210400002)
  • Yuanyuan Yang*, Yonghong Tian, Tiejun Huang, Multiscale video sequence matching for near-duplicate detection and retrieval, Multimedia Tools and Applications, January 2019, 78(1), pp 311–336. 10.1007/s11042-018-5862-3 (WOS:000457317500017) (EI20181905147578)
  • Yifan Zhao, Jia Li*, Yu Zhang, Yafei Song and Yonghong Tian Ordinal Multi-task Part Segmentation with Recurrent Prior Generation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2019 Nov 18. doi: 10.1109/TPAMI.2019.2953854.
  • Jia Li, Jinming Su, Changqun Xia and Yonghong Tian, Distortion-adaptive Salient Object Detection in 360° Omnidirectional Images, Journal of Selected Topics in Signal Processing, 4(1), 38-48, Jan 2020. DOI: 10.1109/JSTSP.2019.2957982..
  • Yu, Z., Liu, J. K., Jia, S., Zhang, Y., Zheng, J., Tian Y*, and Huang, T., Towards the Next Generation of Retinal Neuroprosthesis: Visual Computation with Spikes. Engineering, In Press, (2019)

2018

2017

2016

2015

2014

2013

2012

  • Jingjing Yang, Yonghong Tian, Lingyu Duan, Tiejun Huang, Wen Gao. Group-Sensitive Multiple Kernel Learning for Object Recognition, IEEE Transactions on Image Processing, 21(5), May 2012, 2838-2852.
  • Yonghong Tian, Tiejun Huang, Wen Gao, Multimodal Video Copy Detection using Multi-Detectors Fusion, IEEE COMSOC MMTC E-Letter, 7(5), September 2012, 3-6.
  • Zhongfei Zhang, Zhengyou Zhang, Ramesh Jain, Yueting Zhuang, Noshir CONTRACTOR, Alexander G. HAUPTMANN, Alejandro (Alex) JAIMES, Wanqing LI, Alexander C. LOUI, Tao MEI, Nicu SEBE, Yonghong Tian, Vincent S. TSENG, Qing WANG, Changsheng XU, Huimin YU, Shiwen YU, Societally connected multimedia across cultures, Journal of Zhejiang University SCIENCE C, 13(12), 2012, 875-880.
  • CHEN Ming-Li, ZHANG Chang-Xin, YANG Shao-Juan, MAO Li-Hua, TIAN Yong-Hong, HUANG Tie-Jun, WU Xi-Hong, GAO Wen, LI Liang, Stereopsis-Based Binocular Unmasking, Advances in Psychological Science, 20(9), 2012, 1355-1363. [In Chinese]
  • Yonghong Tian, Tiejun Huang, Wen Gao, Social Multimedia Compution,Communication of China Computer Federation,8(4),2012,8-13. [In Chinese]

2011

2010

2009

2006

2005

2004

2003

2002

2001

Research Funding

Currently, our team is undertaking more than 10 major national academic projects, including a 973 project, a key project from National Natural Science Foundation, a key project from National High-Tech Research and Development (863) Programme and a key project from the Key Technologies R&D Programme. In recent years, the team won in several international competitions and was awarded the First Prize of Science and Technology Progress Awards 2009 set by Ministry of Education and the Second Prize of National Science and Technology Progress Awards 2010.

Some of our funding are as follows:

  • Multi-camera Cooperative Moving Object Detection, Tracking and Anomalous Behavior Analysis in Surveillance Video (A Key Project Grant from NSFC, 2011-2014).
  • Learning-based Video Attention & Interestingness Computational Methodology for Interative Video Technology (Grant from NSFC, 2010-2012)
  • Theory and Metholodogies of the Correlation Analysis on Salient Moving Objects in the Multi-view Surveillance Video (Grant from M.O.E of China, 2010-2012).
  • Robust Statistical Relational Models and Relational Kernel Methods for Complex Link Data and Relational Data (Grant from NSFC, 2007-2009).
  • Video Retrieval Technology and Content Management System for IPTV (Grant from China 863 Hi-Tech Program, 2007-2008).
  • Content Analysis and Enrichment Technology for IPTV Interactive Video Services (Grant from Huawei Company, 2008-2009).

Research Areas

Our current research activities focus on two areas:

1. Brain-like and Deep Computing 

To investigate the new-generation intelligent computing system by biologically simulating human vision system and developing brain-like computation models. In particular, we focus on the following topics:

  • Neural inversion computing
  • Deep learning for video analysis
  • Biologically simulating for human vision system

1.1 Neural inversion computing


  • Building deep neural networks to reveal sensing and processing mechanisms of thehuman visual system (e.g., encoding)
  • Proposing brain-inspired novel visual sensing models and efficient spiking neural network models

Related Papers:

  1. Zhaofei Yu, Jian K. Liu*, Shanshan Jia, Yichen Zhang, Yajing Zheng, Yonghong Tian, Tiejun Huang, Towards the Next Generation of Retinal Neuroprosthesis: Visual Computation with Spikes, Engineering, Volume 6, Issue 4, April 2020, 449-461.
  2. Yichen Zhang, Shanshan Jia, Yajing Zheng, Zhaofei Yu*, Yonghong Tian, Siwei Ma, Tiejun Huang, Jian K. Liu*, Reconstruction of Natural Visual Scenes from Neural Spikes with Deep Neural Networks, Neural Networks, Volume 125, May 2020, Pages 19-30.
  3. Qi Yan, Yajing Zheng, Shanshan Jia, Yichen Zhang, Zhaofei Yu*, Feng Chen, Yonghong Tian, Tiejun Huang, Jian K. Liu*, Revealing Fine Structures of the Retinal Receptive Field by Deep Learning Network, IEEE Transactions on Cybernetics. 10.1109/TCYB.2020.2972983
  4. Yajing Zheng, Shanshan Jia, Zhaofei Yu*, Tiejun Huang, Jian K. Liu, Yonghong Tian*, Probabilistic Inference of Binary Markov Random Fields in Spiking Neural Networks through Mean-field Approximation, Neural Networks, Volume 126, June 2020, Pages 42-51.

1.2 Deep learning for video analysis

Related Papers:

  1. Zhengying Chen, Yonghong Tian*, Wei Zeng and Tiejun Huang, Detecting Abnormal Behaviors in Surveillance Videos Based on Fuzzy Clustering and Multiple Auto-EncodersProc. Int’l Conf. Multimedia and Expo (ICME 2015), Torino, Italy.
  2. Yemin Shi, Wei Zeng, Tiejun Huang, Yaowei Wang∗, Learning Deep Trajectory Descriptor for Action Recognition in Videos using Deep Neural NetworksProc. Int’l Conf. Multimedia and Expo (ICME 2015), Torino, Italy.
  3. Jilong Zheng, Yaowei Wang, Wei Zeng, and Yonghong Tian, CNN Based Vehicle Counting with Virtual Coil in Traffic Surveillance VideoProc. IEEE Int’l Conf. Multimedia Big Data (BigMM 2015), Apr 2015, Beijing, China, 280-281.

1.3 Biological simulating for human vision system

  • Modeling the neurons and circuits in the retina and primary visual cortex of primate (Macaque monkey), via detecting the response/output of the retinal ganglion cells and neurons in the shallow layers of V1 to the visual stimulus pattern;
  • Developing software emulating primate retina, LGN and V1, to implement its coding functionality as accurate as possible.

spikingcoding

2. Multimedia Big Data

To address the technological challenges introduced by multimedia big data, including compression, storage, transmission, analysis, recognition, and security. In particular, we focus on the following topics:

  • Background-based Surveillance Video Coding/Transcoding
  • Machine learning for multimedia content analysis
  • Multi-camera cooperated surveillance video analysis
  • Large-scale content-based copy detection
  • Social multimedia computing

2.1. Ultra-Efficient Surveillance Video Coding/Transcoding

With the exponentially increasing deployments of the high-definition surveillance cameras, one major challenge for a real-time video surveillance system is how to effectively reduce the bandwidth and storage costs. To address this problem this study is devoted to develop a high-efficiency and low-complexity video codec suitable for surveillance videos.

background-based-coding

Related Papers:

  1. Xianguo Zhang, Yonghong Tian*, Tiejun Huang, Siwei Dong, Wen Gao, Optimizing the Hierarchical Prediction and Coding in HEVC for Surveillance and Conference Videos with Background Modeling, IEEE Transactions on Image Processing, 23(10), Oct. 2014. 4511-4526. DOI: 1109/TIP.2014.2352036
  2. Xianguo Zhang, Tiejun Huang*, Yonghong Tian*, Wen Gao, Background-Modeling Based Adaptive Prediction for Surveillance Video Coding, IEEE Transactions on Image Processing, 23(2), Feb 2014, 769-784. DOI: 1109/TIP.2013.2294549.
  3. Wen Gao, Yonghong Tian*, Tiejun Huang, Siwei Ma, Xianguo Zhang, IEEE 1857 Standard Empowering Smart Video Surveillance Systems, IEEE Intelligent Systems, 29(5), Sep.-Oct. 2014, 30-39. DOI: 1109/MIS.2013.101.
  4. Tiejun Huang, Siwei Dong, Yonghong Tian*, Representing Visual Objects in HEVC Coding Loop, IEEE Journal on Emerging and Selected Topics in Circuits and Systems, Volume 4, Issue 1, March 2014, 5-16. DOI: 10.1109/JETCAS.2014.2298274.
  5. Xianguo Zhang, Tiejun Huang*, Yonghong Tian*, Mingchao Geng, Siwei Ma, Wen Gao, Fast and Efficient Transcoding Based on Low-complexity Background Modeling and Adaptive Block Classification, IEEE Transactions on Multimedia, 15(8), Dec 2013, 1769-1785.
  6. Tiejun Huang, Yonghong Tian*, Wen Gao, IEEE 1857: Boosting Video Applications in CPSS, IEEE Intelligent Systems, 28(5), 24-27, Sept.-Oct. 2013.
  7. Long Zhao, Yonghong Tian*, Tiejun Huang, Background-Foreground Division based Search for Motion Estimation in Surveillance Video Coding, Proc. 2014 IEEE Int’l Conf. Multimedia and Expo, Chengdu, China, 2014.
  8. Peiyin Xing, Yonghong Tian*, Tiejun Huang, Wen Gao, Surveillance Video Coding with Quadtree Partition Based ROI Extraction, Proc. 30th Picture Coding Symposium, Dec 8-11, 2013, San Jose, California, 1-4.
  9. Peiyin Xing, Yonghong Tian*, Xianguo Zhang, Yaowei Wang, Tiejun Huang, A Coding Unit Classification Based AVC-to-HEVC Transcoding with Background Modeling for Surveillance Videos, Proc. 2013 IEEE Int’l Conf. Visual Communication and Image Processing, Kuching, Malaysia, Nov 2013.
  10. Xianguo Zhang, Tiejun Huang, Yonghong Tian, Wen Gao, Overview of the IEEE 1857 Surveillance Groups, Proc. 2013 IEEE Int’l Conf. Image Processing, Melbourne, Australia, 2013, 1505-1509.
  11. Xianguo Zhang, Tiejun Huang, Yonghong Tian, Wen Gao, Hierarchical-and-Adaptive Bit-allocation with Selective Background Prediction for High Efficiency Video Coding (HEVC), Proc. 2013 Data Compression Conference, 535.
  12. Shumin Han, Xianguo Zhang, Yonghong Tian, Tiejun Huang, An Efficient Background Reconstruction Based Coding Method for Surveillance Videos Captured By Moving Camera, Proc. 2012 IEEE Ninth Int’l Conf. Advanced Video and Signal-Based Surveillance, Beijing, China, Sep 18 2012, 160-165.(EI20124515644282)
  13. Mingchao Geng, Xianguo Zhang, Yonghong Tian*, Luhong Liang, Tiejun Huang, A Fast and Performance-Maintained Transcoding Method Based on Background Modeling for Surveillance Video, Proc. 2012 IEEE Int’l Conf. Multimedia and Expo, pp. 61-67, Melbourne, Australia, Jul 2012.(EI20124515636441)

2.2 Machine learning for multimedia content analysis

Machine learning models and algorithms are widely recognized as “the engine” in most pattern recognition and multimedia content analysis technologies. This research mainly focuses on the typical learning problems in multimedia content analysis, investigates the common statistical machine learning models and methods, consequently providing a theoretical foundation for multimedia intelligent analysis and retrieval.

machine_learning

Related Papers:

  1. Jingjing Yang, Yonghong Tian*, Lingyu Duan, Tiejun Huang, Wen Gao. Group-Sensitive Multiple Kernel Learning for Object Recognition, IEEE Transactions on Image Processing, 21(5), May 2012, 2838-2852.
  2. Yuanning Li, Yonghong Tian*, Lingyu Duan, Jingjing Yang, Tiejun Huang, Wen Gao. Sequence Multi-Labeling: A Unified Video Annotation Scheme with Spatial and Temporal Context. IEEE Transactions on Multimedia, 12(8), Dec. 2010, 814-828.
  3. Jingjing Yang, Yuanning Li, Yonghong Tian*, Lingyu Duan, Wen Gao. Per-Sample Multiple Kernel Approach for Visual Concept Learning. EURASIP Journal on Image and Video Processing, Vol 2010, Article ID 461450, 13 pages.
  4. Yonghong Tian, Qiang Yang, Tiejun Huang, Charles X. Ling and Wen Gao, Learning contextual dependency network models for link-based classification. IEEE Transactions on Knowledge and Data Engineering, 18(11), Nov 2006, 1482-1496.
  5. Yonghong Tian, Tiejun Huang, Wen Gao. Latent Linkage Semantic Kernels for Collective Classification of Link Data. Journal of Intelligent Information Systems, 26(3), May 2006, 269-301.
  6. Yonghong Tian. Context-Based Statistical Relational Learning. AI Communications, 19(3), Sep. 2006, 291-293.
  7. Jingjing Yang, Yuanning Li, Yonghong Tian, Ningyu Duan, Wen Gao. Group-Sensitive Multiple Kernel Learning for Object Categorization. Proc. 12th IEEE Int’l Conf. Computer Vision, Kyoto, Japan, 2009, 436 – 443. (EI20102312998138)
  8. Jingjing Yang, Yuanning Li, Yonghong Tian, Ningyu Duan, Wen Gao. Multiple Kernel Active Learning for Image Classification. Proc. IEEE Int’l Conf. Multimedia and Expo, Hilton Cancun, Cancun, Mexico, 2009, 550-553.(EI20094712492019)
  9. Jingjing Yang, Yuanning Li, Yonghong Tian, Lingyu Duan, Wen Gao. A New Multiple Kernel Approach for Visual Concept Learning, Proc. 15th Int’l Multimedia Modeling Conf., MMM 2009, LNCS 5371, Sophia-Antipolis, France, 2009, 250-262.(EI20090611898947)

2.3 Multi-camera cooperated surveillance video analysis

Video surveillance systems have become one of most important infrastructures for social security and emergency management applications. This study puts its main focus on the challenging research issues and key technologies about multi-camera cooperated object detection, tracking, and event analysis on large-scale surveillance video data. Its long-term objective is to provide key technologies and solutions for the next-generation intelligent video surveillance systems and applications.

multi_camera

Related Papers:

  1. Peixi Peng, Yonghong Tian*, Yaowei Wang, Jia Li, Tiejun Huang, Robust Multiple Cameras Pedestrian Detection with Multi-view Bayesian Network, Pattern Recognition, Accepted, 9 Dec 2014.
  2. Yonghong Tian, Yaowei Wang, Zhipeng Hu, Tiejun Huang, Selective Eigenbackground for Background Modeling and Subtraction in Crowded Scenes, IEEE Transactions on Circuits and Systems for Video Technology. 23(11), 2013, 1849-1864.
  3. Teng Xu, Tiejun Huang,Yonghong Tian, Survey on Pedestrian Detection Technology for On-board Vision Systems, Journal of Image and Graphics, 18(4), 2013, 359-367. [In Chinese]
  4. Lan Wei, Yonghong Tian*, Yaowei Wang, Tiejun Huang, Swiss-System based Cascade Ranking for Gait-based Person Re-identification, Proc. AAAI 2015, Jan 26, 2015.
  5. Lan Wei, Yonghong Tian*, Yaowei Wang, Tiejun Huang, Multi-view Gait Recognition with Incomplete Training Data, Proc. 2014 IEEE Int’l Conf. Multimedia and Expo, Chengdu, China, 2014.
  6. Jiaqiu Chen, Yaowei Wang, Yonghong Tian, Tiejun Huang, Wavelet Based Smoke Detection Method with RGB Constrast-Image and Shape Constraint, Proc. 2013 IEEE Int’l Conf. Visual Communication and Image Processing, Kuching, Malaysia, Nov 2013.
  7. Chaoran Gu, Luantian Mou, Yonghong Tian*, Tiejun Huang, MPLBoost-based Mixture Model for Effective Human Detection with Deformable Part Model, Proc. 2013 IEEE Int’l Conf. Multimedia and Expo, San Jose, CA, USA, 2013, 1-6.
  8. Xiaoyu Fang, Yonghong Tian*, Yaowei Wang, Chi Su, Teng Xu, Ziwei Xia, Peixi Peng, Wen Gao, Pair-wise Event Detection using Cubic Features and Sequence Discriminant Learning, Proc. 2013 IEEE Int’l Conf. Multimedia and Expo, San Jose, CA, USA, 2013, 1-6.
  9. Xiaoyu Fang, Ziwei Xia, Chi Su, Teng Xu, Yonghong Tian*, Yaowei Wang, Tiejun Huang, A System based on Sequence Learning for Event Detection in Surveillance Video, Proc. 2013 IEEE Int’l Conf. Image Processing, Melbourne, Australia, 2013, 3587-3591.
  10. Peixi Peng, Yonghong Tian*, Yaowei Wang, Tiejun Huang, Multi-camera Pedestrian Detection with a Multi-view Bayesian Network Model, Proc. 2012 British Machine Vision Conf., paper 69, pp. 1-12, Guildford, UK, 2012.
  11. Teng Xu, Peixi Peng, Xiaoyu Fang, Chi Su, Yaowei Wang*, Yonghong Tian*, Wei Zeng, Tiejun Huang, Single and Multiple View Detection, Tracking and Video Analysis in Crowded Environments, Proc. 2012 IEEE Ninth Int’l Conf. Advanced Video and Signal-Based Surveillance, pp. 494-499, Beijing, China, Sep 2012.(EI20124515644337)

2.4 Large-scale content-based copy detection

The Internet is revolutionizing multimedia content distribution, offering users unprecedented opportunities to share digital images, audio, and video but also presenting major challenges for digital rights management (DRM) challenges. Base on the audio-visual perception theory and mechanism, this study is trying to investigate the theory and methodologies of robust mediaprinting technology which can be used to efficiently identify media objects with same or similar content. It is deemed that this technology will play an important role in the new-generation multimedia security systems.

mediaprinting (From: T.J. Huang, Y.H. Tian, W. Gao, J. Lu, Mediaprinting: identifying multimedia content for digital rights management, Computer, 43(12), 2010, 28-35.)

Related Papers:

  1. Yonghong Tian, Mengren Qian, Tiejun Huang, TASC: A Transformation-Aware Soft Cascading Approach for Multimodal Video Copy Detection, ACM Transactions on Information Systems, Accepted, 21 Oct 2014.
  2. Luntian Mou, Tiejun Huang, Yonghong Tian, Menglin Jiang, Wen Gao, Content-Based Copy Detection through Multimodal Feature Representation and Temporal Pyramid Matching, ACM Trans. Multimedia Comput. Commun. Appl., 10(1), Article 5 (December 2013), 20
  3. Yonghong Tian, Tiejun Huang, Menglin Jiang, and Wen Gao, Video Copy Detection and Localization with a Scalable Cascading Framework, IEEE Multimedia, 20(3), Sep. 2013, 72-86.
  4. Yonghong Tian, Tiejun Huang, Wen Gao, Multimodal Video Copy Detection using Multi-Detectors Fusion, IEEE COMSOC MMTC E-Letter, 7(5), September 2012, 3-6.
  5. Tiejun Huang, Yonghong Tian*, Wen Gao, Jian Lu. Mediaprinting: Identifying Multimedia Content for Digital Rights Management. Computer, 43(12), Dec. 2010, 28-35.
  6. Mengren Qian, Luntian Mou, Jia Li, and Yonghong Tian*. Video Picture-in-Picture Detection using Spatio-Temporal Slicing. Proc. ICME’2014 Workshop on Emerg. Multimedia Sys. and Appl., Chengdu, China, 2014.
  7. Menglin Jiang, Yonghong Tian*, Tiejun Huang, Video Copy Detection Using a Soft Cascade of Multimodal Features, Proc. 2012 IEEE Int’l Conf. Multimedia and Expo, Melbourne, Australia, 374-379, 2012.(EI20124515636492)
  8. Luntian Mou, Xilin Chen, Yonghong Tian, Tiejun Huang. Robust and Disrimnative Image Authentication Based on Standard Model Feature, Proc. 2012 IEEE Int’l Symposium on Circuit & System, Seoul, Korea, 1131-1134, 2012.
  9. Yonghong Tian, Menglin Jiang, Luntian Mou, Xiaoyu Fang, Tiejun Huang. A Multimodal Video Copy Detection Approach with Sequential Pyramid Matching, Proc. IEEE Int’l Conf. Image Processing (ICIP 2011), Brussels, Belgium, Sep. 2011, 3690-3693. (EI20120514730536)

2.5 Social multimedia computing

Social multimedia and interactive video are becoming two of the most attractive technologies in new media applications. This research focuses on the fundamental theory, models, and methodologies in various social multimedia applications.

Social_multimedia_computing

Related Papers:

  1. Yonghong Tian, Jaideep Srivastava, Tiejun Huang, and Noshir Contractor. Social Multimedia Computing. Computer, 43(8), Aug. 2010, 27-36. (WOS:000280949000008)(Cover Feature)
  2. Wen Gao, Yonghong Tian*, Tiejun Huang, Qiang. Vlogging: A Survey of Video Blogging Technology on the Web. ACM Computing Surveys, 42(4), Jun. 2010, article 15, 57 pages.
  3. Yonghong Tian, Shui Yu, Chin-Yung Lin, Wen Gao, Wanlei Zhou, Special Issue on Social Multimedia Computing: Challenges, Techniques, and Applications: Guest Editorial, Journal of Multimedia, 9(1), 2014, 1-3.
  4. Shui Yu, Yonghong Tian*, Song Guo, Dapeng Oliver Wu, Can We Beat DDoS Attacks in Clouds? IEEE Transactions on Parallel and Distributed Systems, 25(9), Sep. 2013, 2245-2254. DOI: 10.1109/TPDS.2013.181.
  5. Zhongfei Zhang, Zhengyou Zhang, Ramesh Jain, Yueting Zhuang, Noshir CONTRACTOR, Alexander G. HAUPTMANN, Alejandro (Alex) JAIMES, Wanqing LI, Alexander C. LOUI, Tao MEI, Nicu SEBE, Yonghong Tian, Vincent S. TSENG, Qing WANG, Changsheng XU, Huimin YU, Shiwen YU, Societally connected multimedia across cultures, Journal of Zhejiang University SCIENCE C, 13(12), 2012, 875-880.(WOS:000312185500001)
  6. Amogh Mahapatra, Xin Wan, Yonghong Tian, and Jaideep Srivastava. Augmenting Image Processing with Social Tag Mining for Landmark Recognition. Proc. 17th Int’l Multimedia Modeling Conf., MMM 2011, Jan 5-6, 2011, Taiwan, China, 273-283.(EI20110413622029)

Research Overview

The multimedia learning group at the NELVT lab is dedicated to new theories, cutting-edge algorithms and core technologies for multimedia content analysis, coding and protection in a wide spectrum of next-generation multimedia applications. These technologies are expected to play a crucial role in the further development of digital media industry.

Featured Direction: Multimedia Big Data

Multimedia is increasingly becoming the “biggest big data” as the most important and valuable source for insights and information. It covers from everyone’s experiences to everything happening in the world. There will be lots of multimedia big data — surveillance video, entertainment and social media, medical images, consumer images, voice and video, to name a few, only if their volumes grow to the extent that the traditional multimedia processing and analysis systems cannot handle effectively. As such, multimedia big data will emerge as the next “must have” competency in our society, and is spurring on tremendous amounts of research and development of related technologies and applications.

Multimedia big data introduces many technological challenges, including compression, storage, transmission, analysis, recognition, and security. Among them, two major grand challenges are how to extra-efficiently compress the huge amount of data so as to facilitate transmission and storage, and how to intelligently analyze, mine and understand the multimedia information inside from such a huge amount of big data. Take surveillance video as an example. According to a recent report by IDC, by 2020, as much as 5,800 Exabytes of surveillance videos will be saved, transmitted and analyzed, averagely doubling the data volume every two years. However, traditionally, the average compression rate in the field of video coding increases ~2x every decade. This will lead to a huge gap between the two rates in future several years, consequently presenting an unprecedented challenge for ultra-high efficiency and low-complexity video coding technology. More importantly, only a small percentage of the data would be useful and valuable if they were tagged and analyzed. Yet, technology is far from where it needs to be, and in practice, only 3 percent of potentially useful data is tagged — and even less is currently being analyzed. In this sense, the huge amount of surveillance videos generated by thousands of cameras may become the data tsunami.

As an active and inter-disciplinary research field, multimedia big data also presents a great opportunity for multimedia computing in the big data era. The challenges and opportunities highlighted in this field will foster some interesting future developments in the multimedia research and applications.
——————————–

Reading Materials:

1. Surveillance Video: The Biggest Big Data

2. Video Big Data: Challenges and Opportunities [in Chinese]