Xiaoyong Shen   AI Team Manager at Tencent 10/F, Malata Building, Kejizhongyi Road, Nanshan District, Shenzhen 518075, P.R. China Email:

Biography [CV]

I got my Ph.D. degree in Computer Science and Engineering Department in the Chinese University of Hong Kong in 2016. My supervisor is Prof. Jiaya Jia. Before that, I received the B. S. degree in Computational Mathematics and M. S. degree in Applied Mathematics from Zhejiang University in 2010 and 2012 respectively, under the supervision of Prof. Ligang Liu.

My research interest includes computer graphics and computer vision.

I am a team manager at Tencent working with Prof. Jiaya Jia. We are recruiting self-motivated interns/full-time researchers in computer vision and machine learning. Please send your CV to me if you are interested to it.

Publications [Google Scholar]

2019

• Fast Point R-CNN,
  Yilun Chen, Shu Liu, Xiaoyong Shen, Jiaya Jia.
  IEEE International Conference on Computer Vision (ICCV), 2019
• STD: Sparse-to-Dense 3D Object Detector for Point Cloud,
  Zetong Yang, Yanan Sun, Shu Liu, Xiaoyong Shen, Jiaya Jia.
  IEEE International Conference on Computer Vision (ICCV), 2019
• Attribute-Driven Spontaneous Motion in Unpaired Image Translation,
  Ruizheng Wu, Xin Tao, Xiaodong Gu, Xiaoyong Shen, Jiaya Jia.
  IEEE International Conference on Computer Vision (ICCV), 2019
• Fast and Practical Neural Architecture Search,
  jiequan Cui, Pengguang Chen, Ruiyu Li, Shu Liu, Xiaoyong Shen, Jiaya Jia.
  IEEE International Conference on Computer Vision (ICCV), 2019
• Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation,
  Li Jiang, Hengshuang Zhao, Shu Liu, Xiaoyong Shen, Chi-Wing Fu, Jiaya Jia.
  IEEE International Conference on Computer Vision (ICCV), 2019
• Reflective Decoding Network for Image Captioning,
  Lei Ke, Wenjie Pei, Ruiyu Li, Xiaoyong Shen, Yu-Wing Tai.
  IEEE International Conference on Computer Vision (ICCV), 2019
• Non-local Recurrent Neural Memory for Supervised Sequence Modeling,
  Canmiao Fu, Wenjie Pei, Qiong Cao, Chaopeng Zhang, Yong Zhao, Xiaoyong Shen, Yu-Wing Tai.
  IEEE International Conference on Computer Vision (ICCV), 2019
• Cross-Domain Adaptation for Animal Pose Estimation,
  Jinkun Cao, Hongyang Tang, Hao-shu Fang, Xiaoyong Shen, Cewu Lu, Yu-wing Tai.
  IEEE International Conference on Computer Vision (ICCV), 2019
• Underexposed Photo Enhancement using Deep Illumination Estimation,
  Ruixing Wang, Qing Zhang, Chi-Wing Fu, Xiaoyong Shen, Wei-shi Zheng, Jiaya Jia.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
• MMFace: A Multi-Metric Regression Network for Unconstrained Face Reconstruction,
  Hongwei Yi, Chen Li, Qiong Cao, Xiaoyong Shen, Sheng Li, Guoping Wang, Yu-Wing Tai.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
• Memory-Attended Recurrent Network for Video Captioning,
  Wenjie Pei, Jiyuan Zhang, Xiangrong Wang, Lei Ke, Xiaoyong Shen, Yu-Wing Tai.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
• Associatively Segmenting Instances and Semantics in Point Clouds,
  Xinlong Wang, Shu Liu, Xiaoyong Shen, Chunhua Shen, Jiaya Jia.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
• Learning Shape-Aware Embedding for Scene Text Detection,
  Zhuotao Tian, Michelle Shu, Pengyuan Lyu, Ruiyu Li, Chao Zhou, Xiaoyong Shen, Jiaya Jia.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
• Amodal Instance Segmentation through KINS Dataset,
  Lu Qi, Li Jiang, Shu Liu, Xiaoyong Shen, Jiaya Jia.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
• Dynamic Scene Deblurring with Parameter Selective Sharing and Nested Skip Connections,
  Hongyun Gao, Xin Tao, Xiaoyong Shen, Jiaya Jia.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
• Wide-Context Semantic Image Extrapolation,
  Yi Wang, Xin Tao, Xiaoyong Shen, Jiaya Jia.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019

2018

• Scribble based 3D Shape Segmentation via Weakly-supervised Learning,
  Zhenyu Shu, Xiaoyong Shen, Shiqing Xin， Qingjun Chang， Jieqing Feng，Ladislav Kavan，Ligang Liu.
  IEEE Transactions on Visualization and Computer Graphics (TVCG), 2018
• Image Inpainting via Generative Multi-column Convolutional Neural Networks,
  Yi Wang, Xin Tao, Xiaojuan Qi, Xiaoyong Shen, Jiaya Jia.
  Neural Information Processing Systems (NIPS), 2018
• Referring Image Segmentation via Recurrent Refinement Networks,
  Ruiyu Li, Kaican Li, Yi-Chun Kuo, Michelle Shu, Xiaojuan Qi, Xiaoyong Shen, Jiaya Jia.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018
• Scale-recurrent Network for Deep Image Deblurring,
  Xin Tao, Hongyun Gao, Xiaoyong Shen, Jue Wang, Jiaya Jia.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018

  [project][arxiv]

• Facelet-Bank for Fast Portrait Manipulation,
  Ying-Cong Chen, Huaijia Lin, Michelle Shu, Ruiyu Li, Xin Tao, Yangang ye, Xiaoyong Shen, Jiaya Jia.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018

  [project]

• ICNet for Real-Time Semantic Segmentation on High-Resolution Images,
  Hengshuang Zhao, Xiaojuan Qi, Xiaoyong Shen, Jianping Shi, Jiaya Jia.
  European Conference on Computer Vision (ECCV), 2018

  [code]

2017

• Makeup-Go: Blind Reversion of Portrait Edit,
  Ying-cong Chen, Xiaoyong Shen, Jiaya Jia.
  IEEE International Conference on Computer Vision (ICCV), 2017
• Unsupervised Learning of Stereo Matching,
  Chao Zhou, Hong Zhang, Xiaoyong Shen, Jiaya Jia.
  IEEE International Conference on Computer Vision (ICCV), 2017
• Zero-order Reverse Filtering,
  Xin Tao, Chao Zhou, Xiaoyong Shen, Jue Wang, Jiaya Jia.
  IEEE International Conference on Computer Vision (ICCV), 2017

  [project]

• High-Quality Correspondence and Segmentation Estimation for Dual-Lens Smart-Phone Portraits,
  Xiaoyong Shen, Hongyun Gao, Xin Tao, Chao Zhou,Jiaya Jia.
  IEEE International Conference on Computer Vision (ICCV), 2017
• Multual-Structure for Joint Image Filtering,
  Xiaoyong Shen, Chao Zhou, Li Xu, Jiaya Jia.
  International Journal of Computer Vision (IJCV), 2017
• Automatic Real-time Background Cut for Portrait Videos,
  Xiaoyong Shen, Ruixing Wang, Hengshuang Zhao, Jiaya Jia.
  ArXiv 2017
• Convolutional Neural Pyramid for Image Processing,
  Xiaoyong Shen, Ying-Cong Chen, Xin Tao, Jiaya Jia.
  ArXiv 2017

2016

• Regional Foremost Matching for Internet Images,
  Xiaoyong Shen, Xin Tao, Chao Zhou, Hongyun Gao, Jiaya Jia.
  ACM Transactions on Graphics, 2016 (Proc. SIGGRAPH ASIA 2016)
• Deep Automatic Portrait Matting,
  Xiaoyong Shen, Xin Tao, Hongyun Gao, Chao Zhou, Jiaya Jia.
  European Conference on Computer Vision (ECCV) , 2016. (Spotlight Presentation)

  [project][Data(zip, 1.15GB)]

• Automatic Portrait Segmentation for Image Stylization,
  Xiaoyong Shen, Aaron Hertzmann, Jiaya Jia, Sylvain Paris, Brian Price, Eli Shechtman, Ian Sachs.
  Computer Graphics Forum, 35(2), 2016 ( Proc. Eureographics 2016).

  [project]

• Multispectral Joint Image Restoration via Optimizing a Scale Map,
  Xiaoyong Shen, Qiong Yan, Li Xu, Lizhuang Ma, Jiaya Jia.
  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), vol. 37, no. 12, 2015

  [project]

2013~2015

• Mutual-Structure for Joint Filtering,
  Xiaoyong Shen, Chao Zhou, Li Xu, Jiaya Jia.
  IEEE International Conference on Computer Vision (ICCV) , 2015. (Oral Presentation)

  [project]

• Deep LAC: Deep Localization, Alignment and Classification for Fine-grained Recognition,
  Di Lin, Xiaoyong Shen, Cewu Lu, Jiaya Jia.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015
• Multi-modal and Multi-spectral Registration for Natural Images,
  Xiaoyong Shen, Li Xu, Qi Zhang, Jiaya Jia.
  European Conference on Computer Vision (ECCV), 2014

  [project]

• Rolling Guidance Filter,
  Qi Zhang, Xiaoyong Shen, Li Xu, Jiaya Jia.
  European Conference on Computer Vision (ECCV), 2014

  [project]

• Cross-Field Joint Image Restoration via Scale Map,
  Qiong Yan, Xiaoyong Shen, Li Xu, Shaojie Zhuo, Xiaopeng Zhang, Liang Shen, Jiaya Jia.
  IEEE International Conference on Computer Vision (ICCV), 2013

  [project]

• Mesh Saliency with Global Rarity,
  Jinliang Wu, Xiaoyong Shen, Wei Zhu, Ligang Liu.
  Graphical Models, 75(5): 255-264, 2013
• Interactive Two-Scale Color-to-Gray,
  Jinliang Wu, Xiaoyong Shen, Ligang Liu.
  The Visual Computer (Proc. Computer Graphics International), 2013

Research Experience

Research Intern,   06. 2015 - 09. 2015

    Adobe Research

    Advisor: Ian Sachs, Aaron Hertzmann, Sylvain Paris, Eli Schechtman and Brian Price

Research Assistant,   08. 2012 - 07. 2013

    The Chinese University of Hong Kong

    Advisor: Jiaya Jia

Honors & Awards

Outstanding Graduate Awards of Zhejiang University, 2012

Excellent Bachelor Thesis in Zhejiang University, 2010

Outstanding Graduate Awards of Zhejiang University, 2010

National Scholarship, 2009

The First Prize of Research and Renovation of ZJU, 2008

National Scholarship of Encouragement, 2008

Excellent Student Scholarship in Zhejiang University, 2007-2010

The Title of Excellent All-round Student in Zhejiang University , 2007-2010

Outstanding Student Cadres in Zhejiang University, 2008

Professional Activities

Conference Reviews: Eurographics 2014,  ECCV 2016,  Pacific Graphics 2016

Journal Reviews: TPAMI,  IJCV,  TVCG,  TIP,  TCSVT,  TVC,  CAD,  TMM

Presentations: ICCV 2013,  ECCV 2014,   ICCV 2015,   Eurographics 2016

Miscellanies

Research Papers

  Computer Graphics Papers,  Computer Vision Papers

Some of My Friends

  Li Xu,  Cewu Lu,  Qiong Yan,  Jianping Shi,  Xiaoguang Han,  Ruizhen Hu,  Renjie Liao,  Ziyang Ma,  Xin Tao