Ph.D. student at MMLab@NTU

Resume

About Me

I am currently a Ph.D. student at MMLab@NTU starting from 2021 Fall, supervised by Prof. Chen Change Loy. Previously, I received my M.Eng. degree (2021) and B.Eng. degree (2018) from MC2 Lab@Beihang University, supervised by Prof. Mai Xu.
I am broadly interested in computer vision and deep learning.
My current research mainly focuses on low-level vision.

Publications

Preprints

  • Efficient Diffusion Model for Image Restoration by Residual Shifting,
    Zongsheng Yue, Jianyi Wang, Chen Change Loy,
    Preprints, 2024.
    GitHub StarsGitHub Forks
    [PDF][Project][Code][Video]

  • [StableSR] Exploiting Diffusion Prior for Real-World Image Super-Resolution,
    Jianyi Wang, Zongsheng Yue, Shangchen Zhou, Kelvin C.K. Chan, Chen Change Loy,
    Preprints, 2023.
    GitHub StarsGitHub Forks
    [PDF][Project][Code][Video]

Conference Papers

(* : Co-first author)

  • Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution,
    Shangchen Zhou*, Peiqing Yang*, Jianyi Wang, Yihang Luo, Chen Change Loy,
    Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024 (Highlight).
    GitHub StarsGitHub Forks
    [PDF][Project][Code][Video]

  • ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shifting,
    Zongsheng Yue, Jianyi Wang, Chen Change Loy,
    Conference on Neural Information Processing Systems (NeurIPS), 2023 (Spotlight).
    [PDF][Project][Code]

  • [CLIP-IQA] Exploring CLIP for Assessing the Look and Feel of Images,
    Jianyi Wang, Kelvin C.K. Chan, Chen Change Loy,
    Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2023.
    [PDF][Code]

  • Smoothnet: A plug-and-play network for refining human poses in videos,
    Ailing Zeng, Lei Yang, Xuan Ju, Jiefeng Li, Jianyi Wang, Qiang Xu,
    European Conference on Computer Vision (ECCV), 2022.
    [PDF][Code]

  • HiNet: Deep Image Hiding by Invertible Network,
    Junpeng Jing, Xin Deng, Mai Xu, Jianyi Wang, Zhenyu Guan,
    Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021.
    [PDF][Code]

  • [MW-GAN] Multi-level wavelet-based generative adversarial network for perceptual quality enhancement of compressed video,
    Jianyi Wang, Xin Deng, Mai Xu, Congyong Chen, Yuhang Song,
    European Conference on Computer Vision (ECCV), 2020.
    [PDF][Code]

  • Arena: A general evaluation platform and building toolkit for multi-agent intelligence,
    Yuhang Song, Andrzej Wojcicki, Thomas Lukasiewicz, Jianyi Wang, Abi Aryan, Zhenghua Xu, Mai Xu, Zihan Ding, Lianlong Wu,
    Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2020.
    [PDF][Code]

  • Mega-reward: Achieving human-level play without extrinsic rewards,
    Yuhang Song, Jianyi Wang, Thomas Lukasiewicz, Zhenghua Xu, Shangtong Zhang, Andrzej Wojcicki, Mai Xu,
    Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2020.
    [PDF][Code]

  • [DEHRL] Diversity-driven extensible hierarchical reinforcement learning,
    Yuhang Song*, Jianyi Wang*, Thomas Lukasiewicz, Zhenghua Xu, Mai Xu,
    Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2019 (Oral).
    [PDF][Code]

Journal Papers

  • MW-GAN+ for Perceptual Quality Enhancement on Compressed Video,
    Jianyi Wang, Mai Xu, Xin Deng, Liquan Shen, Yuhang Song,
    IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2021.
    [PDF][Code]

  • Attention-Based Deep Reinforcement Learning for Virtual Cinematography of 360 Videos,
    Jianyi Wang, Mai Xu, Lai Jiang, Yuhang Song,
    IEEE Transactions on Multimedia (TMM), 2020.
    [PDF]

  • Predicting head movement in panoramic video: A deep reinforcement learning approach,
    Mai Xu, Yuhang Song, Jianyi Wang, MingLang Qiao, Liangyu Huo, Zulin Wang,
    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2018.
    [PDF][Code]

Education Background

Ph.D.
Aug. 2021 - Present | School of Computer Science and Engineering | Nanyang Technological University
Advisor: Prof. Chen Change Loy

M.Eng.
Sep. 2018 - Jan. 2021 | School of Electronics and Information Engineering | Beihang University
Advisor: Prof. Mai Xu

B.Eng.
Sep. 2015 - July 2018 | School of Electronics and Information Engineering | Beihang University
Sep. 2013 - July 2015 | School of Energy and Power Engineering | Beihang University
Advisor: Prof. Mai Xu

Experience

Research Intern
Jun. 2024 - Present | TikTok, Singapore
Working with: Dr. Lu Jiang

Research Intern
Jan. 2021 - Aug. 2021 | SenseTime X Lab, China
Working with: Dr. Lei Yang

Research Intern
Mar. 2020 - Aug. 2020 | Bytedance AI Lab, China
Working with: Mr. Qian He and Mr. Siyu Zhou

Professional Service

Conference Reviewer

  • CVPR2022, 2023, 2024 (Outstanding Reviewer, Top 2%)
  • ICCV2023 (Outstanding Reviewer)
  • AAAI2023, 2024
  • ECCV2022, 2024

Journal Reviewer

  • IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
  • International Journal of Computer Vision (IJCV)
  • IEEE Transactions on Image Processing (TIP)
  • IEEE Transactions on Multimedia (TMM)
  • IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
  • IEEE Transactions on Broadcasting (TBC)
  • IEEE Journal of Selected Topics in Signal Processing (JSTSP)
  • IEEE/CAA Journal of Automatica Sinica (JAS)
  • Neurocomputing

Selected Awards

Teaching

  • NTU CX2006:Software Engineering, Teaching Assistant, Spring 2022 & Fall 2022.