"Keep Calm and Don't Overfit."
NEW (12/2020): I will be serving as a Senior Program Committee (SPC) member in IJCAI 2021.
NEW (12/2020): One paper accepted to AAAI 2021.
NEW (09/2020): Our neural rendering paper was accepted by TPAMI. A great pleasure working with NetEase Fuxi Lab, congratulations!
NEW (07/2020): One paper accepted to ACM MM 2020.
NEW (02/2020): One paper accepted to CVPR 2020.
Zhengxia Zou, Zhenwei Shi, Yuhong Guo, and Jieping Ye. Object Detection in 20 Years: A Survey. CoRR, abs/1905.05055, 2019. [PDF]This paper extensively reviews 400+ papers of object detection in the light of its technical evolution, spanning over a quarter-century’s time (from the 1990s to 2019). A number of topics are covered in this paper, including milestone detectors in history, detection datasets, metrics, fundamental building blocks of detection systems, speed up techniques, and the recent state of the art detection methods. - High-impact Citations: Stanford CS231n: Convolutional Neural Networks for Visual Recognition 2019, 2020 | GeorgiaTech-GT8803: Data analytics using deep learning 2019 (Fall) - Media Coverage: 密歇根大学40页最新论文带你全面了解目标检测 | 专栏连载: 二十年的目标检测大综述 | 专栏文章: 2019-2020年必看的十篇「深度学习领域综述」论文 大盘点: 2019年4篇目标检测算法最佳综述
Tianyang Shi*, Zhengxia Zou* (*equal
contribution), Zhenwei Shi, and Yi Yuan.
Neural Rendering for Game Character Auto-creation. IEEE
Transactions on Pattern Analysis and Machine Intelligence,
2020, in press. [PDF]
- Media Coverage: 只需一张自拍，网易伏羲用这种方法直接生成「个人专属」游戏角色 | See Your Own Face in 3D Video Games with a Selfie | This AI finally lets you play as yourself in a video game | NetEase developing AI to turn selfies into 3D game avatars | Chinese Gaming Giant NetEase Leverages AI to Create 3D Game Characters from Selfies | AI Researchers Create 3D Video Game Face Models From User Photos | NetEase Developing AI to Turn Selfies into 3D Game Avatars | (In Spanish) Una AI convierte tu selfie en un personaje de videojuego | How 3D faces can be developed for video games
Zhengxia Zou, Tianyang Shi, Shuang Qiu, Yi Yuan, and Zhenwei Shi. Stylized Neural Painting. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021, Oral Presentation. [PDF] [1min-DemoVideo] [Project] [Github] [Google Colab] | Featured in Remini, an AI photo enhancer with over 50M users worldwide. ( Google Play | IOS App Store )
- Media Coverage: 美术生都要膜拜的AI，照片迅速被画成艺术画 | Automatic Image-to-Painting Translation Method Generates Vivid Paintings in Controllable Styles | An Image-To-Painting Translation Method That Generates Painting Artworks With Controllable Styles - Reddit and YouTube Channels: This AI can "DRAW" Oil-Paintings, Pixel Art, and Illustrations (by @bycloud) | Image-to-Painting Translation With Style Transfe (by @What's AI) | This Image-to-Painting Translation method simulates a real painter on multiple styles using a novel approach!
- Media Coverage: 建造自己的“天空之城”，密歇根大学博士后的这项研究可以虚空造物、偷天换日 | This open-source AI tool can make your video spectacular with sky replacement effects | The Top 10 Trending Machine Learning Projects of 2020 | Skyar, para cambiar el cielo de cualquier video usando Inteligencia Artificial | Этот ИИ-инструмент умеет заменять небо в роликах как в фантастических фильмах - Reddit and YouTube Channels: AI-Based Sky Replacement Is Here! 🌓 (by @Two Minute Papers) | AI Sky Replacement with SkyAR (by @bycloud) | Better than AE or even PS sky replacement | SkyAR X MineCraft - Creative Applications: Streamlit-SkyAR (online interactive app by Travis Hoppe) | The Sky Is In Our Grasp! (Wandb.ai demo by Ayush Thakur) | #SkyAR The Lion King; #SkyAR X Kelly Lacy from Pexels; #SkyAR X Studio Ghibli | Sky Replacement In Video With Python And AI, Epic! (by @Siarhei Palishchuk)
- Media Coverage: 在游戏里还原自己的脸，给AI一张照片就行，网易&密歇根大学出品 | MeInGame: A deep learning method to create videogame characters that look like real people | MeInGame: нейросеть генерирует игрового персонажа по изображению лица | MeInGame: Create a Game Character Face from a Single Portrait
Yinglin Duan*, Tianyang Shi*, Zhengxia Zou* (*Equal contribution), Yenan Lin, Zhehui Qian, Bohan Zhang, and Yi Yuan. Single-Shot Motion Completion with Transformer. CoRR, abs/2103.00776, 2021. [PDF]
Yinglin Duan*, Tianyang Shi* (*Equal contribution), Zhengxia Zou, Jia Qin, Yifei Zhao, Yi Yuan, Jie Hou, Xiang Wen, and Changjie Fan. Semi-Supervised Learning for In-Game Expert-Level Music-to-Dance Translation. CoRR, abs/2009.12763, 2020. [PDF]
Tianyang Shi, Zhengxia Zou, Yi Yuan, and Changjie Fan. Fast and Robust Face-to-Parameter Translation for Game Character Auto-creation. AAAI Conference on Artificial Intelligence (AAAI) 2020. [PDF]
Wenyuan Li, Zhengxia Zou, and Zhenwei Shi. Deep Matting for Cloud Detection in Remote Sensing Images. IEEE Transactions on Geoscience and Remote Sensing, in press, 2020. [PDF]
Zhengxia Zou*, Tianyang Shi* (*equal contribution), Wenyuan Li, Zhou Zhang, and Zhenwei Shi. Do Game Data Generalize Well for Remote Sensing Image Segmentation? Remote Sensing, in press, 2020. [PDF]
[GTA-V-SID] - A synthetic remote sensing image dataset from the video game GTA-V for semantic segmentation.
Sen Lei, Zhenwei Shi, and Zhengxia Zou. Coupled Adversarial Training for Remote Sensing Image Super-resolution. IEEE Transactions on Geoscience and Remote Sensing. 58(5), May 2020, pp. 3633 - 3643. [PDF]
Tianyang Shi, Yi Yuan, Changjie Fan, Zhengxia Zou, Zhenwei Shi, and Yong Liu. Face-to-Parameter Translation for Game Character Auto-Creation. IEEE International Conference on Computer Vision (ICCV) 2019. [PDF]
Numerical optimization is one of the core math foundations in image processing and machine learning. But I remember in the beginning of my Ph.D. years, the math behind always made me frustrated 🙁🙁.
During the winter vacation of 2016, I decided to make a change. I revisited some well-known optimization methods (e.g., Gradient Descent, Newton/Quasi-Newton Method, ALM, etc.), and made a series of GIF visualizations to show how these algorithms behave dynamically. Check out this blog for more details and I hope it will help you better understand these algorithms.