"Keep Calm and Don't Overfit."
NEW (08/2021): One paper accepted to ICCV 2021, oral presentation. ( [Preprint] )
NEW (06/2021): Stylized Neural Painting was launched as a new feature in two AI photo editors (REMINI Google Play | IOS App Store and 你我当年 XIAOMI App Sstore | IOS App Store), with over 50M users worldwide.
NEW (04/2021): One paper accepted to IJCAI 2021.
NEW (12/2020): I will be serving as a Senior Program Committee (SPC) member in IJCAI 2021.
NEW (12/2020): One paper accepted to AAAI 2021.
NEW (09/2020): Our neural rendering paper was accepted by TPAMI. A great pleasure working with NetEase Fuxi Lab, congratulations!
NEW (07/2020): One paper accepted to ACM MM 2020.
NEW (02/2020): One paper accepted to CVPR 2020.
Zhengxia Zou, Zhenwei Shi, Yuhong Guo, and Jieping Ye. Object Detection in 20 Years: A Survey. CoRR, abs/1905.05055, 2019. [PDF]This paper extensively reviews 400+ papers of object detection in the light of its technical evolution, spanning over a quarter-century’s time (from the 1990s to 2019). A number of topics are covered in this paper, including milestone detectors in history, detection datasets, metrics, fundamental building blocks of detection systems, speed up techniques, and the recent state of the art detection methods. - High-impact Citations: CS231n: Convolutional Neural Networks for Visual Recognition 2019-2021 (instructed by Prof. Fei-Fei Li) - Media Coverage: 密歇根大学40页最新论文带你全面了解目标检测 - In Other Languages: English-to-Chinese (1) | English-to-Chinese (2)
Tianyang Shi*, Zhengxia Zou* (*equal
contribution), Zhenwei Shi, and Yi Yuan.
Neural Rendering for Game Character Auto-creation. IEEE
Transactions on Pattern Analysis and Machine
Intelligence, 2020, in press. [PDF]
- Featured Applications: 逆水寒 (Justice) and 天谕手游 (Heaven Mobile), massively multiplayer online role-playing game (MMO-RPG) with 30M+ players worldwide
- Media Coverage: 只需一张自拍，网易伏羲用这种方法直接生成「个人专属」游戏角色 | See Your Own Face in 3D Video Games with a Selfie | NetEase developing AI to turn selfies into 3D game avatars | Chinese Gaming Giant NetEase Leverages AI to Create 3D Game Characters from Selfies | NetEase Developing AI to Turn Selfies into 3D Game Avatars | (In Spanish) Una AI convierte tu selfie en un personaje de videojuego | How 3D faces can be developed for video games
Zhengxia Zou, Tianyang Shi, Shuang Qiu, Yi Yuan, and Zhenwei Shi. Stylized Neural Painting. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021, Oral Presentation. [PDF] [1min-DemoVideo] [Project] [Github] [Google Colab]
- Featured Applications: REMINI, an AI photo enhancer with 50M+ users worldwide | 你我当年, an AI photo editor ranked No. 16 ("photos") in XiaoMI AppStore | RunwayML, a web-based next generation video editing software
- Media Coverage: 有 了这支矢量神经风格画笔，无需GAN也可生成精美绘画 | 美术生都要膜拜的AI，照片迅速被画成艺术画 | Automatic Image-to-Painting Translation Method Generates Vivid Paintings in Controllable Styles | An Image-To-Painting Translation Method That Generates Painting Artworks With Controllable Styles - Social Media Channels: This AI can "DRAW" Oil-Paintings, Pixel Art, and Illustrations | Image-to-Painting Translation With Style Transfer | #Homeless; #The Great Wave off Kanagawa; #Stylized Neural Painting X Schmidhuber
- Media Coverage: 建造自己的“天空之城”，密歇根大学博士后的这项研究可以虚空造物、偷天换日 | This open-source AI tool can make your video spectacular with sky replacement effects | The Top 10 Trending ML Projects of 2020 - Social Media Channels: AI-Based Sky Replacement Is Here! 🌓 (by @Two Minute Papers) | AI Sky Replacement with SkyAR (by @bycloud) | SkyAR X MineCraft | #SkyAR The Lion King; #SkyAR X Kelly Lacy from Pexels; #SkyAR X Studio Ghibli | Streamlit-SkyAR, an online interactive demo by Travis Hoppe
- Media Coverage: 中 外团队联合研发深度学习方法MeInGame，用单张照片即可自动生成定制化游戏角色 | MeInGame: A deep learning method to create videogame characters that look like real people | 在游戏里还原自己的脸，给AI一张照片就行，网易&密歇根大学出品 | MeInGame: нейросеть генерирует игрового персонажа по изображению лица | A deep learning method to create videogame characters that look like real people | MeInGame: Create a Game Character Face from a Single Portrait | Researchers at the University of Michigan and Netease Fuxi AI Lab Introduce ‘MeInGame’: A Deep Learning Technique To Automatically Create a Game Character Face from a Single Portrait | 자신과 빼닮은 캐릭터로 게임할 수 있다…AI로 진화하는 게임산업
Yinglin Duan*, Tianyang Shi*, Zhengxia Zou* (*Equal contribution), Yenan Lin, Zhehui Qian, Bohan Zhang, and Yi Yuan. Single-Shot Motion Completion with Transformer. CoRR, abs/2103.00776, 2021. [PDF]
Dan Wang, Xinrui Cui, Xun Chen, Zhengxia Zou, Tianyang Shi, Septimiu Salcudean, Z. Jane Wang, and Rabab Ward. Multi-view 3D Reconstruction with Transformer. IEEE International Conference on Computer Vision (ICCV), 2021, Oral Presentation. [PDF]
- Media Coverage: Transformer再下一城！VolT - 用于多视图3D重建的 3D Volume Transformer | 基 于Transformer的多视角三维重建算法参数减量质更优
Yinglin Duan*, Tianyang Shi* (*Equal contribution), Zhipeng Hu, Zhengxia Zou, Changjie Fan, Yi Yuan, and Xi Li. Automatic Translation of Music-to-Dance for In-Game Characters. International Joint Conference on Artificial Intelligence (IJCAI) 2021.
Yi Yuan, Jilin Tang, Zhengxia Zou. VANet: A View Attention Guided Network for 3D Reconstruction from Single and Multi-view Images. IEEE International Conference on Multimedia and Expo (ICME) 2021, Oral Presentation.
Tianyang Shi, Zhengxia Zou, Yi Yuan, and Changjie Fan. Fast and Robust Face-to-Parameter Translation for Game Character Auto-creation. AAAI Conference on Artificial Intelligence (AAAI) 2020. [PDF]
Wenyuan Li, Zhengxia Zou, and Zhenwei Shi. Deep Matting for Cloud Detection in Remote Sensing Images. IEEE Transactions on Geoscience and Remote Sensing, in press, 2020. [PDF]
Zhengxia Zou*, Tianyang Shi* (*equal contribution), Wenyuan Li, Zhou Zhang, and Zhenwei Shi. Do Game Data Generalize Well for Remote Sensing Image Segmentation? Remote Sensing, in press, 2020. [PDF]
[GTA-V-SID] - A synthetic remote sensing image dataset from the video game GTA-V for semantic segmentation.
Sen Lei, Zhenwei Shi, and Zhengxia Zou. Coupled Adversarial Training for Remote Sensing Image Super-resolution. IEEE Transactions on Geoscience and Remote Sensing. 58(5), May 2020, pp. 3633 - 3643. [PDF]
Tianyang Shi, Yi Yuan, Changjie Fan, Zhengxia Zou, Zhenwei Shi, and Yong Liu. Face-to-Parameter Translation for Game Character Auto-Creation. IEEE International Conference on Computer Vision (ICCV) 2019. [PDF]
Numerical optimization is one of the math foundations in image processing and machine learning. For most people, optimization algorithms are not easy to understand. I remember in the beginning of my Ph.D. years, the math behind always made me frustrated 🙁🙁.
During the winter break of 2016, I revisited some well-known optimization algorithms (e.g., Gradient Descent, Newton/Quasi-Newton Method, ALM, etc.), and made some GIF visualizations to see how these algorithms behave dynamically. Check out this blog for more details and I hope it will help you better understand them.