I-Chao Shen
ichaoshen@g.ecc.u-tokyo.ac.jp
I am an assistant professor at Department of Computer Science, the Graduate School of Information Science and Technology, The University of Tokyo.
My research focus on computer graphics, computational graphic design, and machine learning.
C.V. |
Google Scholar |
Email
Publication
|
Approximating Procedural Models of 3D Shapes with Neural Networks Ishtiaque Hossain, I-Chao Shen, Oliver van Kaick Eurographics 2025 (conditionally accept) [project page] [paper] |
|
FontCraft: Multimodal Font Design Using Interactive Bayesian Optimization Yuki Tatsukawa, I-Chao Shen, Mustafa Doga Dogan, Anran Qi, Yuki Koyama, Ariel Shamir, Takeo Igarashi CHI 2025 (conditionally accept) a system allows non-expert users to create new fonts using multi-modal input [project page] [paper] |
|
|
CompAct: Designing Interconnected Compliant Mechanisms with Active Material Integration Humphrey Yang, I-Chao Shen, Nikolas Martelaro, Bo Zhu, Haoran Xie, Takeo Igarashi, Lining Yao CHI 2025 (conditionally accept) [project page] [paper] |
|
FontCLIP: A Semantic Typography Visual-Language Model for Multilingual Font Applications Yuki Tatsukawa, I-Chao Shen, Anran Qi, Yuki Koyama, Takeo Igarashi, Ariel Shamir Eurographics 2024 a visual language model that understand typography and support cross-lingual font retrieval and optimization [project page] [paper] [DOI] [supplemental material] [code] [arxiv] |
|
Learned Inference of Annual Ring Pattern of Solid Wood Maria Larsson*, Takashi Ijiri*, I-Chao Shen, Hironori Yoshida, Ariel Shamir, Takeo Igarashi (*: joint first authors) Computer Graphics Forum 2024 [paper] [DOI] |
|
Virtual Measurement Garment for Per-Garment Virtual Try-On Zaiqiang Wu*, Jingyuan Liu*, Long Hin Toby Chong, I-Chao Shen, Takeo Igarashi (*: joint first authors) Graphics Interface 2024 a novel per-garment virtual try-on method which eliminates the need for the physical measurement garment [project page] [paper] [video] |
|
Improving Cache Placement for Efficient Cache-based Rendering Yu-Ting Wu, I-Chao Shen The Visual Computer 2024 a new method for generating better cache distribution for cache-based rendering algorithms [paper] |
|
StylePart: Image-based Shape Part Manipulation I-Chao Shen, Li-Wen Su, Yu-Ting Wu, Bing-Yu Chen The Visual Computer 2024 a latent mapping function that connects the image generative latent space and the 3D man-made shape attribute latent space [project page] [paper] [supplemental material] [arxiv] |
|
NeRF-In: Free-Form Inpainting for Pretrained NeRF with RGB-D Priors I-Chao Shen*, Hao-Kang Liu*, Bing-Yu Chen (*: joint first authors) IEEE Computer Graphics and Applications (CG&A) 2023 an optimization framework that enables users to remove unwanted objects in a pre-trained NeRF [project page] [arxiv] [video] |
|
Palette-Based and Harmony-Guided Colorization for Vector Icons Miao Lin*, I-Chao Shen*, Hsiao-Yuan Chin, Ruo-Xi Chen, Bing-Yu Chen (*: joint first authors) Computer Graphics Forum, Vol. 42, No. 7, (Proceedings of Pacific Graphics 2023 (PG 2023), Daejeon, Korea), 2023. a palette-based colorization algorithm for vector icons without the need for rasterization. [project page] [paper] [video] |
|
Data-guided Authoring of Procedural Models of Shapes Ishtiaque Hossain, I-Chao Shen, Takeo Igarashi, Oliver van Kaick Computer Graphics Forum, Vol. 42, No. 7, (Proceedings of Pacific Graphics 2023 (PG 2023), Daejeon, Korea), 2023. a data-guided assistive system that can create a procedural model to replicate a collection of reference shapes. [project page] [paper] [supplemental material] [code] |
|
EvIcon: Designing High-Usability Icon with Human-in-the-loop Exploration and IconCLIP I-Chao Shen, Fu-Yin Cherng, Takeo Igarashi, Wen-Chieh Lin, Bing-Yu Chen Computer Graphics Forum, Volume 42, Issue 6, September 2023 an assistive system for designing high usability icons with a novel icon-specific visual-language model. [project page] [paper] [video] [arxiv] [IconCEPT10K dataset] |
|
360MVSNet: Deep Multi-view Stereo Network with 360° Images for Indoor Scene Reconstruction Ching-Ya Chiu, Yu-Ting Wu, I-Chao Shen, Yung-Yu Chuang IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2023 (Algorithm Track) a deep learning network for multi-view stereo with 360° images. [project page] [paper] [supplemental material] |
|
StyleFaceUV: a 3D Face UV Map Generator for View-Consistent Face Image Synthesis Wei-Chieh Chung*, Jian-Kai Zhu*, I-Chao Shen, Yu-Ting Wu, Yung-Yu Chuang (*: joint first authors) to appear in British Machine Vision Conference (BMVC) 2022 an approach for generating detailed 3D faces using a pre-trained StyleGAN2 model. [project page] [arxiv] [supplemental material] |
|
ODEN: Live Programming for Neural Network Architecture Editing Chunqi Zhao, I-Chao Shen, Tsukasa Fukusato, Jun Kato, Takeo Igarashi In Proceedings of 26th International Conference on Intelligent User Interfaces (IUI 2022), Online, 2022.03.22-25. a intelligent neural network architecture editing system using live programming techniques [project page] [paper] [demo video] [presentation video] |
|
Per Garment Capture and Synthesis for Real-time Virtual Try-on Toby Chong, I-Chao Shen, Nobuyuki Umetani, Takeo Igarashi in proceeding of User Interface Software and Technology (UIST) 2021 a real-time virtual try-on using per garment capture and synthesis workflow [project page] [paper] [video] [arxiv] [UTokyo english press] [Science Japan (JST)] |
|
Data-driven Sketch Beautification with Neural Feature Representation I-Chao Shen IEEE Computer Graphics and Applications (CG&A) 2021 a data-driven approach for beautifying freehand sketches [project page] [paper] |
|
Multi-Resolution Shared Representative Filtering for Real-Time Depth Completion Yu-Ting Wu, Tzu-Mao Li, I-Chao Shen, Hong-Shiang Lin, Yung-Yu Chuang High-Performance Graphics (HPG) 2021 a real-time depth completion algorithm which can effectively handle large missing regions of depth maps [project page] [paper] |
|
ClipGen: A Deep Generative Model for Clipart Vectorization and Synthesis I-Chao Shen, Bing-Yu Chen Transaction on Visualization and Computer Graphics (TVCG), 2021 a novel deep learning-based approach for automatically vectorizing and synthesizing the clipart of man-made objects [project page] [paper] [arxiv] |
|
ClipFlip : Multi-view Clipart Design I-Chao Shen, Kuan-Hung Liu, Li-Wen Su, Yu-Ting Wu, Bing-Yu Chen Computer Graphics Forum, Volume 40, Issue 1, Feb 2021 an assistive system for clipart design by providing visual scaffolds from the unseen viewpoints [project page] [paper] [supplemental material] [arxiv] |
|
Interactive Optimization of Generative Image Modeling using Sequential Subspace Search and Content-based Guidance Toby Chong Long Hin*, I-Chao Shen*, Issei Sato, Takeo Igarashi (*: joint first authors) Computer Graphics Forum, Volume 40, Issue 1, Feb 2021 a human-in-the-optimization method that allows users to directly explore and search the latent vector space of generative image modeling [project page] [paper] [arxiv] |
|
ZomeFab: Cost-effective Hybrid Fabrication with Interior Zometool Structure I-Chao Shen, Ming-Shiuan Chen, Chun-Kai Huang, Bing-Yu Chen Computer Graphics Forum, Volume 39, Issue 1, Feb 2020 a hybrid 3D fabrication method that combines 3D printing and the Zometool construction set to achieve compact fabrication [project page] [paper] [arxiv] |
|
Transferring Deep Reinforcement Learning with Adversarial Objective and Augmentation I-Chao Shen, Shu-Hsuan Hsu, Bing-Yu Chen to appear in IJCAI-PRICAI 2020 Workshop on Knowledge Based Reinforcement Learning (KBRL) a semi-supervised transfer learning method for deep reinforcement learning [paper][arXiv] [present video] |
|
Director-360: Introducing Camera Handling to 360 Cameras Hao-Juan Huang, I-Chao Shen, Liwei Chan in proceeding of MobileHCI 2020 [paper] |
|
Perception-Driven Semi-Structured Boundary Vectorization Shayan Hoshyari, Edoardo A. Dominici, Alla Sheffer, Nathan Carr, Duygu Ceylan, Zhaowen Wang, I-Chao Shen ACM Transaction on Graphics (Proceedings of SIGGRAPH 2018) a boundary vectorization approach leverages human perception of shapes to generate vector images consistent with viewer expectations [Project Page] [Paper] [bib] |
|
High-resolution 360 Video Foveated Stitching for Real-time VR Wei-Tse Lee*, Hsin-I Chen*, Ming-Shiuan Chen, I-Chao Shen, Bing-Yu Chen (*: joint first authors) Computer Graphics Forum (Proceedings of Pacific Graphics 2017) a real-time 360◦ video foveatedstitching framework [Paper] [Slide] [bib] |
|
A Scalable Active Framework for Region Annotation in 3D Shape Collections Li Yi, Vladimir G. Kim, Duygu Ceylan, I-Chao Shen, Mengyan Yan, Hao Su, Cewu Lu, Qixing Huang, Alla Sheffer, Leonidas Guibas ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2016) a novel active learning method capable of enriching massive geometric datasets with accurate semantic region annotations [Project page] [Paper] [Supplemental] [bib] |
|
Retargeting 3D Objects and Scenes with a General Framework Chun-Kai Huang, Yi-Ling Chen, I-Chao Shen, Bing-Yu Chen Computer Graphics Forum (Proceedings of Pacific Graphics 2016) an interactive method suitable for retargeting both 3D objects and scenes [Project page] [Paper] [Supplemental] [Slide] [bib] |
|
Data-driven Handwriting Synthesis in a Conjoined Manner Hsin-Yi Chen, Tse-Ju Lin, I-Chao Shen, Bing-Yu Chen Computer Graphics Forum (Proceedings of Pacific Graphics 2015) a novel method for synthesizing handwritten text according to the writer’s style while considering characters’ conjoined property [Project page] [Paper] [Slide] [bib] |
|
Gestalt Rule Feature Points I-Chao Shen, Wen-Huang Cheng IEEE Transactions on Multimedia (TMM), volume 17, number 4, page 526-537, April 2015. a new approach for detecting reliable visual features from images in different visual styles (e.g., a photo and a painting) [Paper] [Digital Library] [bib] |
|
Geometrically Consistent Stereoscopic Image Editing using Patch-based Synthesis Sheng-Jie Luo, Ying-Tse Sun, I-Chao Shen, Bing-Yu Chen, Yung-Yu Chuang, IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol.21, No. 1, pp. 56-67, January 2015. a patch-based synthesis framework for stereoscopic image editing problems, including depth-guided texture synthesis, stereoscopic NPR, paint by depth, content adaptation, and 2D to 3D conversion [Project Page] [Paper] [Digital Library] [bib] |
|
Stroke-guided Image Synthesis for Skeletal Structure Editing Sheng-Jie Luo, Chin-Yu Lin, I-Chao Shen, Bing-Yu Chen, Computer Graphics Forum (Pacific Graphics 2013) a technique for synthesizing image objects with different skeletal structures while respecting to an input image object [Project Page] [Paper] [Slide] [Digital Library] [bib] |
|
Perspective-Aware Warping for Seamless Stereoscopic Image Cloning Sheng-Jie Luo, I-Chao Shen, Bing-Yu Chen, Wen-Huang Cheng, Yung-Yu Chuang, SIGGRAPH ASIA 2012 a novel technique for seamless stereoscopic image cloning, which performs both shape adjustment and color blending [Project Page] [Paper] [Digital Library] [bib] |
Preprint
|
AvatarPerfect: User-Assisted 3D Gaussian Splatting Avatar Refinement with Automatic Pose Suggestion Jotaro Sakamiya, I-Chao Shen, Jinsong Zhang, Mustafa Doga Dogan, Takeo Igarashi arXiv, 2024 a user-assisted method to enhance the quality of 3DGS avatars. [arxiv] |
|
AutoPoly: Predicting a Polygonal Mesh Construction Sequence from a Silhouette Image I-Chao Shen, Yu Ju (Edwin) Chen, Oliver van Kaick, Takeo Igarashi arXiv, 2022 a hybrid method that generates a polygonal mesh construction sequence from a silhouette image [project page] [arxiv] |
Short Paper, Poster, and Demo
|
Designing Reconfigurable Joints Atsushi Maruyama, Maria Larsson, I-Chao Shen, Takeo Igarashi SIGGRAPH ASIA 2024 Technical Communication (Honorable Mention Award) [paper] |
|
DualAvatar: Robust Gaussian Splatting Avatar with Dual Representation Jinsong Zhang, I-Chao Shen, Jotaro Sakamiya, Yu-Kun Lai, Takeo Igarashi, Kun Li SIGGRAPH 2024 Poster [paper] [poster] |
|
Generating Font Variations Using Latent Space Trajectory Sotaro Kanazawa, I-Chao Shen, Yuki Tatsukawa, Takeo Igarashi SIGGRAPH 2024 Poster [paper] [poster] |
|
Real-Time Virtual Try-On Using Generative AI Zaiqiang Wu, I-Chao Shen, Yuki Shibata, Takayuki Hori, Mengjia Jin, Wataru Kubo, Takeo Igarashi SIGGRAPH 2024 Real-Time Live! |
|
3D Reconstruction from Sketch with Hidden Lines by Two-Branch Diffusion Model Yuta Fukushima, Anran Qi, I-Chao Shen, Yulia Gryaditskaya, Takeo Igarashi Eurographics 2024 Short Paper [paper] |
|
MicroGlam: Microscopic Skin Image Dataset with Cosmetics Toby Chong, Alina Chadwick, I-Chao Shen, Haoran Xie, Takeo Igarashi SIGGRAPH ASIA 2023 Technical Communication [paper] |
|
Computational Design of Nebuta-like Paper-on-Wire Artworks Naoki Agata, Anran Qi, Yuta Noma, I-Chao Shen, Takeo Igarashi SIGGRAPH 2023 Poster [paper] [poster] |
|
|
Palette-Based Colorization for Vector Icons Miao Lin, I-Chao Shen, Hsiao-Yuan Chin, Ruo-Xi Chen, Bing-Yu Chen SIGGRAPH 2023 Poster [paper] [poster] |
|
OVERPAINT: Automatic Multi-Layer Stencil Generation without Bridges Yuta Fukushima, Anran Qi, I-Chao Shen, Takeo Igarashi SIGGRAPH ASIA 2022 Technical Communication [paper] |
|
Guided Image Weathering using Image-to-Image Translation Li-Yu Chen, I-Chao Shen, Bing-Yu Chen SIGGRAPH ASIA 2021 Technical Communication [paper] [presentation video] |
|
|
Real-time Image-based Virtual Try-on with Measurement Garment Toby Chong, I-Chao Shen, Yunfei Qian, Nobuyuki Umetani, Takeo Igarashi SIGGRAPH ASIA 2021 Emerging Technologies [paper] |
|
User-Assisted Disparity Maps Hsin-Yi Chen, Yi-Shan Lin, I-Chao Shen, Sheng-Jie Luo, Wen-Huang Cheng, Bing-Yu Chen, Pacific Graphics 2012 Short Paper an intuitive and efficient system for correcting the artifacts and noises caused by imperfect disparity estimation [project Page] [paper] [bib] |
Research Funds
Domestic (Japan) Papers and Posters
| Human-in-the-loopによる3D Gaussian Splattingのゴミ除去手法, 坂宮 丞太郎, Jinsong Zhang, I-Chao Shen, Takeo Igarashi. VC 2024 Paper (ショート発表) [paper] |
| 自己教師あり学習を用いたモーションの連続性の学習, Naoki Agata, I-Chao Shen, Takeo Igarashi. VC 2024 Paper (ロング発表) [paper] |
| 「ねぶた風紙細工」をデザインするためのアルゴリズム, Naoki Agata, Anran Qi, Yuta Noma, I-Chao Shen, Takeo Igarashi. VC 2023 Paper (ロング発表) [paper] |
| タイポグラフィに特化した視覚言語モデル, 裕貴 立川, 奕超 沈, 安然 祁, 裕己 小山, 健夫 五十嵐, and アリエル シャミール. VC 2023 Paper (ショート発表) [paper] |
| OVERPAINT: 橋を用いない多層ステンシルの自動生成, Yuta Fukushima, Anran Qi, I-Chao Shen, Takeo Igarashi. VC 2022 Poster [paper] [poster] |