I-Chao Shen

ichaoshen@g.ecc.u-tokyo.ac.jp

I am an assistant professor at Department of Computer Science, the Graduate School of Information Science and Technology, The University of Tokyo. My research focus on computer graphics, with a focus on inverse modeling of 2D graphics and 2D/3D content generation. If you are interested in my research and considering about working with me, please drop me a mail or apply to this group.
C.V.   |   Google Scholar   |   Email   |   ORCID

Publication

Preprint

Short papers

Research funds

Academic services

Domestic papers

Miscellaneous

Publication

MeshLLM: Empowering Large Language Models to Progressively Understand and Generate 3D Mesh
Shuangkang Fang, I-Chao Shen, Yufeng Wang, Yi-Hsuan Tsai, Yi Yang, Shuchang Zhou, Wenrui Ding, Takeo Igarashi, Ming-Hsuan Yang
ICCV 2025
[paper]
NeRF Is a Valuable Assistant for 3D Gaussian Splatting
Shuangkang Fang, I-Chao Shen, Takeo Igarashi, Yufeng Wang, ZeSheng Wang, Yi Yang, Wenrui Ding, Shuchang Zhou
ICCV 2025
[paper]
GarmentImage: Raster Encoding of Garment Sewing Patterns with Diverse Topologies
Yuki Tatsukawa, Anran Qi, I-Chao Shen, Takeo Igarashi
SIGGRAPH 2025 (Conference Track)
[paper] [project page]
The Mokume Dataset and Inverse Modeling of Solid Wood Textures
Maria Larsson, Hodaka Yamaguchi, Ehsan Pajouheshgar, I-Chao Shen, Kenji Tojo, Chia-Ming Chang, Lars Hansson, Olof Broman, Takashi Ijiri, Ariel Shamir, Wenzel Jakob, Takeo Igarashi
SIGGRAPH 2025 (Transaction on Graphics)
[paper] [video] [project page]
Approximating Procedural Models of 3D Shapes with Neural Networks
Ishtiaque Hossain, I-Chao Shen, Oliver van Kaick
Eurographics 2025
[paper] [supplemental material]
FontCraft: Multimodal Font Design Using Interactive Bayesian Optimization
Yuki Tatsukawa, I-Chao Shen, Mustafa Doga Dogan, Anran Qi, Yuki Koyama, Ariel Shamir, Takeo Igarashi
CHI 2025
a system allows non-expert users to create new fonts using multi-modal input
[paper] [project page] [arxiv] [video]
CompAct: Designing Interconnected Compliant Mechanisms with Active Material Integration
Humphrey Yang, I-Chao Shen, Nikolas Martelaro, Bo Zhu, Haoran Xie, Takeo Igarashi, Lining Yao
CHI 2025
[paper] [video]
Interactive Multilayer Gaussian Garments for Low-Cost Try-On
Ryan Zesch, I-Chao Shen, Haoran Xie, Bo Zhu, Shinjiro Sueda, Takeo Igarashi
Graphics Interface (GI) 2025 (Best Graphics Paper)
[paper] [video]
FontCLIP: A Semantic Typography Visual-Language Model for Multilingual Font Applications
Yuki Tatsukawa, I-Chao Shen, Anran Qi, Yuki Koyama, Takeo Igarashi, Ariel Shamir
Eurographics 2024
a visual language model that understand typography and support cross-lingual font retrieval and optimization
[paper] [project page] [DOI] [supplemental material] [code] [arxiv]
Learned Inference of Annual Ring Pattern of Solid Wood
Maria Larsson*, Takashi Ijiri*, I-Chao Shen, Hironori Yoshida, Ariel Shamir, Takeo Igarashi (*: joint first authors)
Computer Graphics Forum 2024
[paper] [DOI]
Virtual Measurement Garment for Per-Garment Virtual Try-On
Zaiqiang Wu*, Jingyuan Liu*, Long Hin Toby Chong, I-Chao Shen, Takeo Igarashi (*: joint first authors)
Graphics Interface 2024
a novel per-garment virtual try-on method which eliminates the need for the physical measurement garment
[paper] [project page] [video]
Improving Cache Placement for Efficient Cache-based Rendering
Yu-Ting Wu, I-Chao Shen
The Visual Computer 2024
a new method for generating better cache distribution for cache-based rendering algorithms
[paper]
StylePart: Image-based Shape Part Manipulation
I-Chao Shen, Li-Wen Su, Yu-Ting Wu, Bing-Yu Chen
The Visual Computer 2024
a latent mapping function that connects the image generative latent space and the 3D man-made shape attribute latent space
[paper] [project page] [supplemental material] [arxiv]
NeRF-In: Free-Form Inpainting for Pretrained NeRF with RGB-D Priors
I-Chao Shen*, Hao-Kang Liu*, Bing-Yu Chen (*: joint first authors)
IEEE Computer Graphics and Applications (CG&A) 2023
an optimization framework that enables users to remove unwanted objects in a pre-trained NeRF
[paper] [project page] [video]
Palette-Based and Harmony-Guided Colorization for Vector Icons
Miao Lin*, I-Chao Shen*, Hsiao-Yuan Chin, Ruo-Xi Chen, Bing-Yu Chen (*: joint first authors)
Computer Graphics Forum, Vol. 42, No. 7, (Proceedings of Pacific Graphics 2023 (PG 2023), Daejeon, Korea), 2023.
a palette-based colorization algorithm for vector icons without the need for rasterization.
[paper] [project page] [video]
Data-guided Authoring of Procedural Models of Shapes
Ishtiaque Hossain, I-Chao Shen, Takeo Igarashi, Oliver van Kaick
Computer Graphics Forum, Vol. 42, No. 7, (Proceedings of Pacific Graphics 2023 (PG 2023), Daejeon, Korea), 2023.
a data-guided assistive system that can create a procedural model to replicate a collection of reference shapes.
[paper] [project page] [supplemental material] [code]
EvIcon: Designing High-Usability Icon with Human-in-the-loop Exploration and IconCLIP
I-Chao Shen, Fu-Yin Cherng, Takeo Igarashi, Wen-Chieh Lin, Bing-Yu Chen
Computer Graphics Forum, Volume 42, Issue 6, September 2023
an assistive system for designing high usability icons with a novel icon-specific visual-language model.
[paper] [project page] [video] [arxiv] [IconCEPT10K dataset]
360MVSNet: Deep Multi-view Stereo Network with 360° Images for Indoor Scene Reconstruction
Ching-Ya Chiu, Yu-Ting Wu, I-Chao Shen, Yung-Yu Chuang
IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2023 (Algorithm Track)
a deep learning network for multi-view stereo with 360° images.
[paper] [project page] [supplemental material]
StyleFaceUV: a 3D Face UV Map Generator for View-Consistent Face Image Synthesis
Wei-Chieh Chung*, Jian-Kai Zhu*, I-Chao Shen, Yu-Ting Wu, Yung-Yu Chuang (*: joint first authors)
British Machine Vision Conference (BMVC) 2022
an approach for generating detailed 3D faces using a pre-trained StyleGAN2 model.
[paper] [project page] [supplemental material]
ODEN: Live Programming for Neural Network Architecture Editing
Chunqi Zhao, I-Chao Shen, Tsukasa Fukusato, Jun Kato, Takeo Igarashi
In Proceedings of 26th International Conference on Intelligent User Interfaces (IUI 2022), Online, 2022.03.22-25.
a intelligent neural network architecture editing system using live programming techniques
[paper] [project page] [demo video] [presentation video]
Per Garment Capture and Synthesis for Real-time Virtual Try-on
Toby Chong, I-Chao Shen, Nobuyuki Umetani, Takeo Igarashi
in proceeding of User Interface Software and Technology (UIST) 2021
a real-time virtual try-on using per garment capture and synthesis workflow
[paper] [project page] [video] [arxiv] [UTokyo english press] [Science Japan (JST)]
Data-driven Sketch Beautification with Neural Feature Representation
I-Chao Shen
IEEE Computer Graphics and Applications (CG&A) 2021
a data-driven approach for beautifying freehand sketches
[paper] [project page]
Multi-Resolution Shared Representative Filtering for Real-Time Depth Completion
Yu-Ting Wu, Tzu-Mao Li, I-Chao Shen, Hong-Shiang Lin, Yung-Yu Chuang
High-Performance Graphics (HPG) 2021
a real-time depth completion algorithm which can effectively handle large missing regions of depth maps
[paper] [project page]
ClipGen: A Deep Generative Model for Clipart Vectorization and Synthesis
I-Chao Shen, Bing-Yu Chen
Transaction on Visualization and Computer Graphics (TVCG), 2021
a novel deep learning-based approach for automatically vectorizing and synthesizing the clipart of man-made objects
[paper] [project page] [arxiv]
ClipFlip : Multi-view Clipart Design
I-Chao Shen, Kuan-Hung Liu, Li-Wen Su, Yu-Ting Wu, Bing-Yu Chen
Computer Graphics Forum, Volume 40, Issue 1, Feb 2021
an assistive system for clipart design by providing visual scaffolds from the unseen viewpoints
[paper] [project page] [supplemental material] [arxiv]
Interactive Optimization of Generative Image Modeling using Sequential Subspace Search and Content-based Guidance
Toby Chong Long Hin*, I-Chao Shen*, Issei Sato, Takeo Igarashi (*: joint first authors)
Computer Graphics Forum, Volume 40, Issue 1, Feb 2021
a human-in-the-optimization method that allows users to directly explore and search the latent vector space of generative image modeling
[paper] [project page] [arxiv]
ZomeFab: Cost-effective Hybrid Fabrication with Interior Zometool Structure
I-Chao Shen, Ming-Shiuan Chen, Chun-Kai Huang, Bing-Yu Chen
Computer Graphics Forum, Volume 39, Issue 1, Feb 2020
a hybrid 3D fabrication method that combines 3D printing and the Zometool construction set to achieve compact fabrication
[paper] [project page] [arxiv]
Transferring Deep Reinforcement Learning with Adversarial Objective and Augmentation
I-Chao Shen, Shu-Hsuan Hsu, Bing-Yu Chen
to appear in IJCAI-PRICAI 2020 Workshop on Knowledge Based Reinforcement Learning (KBRL)
a semi-supervised transfer learning method for deep reinforcement learning
[paper] [arXiv] [present video]
Director-360: Introducing Camera Handling to 360 Cameras
Hao-Juan Huang, I-Chao Shen, Liwei Chan
in proceeding of MobileHCI 2020
[paper]
Perception-Driven Semi-Structured Boundary Vectorization
Shayan Hoshyari, Edoardo A. Dominici, Alla Sheffer, Nathan Carr, Duygu Ceylan,
Zhaowen Wang, I-Chao Shen
ACM Transaction on Graphics (Proceedings of SIGGRAPH 2018)
a boundary vectorization approach leverages human perception of shapes to generate vector images consistent with viewer expectations
[paper] [project page] [bib]
High-resolution 360 Video Foveated Stitching for Real-time VR
Wei-Tse Lee*, Hsin-I Chen*, Ming-Shiuan Chen, I-Chao Shen, Bing-Yu Chen (*: joint first authors)
Computer Graphics Forum (Proceedings of Pacific Graphics 2017)
a real-time 360◦ video foveatedstitching framework
[paper] [slide] [bib]
A Scalable Active Framework for Region Annotation in 3D Shape Collections
Li Yi, Vladimir G. Kim, Duygu Ceylan, I-Chao Shen, Mengyan Yan, Hao Su, Cewu Lu, Qixing Huang, Alla Sheffer, Leonidas Guibas
ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2016)
a novel active learning method capable of enriching massive geometric datasets with accurate semantic region annotations
[paper] [project page] [supplemental] [bib]
Retargeting 3D Objects and Scenes with a General Framework
Chun-Kai Huang, Yi-Ling Chen, I-Chao Shen, Bing-Yu Chen
Computer Graphics Forum (Proceedings of Pacific Graphics 2016)
an interactive method suitable for retargeting both 3D objects and scenes
[paper] [project page] [supplemental] [slide] [bib]
Data-driven Handwriting Synthesis in a Conjoined Manner
Hsin-Yi Chen, Tse-Ju Lin, I-Chao Shen, Bing-Yu Chen
Computer Graphics Forum (Proceedings of Pacific Graphics 2015)
a novel method for synthesizing handwritten text according to the writer’s style while considering characters’ conjoined property
[paper] [project page] [slide] [bib]
Gestalt Rule Feature Points
I-Chao Shen, Wen-Huang Cheng
IEEE Transactions on Multimedia (TMM), volume 17, number 4, page 526-537, April 2015.
a new approach for detecting reliable visual features from images in different visual styles (e.g., a photo and a painting)
[paper] [bib]
Geometrically Consistent Stereoscopic Image Editing using Patch-based Synthesis
Sheng-Jie Luo, Ying-Tse Sun, I-Chao Shen, Bing-Yu Chen, Yung-Yu Chuang,
IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol.21, No. 1, pp. 56-67, January 2015.
a patch-based synthesis framework for stereoscopic image editing problems, including depth-guided texture synthesis, stereoscopic NPR, paint by depth, content adaptation, and 2D to 3D conversion
[paper] [project page] [bib]
Stroke-guided Image Synthesis for Skeletal Structure Editing
Sheng-Jie Luo, Chin-Yu Lin, I-Chao Shen, Bing-Yu Chen,
Computer Graphics Forum (Pacific Graphics 2013)
a technique for synthesizing image objects with different skeletal structures while respecting to an input image object
[paper] [project page] [slide] [bib]
Perspective-Aware Warping for Seamless Stereoscopic Image Cloning
Sheng-Jie Luo, I-Chao Shen, Bing-Yu Chen, Wen-Huang Cheng, Yung-Yu Chuang,
SIGGRAPH ASIA 2012
a novel technique for seamless stereoscopic image cloning, which performs both shape adjustment and color blending
[paper] [project page] [bib]

[top]

Preprint

AvatarPerfect: User-Assisted 3D Gaussian Splatting Avatar Refinement with Automatic Pose Suggestion
Jotaro Sakamiya, I-Chao Shen, Jinsong Zhang, Mustafa Doga Dogan, Takeo Igarashi
arXiv, 2024
a user-assisted method to enhance the quality of 3DGS avatars.
[arxiv]
AutoPoly: Predicting a Polygonal Mesh Construction Sequence from a Silhouette Image
I-Chao Shen, Yu Ju (Edwin) Chen, Oliver van Kaick, Takeo Igarashi
arXiv, 2022
a hybrid method that generates a polygonal mesh construction sequence from a silhouette image
[arxiv] [project page]

[top]

Short Paper, Poster, and Demo

Designing Reconfigurable Joints
Atsushi Maruyama, Maria Larsson, I-Chao Shen, Takeo Igarashi
SIGGRAPH ASIA 2024 Technical Communication (Honorable Mention Award)
[paper]
DualAvatar: Robust Gaussian Splatting Avatar with Dual Representation
Jinsong Zhang, I-Chao Shen, Jotaro Sakamiya, Yu-Kun Lai, Takeo Igarashi, Kun Li
SIGGRAPH 2024 Poster
[paper] [poster]
Generating Font Variations Using Latent Space Trajectory
Sotaro Kanazawa, I-Chao Shen, Yuki Tatsukawa, Takeo Igarashi
SIGGRAPH 2024 Poster
[paper] [poster]
Real-Time Virtual Try-On Using Generative AI
Zaiqiang Wu, I-Chao Shen, Yuki Shibata, Takayuki Hori, Mengjia Jin, Wataru Kubo, Takeo Igarashi
SIGGRAPH 2024 Real-Time Live!
3D Reconstruction from Sketch with Hidden Lines by Two-Branch Diffusion Model
Yuta Fukushima, Anran Qi, I-Chao Shen, Yulia Gryaditskaya, Takeo Igarashi
Eurographics 2024 Short Paper
[paper]
MicroGlam: Microscopic Skin Image Dataset with Cosmetics
Toby Chong, Alina Chadwick, I-Chao Shen, Haoran Xie, Takeo Igarashi
SIGGRAPH ASIA 2023 Technical Communication
[paper]
Computational Design of Nebuta-like Paper-on-Wire Artworks
Naoki Agata, Anran Qi, Yuta Noma, I-Chao Shen, Takeo Igarashi
SIGGRAPH 2023 Poster
[paper] [poster]
Palette-Based Colorization for Vector Icons
Miao Lin, I-Chao Shen, Hsiao-Yuan Chin, Ruo-Xi Chen, Bing-Yu Chen
SIGGRAPH 2023 Poster
[paper] [poster]
OVERPAINT: Automatic Multi-Layer Stencil Generation without Bridges
Yuta Fukushima, Anran Qi, I-Chao Shen, Takeo Igarashi
SIGGRAPH ASIA 2022 Technical Communication
[paper]
Guided Image Weathering using Image-to-Image Translation
Li-Yu Chen, I-Chao Shen, Bing-Yu Chen
SIGGRAPH ASIA 2021 Technical Communication
[paper] [presentation video]
Real-time Image-based Virtual Try-on with Measurement Garment
Toby Chong, I-Chao Shen, Yunfei Qian, Nobuyuki Umetani, Takeo Igarashi
SIGGRAPH ASIA 2021 Emerging Technologies
[paper]
User-Assisted Disparity Maps
Hsin-Yi Chen, Yi-Shan Lin, I-Chao Shen, Sheng-Jie Luo, Wen-Huang Cheng, Bing-Yu Chen,
Pacific Graphics 2012 Short Paper
an intuitive and efficient system for correcting the artifacts and noises caused by imperfect disparity estimation
[project Page] [paper] [bib]

[top]

Research Funds

  • NII Open Collaborative Research, Japan, PI, 2025-2026 [Link]
  • JSPS Kakenhi Grant-in-Aid for Young Scientists (科研費 若手研究), PI, 2023-2028 [Link]
  • JST AIP Challenge Researcher (CREST AIPチャレンジプログラム), PI, 2021 [Link]
  • JSPS Grant-in-Aid for Scientific Research for JPSP foreign fellow (外国人特別研究員), Co-PI, 2021-2023 [Link]
    •

    [top]

    Academic services

  • Technical Papers Committee, SIGGRAPH Asia 2025 [Link]
  • Program Committee, Pacific Graphics 2025 [Link]
  • Short Papers Program Committee (PC), Eurographics 2025 [Link]
  • Technical Papers COI Coordinator, SIGGRAPH 2025 [Link]
  • Technical Papers Committee, SIGGRAPH Asia 2024 [Link]
  • Technical Program Committee, AAAI 2023 [Link], 2024 [Link], 2025 [Link]
  • Reviewer: SIGGRAPH, SIGGRAPH ASIA, Pacific Graphics, Eurographics, NeurIPS, ICLR, ICML, CVPR, CHI, UIST, WACV, BMVC
    •

    [top]

    Domestic (Japan) Papers and Posters

    個別衣服の学習によるリアルタイム仮想試着, Zaiqiang Wu, Jingyuan Liu, Yechen Li, Toby Chong, I-Chao Shen, 五十嵐 健夫 (東京大学), 金 孟佳, 久保 渉, 柴田 勇希, 堀 隆之, 田之上 隼人, 西原 大輝 (ソフトバンク) (デモ)
    Human-in-the-loopによる3D Gaussian Splattingのゴミ除去手法, 坂宮 丞太郎, Jinsong Zhang, I-Chao Shen, Takeo Igarashi. VC 2024 Paper (ショート発表)
    自己教師あり学習を用いたモーションの連続性の学習, Naoki Agata, I-Chao Shen, Takeo Igarashi. VC 2024 Paper (ロング発表)
    「ねぶた風紙細工」をデザインするためのアルゴリズム, Naoki Agata, Anran Qi, Yuta Noma, I-Chao Shen, Takeo Igarashi. VC 2023 Paper (ロング発表)
    タイポグラフィに特化した視覚言語モデル, 裕貴 立川, 奕超 沈, 安然 祁, 裕己 小山, 健夫 五十嵐, and アリエル シャミール. VC 2023 Paper (ショート発表)
    OVERPAINT: 橋を用いない多層ステンシルの自動生成, Yuta Fukushima, Anran Qi, I-Chao Shen, Takeo Igarashi. VC 2022 Poster

    [top]

    Misc

    Visual Computing and HCI conference information [link]
    if you have conference information you want to add to the list, welcome to send a pull request.
    A Curated List of Computational Font Typography Research [link]
    a collection of researches of computational font and typography research.
    Latex template post-process scripts [link]
    a collection of scripts to post-process the latex code to be ready to upload to arxiv or submit the camera-ready version.
    All-in-one latex template [link]
    a latex paper template that supports various conferences across research fields including computer graphics, computer vision, and hci.

    [top]