[Japanese]

I-Chao Shen

ichaoshen@g.ecc.u-tokyo.ac.jp

I am an assistant professor (助教) at the Graduate School of Information Science and Technology, the University of Tokyo. I am a member of the User Interface Research Group and working with Takeo Igarashi. My research focus on computational graphic design, where I explore combinations between different human priors and numerical optimization and develop supportive system for visual content generation.
C.V.   |   Google Scholar   |   Email  

Publication

FontCLIP: A Semantic Typography Visual-Language Model for Multilingual Font Applications
Yuki Tatsukawa, I-Chao Shen, Anran Qi, Yuki Koyama, Takeo Igarashi, Ariel Shamir
Eurographics 2024
a visual language model that understand typography and support cross-lingual font retrieval and optimization
[project page] [paper] [supplemental material] [code] [arxiv]
Virtual Measurement Garment for Per-Garment Virtual Try-On
Zaiqiang Wu*, Jingyuan Liu*, Long Hin Toby Chong, I-Chao Shen, Takeo Igarashi (*: joint first authors)
Graphics Interface 2024
[project page] [paper] [video]
Improving Cache Placement for Efficient Cache-based Rendering
Yu-Ting Wu, I-Chao Shen
The Visual Computer 2024
a new method for generating better cache distribution for cache-based rendering algorithms
[paper]
StylePart: Image-based Shape Part Manipulation
I-Chao Shen, Li-Wen Su, Yu-Ting Wu, Bing-Yu Chen
The Visual Computer 2024
a shape-consistent latent mapping function that connects the image generative latent space and the 3D man-made shape attribute latent space
[project page] [paper] [supplemental material] [arxiv]
NeRF-In: Free-Form Inpainting for Pretrained NeRF with RGB-D Priors
I-Chao Shen*, Hao-Kang Liu*, Bing-Yu Chen (*: joint first authors)
IEEE Computer Graphics and Applications (CG&A) 2023
an optimization framework that enables users to remove unwanted objects or retouch undesired regions in a 3D scene represented by a pre-trained NeRF
[project page] [arxiv] [video]
Palette-Based and Harmony-Guided Colorization for Vector Icons
Miao Lin*, I-Chao Shen*, Hsiao-Yuan Chin, Ruo-Xi Chen, Bing-Yu Chen (*: joint first authors)
Computer Graphics Forum, Vol. 42, No. 7, (Proceedings of Pacific Graphics 2023 (PG 2023), Daejeon, Korea), 2023.
a palette-based colorization algorithm for vector icons without the need for rasterization.
[project page] [paper] [video]
Data-guided Authoring of Procedural Models of Shapes
Ishtiaque Hossain, I-Chao Shen, Takeo Igarashi, Oliver van Kaick
Computer Graphics Forum, Vol. 42, No. 7, (Proceedings of Pacific Graphics 2023 (PG 2023), Daejeon, Korea), 2023.
a data-guided assistive system that can create a procedural model to replicate a collection of reference shapes.
[project page] [paper] [supplemental material] [code]
EvIcon: Designing High-Usability Icon with Human-in-the-loop Exploration and IconCLIP
I-Chao Shen, Fu-Yin Cherng, Takeo Igarashi, Wen-Chieh Lin, Bing-Yu Chen
Computer Graphics Forum, Volume 42, Issue 6, September 2023
an assistive system for designing high usability icons with a novel icon-specific visual-language model.
[project page] [paper] [video] [arxiv]
360MVSNet: Deep Multi-view Stereo Network with 360° Images for Indoor Scene Reconstruction
Ching-Ya Chiu, Yu-Ting Wu, I-Chao Shen, Yung-Yu Chuang
IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2023 (Algorithm Track)
a deep learning network for multi-view stereo with 360° images.
[project page] [paper] [supplemental material]
StyleFaceUV: a 3D Face UV Map Generator for View-Consistent Face Image Synthesis
Wei-Chieh Chung*, Jian-Kai Zhu*, I-Chao Shen, Yu-Ting Wu, Yung-Yu Chuang (*: joint first authors)
to appear in British Machine Vision Conference (BMVC) 2022
an approach for generating detailed 3D faces using a pre-trained StyleGAN2 model.
[project page] [arxiv] [supplemental material]
AutoPoly: Predicting a Polygonal Mesh Construction Sequence from a Silhouette Image
I-Chao Shen, Yu Ju (Edwin) Chen, Oliver van Kaick, Takeo Igarashi
arXiv, 2022
a hybrid method that generates a polygonal mesh construction sequence from a silhouette image
[project page] [arxiv]
ODEN: Live Programming for Neural Network Architecture Editing
Chunqi Zhao, I-Chao Shen, Tsukasa Fukusato, Jun Kato, Takeo Igarashi
In Proceedings of 26th International Conference on Intelligent User Interfaces (IUI 2022), Online, 2022.03.22-25.
a intelligent neural network architecture editing system using live programming techniques
[project page] [paper] [demo video] [presentation video]
Per Garment Capture and Synthesis for Real-time Virtual Try-on
Toby Chong, I-Chao Shen, Nobuyuki Umetani, Takeo Igarashi
in proceeding of User Interface Software and Technology (UIST) 2021
a real-time virtual try-on using per garment capture and synthesis workflow
[project page] [paper] [video] [arxiv] [UTokyo english press] [Science Japan (JST)]
Data-driven Sketch Beautification with Neural Feature Representation
I-Chao Shen
IEEE Computer Graphics and Applications (CG&A) 2021
a data-driven approach for beautifying freehand sketches
[project page] [paper]
Multi-Resolution Shared Representative Filtering for Real-Time Depth Completion
Yu-Ting Wu, Tzu-Mao Li, I-Chao Shen, Hong-Shiang Lin, Yung-Yu Chuang
High-Performance Graphics (HPG) 2021
a real-time depth completion algorithm which can effectively handle large missing regions of depth maps
[project page] [paper]
ClipGen: A Deep Generative Model for Clipart Vectorization and Synthesis
I-Chao Shen, Bing-Yu Chen
Transaction on Visualization and Computer Graphics (TVCG), 2021
a novel deep learning-based approach for automatically vectorizing and synthesizing the clipart of man-made objects
[project page] [paper] [arxiv]
ClipFlip : Multi-view Clipart Design
I-Chao Shen, Kuan-Hung Liu, Li-Wen Su, Yu-Ting Wu, Bing-Yu Chen
Computer Graphics Forum, Volume 40, Issue 1, Feb 2021
an assistive system for clipart design by providing visual scaffolds from the unseen viewpoints
[project page] [paper] [supplemental material] [arxiv]
Interactive Optimization of Generative Image Modeling using Sequential Subspace Search and Content-based Guidance
Toby Chong Long Hin*, I-Chao Shen*, Issei Sato, Takeo Igarashi (*: joint first authors)
Computer Graphics Forum, Volume 40, Issue 1, Feb 2021
a human-in-the-optimization method that allows users to directly explore and search the latent vector space of generative image modeling
[project page] [paper] [arxiv]
ZomeFab: Cost-effective Hybrid Fabrication with Interior Zometool Structure
I-Chao Shen, Ming-Shiuan Chen, Chun-Kai Huang, Bing-Yu Chen
Computer Graphics Forum, Volume 39, Issue 1, Feb 2020
a hybrid 3D fabrication method that combines 3D printing and the Zometool construction set to achieve compact fabrication
[project page] [paper] [arxiv]
Transferring Deep Reinforcement Learning with Adversarial Objective and Augmentation
I-Chao Shen, Shu-Hsuan Hsu, Bing-Yu Chen
to appear in IJCAI-PRICAI 2020 Workshop on Knowledge Based Reinforcement Learning (KBRL)
a semi-supervised transfer learning method for deep reinforcement learning
[paper][arXiv] [present video]
Director-360: Introducing Camera Handling to 360 Cameras
Hao-Juan Huang, I-Chao Shen, Liwei Chan
in proceeding of MobileHCI 2020
[paper]
Perception-Driven Semi-Structured Boundary Vectorization
Shayan Hoshyari, Edoardo A. Dominici, Alla Sheffer, Nathan Carr, Duygu Ceylan,
Zhaowen Wang, I-Chao Shen
ACM Transaction on Graphics (Proceedings of SIGGRAPH 2018)
a boundary vectorization approach leverages human perception of shapes to generate vector images consistent with viewer expectations
[Project Page] [Paper] [bib]
High-resolution 360 Video Foveated Stitching for Real-time VR
Wei-Tse Lee*, Hsin-I Chen*, Ming-Shiuan Chen, I-Chao Shen, Bing-Yu Chen (*: joint first authors)
Computer Graphics Forum (Proceedings of Pacific Graphics 2017)
a real-time 360◦ video foveatedstitching framework
[Paper] [Slide] [bib]
A Scalable Active Framework for Region Annotation in 3D Shape Collections
Li Yi, Vladimir G. Kim, Duygu Ceylan, I-Chao Shen, Mengyan Yan, Hao Su, Cewu Lu, Qixing Huang, Alla Sheffer, Leonidas Guibas
ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2016)
a novel active learning method capable of enriching massive geometric datasets with accurate semantic region annotations
[Project page] [Paper] [Supplemental] [bib]
Retargeting 3D Objects and Scenes with a General Framework
Chun-Kai Huang, Yi-Ling Chen, I-Chao Shen, Bing-Yu Chen
Computer Graphics Forum (Proceedings of Pacific Graphics 2016)
an interactive method suitable for retargeting both 3D objects and scenes
[Project page] [Paper] [Supplemental] [Slide] [bib]
Data-driven Handwriting Synthesis in a Conjoined Manner
Hsin-Yi Chen, Tse-Ju Lin, I-Chao Shen, Bing-Yu Chen
Computer Graphics Forum (Proceedings of Pacific Graphics 2015)
a novel method for synthesizing handwritten text according to the writer’s style while considering characters’ conjoined property
[Project page] [Paper] [Slide] [bib]
Gestalt Rule Feature Points
I-Chao Shen, Wen-Huang Cheng
IEEE Transactions on Multimedia (TMM), volume 17, number 4, page 526-537, April 2015.
a new approach for detecting reliable visual features from images in different visual styles (e.g., a photo and a painting)
[Paper] [Digital Library] [bib]
Geometrically Consistent Stereoscopic Image Editing using Patch-based Synthesis
Sheng-Jie Luo, Ying-Tse Sun, I-Chao Shen, Bing-Yu Chen, Yung-Yu Chuang,
IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol.21, No. 1, pp. 56-67, January 2015.
a patch-based synthesis framework for stereoscopic image editing problems, including depth-guided texture synthesis, stereoscopic NPR, paint by depth, content adaptation, and 2D to 3D conversion
[Project Page] [Paper] [Digital Library] [bib]
Stroke-guided Image Synthesis for Skeletal Structure Editing
Sheng-Jie Luo, Chin-Yu Lin, I-Chao Shen, Bing-Yu Chen,
Computer Graphics Forum (Pacific Graphics 2013)
a technique for synthesizing image objects with different skeletal structures while respecting to an input image object
[Project Page] [Paper] [Slide] [Digital Library] [bib]
Perspective-Aware Warping for Seamless Stereoscopic Image Cloning
Sheng-Jie Luo, I-Chao Shen, Bing-Yu Chen, Wen-Huang Cheng, Yung-Yu Chuang,
SIGGRAPH ASIA 2012
a novel technique for seamless stereoscopic image cloning, which performs both shape adjustment and color blending
[Project Page] [Paper] [Digital Library] [bib]

Short Paper, Poster, and Demo

3D Reconstruction from Sketch with Hidden Lines by Two-Branch Diffusion Model
Yuta Fukushima, Anran Qi, I-Chao Shen, Yulia Gryaditskaya, Takeo Igarashi
Eurographics 2024 Short Paper
[paper]
MicroGlam: Microscopic Skin Image Dataset with Cosmetics
Toby Chong, Alina Chadwick, I-Chao Shen, Haoran Xie, Takeo Igarashi
SIGGRAPH ASIA 2023 Technical Communication
[paper]
Computational Design of Nebuta-like Paper-on-Wire Artworks
Naoki Agata, Anran Qi, Yuta Noma, I-Chao Shen, Takeo Igarashi
SIGGRAPH 2023 Poster
[paper] [poster]
Palette-Based Colorization for Vector Icons
Miao Lin, I-Chao Shen, Hsiao-Yuan Chin, Ruo-Xi Chen, Bing-Yu Chen
SIGGRAPH 2023 Poster
[paper] [poster]
OVERPAINT: Automatic Multi-Layer Stencil Generation without Bridges
Yuta Fukushima, Anran Qi, I-Chao Shen, Takeo Igarashi
SIGGRAPH ASIA 2022 Technical Communication
[paper]
Guided Image Weathering using Image-to-Image Translation
Li-Yu Chen, I-Chao Shen, Bing-Yu Chen
SIGGRAPH ASIA 2021 Technical Communication
[paper] [presentation video]
Real-time Image-based Virtual Try-on with Measurement Garment
Toby Chong, I-Chao Shen, Yunfei Qian, Nobuyuki Umetani, Takeo Igarashi
SIGGRAPH ASIA 2021 Emerging Technologies
[paper]
User-Assisted Disparity Maps
Hsin-Yi Chen, Yi-Shan Lin, I-Chao Shen, Sheng-Jie Luo, Wen-Huang Cheng, Bing-Yu Chen,
Pacific Graphics 2012 Short Paper
an intuitive and efficient system for correcting the artifacts and noises caused by imperfect disparity estimation
[project Page] [paper] [bib]

Domestic (Japan) Papers and Posters

「ねぶた風紙細工」をデザインするためのアルゴリズム, Naoki Agata, Anran Qi, Yuta Noma, I-Chao Shen, Takeo Igarashi. VC 2023 Paper (ロング発表) [paper]
「タイポグラフィに特化した視覚言語モデル, 裕貴 立川, 健夫 五十嵐, 裕己 小山, 奕超 沈, 安然 祁 and アリエル シャミール. VC 2023 Paper (ショート発表) [paper]
OVERPAINT: 橋を用いない多層ステンシルの自動生成, Yuta Fukushima, Anran Qi, I-Chao Shen, Takeo Igarashi. VC 2022 Poster [paper] [poster]