I-Chao Shen

ichaoshen@g.ecc.u-tokyo.ac.jp

I am an assistant professor at the Graduate School of Information Science and Technology, the University of Tokyo. I am a member of the User Interface Research Group and working with Takeo Igarashi. My research focus on computer graphics, computational graphic design, and machine learning.
C.V. | Google Scholar | Email

Publication

	FontCLIP: A Semantic Typography Visual-Language Model for Multilingual Font Applications Yuki Tatsukawa, I-Chao Shen, Anran Qi, Yuki Koyama, Takeo Igarashi, Ariel Shamir Eurographics 2024 a visual language model that understand typography and support cross-lingual font retrieval and optimization [project page] [paper] [DOI] [supplemental material] [code] [arxiv]
	Learned Inference of Annual Ring Pattern of Solid Wood Maria Larsson^, Takashi Ijiri^, I-Chao Shen, Hironori Yoshida, Ariel Shamir, Takeo Igarashi (*: joint first authors) Computer Graphics Forum 2024 [paper] [DOI]
	Virtual Measurement Garment for Per-Garment Virtual Try-On Zaiqiang Wu^, Jingyuan Liu^, Long Hin Toby Chong, I-Chao Shen, Takeo Igarashi (*: joint first authors) Graphics Interface 2024 a novel per-garment virtual try-on method which eliminates the need for the physical measurement garment [project page] [paper] [video]
	Improving Cache Placement for Efficient Cache-based Rendering Yu-Ting Wu, I-Chao Shen The Visual Computer 2024 a new method for generating better cache distribution for cache-based rendering algorithms [paper]
	StylePart: Image-based Shape Part Manipulation I-Chao Shen, Li-Wen Su, Yu-Ting Wu, Bing-Yu Chen The Visual Computer 2024 a latent mapping function that connects the image generative latent space and the 3D man-made shape attribute latent space [project page] [paper] [supplemental material] [arxiv]
	NeRF-In: Free-Form Inpainting for Pretrained NeRF with RGB-D Priors I-Chao Shen^, Hao-Kang Liu^, Bing-Yu Chen (*: joint first authors) IEEE Computer Graphics and Applications (CG&A) 2023 an optimization framework that enables users to remove unwanted objects in a pre-trained NeRF [project page] [arxiv] [video]
	Palette-Based and Harmony-Guided Colorization for Vector Icons Miao Lin^, I-Chao Shen^, Hsiao-Yuan Chin, Ruo-Xi Chen, Bing-Yu Chen (*: joint first authors) Computer Graphics Forum, Vol. 42, No. 7, (Proceedings of Pacific Graphics 2023 (PG 2023), Daejeon, Korea), 2023. a palette-based colorization algorithm for vector icons without the need for rasterization. [project page] [paper] [video]
	Data-guided Authoring of Procedural Models of Shapes Ishtiaque Hossain, I-Chao Shen, Takeo Igarashi, Oliver van Kaick Computer Graphics Forum, Vol. 42, No. 7, (Proceedings of Pacific Graphics 2023 (PG 2023), Daejeon, Korea), 2023. a data-guided assistive system that can create a procedural model to replicate a collection of reference shapes. [project page] [paper] [supplemental material] [code]
	EvIcon: Designing High-Usability Icon with Human-in-the-loop Exploration and IconCLIP I-Chao Shen, Fu-Yin Cherng, Takeo Igarashi, Wen-Chieh Lin, Bing-Yu Chen Computer Graphics Forum, Volume 42, Issue 6, September 2023 an assistive system for designing high usability icons with a novel icon-specific visual-language model. [project page] [paper] [video] [arxiv]
	360MVSNet: Deep Multi-view Stereo Network with 360° Images for Indoor Scene Reconstruction Ching-Ya Chiu, Yu-Ting Wu, I-Chao Shen, Yung-Yu Chuang IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2023 (Algorithm Track) a deep learning network for multi-view stereo with 360° images. [project page] [paper] [supplemental material]
	StyleFaceUV: a 3D Face UV Map Generator for View-Consistent Face Image Synthesis Wei-Chieh Chung^, Jian-Kai Zhu^, I-Chao Shen, Yu-Ting Wu, Yung-Yu Chuang (*: joint first authors) to appear in British Machine Vision Conference (BMVC) 2022 an approach for generating detailed 3D faces using a pre-trained StyleGAN2 model. [project page] [arxiv] [supplemental material]
	AutoPoly: Predicting a Polygonal Mesh Construction Sequence from a Silhouette Image I-Chao Shen, Yu Ju (Edwin) Chen, Oliver van Kaick, Takeo Igarashi arXiv, 2022 a hybrid method that generates a polygonal mesh construction sequence from a silhouette image [project page] [arxiv]
	ODEN: Live Programming for Neural Network Architecture Editing Chunqi Zhao, I-Chao Shen, Tsukasa Fukusato, Jun Kato, Takeo Igarashi In Proceedings of 26th International Conference on Intelligent User Interfaces (IUI 2022), Online, 2022.03.22-25. a intelligent neural network architecture editing system using live programming techniques [project page] [paper] [demo video] [presentation video]
	Per Garment Capture and Synthesis for Real-time Virtual Try-on Toby Chong, I-Chao Shen, Nobuyuki Umetani, Takeo Igarashi in proceeding of User Interface Software and Technology (UIST) 2021 a real-time virtual try-on using per garment capture and synthesis workflow [project page] [paper] [video] [arxiv] [UTokyo english press] [Science Japan (JST)]
	Data-driven Sketch Beautification with Neural Feature Representation I-Chao Shen IEEE Computer Graphics and Applications (CG&A) 2021 a data-driven approach for beautifying freehand sketches [project page] [paper]
	Multi-Resolution Shared Representative Filtering for Real-Time Depth Completion Yu-Ting Wu, Tzu-Mao Li, I-Chao Shen, Hong-Shiang Lin, Yung-Yu Chuang High-Performance Graphics (HPG) 2021 a real-time depth completion algorithm which can effectively handle large missing regions of depth maps [project page] [paper]
	ClipGen: A Deep Generative Model for Clipart Vectorization and Synthesis I-Chao Shen, Bing-Yu Chen Transaction on Visualization and Computer Graphics (TVCG), 2021 a novel deep learning-based approach for automatically vectorizing and synthesizing the clipart of man-made objects [project page] [paper] [arxiv]
	ClipFlip : Multi-view Clipart Design I-Chao Shen, Kuan-Hung Liu, Li-Wen Su, Yu-Ting Wu, Bing-Yu Chen Computer Graphics Forum, Volume 40, Issue 1, Feb 2021 an assistive system for clipart design by providing visual scaffolds from the unseen viewpoints [project page] [paper] [supplemental material] [arxiv]
	Interactive Optimization of Generative Image Modeling using Sequential Subspace Search and Content-based Guidance Toby Chong Long Hin^, I-Chao Shen^, Issei Sato, Takeo Igarashi (*: joint first authors) Computer Graphics Forum, Volume 40, Issue 1, Feb 2021 a human-in-the-optimization method that allows users to directly explore and search the latent vector space of generative image modeling [project page] [paper] [arxiv]
	ZomeFab: Cost-effective Hybrid Fabrication with Interior Zometool Structure I-Chao Shen, Ming-Shiuan Chen, Chun-Kai Huang, Bing-Yu Chen Computer Graphics Forum, Volume 39, Issue 1, Feb 2020 a hybrid 3D fabrication method that combines 3D printing and the Zometool construction set to achieve compact fabrication [project page] [paper] [arxiv]
	Transferring Deep Reinforcement Learning with Adversarial Objective and Augmentation I-Chao Shen, Shu-Hsuan Hsu, Bing-Yu Chen to appear in IJCAI-PRICAI 2020 Workshop on Knowledge Based Reinforcement Learning (KBRL) a semi-supervised transfer learning method for deep reinforcement learning [paper][arXiv] [present video]
	Director-360: Introducing Camera Handling to 360 Cameras Hao-Juan Huang, I-Chao Shen, Liwei Chan in proceeding of MobileHCI 2020 [paper]
	Perception-Driven Semi-Structured Boundary Vectorization Shayan Hoshyari, Edoardo A. Dominici, Alla Sheffer, Nathan Carr, Duygu Ceylan, Zhaowen Wang, I-Chao Shen ACM Transaction on Graphics (Proceedings of SIGGRAPH 2018) a boundary vectorization approach leverages human perception of shapes to generate vector images consistent with viewer expectations [Project Page] [Paper] [bib]
	High-resolution 360 Video Foveated Stitching for Real-time VR Wei-Tse Lee, Hsin-I Chen, Ming-Shiuan Chen, I-Chao Shen, Bing-Yu Chen (*: joint first authors) Computer Graphics Forum (Proceedings of Pacific Graphics 2017) a real-time 360◦ video foveatedstitching framework [Paper] [Slide] [bib]
	A Scalable Active Framework for Region Annotation in 3D Shape Collections Li Yi, Vladimir G. Kim, Duygu Ceylan, I-Chao Shen, Mengyan Yan, Hao Su, Cewu Lu, Qixing Huang, Alla Sheffer, Leonidas Guibas ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2016) a novel active learning method capable of enriching massive geometric datasets with accurate semantic region annotations [Project page] [Paper] [Supplemental] [bib]
	Retargeting 3D Objects and Scenes with a General Framework Chun-Kai Huang, Yi-Ling Chen, I-Chao Shen, Bing-Yu Chen Computer Graphics Forum (Proceedings of Pacific Graphics 2016) an interactive method suitable for retargeting both 3D objects and scenes [Project page] [Paper] [Supplemental] [Slide] [bib]
	Data-driven Handwriting Synthesis in a Conjoined Manner Hsin-Yi Chen, Tse-Ju Lin, I-Chao Shen, Bing-Yu Chen Computer Graphics Forum (Proceedings of Pacific Graphics 2015) a novel method for synthesizing handwritten text according to the writer’s style while considering characters’ conjoined property [Project page] [Paper] [Slide] [bib]
	Gestalt Rule Feature Points I-Chao Shen, Wen-Huang Cheng IEEE Transactions on Multimedia (TMM), volume 17, number 4, page 526-537, April 2015. a new approach for detecting reliable visual features from images in different visual styles (e.g., a photo and a painting) [Paper] [Digital Library] [bib]
	Geometrically Consistent Stereoscopic Image Editing using Patch-based Synthesis Sheng-Jie Luo, Ying-Tse Sun, I-Chao Shen, Bing-Yu Chen, Yung-Yu Chuang, IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol.21, No. 1, pp. 56-67, January 2015. a patch-based synthesis framework for stereoscopic image editing problems, including depth-guided texture synthesis, stereoscopic NPR, paint by depth, content adaptation, and 2D to 3D conversion [Project Page] [Paper] [Digital Library] [bib]
	Stroke-guided Image Synthesis for Skeletal Structure Editing Sheng-Jie Luo, Chin-Yu Lin, I-Chao Shen, Bing-Yu Chen, Computer Graphics Forum (Pacific Graphics 2013) a technique for synthesizing image objects with different skeletal structures while respecting to an input image object [Project Page] [Paper] [Slide] [Digital Library] [bib]
	Perspective-Aware Warping for Seamless Stereoscopic Image Cloning Sheng-Jie Luo, I-Chao Shen, Bing-Yu Chen, Wen-Huang Cheng, Yung-Yu Chuang, SIGGRAPH ASIA 2012 a novel technique for seamless stereoscopic image cloning, which performs both shape adjustment and color blending [Project Page] [Paper] [Digital Library] [bib]

Short Paper, Poster, and Demo

	Designing Reconfigurable Joints Atsushi Maruyama, Maria Larsson, I-Chao Shen, Takeo Igarashi SIGGRAPH ASIA 2024 Technical Communication [paper]
	DualAvatar: Robust Gaussian Splatting Avatar with Dual Representation Jinsong Zhang, I-Chao Shen, Jotaro Sakamiya, Yu-Kun Lai, Takeo Igarashi, Kun Li SIGGRAPH 2024 Poster [paper] [poster]
	Generating Font Variations Using Latent Space Trajectory Sotaro Kanazawa, I-Chao Shen, Yuki Tatsukawa, Takeo Igarashi SIGGRAPH 2024 Poster [paper] [poster]
	Real-Time Virtual Try-On Using Generative AI Zaiqiang Wu, I-Chao Shen, Yuki Shibata, Takayuki Hori, Mengjia Jin, Wataru Kubo, Takeo Igarashi SIGGRAPH 2024 Real-Time Live!
	3D Reconstruction from Sketch with Hidden Lines by Two-Branch Diffusion Model Yuta Fukushima, Anran Qi, I-Chao Shen, Yulia Gryaditskaya, Takeo Igarashi Eurographics 2024 Short Paper [paper]
	MicroGlam: Microscopic Skin Image Dataset with Cosmetics Toby Chong, Alina Chadwick, I-Chao Shen, Haoran Xie, Takeo Igarashi SIGGRAPH ASIA 2023 Technical Communication [paper]
	Computational Design of Nebuta-like Paper-on-Wire Artworks Naoki Agata, Anran Qi, Yuta Noma, I-Chao Shen, Takeo Igarashi SIGGRAPH 2023 Poster [paper] [poster]
	Palette-Based Colorization for Vector Icons Miao Lin, I-Chao Shen, Hsiao-Yuan Chin, Ruo-Xi Chen, Bing-Yu Chen SIGGRAPH 2023 Poster [paper] [poster]
	OVERPAINT: Automatic Multi-Layer Stencil Generation without Bridges Yuta Fukushima, Anran Qi, I-Chao Shen, Takeo Igarashi SIGGRAPH ASIA 2022 Technical Communication [paper]
	Guided Image Weathering using Image-to-Image Translation Li-Yu Chen, I-Chao Shen, Bing-Yu Chen SIGGRAPH ASIA 2021 Technical Communication [paper] [presentation video]
	Real-time Image-based Virtual Try-on with Measurement Garment Toby Chong, I-Chao Shen, Yunfei Qian, Nobuyuki Umetani, Takeo Igarashi SIGGRAPH ASIA 2021 Emerging Technologies [paper]
	User-Assisted Disparity Maps Hsin-Yi Chen, Yi-Shan Lin, I-Chao Shen, Sheng-Jie Luo, Wen-Huang Cheng, Bing-Yu Chen, Pacific Graphics 2012 Short Paper an intuitive and efficient system for correcting the artifacts and noises caused by imperfect disparity estimation [project Page] [paper] [bib]

Domestic (Japan) Papers and Posters

Human-in-the-loopによる3D Gaussian Splattingのゴミ除去手法, 坂宮丞太郎, Jinsong Zhang, I-Chao Shen, Takeo Igarashi. VC 2024 Paper (ショート発表) [paper]

自己教師あり学習を用いたモーションの連続性の学習, Naoki Agata, I-Chao Shen, Takeo Igarashi. VC 2024 Paper (ロング発表) [paper]

「ねぶた風紙細工」をデザインするためのアルゴリズム, Naoki Agata, Anran Qi, Yuta Noma, I-Chao Shen, Takeo Igarashi. VC 2023 Paper (ロング発表) [paper]

タイポグラフィに特化した視覚言語モデル, 裕貴立川, 奕超沈, 安然祁, 裕己小山, 健夫五十嵐, and アリエルシャミール. VC 2023 Paper (ショート発表) [paper]

OVERPAINT: 橋を用いない多層ステンシルの自動生成, Yuta Fukushima, Anran Qi, I-Chao Shen, Takeo Igarashi. VC 2022 Poster [paper] [poster]