I-Chao Shen

ichao.shen@ui.is.s.u-tokyo.ac.jp

I am a project assistant professor (特任助教) at The University of Tokyo, working with Takeo Igarashi. My research focus on human-guided optimization, where I explore combinations between different human priors and numerical optimization and develop supportive system for visual content design.
C.V. | Google Scholar | Email

Publication

	360MVSNet: Deep Multi-view Stereo Network with 360° Images for Indoor Scene Reconstruction Ching-Ya Chiu, Yu-Ting Wu, I-Chao Shen, Yung-Yu Chuang to appear in IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2023 (Algorithm Track) a deep learning network for multi-view stereo with 360° images. [project page] [paper] [supplemental material]
	StyleFaceUV: a 3D Face UV Map Generator for View-Consistent Face Image Synthesis Wei-Chieh Chung^, Jian-Kai Zhu^, I-Chao Shen, Yu-Ting Wu, Yung-Yu Chuang (*: joint first authors) to appear in British Machine Vision Conference (BMVC) 2022 an approach for generating detailed 3D faces using a pre-trained StyleGAN2 model. [project page] [paper] [supplemental material]
	NeRF-In: Free-Form NeRF Inpainting with RGB-D Priors Hao-Kang Liu^, I-Chao Shen^, Bing-Yu Chen (*: joint first authors) arXiv, 2022 an optimization framework that enables users to remove unwanted objects or retouch undesired regions in a 3D scene represented by a pre-trained NeRF [project page] [arxiv]
	AutoPoly: Predicting a Polygonal Mesh Construction Sequence from a Silhouette Image I-Chao Shen, Yu Ju (Edwin) Chen, Oliver van Kaick, Takeo Igarashi arXiv, 2022 a hybrid method that generates a polygonal mesh construction sequence from a silhouette image [project page] [arxiv]
	ODEN: Live Programming for Neural Network Architecture Editing Chunqi Zhao, I-Chao Shen, Tsukasa Fukusato, Jun Kato, Takeo Igarashi In Proceedings of 26th International Conference on Intelligent User Interfaces (IUI 2022), Online, 2022.03.22-25. a intelligent neural network architecture editing system using live programming techniques [project page] [paper] [demo video] [presentation video]
	StylePart: Image-based Shape Part Manipulation I-Chao Shen, Li-Wen Su, Yu-Ting Wu, Bing-Yu Chen arXiv, 2021 a shape-consistent latent mapping function that connects the image generative latent space and the 3D man-made shape attribute latent space [project page] [arxiv]
	Per Garment Capture and Synthesis for Real-time Virtual Try-on Toby Chong, I-Chao Shen, Nobuyuki Umetani, Takeo Igarashi in proceeding of User Interface Software and Technology (UIST) 2021 a real-time virtual try-on using per garment capture and synthesis workflow [project page] [paper] [video] [arxiv] [UTokyo english press] [Science Japan (JST)]
	Data-driven Sketch Beautification with Neural Feature Representation I-Chao Shen IEEE Computer Graphics and Applications (CG&A) 2021 a data-driven approach for beautifying freehand sketches [project page] [paper]
	Multi-Resolution Shared Representative Filtering for Real-Time Depth Completion Yu-Ting Wu, Tzu-Mao Li, I-Chao Shen, Hong-Shiang Lin, Yung-Yu Chuang High-Performance Graphics (HPG) 2021 a real-time depth completion algorithm which can effectively handle large missing regions of depth maps [project page] [paper]
	ClipGen: A Deep Generative Model for Clipart Vectorization and Synthesis I-Chao Shen, Bing-Yu Chen Transaction on Visualization and Computer Graphics (TVCG), 2021 a novel deep learning-based approach for automatically vectorizing and synthesizing the clipart of man-made objects [project page] [paper] [arxiv]
	ClipFlip : Multi-view Clipart Design I-Chao Shen, Kuan-Hung Liu, Li-Wen Su, Yu-Ting Wu, Bing-Yu Chen Computer Graphics Forum, Volume 40, Issue 1, Feb 2021 an assistive system for clipart design by providing visual scaffolds from the unseen viewpoints [project page] [paper] [supplemental material] [arxiv]
	Interactive Optimization of Generative Image Modeling using Sequential Subspace Search and Content-based Guidance Toby Chong Long Hin^, I-Chao Shen^, Issei Sato, Takeo Igarashi (*: joint first authors) Computer Graphics Forum, Volume 40, Issue 1, Feb 2021 a human-in-the-optimization method that allows users to directly explore and search the latent vector space of generative image modeling [project page] [paper] [arxiv]
	ZomeFab: Cost-effective Hybrid Fabrication with Interior Zometool Structure I-Chao Shen, Ming-Shiuan Chen, Chun-Kai Huang, Bing-Yu Chen Computer Graphics Forum, Volume 39, Issue 1, Feb 2020 a hybrid 3D fabrication method that combines 3D printing and the Zometool construction set to achieve compact fabrication [project page] [paper] [arxiv]
	Transferring Deep Reinforcement Learning with Adversarial Objective and Augmentation I-Chao Shen, Shu-Hsuan Hsu, Bing-Yu Chen to appear in IJCAI-PRICAI 2020 Workshop on Knowledge Based Reinforcement Learning (KBRL) a semi-supervised transfer learning method for deep reinforcement learning [paper][arXiv] [present video]
	Director-360: Introducing Camera Handling to 360 Cameras Hao-Juan Huang, I-Chao Shen, Liwei Chan in proceeding of MobileHCI 2020 [paper]
	Perception-Driven Semi-Structured Boundary Vectorization Shayan Hoshyari, Edoardo A. Dominici, Alla Sheffer, Nathan Carr, Duygu Ceylan, Zhaowen Wang, I-Chao Shen ACM Transaction on Graphics (Proceedings of SIGGRAPH 2018) a boundary vectorization approach leverages human perception of shapes to generate vector images consistent with viewer expectations [Project Page] [Paper] [Bib]
	High-resolution 360 Video Foveated Stitching for Real-time VR Wei-Tse Lee, Hsin-I Chen, Ming-Shiuan Chen, I-Chao Shen, Bing-Yu Chen (*: joint first authors) Computer Graphics Forum (Proceedings of Pacific Graphics 2017) a real-time 360◦ video foveatedstitching framework [Paper] [Slide] [Bib]
	A Scalable Active Framework for Region Annotation in 3D Shape Collections Li Yi, Vladimir G. Kim, Duygu Ceylan, I-Chao Shen, Mengyan Yan, Hao Su, Cewu Lu, Qixing Huang, Alla Sheffer, Leonidas Guibas ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2016) a novel active learning method capable of enriching massive geometric datasets with accurate semantic region annotations [Project page] [Paper] [Supplemental] [Bib]
	Retargeting 3D Objects and Scenes with a General Framework Chun-Kai Huang, Yi-Ling Chen, I-Chao Shen, Bing-Yu Chen Computer Graphics Forum (Proceedings of Pacific Graphics 2016) an interactive method suitable for retargeting both 3D objects and scenes [Project page] [Paper] [Supplemental] [Slide] [Bib]
	Data-driven Handwriting Synthesis in a Conjoined Manner Hsin-Yi Chen, Tse-Ju Lin, I-Chao Shen, Bing-Yu Chen Computer Graphics Forum (Proceedings of Pacific Graphics 2015) a novel method for synthesizing handwritten text according to the writer’s style while considering characters’ conjoined property [Project page] [Paper] [Slide] [Bib]
	Gestalt Rule Feature Points I-Chao Shen, Wen-Huang Cheng IEEE Transactions on Multimedia (TMM), volume 17, number 4, page 526-537, April 2015. a new approach for detecting reliable visual features from images in different visual styles (e.g., a photo and a painting) [Paper] [Digital Library] [Bib]
	Geometrically Consistent Stereoscopic Image Editing using Patch-based Synthesis Sheng-Jie Luo, Ying-Tse Sun, I-Chao Shen, Bing-Yu Chen, Yung-Yu Chuang, IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol.21, No. 1, pp. 56-67, January 2015. a patch-based synthesis framework for stereoscopic image editing problems, including depth-guided texture synthesis, stereoscopic NPR, paint by depth, content adaptation, and 2D to 3D conversion [Project Page] [Paper] [Digital Library] [Bib]
	Stroke-guided Image Synthesis for Skeletal Structure Editing Sheng-Jie Luo, Chin-Yu Lin, I-Chao Shen, Bing-Yu Chen, Computer Graphics Forum (Pacific Graphics 2013) a technique for synthesizing image objects with different skeletal structures while respecting to an input image object [Project Page] [Paper] [Slide] [Digital Library] [Bib]
	Perspective-Aware Warping for Seamless Stereoscopic Image Cloning Sheng-Jie Luo, I-Chao Shen, Bing-Yu Chen, Wen-Huang Cheng, Yung-Yu Chuang, SIGGRAPH ASIA 2012 a novel technique for seamless stereoscopic image cloning, which performs both shape adjustment and color blending [Project Page] [Paper] [Digital Library] [Bib]

Short paper and Demo

	OVERPAINT: Automatic Multi-Layer Stencil Generation without Bridges Yuta Fukushima, Anran Qi, I-Chao Shen, Takeo Igarashi SIGGRAPH ASIA 2022 Technical Communication [paper] [presentation video]
	Guided Image Weathering using Image-to-Image Translation Li-Yu Chen, I-Chao Shen, Bing-Yu Chen SIGGRAPH ASIA 2021 Technical Communication [paper] [presentation video]
	Real-time Image-based Virtual Try-on with Measurement Garment Toby Chong, I-Chao Shen, Yunfei Qian, Nobuyuki Umetani, Takeo Igarashi SIGGRAPH ASIA 2021 Emerging Technologies [paper]
	User-Assisted Disparity Maps Hsin-Yi Chen, Yi-Shan Lin, I-Chao Shen, Sheng-Jie Luo, Wen-Huang Cheng, Bing-Yu Chen, Pacific Graphics 2012 Short Paper an intuitive and efficient system for correcting the artifacts and noises caused by imperfect disparity estimation [project Page] [paper] [bib]

Domestic (Japan) papers

OVERPAINT: 橋を用いない多層ステンシルの自動生成
Yuta Fukushima, Anran Qi, I-Chao Shen, Takeo Igarashi
VC 2022 Poster
[paper] [poster]