[Personal Information][Research Interests][Actvities][Skills][Projects][Publications]

 

Personal Information

Name:
Sehwan Kim
Birthday:
Sept. 15. 1975.
Affiliation:
UCSB Four Eyes Lab.
Address:
Computer Science Department, University of California, Santa Barbara, CA 93106-5110, USA
Phone:
+1-805-893-4400
Fax:
+1-805-893-8553
Email:
skim_at_cs.ucsb.edu or sehnkim_at_gmail.com
Web:
http://www.cs.ucsb.edu/~skim/

 

Educational Background

Ph.D. in Dept. of Info. & Comm. (DIC), 2006
 
Gwangju Institute of Science and Technology (GIST), Gwangju, Korea
Advisor: Prof. Woontack Woo
Dissertation: Indoor Scene 3D Reconstruction Using Depth and Color Images
M.S. in Dept. of Info. & Comm. (DIC), 2000
 
Gwangju Institute of Science and Technology (GIST), Gwangju, Korea
Advisor: Prof. Yo-Sung Ho
Thesis: A Study on Illumination Adaptive Face Detection and Feature Extraction
B.S. in Dept. of Electronic Engineering (EE), 1998
 
University of Seoul (UOS), Seoul, Korea

 

Research Experiences

Oct. 2006 - Current

Post-Doctoral Researcher in Four Eyes Lab., Dept of Computer Science, Univ. of California, Santa Barbara, CA 93106-5110, USA.

  • Advisor: Prof. Tobias Hollerer
  • Investigating registration and interaction techniques for Mobile Augmented Reality System (MARS) based on the concept "Anywhere Augmentation".
Mar. 2006 - Sept. 2006

Post-Doctoral Researcher in Culture Technology Research Center (CTRC), Gwangju Institute of Science and Technology (GIST), Gwangju, Korea.

  • Advisor: Prof. Woontack Woo
  • Investigating super-resolution photo-realistic 3D scene reconstruction techniques.
Mar. 2001 - Feb. 2006

Research Assistant in U-VR Lab., Dept. of Info. & Comm. (DIC), Gwangju Institute of Science and Technology (GIST), Gwangju, Korea.

  • Advisor: Prof. Woontack Woo
  • Investigated registration and integration techniques for a photo-realistic 3D scene reconstruction.
  • Investigated multi-modal full-body interaction algorithms, based on disparity and motion information, in real-time.
  • Investigated object-tracking algorithms with asynchronous digital cameras.
  • Developed 3D vision-based natural interaction algorithms for Augmented Reality (AR) systems.
Mar. 1998 - Feb. 2001

Research Assistant in Visual Communication Lab., Dept. of Info. & Comm. (DIC), Gwangju Institute of Science and Technology (GIST), Gwangju, Korea.

  • Advisor: Prof. Yosung Ho
  • Investigated image retrieval algorithms based on color/texture/shape etc.
  • Investigated face detection and feature extraction algorithms.
  • Developed early vision algorithms: edge detection, motion estimation, stereo vision, etc.
  • Developed various image/video coding algorithms, which include transform, quantization, and entropy coding.
  • JPEG, MPEG-1, -2, -4, -7, H. 261, H. 263, etc.

 

Research Interests

  • Virtual/Mixed Reality
  • 3D vision-based pi-VE (Photo-realistic Interactive Virtual Environment) Generation
  • 3D Computer Vision, Image Processing and Its Applications including Attentive AR and Mediated Reality (MR)
  • 3D Vision-based HCI (Face Detection and Tracking, Full-body Interaction)
  • Super-resolution 3D Surface Generation

 

Teaching Experiences

  • Teaching Assistant, 2005 Fall, Image-based Rendering (Prof. Jongwon Lee, Sejong Univ.), Dept. of Info. & Comm., GIST.
  • Teaching Assistant, 2005 Spring, Wearable Augmented Reality (Prof. Jongwon Lee, Sejong Univ.), Dept. of Info. & Comm., GIST.
  • Teaching Assistant, 2004 Winter, Geometric Computational 3D Vision (Prof. Yongduek Seo, Sogang Univ.), Dept. of Info. & Comm., GIST. (Textbook: R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, March 2004.)
  • Teaching Assistant, 2004 Fall, Augmented Reality (Prof. Jongwon Lee, Sejong Univ.), Dept. of Info. & Comm., GIST.
  • Teaching Assistant, 2004 Spring, Human Computer Interaction (Prof. Woontack Woo), Dept. of Info. & Comm., GIST.
  • Teaching Assistant, 2003 Spring, Random Process (Prof. Woontack Woo), Dept. of Info. & Comm., GIST.
  • Teaching Assistant, 2002 Spring, Human Computer Interaction (Prof. Woontack Woo), Dept. of Info. & Comm., GIST.
  • Grader, 2000 Spring, Digital Signal Processing (Prof. Yo-Sung Ho), Dept. of Info. & Comm., GIST.

 

Professional Activities, Honors and Awards

  • Steering Committee Member: The 5th International Symposium on Ubiquitous VR 2007
  • General Co-Chair: The 4th International Symposium on Ubiquitous VR 2006
  • Technical Program Committee (TPC) Member: TSI 2006 Workshop in Pervasive 2006
  • Reviewer of Machine Vision and Applications (MVA) Journal (Springer) (2006 - Current)
  • Reviewer of International Symposium on Ubiquitous Computing Systems 2006
  • Reviewer of IEICE Trans. on Information and Systems (2005 - Current)
  • Jan. 2002 - Current Student member of SPIE
  • Jan. 2002 - Current Student member of IEEK
  • Aug. 2001 - Current Student member of IEEE
  • Sept. 2002 Student Volunteer, VSMM Conference, Gyungju, Korea
  • Jan. 2002 Award in Public Subscription of Thesis for Activating S/W Industry in Gwangju, Korea IT Industry Promotion Agency (KIPA), Gwangju, Korea.
  • June 2001 - Aug. 2001 Summer Sessions Student at University of California at Berkeley (UCB), Taken Classes: Scheme Language (Dept. of Computer Science), Technical Writing

 

Scholarships

  • Oct. 2006 - Sept. 2007 Scholarship from Korea Research Foundcation (KRF)
  • Mar. 2000 - Feb. 2004 Scholarship from Korean Government
  • Mar. 1998 - Feb. 2000 Scholarship from Korean Government

 

Software and Hardware Skills

  • Programming Languages: C/C++, Visual C++, MS Access, Matlab, HTML, UNIX, Scheme
  • Image/Vision/VR Libraries: MFC (Microsoft Foundation Class), OpenGL, OpenGL Performer, OpenCV (Intel Computer Vision Library), IPL (Intel Image Processing Library), CAVELib
  • Software Tools: MS Office, Latex, Maya, GeoMagic, Photoshop, Premiere
  • Operating Systems: Linux, DOS, MS Windows
  • Image/Vision System Interfaces: IEEE1394 cameras, USB cameras, Point Grey Cameras (Digiclops, Bumblebee, Ladybug, Firefly, Dragonfly, Flea)

 

Projects

Oct. 2006 - Current

(FTTH, ETRI) Development of Immersive Media Contents Generation Platform for FTTH Subscribers (2nd Year/4 Years)

  • Role: Project Member
  • Task: To generate a super-resolution 3D surface by integrating multiple 3D point clouds, acquired from several viewpoints, using a Bayesian method.
July 2005 - Dec. 2005

(FTTH, ETRI) Development of Immersive Media Contents Generation Platform for FTTH Subscribers (1st Year/4 Years)

  • Role: Project Member
  • Task: To integrate multiple 3D point clouds, acquired from several viewpoints, into a single 3D point cloud using color and depth information by minimizing an energy function that consists of data and smoothness terms in both 2D and 3D spaces.
Aug. 2004 - July 2005

(ITRC, IITA) Research on Realistic Digital Broadcasting Technology (2nd Year/2 Years)

  • Role: Project Leader
  • Task: To develop registration and integration algorithms to reconstruct an indoor scene by a projection technique of a 3D point cloud onto virtual image planes through camera projection matrices (Initial camera poses are calculated using a camera calibration algorithm)
Aug. 2003 - July 2004

(ITRC, IITA) Research on Realistic Digital Broadcasting Technology (1st Year/2 Years)

  • Role: Project Leader
  • Task: To develop a depth image refinement technique using spatio-temporal properties of 3D point clouds which are acquired by projecting a specially-designed pattern on an indoor environment using a projection equipment.
June 2003 - Nov. 2003
(ETRI) Image-based Panoramic 3D VE Generation, Modeling, and 3D HMD Display
  • Role: Project Leader
  • Task: To develop a stitching algorithm to generate a 3D virtual environment by moving a mobile robot on which one multi-view camera is attached.
May 2002 - Nov. 2002

(ETRI) Panoramic 3D VE Generation using Multi-view Images

  • Role: Project Leader
  • Task: To develop a stitching algorithm to generate a 3D virtual environment by rotating two multi-view cameras, on a long bar, using a turntable.
Jan. 2002 - Dec. 2002

(GIST) A Study on the Vision-based 3D Interface for Human-Computer Interaction II

  • Role: Project Leader
  • Task: To track a human body and two markers attached to a stick which is grasped by a user, and develop 3D vision-based natural interaction algorithms for fighting with an intelligent virtual avatar.
Jan. 2001 - Dec. 2001

(GIST) A Study on the Vision-based 3D Interface for Human-Computer Interaction I

  • Role: Project Leader
  • Task: To generate an invisible 3D space sensor in a real environment, and develop a 3D vision-based natural interaction algorithms for interacting with the 3D space sensor.

Publications

International Papers

  • S. Kim, Y. Suh, Y. Lee and W. Woo, "U-VR: When VR Meets ubiComp", The 4th International Symposium on ubiquitous VR, pp. 1-4, July 16-10, 2006.
  • S. Kim, Y. Lee and W. Woo, "How to Realize Ubiquitous VR?," The 3rd International Workshop on the Tangible Space Initiative: TSI 2006 in conjunction with Pervasive 2006, pp. 493-504, May 7-10, 2006.
  • S. Kim and W. Woo, "Panoramic 3D Reconstruction of an Indoor Scene Using A Multi-view Camera," 12th Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV2006), pp. 25-30, Feb. 2-3, 2006.
  • S. Kim and W. Woo, "Registration of partial 3D point clouds acquired from a multi-view camera for indoor scene reconstruction," IEICE Trans. on Information and Systems, Vol. E89-D, No. 1, pp. 62-72, 2006.
  • J. Cha, S-M. Kim, S-Y. Kim, S. Kim, S. Yoon, I. Oakley, J. Ryu, K. Lee, W. Woo and Y-S. Ho, "Client System for Realistic Broadcasting: A First Prototype," Lecture Notes in Computer Science, vol. 3768, pp. 176-186, Nov. 13-16, 2005.
  • S. Kim and W. Woo, "Indoor Scene Reconstruction using a Projection-based Registration Technique of Multi-view Depth Images," Lecture Notes in Computer Science, vol. 3768, pp. 759-771, Nov. 13-16, 2005.
  • S. Kim and W. Woo, "Projection-based Registration Using a Multi-view Camera for Indoor Scene Reconstruction," Proc. of 3-D Digital Imaging and Modeling (3-DIM), pp. 484-491, June. 13-17, 2005.
  • M. Lee, S. Kim and W. Woo, "A 3D Vision-based Interaction Method with a Simplified Hand Model," 11th Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV2005), pp. 148-153, Feb. 27 - 28, 2005.
  • S. Jang, S. Kim and W. Woo, "When VR meets UbiComp," The Third Young Investigator's Forum in Virtual Reality, Feb. 24-26, 2005. (CD Proceedings)
  • S. Kim, K. Kim and W. Woo, "Projection-based Registration using Color and Texture Information for Virtual Environment Generation," Lecture Notes in Computer Science, vol. 3331, pp. 434-443, Nov. 30 - Dec. 3, 2004.
  • S. Kim , E. Chang, C. Ahn and W. Woo, "Image-based Panoramic 3D Virtual Environment Using Rotating two Multi-view Cameras," IEEE Proc. ICIP2003 , vol. 1, pp. 917-920, Sept. 14-17, 2003.
  • J. Yoon, S. Kim, J. Ryu and W. Woo, "Multimodal Gumdo Simulation: The Whole Body Interaction with an Intelligent Cyber Fencer," Lecture Notes in Computer Science, vol. 2532, pp. 1088-1095, Dec. 16, 2002.
  • J. Yoon, S. Kim, J. Ryu and W. Woo, "An Immersive Kendo (Gum-do) Game with an Intelligent Cyber-Fighter," Proc. of VRAI02, pp. 400-407, Apr. 9, 2002.
  • S. Kim and W. Woo, "3D Movement Tracking with Asynchronous Digital Cameras for Interactive Systems," Proc. of SPIE PW-EI-VCIP'02, vol. 4671, pp. 502-512, Jan. 2002.
  • S. Kim, W. Woo and Y. Ho, "Image Retrieval using Multi-Scale Color Clustering," IEEE Proc. ICIP2001, vol. I, pp. 666-669, Oct. 7-10, 2001.
  • S. Kim, W. Woo and Y. Ho, "Image Segmentation using Multi-Scale Color Clustering for Image Retrieval Systems," Proc. of ITC-CSCC2001, vol. II, pp. 889-982, July, 2001.
  • S. Kim and Y. Ho, "Illumination-Adaptive Face Detection and Facial Feature Extraction," Proc. of World Multiconference on SCI 2000, vol. 5, part 1, pp. 128-132, July 23-26, 2000.

 

Domestic Papers (In Korean)

  • S. Kim and W. Woo, "3D Scene Reconstruction Using Depth and Color Images," Journal of HCI Korea, pp. 58-66, May 25, 2006 (Invited Paper).
  • S. Kim and W. Woo, "Panoramic 3D Reconstruction of an Indoor Scene Using Depth and Color Images Acquired from A Multi-view Camera," Proc. of Korean HCI2006, Vol. 1, pp. 24-32, Feb. 3-6. 2006.
  • S. Kim and W. Woo, "Photo-realistic 3D Reconstruction of an Indoor Scene Using Registration and Integration Techniques," 18th Workshop on Image Processing and Image Understanding (IPIU06), pp. 262-267, Feb. 8-10, 2006.
  • S-Y. Kim, J. Cha, S-M. Kim, S. Kim, S. Yoon, J. Ryu, K. Lee, W. Woo and Y-S. Ho, "Immersive Contents Representation for the Client System of Realistic Broadcasting," Proc. of The Institute of Electronics Engineers of Korea (IEEK), pp. 18-22, Nov., 2005.
  • S. Kim and W. Woo, "Projection-based Registration Using Color and Depth Images for Indoor Scene Reconstruction," Journal of The Institute of Electronics Engineers of Korea (IEEK), vol. 42, pp. 39-52, Mar., 2005.
  • M. Lee, S. Kim and W. Woo, "Development of Natural Interaction-enabled AR-based Immersive Modeling Environment," Proc. of Korean HCI2005, pp. 263-268, Jan. 31 - Feb. 3, 2005.
  • S. Kim, K. Kim and W. Woo, "Multiple Camera Calibration for 3D Panoramic Virtual Environment," Journal of The Institute of Electronics Engineers of Korea (IEEK), vol. 41, pp. 137-148, Mar. 1, 2004.
  • S. Kim, K. Kim and W. Woo, "Depth-based Registration for 3D Panoramic Virtual Environment Generation," 16th Workshop on Image Processing and Image Understanding (IPIU04), pp. 129-134, Jan. 9-10, 2004.
  • K. Kim, S. Kim and W. Woo, "Multi-view Camera Calibration for 3D Panoramic Virtual Environment Generation," 16th Workshop on Image Processing and Image Understanding (IPIU04), pp. 154-159, Jan. 9-10, 2004.
  • K. Kim, S. Kim, J. Park and W. Woo, "Extrinsic calibration using a multi-view camera," Proc. of The Institute of Electronics Engineers of Korea (IEEK), vol. 26, no. 2, pp. 187-190, Nov. 29, 2003.
  • K. Kim, S. Kim and W. Woo, "Optimization Technique of Extrinsic Parameters using a Multi-view Camera," Proc. of The 2003 Korean Signal Processing Conference, vol. 16, no. 1. pp. 75-78, 2003.
  • J. Yoon, S. Kim , J. Ryu and W. Woo, "A Full Body Gumdo Game with an Intelligent Cyber Fencer using Multi-modal (3D Vision and Speech) Interface," Journal on Korea Information Science Society (KISS), vol. 9, no. 4, pp. 420-430, Aug., 2003.
  • S. Kim and W. Woo, "Research trend on 3D image-based immersive virtual environment generation techniques," Journal on Korea Information Processing Society (KIPS03), vol. 10, pp. 32-39, Jan. 1, 2003.
  • S. Kim and W. Woo, "Virtual Environment Generation using 3D Image-based Panorama," 15th Workshop on Image Processing and Image Understanding (IPIU03), pp. 111-116, Jan. 8-10, 2003.
  • S. Kim and W. Woo, "Image-based 3D Mosaicking using Multiple 3D Cameras," Proc. of the Korean Institute of Communication and Sciences (KICS02), vol. 26, pp. 58-61, Nov. 23, 2002.
  • J. Yoon, S. Kim, J. Ryu and W. Woo, "An Immersive Multi-modal Virtual Kendo (Gum-do) Game with an Intelligent Cyber Fighter," Proc. of Korean HCI, Feb. 2002. (CD Proceedings)
  • S. Kim, N. Zhang and W. Woo, "Wearable Data Retrieval System using 3D Vision-based HMD," Proc. of Korean HCI, Feb. 4-7, 2002.
  • S. Kim and Y. Ho, "Illumination-adaptive Face Detection and Facial Feature Extraction in Color Images," Proc. of The 1999 Korean Signal Processing Conference (KSPC), vol. 12, No. 1, pp. 1097-1100, Oct. 2, 1999.