“Universal Media Book (UMB)” / The UMB is my Computer Science Master’s Thesis project from the University of Kentucky. The Universal Media Book is an integration of projected imagery with a physical book that acts as a tangible interface to multimedia data (images, videos and volumetric data). Using a camera projector pair, a tracking framework is presented wherein the 3D position of planar pages are monitored as they are turned back and forth by a user, and data is correctly warped and projected onto each page at interactive rates. In each frame, feature points are independently extracted from the camera and projector images, and matched in order to recover the geometry of the pages in motion.
(1) Offline calibration of projector and camera to world points (2) Page tracking framework (3) Volumetric data slicing tracking framework
(1) The result of feature detection in one frame (2) The result of matching four features between the projector image and its corresponding camera image for that frame
User slicing through volumetric data parallel to projector
User slicing through volumetric data at quite an oblique angle to the projector
User slicing through volumetric data while occluding part of the projected image
