Paper Title
Hidden Surface Removal in Augmented Reality: Hand Detection Using Color Information

Abstract
Augmented Reality (AR) is growing rapidly and enables to combine virtual information with the real environment in the real-time. Furthermore, in recent years, much attention has been focused on interaction techniques between users and virtual objects, such as the user directly manipulating virtual objects with his/her bare hands. Therefore, the authors believe that more accurate overlay techniques will be required to interact more seamlessly.On the other hand, in AR technology, since the 3-dimensional (3D) model is superimposed on the image of the real space afterwards, it is always displayed on the front side than the hand. Thus, it becomes an unnatural scene in some cases (occlusion problem).In this study, this system considers the object-context relations between the user's hand and the virtual object by acquiring depth information of the user's finger using a depth sensor.Moreover, by analyzing the color information in the vicinity of the position of the finger obtained from the depth sensor, and this system defines the color range of the user's hand. Then, this system extracts an area of the hand by using the definition of the color range of the user's hand.Furthermore, the fingers are distinguished by using the Canny method. In this way, this system realizes hidden surface removal along the area of the user's hand.In the evaluation experiment, it is confirmed that the hidden surface removal in this study make it possible to distinguish between finger boundaries and to clarify and process finger contours. Keywords - Occlusion Problem, Noise Removal, Canny Edge Detection, Image Processing, Histogram Processing.

Author - Ishizu Takahiro, Makoto Sakamoto, Kenji Sakoma

Published : Volume-7,Issue-2  ( Feb, 2020 )

	|		PDF	|	Viewed - 53	|	Published on 2020-04-17