Paper Title
3D Painting Using Inertial System and Monocular Vision for Localization of Handheld Controller in Virtual Reality

Abstract
The motivation for this research comes from Google Tilt Brush which is expensive for general people. That is why a concept which emphasize on the betterment of software than hardware is considered. We have worked on some problems like removing noise from sensor data, drift due to double integration and cost. People who have smart phone will be able to paint in virtual reality using cardboard and daydream of google without buying Oculus Rift and HTC Vive which are too costly for mass people. External sensors like satellite positioning sensor, barometer, laser, ultra- wideband system, ultrasonic positioning system are not being used. In this research, along with extended Kalman filter, Butterworth filter has been used to estimate position from 6-DOF (Degrees of Freedom) MEMS (Microelectromechanical Systems) sensor data. A monocular visual method, SLAM (Simultaneous Localization and Mapping), measures the distance or localization using smartphone camera in the controller application to eliminate drift. The painting application utilizes Google VR (Virtual Reality) Software Development Kit (SDK) with Unity3D engine. Experimental results reveal that proposed research can paint using virtual reality headset along with controller application using mobiles instead of external controller device i.e. Oculus Rift and HTC Vive with satisfactory precision rate. IndexTerms - 3D painting, extended Kalman filter, monocular SLAM, sensor, virtual reality.

Author - A.F.M. Saifuddin Saif, Shanjidah Akhter, Pahlwan Rabiul Islam, Latifun Ahsin Bhuiyaan, Mehedi Hasan

Published : Volume-5,Issue-3  ( Mar, 2018 )

	|		PDF	|	Viewed - 74	|	Published on 2018-04-27