Eyeball tracking and Object Detection in Smart Glasses

We have implemented a system that uses a micro camera to detect the central position of eyeball through smart glasses, tracks the area and position of the object seen from the smart glasses, and recognizes the object. Here, we use the MobileNet single shot detector and convolutional neural network model provided by the OpenCV library to detect the region and center position of the observed object. In the future, we will implement a smart communication system based on viewing communication that includes not only the information seen through smart glasses, but also traditional information exchange functions such as telephone, text message, and e-mail. Finally, what we aim for is to expect a new era of communication that allows users to communicate easily and conveniently with the observed object through the eye and intuitively with the observed object while the user is free to use their hands.