Autonomous Vehicle and Augmented Reality Usage

  • Dr. Yusuf UZUN
  • Mehmet BİLBAN
Keywords: Augmented Reality, Deep Learning, Mobile Application, Autonomous Vehicle, TURKEY


With the development of autonomous development technology, the need for additional applications to be used inside and outside the vehicle is increasing. As a result of the literature review, many applications have been developed to display vehicle data directly on the monitor, with reflections on glass, and on hardware devices. These applications have been developed only for a defined problem and for a particular autonomous system. In this study, a basic autonomous vehicle software infrastructure and mobile Augmented Reality application that can work on Android devices have been developed. The Mobile Augmented Reality app serves inside and outside the vehicle. In addition, this application has been shown to support multiple autonomous system infrastructures.


[1] V. Rastogi. (2017). Virtual reality based simulation testbed for evaluation of autonomous vehicle behavior algorithms. A Thesis Presented to the Graduate School of Clemson University in Partial Fulfillment of the Requirements for the Degree Master of Science Computer Science. Clemson University.
[2] I. E.Sutherland. (1968). A head-mounted three dimensional display. In Proceedings of the AFIPS Fall Joint Computer Conferance, pp. 757–764.
[3] J. Fredriksson, B. Kulcsar, & J. Sjöberg. (2015). Proceedings of the 3rd international symposium on future active safety technology towards zero traffic accidents. Available at:
[4] MIT Racecar. (2017). MIT racecar mobile platform. Available:
[5] Openzeka. (2019). Openzeka online. Available at:
[6] ROS. (2019). Robot operating system. Available at:
[7] L. Joseph. (2018). Robot operating system for absolute beginners_ robotics programming made easy-apress. Available at:
[9] M. Bojarski et al. (2016). End to end learning for self-driving cars. Available at:
[10] Y. LeCun et al. (1989). Backpropagation applied to handwritten zip code recognition. Neural Computer, pp. 541–551.
[11] A. Krizhevsky, I. Sutskever, & G. E. Hinton. (2015). ImageNet classification with deep convolutional neural networks. Journal of Geotechnology and Geoenvironmental Engineering, 12, 04015009.
[12] K. Z. and D. D. T. Mariusz Bojarski, Ben Firner, Beat Flepp, Larry Jackel, & Urs Muller. (2016). End-to-end deep learning for self-driving cars. Available at:
[13] R. T.Azuma, (1997). Survey of augmented reality. Available at:
[14] J. Paulo Lima et al. (2017). Markerless tracking system for augmented reality in the automotive industry. Expert Systems with Applications, 82, 100–114.
[15] P. Khandelwal, P. Swarnalatha, N. Bisht, & S. Prabu. (2015). Detection of features to track objects and segmentation using grabcut for application in marker-less augmented reality. Procedia Computer Science, 58, 698–705.
[16] Android Developers. (2019). Android neural networks API. Available at:
[17] Arun Mani Sam. (2019). Developing SSD-Object detection models for android using tensorflow. Available at:
[18] L. Moroney. (2018). Using tensorflow lite on android. Available at:*Bt9qwKDjd1xi5RDd.
[19] TensorFlow. (2019). TensorFlow lite object detection. Available at:
How to Cite
Dr. Yusuf UZUN, & Mehmet BİLBAN. (2019). Autonomous Vehicle and Augmented Reality Usage. International Journal of Engineering and Management Research, 9(6), 39-43. Retrieved from