Real-Time WebRTC based Mobile Surveillance System

  • Alistair Baretto Student, Department of Computer Engineering, Fr. C. Rodrigues Institute of Technology, Navi Mumbai, INDIA
  • Noel Pudussery Student, Department of Computer Engineering, Fr. C. Rodrigues Institute of Technology, Navi Mumbai, INDIA
  • Veerasai Subramaniam Student, Department of Computer Engineering, Fr. C. Rodrigues Institute of Technology, Navi Mumbai, INDIA
  • Amroz Siddiqui Assistant Professor, Department of Computer Engineering, Fr. C. Rodrigues Institute of Technology, Navi Mumbai, INDIA
Keywords: Computer Vision, Deep learning, WebRTC, YOLO, Android Development, REST API, STUN/TURN, Surveillance

Abstract

The rapid growth that has taken place in Computer Vision has been instrumental in driving the advancement of Image processing techniques and drawing inferences from them. Combined with the enormous capabilities that Deep Neural networks bring to the table, computers can be efficiently trained to automate the tasks and yield accurate and robust results quickly thus optimizing the process. Technological growth has enabled us to bring such computationally intensive tasks to lighter and lower-end mobile devices thus opening up a wide range of possibilities. WebRTC-the open-source web standard enables us to send multimedia-based data from peer to peer paving the way for Real-time Communication over the Web. With this project, we aim to build on one such opportunity that can enable us to perform custom object detection through an android based application installed on our mobile phones. Therefore, our problem statement is to be able to capture real-time feeds, perform custom object detection, generate inference results, and appropriately send intruder alerts when needed. To implement this, we propose a mobile-based over-the-cloud solution that can capitalize on the enormous and encouraging features of the YOLO algorithm and incorporate the functionalities of OpenCV’s DNN module for providing us with fast and correct inferences.  Coupled with a good and intuitive UI, we can ensure ease of use of our application.

Downloads

Download data is not yet available.

References

Santos-González I, Rivero-García A, Molina-Gil J, & Caballero-Gil P. (2017). Implementation and analysis of real-time streaming protocols. Sensors (Basel), 17(4), 846. DOI: 10.3390/s17040846.

Limi Kalita. (2014). Socket programming. International Journal of Computer Science and Information Technologies, 5(3), 4802-4807.

Q. Mao, H. Sun, Y. Liu, & R. Jia. (2019). Mini-YOLOv3: Real-time object detector for embedded applications. In: IEEE Access, 7, 133529-133538. DOI: 10.1109/ACCESS.2019.2941547.

Real Time Transport Protocol (RTP). Available at: https://www.geeksforgeeks.org/real-time-transport-protocol-rtp/.

Real-time communication for the web. Available at: https://webrtc.org/.

PeerJS Docs. Available at: https://peerjs.com/docs.html#start.

Srujan Patel, Naeem Patel, Siddesh Deshpande, & Amroz Siddiqui. (2021). Ship intrusion detection system with YOLO algorithm. International Research Journal of Engineering and Technology (IRJET), 8(1).

Andrei Costin. (2016). Security of CCTV and video surveillance systems: Threats, vulnerabilities, attacks, and mitigations. In: Proceedings of the 6th International Workshop on Trustworthy Embedded Devices (TrustED '16). Association for Computing Machinery, New York, NY, USA, pp. 45–54. DOI: https://doi.org/10.1145/2995289.2995290.

W. Thomas & R. D. Daruwala. (2014). Performance comparison of CPU and GPU on a discrete heterogeneous architecture. International Conference on Circuits, Systems, Communication and Information Technology Applications (CSCITA), Mumbai, India, pp. 271-276. DOI: 10.1109/CSCITA.2014.6839271.

Mahankali, Naveen Kumar & Ayyasamy, Vadivel. (2015). OpenCV for computer vision applications.

Ahmad, Tanvir, MA, Yinglong, Yahya, Muhammad, Ahmad, Belal, Nazir, Shah, Haq, Amin, & Ali, Rahman. (2020). Object detection through modified YOLO neural network. scientific programming. DOI: 10.1155/2020/8403262.

D. Steinkraus, I. Buck, & P. Simard. (2005). Using gpus for machine learning algorithms. Available at: https://hgpu.org/?p=1223.

G. Bradski & A. Kaehler. (2008). Learning OpenCV: Computer vision with the OpenCV library. O’Reilly Media, Inc.

J. Redmon & A. Farhadi. (2018). Yolov3: An incremental improvement. arXiv preprint: arXiv:1804.02767.

Neumann, Andy, Laranjeiro, Nuno, & Bernardino, Jorge. (2018). An analysis of public REST web service APIs. IEEE Transactions on Services Computing, pp. 1-1. DOI: 10.1109/TSC.2018.2847344.

Chaitanya Mukund Kulkarni & Prof. M. S. Takalikar. (2018). Analysis of REST API implementation. International Journal of Scientific Research in Computer Science, Engineering and Information Technology (IJSRCSEIT). 3(5).

Peng Liang & Yang Shun. (2010). Research and implementation of voice transmission based on RTP protocol. International Conference on Computational Problem-Solving, Li Jiang, China, pp. 416-419.

S. Delcev & D. Draskovic. (2018). Modern java script frameworks: A survey study. Zooming Innovation in Consumer Technologies Conference (ZINC), Novi Sad, Serbia, pp. 106-109. DOI: 10.1109/ZINC.2018.8448444.

J. Liu & J. Yu. (2011). Research on development of android applications. In: 4th International Conference on Intelligent Networks and Intelligent Systems, Kuming, China, pp. 69-72. DOI: 10.1109/ICINIS.2011.40.

S. Tilkov & S. Vinoski. (2010). Node.js: Using JavaScript to build high-performance network programs. In: IEEE Internet Computing, 14(6), 80-83. DOI: 10.1109/MIC.2010.145.

M. Kuhara, N. Amano, K. Watanabe, Y. Nogami, & M. Fukushi. (2014). A peer-to-peer communication function among web browsers for web-based volunteer computing. In: 14th International Symposium on Communications and Information Technologies (ISCIT), Incheon, Korea (South), pp. 383-387. DOI: 10.1109/ISCIT.2014.7011937.

Rosenberg, J. (2010). Traversal using relays around NAT (TURN): Relay extensions to session traversal utilities for NAT (STUN). Available at: https://tools.ietf.org/id/draft-ietf-behave-turn-05.html.

Published
2021-06-02
How to Cite
Alistair Baretto, Noel Pudussery, Veerasai Subramaniam, & Amroz Siddiqui. (2021). Real-Time WebRTC based Mobile Surveillance System. International Journal of Engineering and Management Research, 11(3), 30-35. https://doi.org/10.31033/ijemr.11.3.4