Converting a DJI Tello Quadcopter into a Face-follower Machine Using the Haar Cascade with PID Controller

Authors

DOI:

https://doi.org/10.24086/cuesj.v7n2y2023.pp54-59

Keywords:

Backward/forward, DJI Tello, Haar Cascade, PID controller, Right/left, Tello drone

Abstract

Drones have been frequently used for photography in recent years at significantly cheaper rates. However, the most modern drones are exceedingly error-prone and require precise manual control to take high-quality photos or films. We suggest using the AI method of Haar cascades with a PID controller to give drones vision, enabling them to do autonomous tracking and detection. This project aims to improve photography fields. The proposed system tries to detect the face and track the person's movements. This system will help photographers and journalists upgrade their work, even if it is used in surveillance and the military. The algorithm's results show that the DJI Tello tiny drone's camera is capable of detecting and tracking faces. The micro drone was picked since it is lightweight and compact, making its use safe and enabling testing to take place inside. Additionally, the DJI Tello may be easily programmed using Python. The position of the drone is contrasted with the set point in the center of the image to identify errors, allowing control signals for calculating forward/backwards, right/left, and yaw movements. The proposed system results show that the drone can detect and track the face very well, and the PID values are stable.

Downloads

Download data is not yet available.

Author Biography

Shalaw M. Abdallah, Department Software Engineering, Koya University, Kurdistan, Iraq

Shalaw Abdallah is a  software engineer and an inbound marketer. He Has a master's degree in Computer science. His research interest is animation, animation studio and films.  

References

S. Han, W. Shen and Z. Liu. Deep Drone: Object Detection and Tracking for Smart Drones on Embedded System, 2016. Available from: https://web.stanford.edu/class/cs231a/prev_projects_2016/deepdrone-object 2_.pdf

T. Lee, S. Mckeever and J. Courtney. Flying free: A research overview of deep learning in drone navigation autonomy. Drones, vol. 52, p. 52, 2021.

K. Kakaes. From orville wright to september 11: What the history of drone technology says about its future. In: Drone Wars: Transforming Conflict, Law, and Policy, Cambridge University Press, Cambridge, pp359-387, 2015.

J. B. Song and S. K. Byun. Design and control of an omnidirectional mobile robot with steerable omnidirectional wheels. In: Mobile Robotics, Moving Intelligence. IntechOpen, London, 2006.

L. M. Sukma. Tracking Object based on GPS and IMU Sensor. In: 2018 5th International Conference on Information Technology, Computer, and Electrical Engineering (ICITACEE). IEEE, United States, 2018.

A. Laurell, E. Karlsson and Y. Naqqar. GPS and IMU Sensor Fusion to Improve Velocity Accuracy. Uppsala Universitet, Sweden, 2022.

C. Ye, S. Ma and L. Hui. An omnidirectional mobile robot. Science China Information Sciences, vol. 54, pp. 2631-2638, 2011.

F. G. Francois and S. M. Killough. A new family of omnidirectional and holonomic wheeled platforms for mobile robots. IEEE Transactions on Robotics and Automation, vol. 10, no. 4, pp. 480- 489, 1994.

K. G. Shanthi, S. S. Vidhya, K. Vishakha, S. Subiksha, K. K. Srija and R. S. Mamtha. Haar cascade face detection and local binary pattern histogram face recognition based drone. In: 2022 8th International Conference on Advanced Computing and Communication Systems (ICACCS). vol. 1. pp. 295-298, 2022.

A. P. Atmaja, S. B. Setyawan, L. D. Setia, S. V. Yulianto, B. Winarno and T. Lestariningsih. Face recognition system using micro unmanned aerial vehicle. Journal of Physics: Conference Series. vol. 1845, no. 1, p. 012043, 2021.

K. G. Shanthi and P. Sivalakshmi. Smart drone with real time face recognition. Materials Today: Proceedings, vol. 80, pp. 3212-321, 2023.

L. Wang and A. A. Siddique. Facial recognition system using LBPH face recognizer for anti-theft and surveillance application based on drone technology. Measurement and Control. vol. 53, no. (7-8), pp. 1070-1077, 2020.

B. Vergouw, H. Nagel, G. Bondt and B. Custers. Drone technology: Types, payloads, applications, frequency spectrum issues and future developments. In: The Future of Drone Use: Opportunities and Threats from Ethical and Legal Perspectives, Springer, Germany, pp. 21-45, 2016.

A. S. Priambodo, F. Arifin, A. Nasuha and A. Winursito. Face tracking for flying robot quadcopter based on haar cascade classifier and PID COntroller. Journal of Physics: Conference Series. vol. 2111, no. 1, p. 012046, 2021.

A. Kasinski and S. Adam. The architecture and performance of the face and eyes detection system based on the Haar cascade classifiers. Pattern Analysis and Applications, vol. 13, no. pp. 197- 211, 2010.

R. Lienhart, A. Kuranov and V. Pisarevsky. Empirical analysis of detection cascades of boosted classifiers for rapid object detection. In: Pattern Recognition: 25th DAGM Symposium, Magdeburg, Germany, September 10-12, 2003. Proceedings 25. Springer, Berlin, Heidelberg, 2003.

A. L. Salih, M. Moghavvemi, M. Haf and K. Gaeid. Flight PID controller design for a UAV quadrotor. Scientific Research and Essays, vol. 5, no. 23, pp. 3660-3667, 2010.

W. Raza, A. Osman, F. Ferrini and F. De Natale. Energy-efficient inference on the edge exploiting TinyML capabilities for UAVs. Drones, vol. 5, no. 4, p. 127, 2021.

G. C. Goodwin, S. F. Graebe and M. E. Salgado. Control system design. IEEE Control Systems, United States, 2007.

I. C. Pérez, D. Flores-Araiza, J. A. Fortoul-Díaz, R. Maximo and H. G. Gonzalez-Hernandez. Identification and PID control for a quadrocopter. In: 2014 International Conference on Electronics, Communications and Computers (CONIELECOMP). IEEE, United States. 2014.

W. Bolton. Programmable logic controllers fourth edition. In: Africa’s Potential for the Ecological Intensification of Agriculture, Elsevier, Amsterdam, 2006.

D. Nixon, A. Mironov, M. A. M. Martinez, J. Blackman, Codecae, B. Luckcuck, A. Christensen, D. Clifton, M. Keller, R. Coeffic and S. Windoffe. BetaFlight. Available from: https://github.com/betaflight/betaflight [Last accessed on 2022 Dec 20].

Downloads

Published

2023-12-20

How to Cite

1.
Abdallah SM. Converting a DJI Tello Quadcopter into a Face-follower Machine Using the Haar Cascade with PID Controller. Cihan U Erbil SCI J [Internet]. 2023 Dec. 20 [cited 2026 Jun. 23];7(2):54-9. Available from: https://journals.cihanuniversity.edu.iq/index.php/cuesj/article/view/1036

Issue

Vol. 7 No. 2 (2023)

Section

Research Article

License

Authors who publish with this journal agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License [CC BY-NC-ND 4.0] that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
Received 2023-10-02
Accepted 2023-11-12
Published 2023-12-20