Attendance Authentication System Using Face Recognition
Attendance Authentication System Using Face Recognition
net/publication/341316377
CITATIONS READS
0 674
1 author:
Dr.Sabeenian R.S
Sona College of Technology
90 PUBLICATIONS 334 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Dr.Sabeenian R.S on 20 May 2020.
I. Introduction
Face recognition is a process, which uses biometrics to ascertain and endorse the presence of the face of a human
by mapping the facial features from the image or video. It compares the given face from the image with the dataset
available to obtain the recognition. The process involved in the face recognition is creation of dataset, detection
encoding and recognition.
Applications of face detection are in surveillance, tracking, photography etc. Dataset can be created through
webcam or can be stored manually. The process of face detection involves finding out the human face from the
image. The face detection algorithm attempts to detect eyes, eyebrows, mouth, nose, nostrils and iris. The facial
regions are summarized and validated to detect the face. Feature extraction is carried out in face encoding. Face
recognition comprises the process of identification and verification of face. In the identification process, the system
ascertains whether the person’s face is available in the database and in the verification process the system checks the
biometric profile available in the face print with the biometric profile of the given face captured live or through a
video. Face detection [1] can be knowledge based methods, feature invariant method, template matching method or
appearance based methods whereas the face recognition methods are, feature from global appearance like principal
component analysis (PCA) and independent component analysis (ICA), and features from local appearance like local
feature analysis or Gabor wavelet method. The other classification of face recognition is based on the similarity
measures with Euclidian distance in neural network. Now a day’s lots of hybrid methods are also developed for
better accuracy. The essential components of face recognition are illustrated with the block diagram given below.
DOI: 10.5373/JARDCS/V12SP4/20201599
ISSN 1943-023X 1235
Received: 20 Feb 2020/Accepted: 18 Mar 2020
Jour of Adv Research in Dynamical & Control Systems, Vol. 12, 04-Special Issue, 2020
Face recognition has eclectic application area like schools and college attendance authentication system, access
control, law enforcement, secure payment transaction, security, identification of criminal, unlocking of phone,
diagnoses of diseases, etc.
The second section of the paper illustrates, the different algorithms followed in attendance system with face
recognition. In the third section, various face detectors has been implemented and their comparisons has also been
enumerated. Further, recognition using CNN and LBPH has also been implemented. In the fourth section, classroom
attendance authentication system using face recognition has been proposed using raspberry pi 3 B+. APPACHE web
server is used for storing the MySQL database. Gmail is used for message transfer to parents. Further the confusion
matrix provides the classification report wherein the precision, recall, f1-score and accuracy are obtained on tested
datasets. The fifth section illustrates the results obtained in the face recognition. The concluding section gives the
summary of the proposed work with future plan.
DOI: 10.5373/JARDCS/V12SP4/20201599
ISSN 1943-023X 1236
Received: 20 Feb 2020/Accepted: 18 Mar 2020
Jour of Adv Research in Dynamical & Control Systems, Vol. 12, 04-Special Issue, 2020
The model proposed in paper [8] uses an improved AlexNet conventional Neural Network and webFace dataset.
In the model, face recognition and RFID card is used for capturing attendance. The campus card is used by the
student to allow only enrolled students in the class and prevent the other personnel to enter in class. After RFID
verification, the feature extraction is done which is compared with the image dataset and present is entered in the
excel sheet against the name of the student.
The system indicated in the paper [9] proposes a face recognition technique which uses an Arduino
microcontroller which compares the image with the available dataset. In this model, if the students go out of the class
then the attendance is put on hold for 15 minutes and attendance confirmation is done only if re-entry in the class is
done within the given time of 15 minutes. The attendance is captured periodically by checking the in-out time.
The system proposed in paper [10] uses three types of face recognition method such as Eigen face, Fisher face
and Local Binary Pattern. The mobile application prepared by the above mentioned models are used for students,
teacher and parents. All the three method has been tested for different Euclidian distance and the accuracy rate is
analyzed.
The system proposed in [11] uses a face recognition model which is integrated as face recognition API with
RFID based system which is used for gathering the video from the camera. RFID reader device is used to validate the
accuracy of face recognition model.
The system depicted in paper [12] employs a modified Viola jones algorithm for face detection and alignment
free face recognition. Attendance in Excel sheet is entered if the face in the image and dataset are similar.
The system proposed [13] consist of four parts such as capturing of image, group segmentation and selection of
faces, comparison and face recognition and attendance updating, in the database. The image is captured through the
camera which is followed by segmentation and face detection using Haar cascade algorithm. Identification of face is
done through histogram values. Attendance is entered in the database if the image in the dataset is found similar to
the image captured by camera.
The paper [14] presents, new and better updates on yolo face detector. New network has been trained for better
accuracy and speed.
Haar Cascade classifier, based on Haar wavelets, has been invented by Viola and Jones in the year 2001. Haar
wavelets method is used to analyze pixels in the image to square shaped function Haar features are image features
used in face recognition.
These features are adjacent rectangle regions in the detection window. Haar cascade is usually trained with
positive and negative pictures, then combination of these are taken for representing the face i.e. positive pictures
possesses a face whereas the negative picture does not contain face for face detection. The features are obtained by
computing the subtraction between the sum of bright pixels with the sum of dark pixels.
Adaboost learning algorithm is used for selection of important features from the larger set and removes the
redundant features. All the features are tested one by one for detecting the face. If any features does not appear in the
block then detection stops.
Some of the haar features are edge feature, line feature and four rectangle features. Edge features are used for
detecting the edges whereas line feature and four rectangle feature is used for detecting slanted line. For detecting the
presence of the haar like features in an image the value of delta should be closer to one.
n n
1 1
= dark- white =
n
I(X ) -
dark n
I(X )
white
DOI: 10.5373/JARDCS/V12SP4/20201599
ISSN 1943-023X 1237
Received: 20 Feb 2020/Accepted: 18 Mar 2020
Jour of Adv Research in Dynamical & Control Systems, Vol. 12, 04-Special Issue, 2020
DOI: 10.5373/JARDCS/V12SP4/20201599
ISSN 1943-023X 1238
Received: 20 Feb 2020/Accepted: 18 Mar 2020
Jour of Adv Research in Dynamical & Control Systems, Vol. 12, 04-Special Issue, 2020
DOI: 10.5373/JARDCS/V12SP4/20201599
ISSN 1943-023X 1239
Received: 20 Feb 2020/Accepted: 18 Mar 2020
Jour of Adv Research in Dynamical & Control Systems, Vol. 12, 04-Special Issue, 2020
DOI: 10.5373/JARDCS/V12SP4/20201599
ISSN 1943-023X 1240
Received: 20 Feb 2020/Accepted: 18 Mar 2020
Jour of Adv Research in Dynamical & Control Systems, Vol. 12, 04-Special Issue, 2020
A. Raspberry pi 3 B+
Raspberry pi 3B + is a credit card sized computer with 64 bit quad core Arm cortex- A53 CPU works at 1.4 GHz.
It contains built-in enhanced dual band 2.4GHz and 5 GHz Wi-Fi and 4.2/BLE Bluetooth connectivity with faster
Ethernet. 1GB of RAM is available in raspberry pi. It comes with 2.5A power supply with micro USB cable and
noise filter. Raspbian OS is flashed onto a micro secured SD card, which runs the raspberry pi using python
programming language.
Features
14th March 2018, the day raspberry Pi 3 B+, an advanced version of Raspberry Pi 3 B model was introduced
by Raspberry Pi foundation. It is a tiny single computer board, capable of doing some functions like a computer
or laptop, comes with CPU, USB ports, GPU, I/O pins, Bluetooth, Wi-Fi, USB and network boot.
DOI: 10.5373/JARDCS/V12SP4/20201599
ISSN 1943-023X 1241
Received: 20 Feb 2020/Accepted: 18 Mar 2020
Jour of Adv Research in Dynamical & Control Systems, Vol. 12, 04-Special Issue, 2020
necessary electrical current to the data cable used device thereby reduces the number of cables required for the
installation of a device.
DOI: 10.5373/JARDCS/V12SP4/20201599
ISSN 1943-023X 1242
Received: 20 Feb 2020/Accepted: 18 Mar 2020
Jour of Adv Research in Dynamical & Control Systems, Vol. 12, 04-Special Issue, 2020
Fig.10: Process Flow for Functioning of Creation of Database and Web Server
DOI: 10.5373/JARDCS/V12SP4/20201599
ISSN 1943-023X 1243
Received: 20 Feb 2020/Accepted: 18 Mar 2020
Jour of Adv Research in Dynamical & Control Systems, Vol. 12, 04-Special Issue, 2020
To create a GUI first the Tkinter module is imported. The second step towards creation of GUI is initialization of
window manager which is performed by Tkinter. Tk( ) which is followed by renaming of GUI window. A blank
window will be created with minimum, maximum and close buttons.
Different types of widgets like button, label, canvas, check button and entry are used for developing GUI with the
help of python script.
The widget for the development of the GUI is listed below.
Button – The event proposed is triggered when clicked.
Label – This widget is used for inserting text into the window.
Canvas – canvas is used to draw shape to the GUI and also supports various drawing techniques.
Entry – creation of input field is done through this widget. The text can be entered in the field provided for
processing.
Menu – menu is used to create menu in the GUI.
Check button - It is a toggle button, records all true false or on-off state.
Frame – The grouping of the widget is done through this widget, is used as a container in Tkinter.
Combo box – IT is a dropdown menu used for displaying all the elements which is defined in the python code.
Message box – Displaying of message is performed through importing this library.
Radio button – It suggest multi choice option to the user.
Spin box – This widget comprises two tabs, used for up and down scroll.
List Box – It provides the option to select a list like java, python, C ++ to the user from which different features can
be accepted.
Scrollbar – talk about the slider controller for implementing the listed widgets.
Geometry Management- this is used to establish the frame or the window. There are three prominent type of
geometry measurement classes are available.
Pack ( ) – It arranges the widget in a block manner.
Grid ( ) - It arranges the widget in a table like structure.
Place ( ) – It is used to place the given widget in specified place.
The flow diagram of developing the GUI is given below.
DOI: 10.5373/JARDCS/V12SP4/20201599
ISSN 1943-023X 1244
Received: 20 Feb 2020/Accepted: 18 Mar 2020
Jour of Adv Research in Dynamical & Control Systems, Vol. 12, 04-Special Issue, 2020
H. Confusion Matrix
The confusion matrix also called as error matrix is used to analyze the performance of the algorithm on tested
dataset. The confusion matrix is prepared by Sklearn library with the help of the function confusion matrix. Python
script is written for obtaining confusion matrix array, the output array without normalization.
The classification is also obtained which gives precision, recall f1-score and accuracy. These parameters are
calculated with the help of true positive, true negative, false positive and false negative. The true positive outcomes
are the correct prediction of positive class by the system, true negative is nothing but the outcome in which the
DOI: 10.5373/JARDCS/V12SP4/20201599
ISSN 1943-023X 1245
Received: 20 Feb 2020/Accepted: 18 Mar 2020
Jour of Adv Research in Dynamical & Control Systems, Vol. 12, 04-Special Issue, 2020
system predicts the negative class, false positive is an outcome which is incorrectly predicted the positive class by
the system and false negative predict incorrectly the negative class. True positive is denoted by TP, true negative is
represented as TN, false positive and false negative are denoted by FP & FN respectively.
1) Precision
Positive predictive value is termed as precision. The ratio between actual positives to the total positive provides
precision.
Precision= (1)
2) Accuracy
The ratio between the sum of true prediction (true positive and true negative) and the total predictions (true
positive, false positive, true negative, and false negative) is termed as accuracy.
Accuracy = (2)
3) F1 – Score
F1 score, a statistical measure to the rate performance, conveys a balance between sensitivity and precision. It is
a mean of an individual’s performance, based on recall and precision, also called F score.
F1- score (3)
4) Sensitivity
Sensitivity is also called recall. It is obtained by dividing the true positive by the sum of true positive and the true
negatives.
Sensitivity = *100 (4)
The tested data of eight students is used for making the confusion matrix. The recognition has been carried out
for eight students. The face recognition of Liz and Anita had confusion with Aishwarya and Benita. Remaining all
faces have been recognized with 100% accuracy. The output array and the classification report obtained in the
terminal are depicted below which shows 95% accuracy.
DOI: 10.5373/JARDCS/V12SP4/20201599
ISSN 1943-023X 1246
Received: 20 Feb 2020/Accepted: 18 Mar 2020
Jour of Adv Research in Dynamical & Control Systems, Vol. 12, 04-Special Issue, 2020
DOI: 10.5373/JARDCS/V12SP4/20201599
ISSN 1943-023X 1247
Received: 20 Feb 2020/Accepted: 18 Mar 2020
Jour of Adv Research in Dynamical & Control Systems, Vol. 12, 04-Special Issue, 2020
VI. Conclusion
Different types of face detection using Haarcascade method, DNN face detection using single shot multibox
detector, HOG and CNN face detector implemented and comparative study carried out. Implemented two method of
face recognition, local binary pattern histogram and convolution neural network. Raspberry pi based face recognition
implemented using local binary pattern histogram algorithm with an accuracy of 95%. Apache web server provides
the Application programming Interface API for launching the MySQL database which maintains the Attendance log
of students. The parents are informed about the absent students through Gmail with the assistance of SMTP.
Performance can be improved by using raspberry pi 4 model for handling heavy face recognition algorithm along
with additional feature of recording of Lecture as a future work.
References
[1] Mallikarjuna Reddy, K.Naresh, S.Shiva Kumar, Madar Bindu, “Comparison of various detection and face
recognition algorithms”, International Journal of Engineering Research in Computer Science and
Engineering, vol 5, issue 4, April 2018.
[2] Omar Abdul Rhman Salim, Rashidah Funke Olanrewaju, Wasiu Adebayo Balogum, “Class Attendance
Management System using Face Recognition”, 7th International Conference on Computer & communication
Engineering, September 2018.
[3] Priyanka Wagh, Roshani Thakare, Jagruti Chaudhari, Shweta patil, “ Attendance System based on Face
Recognition using Eigen face and PCA algorithm”. 2015, International conference on Green Computing and
Internet of Things, 8-10 October 2015.
[4] Shubhobrata Bhattacharya, Gowtham Sandeep Nainala, Prosenjit Das, Aurobinda Routray, “Smart Attendance
Monitoring System (SAMS): A Face Recognition based Attendance System for classroom environment”, 2018
IEEE 18th International conference on Advanced Learning Technologies,9-13 July 2018, Mumbai, India.
[5] E. Varadharajan, R.Dharani, S. Jeevitha, B. Kavinnathi, S. Hemalatha, “ Automatic Attendance Management
System using Face detection”, South Asian Journal of research in Engineering Science and Technology, vol 3,
issue 10 April 2018.
[6] Nilest D. Veer, B.F Momin, “ An Automatic Attendance System using Video Surveillance Camera”, IEEE
International Conference on recent trends in Electronics Information Communication Technology, May 20-21,
2016.
[7] Rekha E, Dr. Ramaprasad, “An Efficient Automated Attendance Management System Based on Eigen Face
Recognition”, 2017 7th International Conference on Cloud Computing, Data Science & Engineering.
[8] Wenxian Zeng, Qinglin Meng, Ran Li, “Design of Intelligent Classroom Attendance System Based on Face
Recognition”, 2019 IEEE 3rd International Technology, Networking Electronics and Automation Control
Conference(ITNEC), Chengdu,China, 2019, pp.611-615.
[9] Soniya V, Swetha Sri R, Swetha Titty K, Ramakrishnan R, Sivakumar S, “Attendance Automation Using Face
Recognition Biometric Authentication”, 2017 International Conference on Power and Embedded Drive
Control (ICPEDC).
[10] Refik Samet, Muhammed Tanrivendi, “Face recognition based mobile Automatic Attendance Management
System”, 2017 International Conference on Cyber worlds, Chester UK.
[11] Marko Arsenovic, Srdjan Sladojevic, Andras Anderla, Darko Stefanovic, “Face Time-Deep Learning Based
Recognition Attendance System”, 15th International Symposium on Intelligent System and Informatics, Sept.
14-16, 2017, Subotica, Serbia.
[12] Nazare Kanchan Jayant, Surekha Borra, “ Attendance Management System using Hybrid Face Recognition
Techniques”, 2016 Conference on Advances in Signal Processing.
[13] Jenif W.S.D Souza, Jothi S, Chandrasekar, “ Automated Attendance Marking and Management System by
Facial Recognition using Histogram”, 2019 5th International Conference on Advanced Computing &
Communication System.
[14] Joseph Redmon, Ali Farhadi, “yolov3: An incremental Improvement”. Published in ArXiv 2018.
DOI: 10.5373/JARDCS/V12SP4/20201599
ISSN 1943-023X 1248
Received: 20 Feb 2020/Accepted: 18 Mar 2020