Implementation of a Chatbot-Based AI Agent for Employee and Student Attendance Systems with Face Recognition and N8N Integration

Muh. Dwicky P. Sanjaya; Adhy Rizaldy; Rahman; Asrul Ashari Muin; A. Mustika Abidin

doi:10.59934/jaiea.v5i3.2337

Authors

Muh. Dwicky P. Sanjaya Department of Information Systems, Faculty of Science and Technology, Universitas Islam Negeri Alauddin Makassar, Indonesia
Adhy Rizaldy Department of Information Systems, Faculty of Science and Technology, Universitas Islam Negeri Alauddin Makassar, Indonesia
Rahman Department of Information Systems, Faculty of Science and Technology, Universitas Islam Negeri Alauddin Makassar, Indonesia
Asrul Ashari Muin Department of Information Systems, Faculty of Science and Technology, Universitas Islam Negeri Alauddin Makassar, Indonesia
A. Mustika Abidin Department of Information Systems, Faculty of Science and Technology, Universitas Islam Negeri Alauddin Makassar, Indonesia

DOI:

https://doi.org/10.59934/jaiea.v5i3.2337

Keywords:

AI agent, chatbot, face recognition, N8N, workflow automation

Abstract

Students frequently rely on direct messaging to verify the presence of lecturers and staff on campus, a practice that often results in delayed responses due to the recipients' busy schedules. This study aims to design, implement, and evaluate an automated attendance system based on an AI agent utilizing face recognition technology and n8n as a centralized workflow automation platform. The research employs a Research and Development (R&D) approach with the Agile development method. Real-time face detection and recognition are performed from CCTV camera feeds using a Python module that integrates the InsightFace and MediaPipe algorithms. Identified attendance data is automatically stored in Google Sheets, subsequently processed by n8n to deliver information to users via a WhatsApp chatbot powered by the Gemini 2.5 Flash model. Testing conducted on 419 samples yielded an accuracy of 86.16%, with 275 True Negative values demonstrating the system's capability in filtering unregistered faces. The overall average system latency was 15.9 seconds, with a chatbot automation response time of only 9.3 seconds. This research demonstrates that the integration of workflow automation and AI agents is effective in improving the efficiency of academic attendance information access.

Downloads

Download data is not yet available.

References

E. S. Rahman, "Pengembangan aplikasi presensi mengajar dosen pada program studi ilmu komputer ITSB Muhammadiyah Selayar," Jurnal Media Elektrik, vol. 20, no. 3, pp. 106–111, 2023.

Y. Febrianti, P. Navitas, and N. Winaris, "Communication dynamics between first-year doctoral students and supervisors," Jurnal Ilmu Komunikasi, pp. 169–184, 2023, doi: 10.24002/jik.v20i2.5735.

A. Fu'adi, "Pembangunan sistem monitoring kehadiran mahasiswa menggunakan YOLO dan OpenCV," Jurnal Ilmiah Teknologi Informasi Asia, vol. 18, no. 1, pp. 84–87, 2024, doi: 10.32815/jitika.v18i1.999.

D. Rahma, J. Direza, and I. Fannani, "Pengembangan sistem otomatisasi manajemen stok dan pelaporan gudang menggunakan n8n dan chatbot," Jurnal Ilmiah Ilmu Manajemen, vol. 12, no. 2, pp. 544–557, 2025.

M. Wali and T. Iqbal, "Implementing workflow automation with n8n to enhance operational efficiency in the Sharia Cooperative of Bank Indonesia, Aceh Province," Journal Digital Technology Trend, vol. 4, no. 1, pp. 36–47, 2025, doi: 10.56347/jdtt.v4i1.341.

A. Ramadhani, M. D. Yantoro, M. F. Akmal, M. Mahfud, and Fauzi, "Chatbot otomatis dengan n8n dan AI untuk analisis data dan pelaporan hasil," Jurnal Riset Teknik Komputer, vol. 2, no. 2, pp. 18–23, 2025, doi: 10.69714/x1p94182.

V. A. Putri, K. Carissa, A. Sotyawardani, and R. A. Rafael, "Peran artificial intelligence dalam proses pembelajaran mahasiswa di Universitas Negeri Surabaya," Prosiding Seminar Nasional, pp. 615–630, 2023.

S. L. Zahara, Z. U. Azkia, and M. M. Chusni, "Implementasi teknologi artificial intelligence dalam bidang pendidikan," Jurnal Penelitian Sains dan Pendidikan, vol. 3, no. 1, pp. 15–20, 2023, doi: 10.23971/jpsp.v3i1.4022.

M. Robani Tsabita, F. R. Aderiyana, N. S. Manahan, M. P. Wilantara, Fathoni, and A. Ibrahim, "Analisis literatur mengenai peran AI agent dalam efisiensi automasi digital," Journal of Information Systems and Informatics Engineering, vol. 9, no. 1, pp. 77–90, 2025.

M. Arif Budiman, "Penggunaan agen berbasis intelijen untuk menangani kejahatan siber," Journal of Innovation Research and Knowledge, vol. 1, no. 8, pp. 455–462, 2022.

W. Rachbini, T. Evi, and Suyanto, Pengenalan ChatGPT: Tips dan Trik bagi Pemula. Banten: CV. AA. RIZKY, 2023.

Supiyandi, T. Ardiansyah, S. P. Balqis, J. Haqqoni, and S. N. Iskandar, "Deteksi wajah dalam foto menggunakan teknologi visi komputer," Mars: Jurnal Teknik Mesin, Industri, Elektro dan Ilmu Komputer, vol. 2, no. 6, pp. 32–39, 2024, doi: 10.61132/mars.v2i6.490.

A. H. Nur'azizan, A. R. Ardiansyah, and R. Fernandis, "Implementasi deteksi bahasa isyarat tangan menggunakan OpenCV dan MediaPipe," in Proc. Seminar Nasional, vol. 3, pp. 331–337, 2024.

M. Setiawan, R. Helilintar, and I. Farida, "Pemanfaatan pustaka InsightFace dalam sistem presensi berbasis pengenalan wajah," in Proc. SEMNAS INOTEK, vol. 9, pp. 1878–1885, 2025.

F. Rizal, R. Putri, and H. M. Yusdartono, "Rancang bangun sistem presensi mahasiswa berbasis IoT dengan kamera dan barcode," RELE: Jurnal Teknik Elektro, vol. 7, no. 1, pp. 1–6, 2024, doi: 10.30596/rele.v7i1.18878.

M. A. Khair, P. Aldiyuda, and N. E. Pakpahan, "Perancangan sistem absensi mahasiswa berbasis face recognition di lingkungan UPN Veteran Jakarta," Jurnal Informatik, vol. 20, no. 1, pp. 35–42, 2024.

R. Deden, A. Hidayat, E. A. Hadi, and E. Rusnandi, "Automation of technical documentation validation workflows based on GitHub using n8n during software development stages," JMTAS: Journal of Multimedia Technology and Applied Software, pp. 64–69, 2025, doi: 10.71266/jmtas.v2i2.62.

M. Bannett, "Deep learning powered architectures for intelligent workflow dynamics, adaptive task scheduling, and autonomous orchestration of complex processes in n8n," MetaVision Journal of Multidisciplinary Studies, vol. I, no. III, 2024.

I. Nakavisute and T. Sincharoonsak, "Optimizing the automation process with n8n," TPM, vol. 32, no. S8, pp. 1786–1793, 2025.

C. Ramadhan, M. A. Senubekti, and D. Amalia, "Penerapan metodologi Agile dalam pengembangan perangkat lunak," Router: Jurnal Teknik Informatika dan Terapan, vol. 3, no. 2, pp. 10–15, 2025, doi: 10.62951/router.v3i2.411.