AI Agents vs. Human Investigators: Balancing Automation, Security, and Expertise in Cyber Forensic Analysis

Sneha Sudhakaran

Florida Tech

Abstract

In an era where cyber threats are rapidly evolving, the reliability of cyber forensic analysis has become increasingly critical for effective digital investigations and cybersecurity responses. Artificial Intelligence (AI) agents are being adopted across digital forensic practices due to their ability to automate processes such as anomaly detection, evidence classification, and behavioral pattern recognition, significantly enhancing scalability and reducing investigation timelines. However, the characteristics that make AI indispensable also introduce notable risks. AI systems, often trained on biased or incomplete datasets, can produce misleading results, including false positives and false negatives, thereby jeopardizing the integrity of forensic investigations. Furthermore, AI agents typically lack the contextual comprehension and ethical judgment required to interpret nuanced or legally sensitive scenarios. This study presents a meticulous comparative analysis of the effectiveness of the most commonly used AI agent, ChatGPT, and human forensic investigators in the realm of cyber forensic analysis. Our research reveals critical limitations within AI-driven approaches, demonstrating scenarios in which sophisticated or novel cyber threats remain undetected due to the rigid pattern-based nature of AI systems. Conversely, our analysis highlights the crucial role that human forensic investigators play in mitigating these risks. Through adaptive decision-making, ethical reasoning, and contextual understanding, human investigators effectively identify subtle anomalies and threats that may evade automated detection systems. To reinforce our findings, we conducted comprehensive reliability testing of forensic techniques using multiple cyber threat scenarios. These tests confirmed that while AI agents significantly improve the efficiency of routine analyses, human oversight remains crucial in ensuring accuracy and comprehensiveness of the results. Our work validates the need for a hybrid forensic framework that combines the strengths of both AI automation and human expertise. Our study concludes by advocating for an integrated forensic analysis approach, proposing targeted strategies to incorporate both AI-driven efficiencies and human analytical insights. This collaborative model enhances overall forensic reliability, ensuring robust outcomes in the face of increasingly sophisticated cyber threats.

About the Speaker

Dr. Sneha Sudhakaran is an Assistant Professor of Computer Science at the Florida Institute of Technology, specializing in cyber forensics with emphasis on mobile and memory forensics. She earned her Ph.D. from Louisiana State University, where she developed Android forensic tools such as DroidScraper and AmpleDroid to recover evidence from application memory. Her research spans mobile application security, SCADA and drone forensics, image forensics, and Android reverse engineering, with publications in leading venues including Digital Investigation and Computers & Security. Dr. Sudhakaran is the founder of the Women in Cyber Security (WiCyS) chapter at Florida Tech and contributes actively to WiCyS Global, AAFS. She serves as reviewer for Elsevier Computers & Security, Digital Investigation, and SIGCSE, and as a committee member, moderator and session chair for WiSec, USENIX, DFRWS, AAFS and PAINE. Beyond her academic role, she contributes as an item writer for EC-Council’s CHFI certification and serves on the Board of Studies at Amrita University. Through her research, teaching, and professional service, Dr. Sudhakaran advances both the science and practice of cybersecurity while promoting diversity and workforce development in the field.