College of Information Technology
Department of Information Systems
PhishArena is an interactive cybersecurity platform designed to simulate real-world phishing attacks and improve user awareness through practical experience. Instead of relying only on theoretical knowledge, the system provides structured, scenario-based training where users engage with realistic phishing situations.
Powered by AI and Large Language Models (LLMs), the platform evaluates user responses based on professionalism, realism, and completeness, providing intelligent feedback to improve understanding of social engineering attacks.
Enhance users’ ability to identify and respond to phishing attacks through realistic training scenarios.
Create an engaging and practical environment that goes beyond traditional theoretical awareness methods.
Replicate real-world email environments such as Outlook and Thunderbird to improve hands-on experience.
Use AI and LLM technologies to analyze responses and provide intelligent feedback and explanations.
Many cybersecurity awareness programs focus mainly on theoretical knowledge rather than practical phishing detection skills.
Attackers continuously improve phishing methods, making malicious emails harder for users to identify and detect.
Human mistakes remain one of the leading causes of cybersecurity breaches, highlighting the need for better awareness solutions.
Simulates real-world email environments to help users experience phishing scenarios in a practical way.
Uses AI and Large Language Models to evaluate user responses and provide intelligent explanations and feedback.
Provides a gamified and engaging learning experience instead of traditional static cybersecurity training methods.
Helps users improve their ability to identify suspicious emails and reduce risks caused by phishing attacks.
Analyzes submitted responses instantly and generates quick feedback to improve user decision-making skills.
The PhishArena architecture combines realistic email communication with AI-powered evaluation services using Flask, SMTP/IMAP servers, and Large Language Models (LLMs).
Ollama (LLM)
Flask (Python)
Ubuntu Operating System
HTML
CSS
JavaScript
The platform is deployed on Ubuntu Linux to provide a stable and secure environment for backend services and AI integration.
Postfix is used to manage SMTP communication and simulate realistic phishing email delivery scenarios.
Dovecot handles IMAP services and mailbox access for receiving and managing user email interactions.
Ollama powers the AI evaluation process by analyzing user responses and generating intelligent feedback.
Flask connects all system components together and processes communication between the frontend and AI services.
The web interface allows users to interact with the platform, submit responses, and receive evaluation results instantly.
The PhishArena platform operates within a dedicated experimental environment that integrates Ubuntu-based services, AI evaluation modules, and email simulation systems. The following workflow demonstrates how the platform is launched and used during testing and demonstrations.
Start the Ubuntu-based environment containing Flask services, SMTP/IMAP servers, and AI modules.
Access PhishArena through Thunderbird or the web-based interface for phishing simulation.
The system analyzes user responses using Large Language Models and generates intelligent feedback.
Users receive feedback, scores, and progress tracking after completing phishing scenarios.
Different Large Language Models (LLMs) were tested to evaluate their phishing detection performance based on accuracy, response time, and practical usability within the PhishArena platform.
| Model Configuration | Accuracy | Avg Generation Time |
|---|---|---|
| Llama 3.2:1B + mxbai-embed-large | 88% | 4.8s |
| Qwen3:1.7b + mxbai-embed-large | 82% | 6.2s |
| Gemma3:1b + mxbai-embed-large | 76% | 5.9s |
| Qwen3:1.7b + all-minilm | 79% | 4.5s |
| Phi4-mini + all-minilm | 64% | 4.1s |
Llama 3.2:1B was selected as the primary AI model due to its fast response time, lightweight deployment, and smooth real-time interaction through Ollama, making it suitable for interactive phishing awareness simulations.
PhishArena demonstrates how AI-powered phishing awareness platforms can provide realistic cybersecurity training through interactive simulations and intelligent response evaluation. By integrating LLM technologies with email-based environments, the platform enhances phishing detection skills while improving user awareness in a practical and engaging way.
Impact: PhishArena bridges the gap between theoretical cybersecurity awareness and practical phishing detection by creating an immersive AI-driven training environment that improves user readiness against phishing attacks.
This project is a Final Year Senior Project completed during Semester 2 of the Academic Year 2025/2026 at the College of Information Technology — University of Bahrain.
Cybersecurity Graduates - Batch 2026