In this study, we explore the integration of artificial intelligence (AI) into phishing (scam) mitigation, not as a replacement for human expertise but as a complement to it. We propose a novel hybrid pipeline designed to enhance the efficiency of IT personnel in responding to phishing threats. Our approach consists of three key components: (1) Feature Extraction, where fine-tuned language models analyze phishing emails to extract contextual features; (2) Campaign Detection, leveraging community detection algorithms to identify and cluster similar phishing emails; and (3) Campaign Profiling, generating comprehensive attack summaries to streamline response efforts. By clustering related emails and providing a comprehensive attack summary, our framework enables security teams to identify and neutralize threats faster, block incoming emails, and respond to users.