A Framework for Evaluating Anti Spammer Systems for Twitter

Despite several benefits to modern communities and businesses, Twitter has attracted many spammers that have overwhelmed legitimate users with unwanted and disruptive advertising and fake information. Detecting spammers is always challenging because of the huge volume of data that needs to be analyzed while spammers continue to learn and adapt to avoid being detected by anti-spammer systems. Several spam classification systems are proposed that use various features extracted from the content and user’s information from their Tweets. Nevertheless, no comprehensive study has been done to compare and evaluate the effectiveness and efficiency of these systems. It is not known what the best anti-spammer system is and why. This paper proposes an evaluation framework that allows researchers, developers, and practitioners to access existing user-based and content-based features, implement their own features, and evaluate the performance of their systems against other systems. Our framework helps identify the most effective and efficient spammer detection features, evaluate the impact of using different numbers of recent tweets, and therefore obtaining a faster and more accurate classifier model.