An Architecture for Real-Time Massive Data Extraction from Social Media

Social media already plays a significant role in human’s daily life. Therefore, social media and associated network connections have become an arena of enormous opportunities to perform data analysis. Its impact on daily life covers areas as diverse as digital marketing, social opinion analysis, political situation monitoring and natural disaster notification. Event detection is a “building-block” that sustains goal-oriented analytics, such as the “real-time evaluation of peoples’ reaction to certain event(s)”. We propose to develop social models aimed at the extraction and prediction of event patterns based on online social media event detection in real-time. At its current stage the research is focused on the development of highly loaded, fault-tolerant, scalable system for social media data extraction and real-time analysis.