A System for Analysis of Big Data from Social Media

Publication Type:

Journal Article

Source:

Information & Security: An International Journal, Volume 47, Issue 1, p.44-61 (2020)

Keywords:

big data, Cyber Aggregator, cyber security, OSINT, social media monitoring

Abstract:

The article presents the basic principles of building and using a monitoring and analysis system of social media on cybersecurity, based on the concepts of Big Data, Data/Text Mining, Information Extraction, Complex Networks. The authors substantiate information technologies for creating a system of content monitoring, selection of relevant information from social networks, implementation of search engines for their refinement by users, saving queries as RSS feeds, and maintaining personal databases in client applications.

The described OSINT system is based on collection of information from open sources, its analysis, preparation and timely delivery of the final product to the customer in order to solve certain intelligence tasks. Hence, the system is the result of a systematic collection, processing and analysis of the necessary publicly available information. It is based on the application of methods and tools of information retrieval, data analysis and aggregation of information flows, and is used for social media content monitoring as a component of decision support systems for information and cybersecurity.