A unified OLAP/OLTP big data processing framework in telecom industry

This paper studies the system performance of SQL-on-Hadoop technology and MPP technology in an OLAP and OLTP mixed scenario, which is becoming the most common big data application scenario in telecom industry. Until recently, most SQL-on-Hadoop systems only focus on the speed of data analysis but overlook the support for transactions. MPP columnar databases, on the other hand, are able to deal with both analytical and transactional tasks, but tend to have poor transactional performance due to the column-store mechanism. By adopting proper optimization methods, it is possible to increase transactional performance of MPP columnar databases. Finally, a unified data processing framework is proposed for a better support of hybrid OLAP/OLTP big data applications.