A Scalable Product Recommendations Using Collaborative Filtering in Hadoop for Bigdata

Abstract The growth of data and information causes the need of next-generation databases and data science tools. Most of the business needs a service recommendation system which have been used by millions of users. Day by day, the amount of customers, products and information has grown rapidly, yielding the big data analysis problem for service recommender systems. Consequently, conventional recommender service systems often suffer from lack of scalability and efficiency problems when processing or analysis of this data on a large scale. To avoid these problems, a novel recommendations system using collaborative filtering algorithm is implemented in Apache Hadoop leveraging MapReduce paradigm for Bigdata. Apache Hadoop is an open framework for Distributed processing systems can process large volumes of data. It can be used for offline processing and not suitable for low latency analytics. Port data onto the next generation databases like HBase and optimize the performance of it. For the product recommendations the Amazon dataset is used. Proposed Framework have significant improvement in performance compared to conventional tools.