Analytics in e-commerce at scale

This article focuses on the challenges of architecting distributed and analytical systems for scale, to handle more than a billion online visits per month in India's largest e-commerce company, Flipkart.* The article explains how Flipkart evolved its technology, functions and analytics over time, with Internet users increasingly resorting to the e-commerce market year-on-year. The article then goes into detail of how Flipkart Data Platform (FDP), the big data platform in Flipkart handles the ingestion, storage, processing, analytics, queries, and reporting of the petabytes of data every day, and of how the Data Sciences and machine learning (ML) department provide inferences that power various business workflows in the Flipkart systems. The article then concludes with a summary of how data processing has evolved over the years in Flipkart ensuring that the engineered information is as close to accurate as it should be.