Big Data Management Platform Project

In a rapidly digitalizing world, there is an increasing need to enrich analytical platforms with up-to-date technologies and approaches in order to better understand customers and better meet their needs. In this context, it was important for LC Waikiki to be able to process and analyze this data quickly with the growing variety of data volumes and to be able to serve this data quickly to the teams that determine the company's strategy.

In order to meet the need for an environment that will increase LC Waikiki's data processing capacity and speed, where teams dealing with data and generating value from it can quickly analyze bulk data, we set out with our Komtaş, Analythinx and Istanbul Data Science Academy teams to provide LC Waikiki with a bigdata environment that we can operate with Cloudera license.

‍

“With the environment created within the scope of the project, we were able to process the data quickly and enable our strategic and decision-making teams to use this data in an agile way. I would like to thank my team who made every effort with the perception of sustainability and quality in the project, and teams at Komtaş, Analythinx and Istanbul Data Science Academy for their support.“

Ahmet Kalafat - LC Waikiki - Big Data & Data Architecture Manager

‍

Project Process

‍

Within the scope of the project, LC Waikiki and Analythinx increased the data processing speed by 12 times on average and 30 times at maximum.

With the Cloudera big data platform, we redesigned the data transformation and preparation steps with a massively parallel data processing technique using Apache Spark technology. Compared to the traditional method, we can process the data 10 times faster and make it ready for presentation in the data warehouse. This time includes collecting the data from the source system and transferring it to the data warehouse.

With the big data infrastructure, an environment with high processing power was prepared for advanced analytical studies within the organization and dissemination studies were carried out within the organization. Cloudera was preferred as the technology infrastructure and a big data infrastructure ready for transition to the cloud was positioned.

By providing customized trainings on big data from Istanbul Data Science Academy, it was aimed to increase the competencies of LC Waikiki teams.

With this project, LC Waikiki now has a powerful analytical platform system where it can store unstructured data, work on streaming data, and create sandboxes for all stakeholders dealing with data.