Download PDF
Global Manufacturer Averts Data Swamp with New Data Lake Architecture
Technology Category
- Analytics & Modeling - Big Data Analytics
- Infrastructure as a Service (IaaS) - Cloud Storage Services
- Application Infrastructure & Middleware - Data Exchange & Integration
Applicable Industries
- Electronics
Applicable Functions
- Business Operation
- Sales & Marketing
Services
- System Integration
- Software Design & Engineering Services
The Challenge
A global electronics component manufacturer launched a sales and marketing data hub, only to find that it could not scale to handle the volume or velocity that its one terabyte of data presented. They needed an infrastructure that was easier, faster, and more reliable. The company had built a Hadoop data lake consisting of multiple disparate data sources of structured and unstructured data, yet they were unable to effectively leverage the data to create actionable business insights. The Hadoop implementation was also showing signs of performance issues. The organization turned to Antuit’s team of big data architects and engineers to improve the performance of their architecture and create a scalable platform for data consumption.
About The Customer
A multi-billion dollar global manufacturer of electronic components, connectors, and sensors wanted to enhance the value being derived from their extensive data. The company had launched a strategic initiative to utilize data as a strategic asset to transform the business. The company had built a Hadoop data lake consisting of multiple disparate data sources of structured and unstructured data, yet they were unable to effectively leverage the data to create actionable business insights. The Hadoop implementation was also showing signs of performance issues. The organization turned to Antuit’s team of big data architects and engineers to improve the performance of their architecture and create a scalable platform for data consumption.
The Solution
Working collaboratively with the client, the Antuit team audited the existing process, and then re-engineered and implemented a robust scalable architecture. As a result of this process, Antuit uncovered a number of challenges. The client’s existing architecture could not handle the +10 years of sales and marketing data. The existing systems did not scale, and therefore were not prepared to handle the velocity or volume of data expected in the future. Some power users within the organization were executing overwhelmingly complex queries that exceeded system limitations. Finally, the data systems themselves were housed and managed by disparate business units with minimal integration. Mindful of the significant investment the client had made in its Hadoop architecture, Antuit recommended and then implemented a number of changes. The Antuit team helped the client restructure the data lake and created a better data process by partitioning and compressing data, using split-able file formats, and helping them to identify and use the right data types. To create a seamless experience, Antuit was able to leverage multiple test environments to validate approaches and identify ancillary technologies that, once integrated, would keep their data lake running smoothly and efficiently.
Operational Impact
Quantitative Benefit
Related Case Studies.
Case Study
Remote Temperature Monitoring of Perishable Goods Saves Money
RMONI was facing temperature monitoring challenges in a cold chain business. A cold chain must be established and maintained to ensure goods have been properly refrigerated during every step of the process, making temperature monitoring a critical business function. Manual registration practice can be very costly, labor intensive and prone to mistakes.
Case Study
Cloud Solution for Energy Management Platform-Schneider Electric
Schneider Electric required a cloud solution for its energy management platform to manage high computational operations, which were essential for catering to client requirements. As the business involves storage and analysis of huge amounts of data, the company also needed a convenient and scalable storage solution to facilitate operations efficiently.
Case Study
Leveraging the IoT to Gain a Competitive Edge in International Competition
Many large manufacturers in and outside Japan are competing for larger market share in the same space, expecting a growing demand for projectors in the areas of entertainment, which requires glamor and strong visual performance as well as digital signage that can attract people’s attention. “It is becoming more and more difficult to differentiate ourselves with stand-alone hardware products,” says Kazuyuki Kitagawa, Director of Service & Support at Panasonic AVC Networks. “In order for Panasonic to grow market share and overall business, it is essential for us to develop solutions that deliver significant added value.” Panasonic believes projection failure and quality deterioration should never happen. This is what and has driven them to make their projectors IoT-enabled. More specifically, Panasonic has developed a system that collects data from projectors, visualizes detailed operational statuses, and predicts issues and address them before failure occurs. Their projectors are embedded with a variety of sensors that measure power supply, voltage, video input/ output signals, intake/exhaust air temperatures, cooling fan operations, and light bulb operating time. These sensors have been used to make the projector more intelligent, automatically suspending operation when the temperature rises excessively, and automatically switching light bulbs. Although this was a great first step, Panasonic projectors were still not equipped with any capability to send the data over a network.
