Download PDF
hireEZ > Case Studies > IMVU's Transformation: Leveraging AWS for Advanced Analytics and Data Streaming
hireEZ Logo

IMVU's Transformation: Leveraging AWS for Advanced Analytics and Data Streaming

Technology Category
  • Analytics & Modeling - Machine Learning
  • Platform as a Service (PaaS) - Application Development Platforms
Applicable Industries
  • Cement
  • Construction & Infrastructure
Applicable Functions
  • Logistics & Transportation
  • Product Research & Development
Use Cases
  • Behavior & Emotion Tracking
  • Livestock Monitoring
Services
  • Data Science Services
The Challenge

IMVU, the world’s largest avatar-based social network, was facing challenges with its on-premises infrastructure which was limiting its capacity for advanced analytics. The company had been an early adopter of Apache Hadoop and Big Data technologies, but found it difficult to support and upgrade their 90-node Hadoop cluster and in-house built tooling. IMVU’s analysts lacked the tools to rapidly generate a range of business-critical reports on customer in-game behavior at scale. They were working with historical data in batches, which made analytics more complex and created multiple bottlenecks. Late reports resulted in inaccurate assumptions about customer in-game purchases, leading to slower sales and loss of profit. The analytics team also lacked a test environment to efficiently check analytics assumptions. The company sought to modernize their platform’s data architecture by introducing CI/CD, Infrastructure as Code (IaC), and other best practices, to achieve faster analytics iterations, better maintainability, and lower TCO.

About The Customer

IMVU is the world’s largest avatar-based social network, with over 7 million users monthly. Users can customize their avatars, chat with friends, shop, hang out at cool parties, and earn real money by creating virtual products. The company was one of the pioneers and early adopters of Apache Hadoop, taking advantage of Big Data technologies before they became mainstream. IMVU was looking to enhance and re-architect their platform by augmenting it through advanced analytics and data streaming. The company sought to modernize their platform’s data architecture by introducing CI/CD, Infrastructure as Code (IaC), and other best practices, to achieve faster analytics iterations, better maintainability, and lower TCO.

The Solution

IMVU partnered with Provectus and AWS to drive innovation, implement streaming architecture, enable advanced analytics, and build several AI-powered apps to improve customer retention in the long term. They developed a comprehensive migration and modernization strategy towards NextGen architecture. Their data pipelines were modernized and re-architected to meet the requirements for a modern Data Platform, utilizing open source solutions and AWS services. The Data Platform was designed to use Airflow for both job scheduling and monitoring, to run on Amazon EKS. Data pipelines were optimized to utilize Amazon’s EMR Autoscaling policies. Provectus optimized Hive/Spark jobs, decoupled compute and storage layers, introduced a new query engine based on Apache Presto and implemented concise and self-documented delivery pipelines. The Business Intelligence (BI) layer was optimized to serve the needs of IMVU’s data analytics team. As part of data platform modernization and re-architecture, Provectus migrated Hadoop clusters to Amazon EMR with Data and Compute decoupling.

Operational Impact

  • IMVU received a scalable, cloud-native infrastructure for its data platform, which unlocked the full potential of AWS cloud and IMVU unique user generated data and created a foundation for near real time analytical and machine learning use cases. The IMVU team can now take advantage of vast amounts of data generated by users to look into customer lifetime behavior and generate a range of comprehensive reports, including but not limited to in-game purchases, customer engagement, and avatar preferences. The analysts of IMVU can also generate reports much faster, whenever they need to. Infrastructure-wise, IMVU has overcome significant technological barriers to fast and seamless code deployments. By having their platform re-architected for AWS, IMVU has created a solid foundation for their cloud-based products, as well as introduced the potential for using Artificial Intelligence and Machine Learning for customer retention.

Quantitative Benefit

  • 400 Spark Jobs

  • 2x TCO Optimization

  • 1PB Processed Daily

Related Case Studies.

Case Study
IoT System for Tunnel Construction
The Zenitaka Corporation ('Zenitaka') has two major business areas: its architectural business focuses on structures such as government buildings, office buildings, and commercial facilities, while its civil engineering business is targeted at structures such as tunnels, bridges and dams. Within these areas, there presented two issues that have always persisted in regard to the construction of mountain tunnels. These issues are 'improving safety" and "reducing energy consumption". Mountain tunnels construction requires a massive amount of electricity. This is because there are many kinds of electrical equipment being used day and night, including construction machinery, construction lighting, and ventilating fan. Despite this, the amount of power consumption is generally not tightly managed. In many cases, the exact amount of power consumption is only ascertained when the bill from the power company becomes available. Sometimes, corporations install demand-monitoring equipment to help curb the maximum power demanded. However, even in these cases, the devices only allow the total volume of power consumption to be ascertained, or they may issue warnings to prevent the contracted volume of power from being exceeded. In order to tackle the issue of reducing power consumption, it was first necessary to obtain an accurate breakdown of how much power was being used in each particular area. In other words, we needed to be able to visualize the amount of power being consumed. Safety, was also not being managed very rigorously. Even now, tunnel construction sites often use a 'name label' system for managing entry into the work site. Specifically, red labels with white reverse sides that bear the workers' names on both sides are displayed at the tunnel work site entrance. The workers themselves then flip the name label to the appropriate side when entering or exiting from the work site to indicate whether or not they are working inside the tunnel at any given time. If a worker forgets to flip his or her name label when entering or exiting from the tunnel, management cannot be performed effectively. In order to tackle the challenges mentioned above, Zenitaka decided to build a system that could improve the safety of tunnel construction as well as reduce the amount of power consumed. In other words, this new system would facilitate a clear picture of which workers were working in each location at the mountain tunnel construction site, as well as which processes were being carried out at those respective locations at any given time. The system would maintain the safety of all workers while also carefully controlling the electrical equipment to reduce unnecessary power consumption. Having decided on the concept, our next concern was whether there existed any kind of robust hardware that would not break down at the construction work site, that could move freely in response to changes in the working environment, and that could accurately detect workers and vehicles using radio frequency identification (RFID). Given that this system would involve many components that were new to Zenitaka, we decided to enlist the cooperation of E.I.Sol Co., Ltd. ('E.I.Sol') as our joint development partner, as they had provided us with a highly practical proposal.
Learn more
© 2015-2024 IoT ONE Limited | Privacy Policy

Contact us

Let's talk!

* Required
* Required
* Required
* Invalid email address
By submitting this form, you agree that IoT ONE may contact you with insights and marketing messaging.
No thanks, I don't want to receive any marketing emails from IoT ONE.
Submit

Thank you for your message!
We will contact you soon.