Download PDF
Juspay's Real-Time Transaction Analysis and Cost Reduction with ClickHouse
Technology Category
- Networks & Connectivity - Gateways
- Networks & Connectivity - NFC
Applicable Industries
- Cement
- Construction & Infrastructure
Applicable Functions
- Product Research & Development
- Quality Assurance
Use Cases
- Behavior & Emotion Tracking
- Real-Time Location System (RTLS)
Services
- System Integration
- Testing & Certification
The Challenge
Juspay, an Indian fintech company, is responsible for over 50 million daily transactions for clients such as Amazon, Google, and Vodafone. As a pioneer in the payments industry, Juspay's mission is to streamline online payments for merchants, acting as an intermediary between payment providers and merchant systems. To ensure a seamless transaction environment, Juspay needed to provide monitoring and analytics services to guarantee the performance of the payment system. With a diverse array of merchants and their ever-evolving needs, Juspay had to keep up with frequent releases, often multiple releases daily. They needed a monitoring solution that would enable them to maintain their rapid release pace while ensuring that the latest release did not impact the running payment systems. Furthermore, Juspay was facing high operating costs with their previous solution, BigQuery from GCP, which was costing over a thousand dollars per day.
About The Customer
Juspay is an Indian fintech company that has established itself as a pioneer in the payments industry. It acts as an intermediary between payment providers and merchant systems, with a mission to streamline online payments for merchants. Juspay handles over 50 million daily transactions for clients such as Amazon, Google, and Vodafone. The company is known for its rapid release pace, often releasing multiple updates daily to keep up with the diverse and ever-evolving needs of its array of merchants. Juspay's commitment to innovation and seamless transaction environments has made it a leader in its field.
The Solution
Juspay selected ClickHouse to power its critical A/B testing and monitoring needs. ClickHouse enables Juspay to compare the success rate percentage between different versions and determine if a newer version is performing poorly. In such cases, a rollback is conducted, which is especially helpful when a new release is expected to improve performance but ends up affecting other services. A traditional relational database was not capable of performing this level of analysis due to the massive volume of data generated by A/B tests. With ClickHouse, Juspay can group by all columns of low cardinality fields, which could amount to up to 10,000 dimensions with 50 million transactions a day. For monitoring and A/B testing, Juspay uses a combination of Kafka, ClickHouse, and Grafana. They monitor active logs and perform transformations in Kafka, before utilizing Kafka queues to transfer data to ClickHouse via the Kafka engine. Juspay also uses ClickHouse to provide their merchants with real-time analytics and a live view of their system performance.
Operational Impact
Quantitative Benefit
Related Case Studies.
Case Study
System 800xA at Indian Cement Plants
Chettinad Cement recognized that further efficiencies could be achieved in its cement manufacturing process. It looked to investing in comprehensive operational and control technologies to manage and derive productivity and energy efficiency gains from the assets on Line 2, their second plant in India.
Case Study
IoT System for Tunnel Construction
The Zenitaka Corporation ('Zenitaka') has two major business areas: its architectural business focuses on structures such as government buildings, office buildings, and commercial facilities, while its civil engineering business is targeted at structures such as tunnels, bridges and dams. Within these areas, there presented two issues that have always persisted in regard to the construction of mountain tunnels. These issues are 'improving safety" and "reducing energy consumption". Mountain tunnels construction requires a massive amount of electricity. This is because there are many kinds of electrical equipment being used day and night, including construction machinery, construction lighting, and ventilating fan. Despite this, the amount of power consumption is generally not tightly managed. In many cases, the exact amount of power consumption is only ascertained when the bill from the power company becomes available. Sometimes, corporations install demand-monitoring equipment to help curb the maximum power demanded. However, even in these cases, the devices only allow the total volume of power consumption to be ascertained, or they may issue warnings to prevent the contracted volume of power from being exceeded. In order to tackle the issue of reducing power consumption, it was first necessary to obtain an accurate breakdown of how much power was being used in each particular area. In other words, we needed to be able to visualize the amount of power being consumed. Safety, was also not being managed very rigorously. Even now, tunnel construction sites often use a 'name label' system for managing entry into the work site. Specifically, red labels with white reverse sides that bear the workers' names on both sides are displayed at the tunnel work site entrance. The workers themselves then flip the name label to the appropriate side when entering or exiting from the work site to indicate whether or not they are working inside the tunnel at any given time. If a worker forgets to flip his or her name label when entering or exiting from the tunnel, management cannot be performed effectively. In order to tackle the challenges mentioned above, Zenitaka decided to build a system that could improve the safety of tunnel construction as well as reduce the amount of power consumed. In other words, this new system would facilitate a clear picture of which workers were working in each location at the mountain tunnel construction site, as well as which processes were being carried out at those respective locations at any given time. The system would maintain the safety of all workers while also carefully controlling the electrical equipment to reduce unnecessary power consumption. Having decided on the concept, our next concern was whether there existed any kind of robust hardware that would not break down at the construction work site, that could move freely in response to changes in the working environment, and that could accurately detect workers and vehicles using radio frequency identification (RFID). Given that this system would involve many components that were new to Zenitaka, we decided to enlist the cooperation of E.I.Sol Co., Ltd. ('E.I.Sol') as our joint development partner, as they had provided us with a highly practical proposal.
Case Study
Splunk Partnership Ties Together Big Data & IoT Services
Splunk was faced with the need to meet emerging customer demands for interfacing IoT projects to its suite of services. The company required an IoT partner that would be able to easily and quickly integrate with its Splunk Enterprise platform, rather than allocating development resources and time to building out an IoT interface and application platform.
Case Study
Bridge monitoring in Hamburg Port
Kattwyk Bridge is used for both rail and road transport, and it has played an important role in the Port of Hamburg since 1973. However, the increasing pressure from traffic requires a monitoring solution. The goal of the project is to assess in real-time the bridge's status and dynamic responses to traffic and lift processes.
Case Study
Bellas Landscaping
Leading landscaping firm serving central Illinois streamlines operations with Samsara’s real-time fleet tracking solution: • 30+ vehicle fleet includes International Terrastar dump trucks and flatbeds, medium- and light-duty pickups from Ford and Chevrolet. Winter fleet includes of snow plows and salters.