Download PDF
SpotOn Accelerates Reporting with Fivetran Transformations for dbt Core
Technology Category
- Infrastructure as a Service (IaaS) - Cloud Databases
- Platform as a Service (PaaS) - Application Development Platforms
Applicable Industries
- Electrical Grids
- Equipment & Machinery
Applicable Functions
- Product Research & Development
Use Cases
- Leasing Finance Automation
- Time Sensitive Networking
Services
- Cloud Planning, Design & Implementation Services
The Challenge
SpotOn, a rapidly growing software and payment company, faced significant challenges in efficiently transforming their captured customer transaction data into fast, reliable, and informative reporting for their clients. As the company scaled, the complexity of turning data into reporting for customers and internal stakeholders increased, with client data scattered across 30 unconnected MySQL databases. The engineering team lacked a central repository for efficient reporting generation. The existing data transformation process using stored procedures in Snowflake became increasingly complex and resource-intensive, with over 2,000 lines of code behind a single table. Changes were not automatically monitored or logged without version control, making quality assurance time-consuming and scaling required writing code from scratch for each new use case. This resulted in high costs, resource-intensive processes, and suboptimal results, impacting the company's ability to scale quickly to meet growing customer needs.
About The Customer
SpotOn is one of the fastest-growing software and payment companies, offering comprehensive, cloud-based technology for businesses of all types and sizes. With the acquisition of Appetize, SpotOn’s client base grew to include enterprise venues like Madison Square Garden, Fenway Park, and MetLife Stadium, all with unique needs and complex data. The company's product team is tasked with efficiently turning captured customer transaction data into fast, reliable, informative reporting for their clients, while their internal data team harnesses data to optimize internal operations.
The Solution
To address these challenges, SpotOn turned to Fivetran, Snowflake, and dbt. Fivetran was used to seamlessly move all of their clients’ customer data from 30 disparate MySQL databases into Snowflake, providing a secure foundation of data that could then be transformed at scale to meet their various analytical needs. With Fivetran Transformations for dbt Core, SpotOn was able to automate faster, more reliable reporting for their clients, while saving time and cost. dbt Core modularized the 2,000 lines of transformation code, making data models more readable, easier to debug, and scalable with jinja templates. By integrating their dbt project into Fivetran, Fivetran Transformations for dbt Core could orchestrate those model runs automatically post-Fivetran connector load, eliminating the need for custom scripting, third-party tools, or DevOps. SpotOn's data engineering team also used dbt Cloud to turn large volumes of data from multiple databases into powerful internal analytics and BI, enabling collaborative, data-driven growth.
Operational Impact
Quantitative Benefit
Related Case Studies.
Case Study
Smart Water Filtration Systems
Before working with Ayla Networks, Ozner was already using cloud connectivity to identify and solve water-filtration system malfunctions as well as to monitor filter cartridges for replacements.But, in June 2015, Ozner executives talked with Ayla about how the company might further improve its water systems with IoT technology. They liked what they heard from Ayla, but the executives needed to be sure that Ayla’s Agile IoT Platform provided the security and reliability Ozner required.
Case Study
IoT enabled Fleet Management with MindSphere
In view of growing competition, Gämmerler had a strong need to remain competitive via process optimization, reliability and gentle handling of printed products, even at highest press speeds. In addition, a digitalization initiative also included developing a key differentiation via data-driven services offers.
Case Study
Predictive Maintenance for Industrial Chillers
For global leaders in the industrial chiller manufacturing, reliability of the entire production process is of the utmost importance. Chillers are refrigeration systems that produce ice water to provide cooling for a process or industrial application. One of those leaders sought a way to respond to asset performance issues, even before they occur. The intelligence to guarantee maximum reliability of cooling devices is embedded (pre-alarming). A pre-alarming phase means that the cooling device still works, but symptoms may appear, telling manufacturers that a failure is likely to occur in the near future. Chillers who are not internet connected at that moment, provide little insight in this pre-alarming phase.
Case Study
Premium Appliance Producer Innovates with Internet of Everything
Sub-Zero faced the largest product launch in the company’s history:It wanted to launch 60 new products as scheduled while simultaneously opening a new “greenfield” production facility, yet still adhering to stringent quality requirements and manage issues from new supply-chain partners. A the same time, it wanted to increase staff productivity time and collaboration while reducing travel and costs.
Case Study
Integration of PLC with IoT for Bosch Rexroth
The application arises from the need to monitor and anticipate the problems of one or more machines managed by a PLC. These problems, often resulting from the accumulation over time of small discrepancies, require, when they occur, ex post technical operations maintenance.
Case Study
Robot Saves Money and Time for US Custom Molding Company
Injection Technology (Itech) is a custom molder for a variety of clients that require precision plastic parts for such products as electric meter covers, dental appliance cases and spools. With 95 employees operating 23 molding machines in a 30,000 square foot plant, Itech wanted to reduce man hours and increase efficiency.
