下载PDF
Auto Database Integration
技术
- 应用基础设施与中间件 - 数据交换与集成
- 应用基础设施与中间件 - 数据库管理和存储
- 平台即服务 (PaaS) - 数据管理平台
适用功能
- 商业运营
服务
- 软件设计与工程服务
- 系统集成
挑战
The logistics company faced significant challenges in managing an evolving data model across a large, heterogeneous set of data sources. With almost 50 different relational databases running Oracle, MySQL, and PostgreSQL, the company needed to address performance issues and enable more interactive data exploration. The introduction of a Hazelcast in-memory data grid as a distributed cache improved data retrieval latency but added a new layer of maintenance complexity. The company needed to keep the data model of the data grid in sync with the data sources as the relational database schemas changed over time.
关于客户
The customer is a logistics company that operates on a global scale, tracking logistics events and managing a complex system that has evolved over time. The company deals with a diverse set of data sources, including almost 50 different relational databases running Oracle, MySQL, and PostgreSQL. The company's system has grown in terms of functional features, geographical locality, and business arrangements, leading to a constant need for new features and data model changes. The company aims to reduce maintenance costs, improve performance, and enable more interactive data exploration.
解决方案
To address the maintenance problem, the company implemented Auto Database Integration (ADBI) to streamline the process of keeping the data model of the Hazelcast IMDG in sync with the relational database sources. At design time, ADBI connects to the relational databases, analyzes the metadata of the tables, and generates the necessary Java POJOs to interact with both the databases and the in-memory grid. ADBI can analyze metadata from all major database engines, making it suitable for managing a heterogeneous set of sources. At run-time, ADBI provides the functionality to feed data from the sources to the data grid, leveraging the Hazelcast Portable interface. This allows the data grid to serve as a vessel for the data without any modifications. Java applications using ADBI can access data from both the grid and the relational databases using Java Streams, enabling seamless optimization and reducing the need for business logic rewrites.
运营影响
数量效益