MFEC x Confluent
MFEC is proud to be a part of the Build with Confluent initiative. By verifying our streaming-based use cases with Confluent, you can have confidence that our Confluent-based service offering is not only built on the leading data streaming platform but also verified by the experts at Confluent.
Confluent is the data streaming platform that is pioneering a fundamentally new category of data infrastructure that sets data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion – designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven back-end operations.
Real-time Data Integration Hub use case
Centralizing data helps reduce data silos in your organization. All departments can syncronize data, with access permissions set for each user. This allows each user to have the required information in real-time and to work with it immediately. However, consolidates data from each source might be complex and time-consuming to develop because the data resides in different locations and databases brand. Additionally, if you also have legacy systems, there will be several challenges, both in gathering data out of mainframe and in converting data from the Mainframe (Binary) into a readable (String) format.
Confluent Platform will centralized data from disparate sources system such as databases, legacy systems and your applications. You can transformation and converting data on the fly before send to destinations. In this use case we have legacy system which is mainframe. Data out of mainframe is a binary format. We have to convert to string format with EBCIDIC converter and COPYBOOK MAPPING before send to target system
Some data is sensitive and requires encryption before being sent to the target system, such as passcodes, credit card information, and other confidential data. MFEC has implemented SecuredFlow SMTs to help users secure their data through encryption. Single Message Transformations (SMTs) enable simple and lightweight data modifications for both inbound and outbound data pipeline.
Data Integration Hub allows organization to:
1. Easy to managed data in one centralized realtime data platform.
2. Get real-time data to use for serveral use case e.g., detect abnormal behavior for fraud system or send real-time transaction/data to notification channel immedialy.
3. Encryption data with customize SMTs.
In this use case example, MFEC has incorporated Confluent into the solution as follows:
- Pre-built connector: Change Data Capture (CDC) connector is integrated with databases and MQ connector. This part ensures real-time data retrieval from each source.
- Stream processing: data transformation using for
- EBCIDIC CONVERTER (Development by MFEC)
- COPYBOOK MAPPING (Development by MFEC)
- Pre-built connector: use sink connector to pull data to destination such as JDBC connector and HTTP connector.
- Customize SMTs: use MFEC customize SMTs (SecuredFlow) for sink connector to encrypt sensitive data.
Wrapping Up
From all the information presented, you have seen that how confluent helps your organization to reduce data silo and modernization legacy system into new real-time centralized platform. MFEC is delighted to assist and provide guidance to enhance your system’s real-time capabilities to add value to your business.
Want to try Confluent Cloud or have ideas for another real-time use case? Reach out to us at dpm@mfec.co.th
