SaFi Bank Space : Ably Usage/Configuration Plan

Ably configuration plan

 Backend

1. For those kafka topics mapped to ably customer channel; need to use customerId as kafka message key . For those kafka topics mapped to ably account channel; need to use accountId as kafka message key.

2. use topic as event type

3. requestId and other metadata can be pass in kafka message header

Frontend

1. pass customerId in _prepareAbly

2. map event type, example customer_events_constants.dart

3. flow in FE side:
   

   

Infrastructure

1. need to add 3rd party plugin for message transformation.
   Since official confluent message transformation does not support insert field from header, we use additional plugin.
   For this usecase, we want to add requestId from kafka message header to message field.
   plugin: https://github.com/jcustenborder/kafka-connect-transform-common

 Related articles

Ably Kafka Connector
Setup Ably connector with distributed mode