Current
Potential issues:
Bugs in Microservices (producers)
Bugs in Kafka Streams
Bugs in Domain handler (consumers, writing to Hive)
Listen to Domain DB state improvement (CDC)
Rely on final state in Domain Database changes instead of what Microservices maintain, use Source connector to capture that to Kafka. We still have below issues:
Bugs in Kafka Streams
Bugs in Domain handler (consumers, writing to Hive)
Realm Mongo DB Device sync for Mobile
It is using DB sync product from Mongo DB Realm Device Sync. It will sync automatically Realm DB Flutter SDK in the mobile app as a local DB in Flutter.
We still have below potential issues:
Bugs in Kafka Streams
Realm Query Language to do streams processing from MongoDB Realm
We use Realm Query Language to do the transformation, filter, join, and let the Realm calculates. The owner who maintain the RQL is mobile who is also the consumer.
Will need to safeguard “drastic” changes to DB schema in pipeline to RQL wont break. But this will minimize the amount of maintenance layers.
Attachments:
Screen Shot 2023-02-09 at 18.49.02.png (image/png)
Screen Shot 2023-02-09 at 18.52.55.png (image/png)
Screen Shot 2023-02-09 at 18.55.41.png (image/png)
Screen Shot 2023-02-09 at 18.59.06.png (image/png)