BIG data architecture

Posted by Roshan on Aug 04, 2020; 4:28pm
URL: http://erman-arslan-s-oracle-forum.124.s1.nabble.com/BIG-data-architecture-tp8559.html

Hi Erman,

our BI environment uses Oracle Golden Gate which will replicate tables from source environment on Solaris servers to it.

The environment on BI is same as that of the source since we use downstream configuration for Golden Gate. The architecture uses SQL/PLSQL scripts to process data from the replicated tables.
BIARCHITECTURE.jpg

We have another environment which uses Big Data. It uses Streamet/talend to extract data from source and process the data instead of using SQL/PLSQL scripts as from above architecture for the transformation.

BIARCHITECTURE2.jpg

The replication tool for source is Streamset.

Kindly advise which of the above will be the best architecture in terms of:

1. Costing
2. Reliability
and any other metrics.
Each architecture has some flaws and benefits when we compare them.

Also in what ways can we integrate them?
Thanks,

Roshan