golden gate replication

[Roshan]

Oracle DB 12.1.0.2
GG 18c

Hi Erman,

can you please advise why trail file has metadata with 132 columns for a table when source and target tables have 112 columns during Striim replication.

Error fails below:
2751 : Inconsistent source & target table strcture Target {impala::common.cb_subscriber} has less number of column as compared to source {CBS_CORE.CB_SUBSCRIBER}.No of columns in target {112} but expected {132}

Regards,

Roshan

[ErmanArslansOracleBlog]

What are those 132 columns? I mean what exactly are those 20 different columns? -> check with logdump

Check this one also -> https://www.rittmanmead.com/blog/2016/09/using-logdump-to-debug-oracle-goldengate-and-kafka/

In this blog post, there is a column mismatch situation as well.. There, it is caused by a function based index..

[Roshan]

Thanks. I checked with logdump, there seems to be additional SYS columns as in the doc.

CB_RECEIPTS.txt
CB_SUBSCRIBER_MASTER.txt

I will investigate further.

[ErmanArslansOracleBlog]

Good ... You will find your way from now on, then..

[Roshan]

Hi Erman,

I added the parameter EXCLUDEHIDDENCOLUMNS in the extract and I see the hidden fields have disappeared in the logdump.

But still replication to Kudu is failing.
CB_RECEIPTS2.txt
Kindly advise.

Regards,

Roshan

[ErmanArslansOracleBlog]

What is the error now?

[Roshan]

On Striim, following error is still being displayed.

2751 : Inconsistent source & target table strcture Target {impala::common.cb_receipts} has less number of column as compared to source {CBS_CORE.CB_RECEIPTS}.No of columns in target {26} but expected {46}

Kindly advise.

Striim_GG_metadata.txt

Extract from striimserver.log:

2020-10-24 16:27:11,771 @S10_124_0_88 @admin.GG_REMOTE_CDC_KUDU -WARN com.webaction.proc.GGTrailParser_1_0.prepareHasNext() : As table is not in the Wildcard list, ignoring data for table with tableID {12} Trail File {cd000006071} Record Offset {257982050}
2020-10-24 16:27:11,771 @S10_124_0_88 @admin.GG_REMOTE_CDC_KUDU -INFO com.webaction.appmanager.ApplicationStateMachine.takeAction() : Taking Action NODE_ERROR for application admin.GG_REMOTE_CDC_KUDU; Current Status: RUNNING; Event: ServerId: 5bc4ab1d-148d-4e58-84ee-76e6df2629b2 FlowId: 01eb14f0-8974-7771-aa20-005056a1681b Action: NODE_ERROR exceptionEvent: ExceptionEvent : {
"componentName" : "TGT_GGREMOTE_CDC_KUDU" , "componentType" : "TARGET" , "exception" : "com.webaction.exception.ColumnMapException" , "message" : "2751 : Inconsistent source & target table strcture  Target {impala::common.cb_receipts} has less number of column as compared to source {CBS_CORE.CB_RECEIPTS}.No of columns in target {26} but expected {46}" , "relatedEvents" : "[]" , "action" : "CRASH" , "exceptionType" : "AdapterException" , "epochNumber" : 1603542401080
}
2020-10-24 16:27:11,771 @S10_124_0_88 @admin.GG_REMOTE_CDC_KUDU -WARN com.webaction.proc.GGTrailParser_1_0.prepareHasNext() : As table is not in the Wildcard list, ignoring data for table with tableID {12} Trail File {cd000006071} Record Offset {257982218}
2020-10-24 16:27:11,772 @S10_124_0_88 @admin.GG_REMOTE_CDC_KUDU -WARN

[ErmanArslansOracleBlog]

Check the trail using logdump as shown in the blog post that I sent you earlier.
Check the column count (Columns:) and column names.
What do you see? Any system genarated columns?
What is the column count of the table when you check it from dba_tab_columns?
I suspect that there is still some things in the background, which are not table columns, but expose themselves as table columns.

[Roshan]

The column count is 26 when I checked the trail using logdump.

CB_RECEIPTS2.txt

system generated columns have disappeared.

column count from dba_tab_columns is 26.

[Roshan]

I managed to fix the issue by recreating the flow for GG trail to Kudu. In the metadata section of Striim, the Type for the above table contained the invisible fields. After recreating the flow, the fields disappeared.