RMAN recover error

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

RMAN recover error

Roshan
Oracle DB 12.1.0.2
Solaris 11.4

Hello Erman,

kindly advise whether error below is due to OS configuration? or a bug on Oracle?

DBGRPC:           krmxrpc - channel ORA_DISK_1 kpurpc2 err=0 db=target proc=SYS.DBMS_BACKUP_RESTORE.CFILEUSECURRENT excl: 0
DBGRPC:           krmxrpc - channel ORA_DISK_1 kpurpc2 err=0 db=target proc=SYS.DBMS_BACKUP_RESTORE.DEVICESTATUS excl: 0
DBGRPC:           krmxrpc - channel ORA_DISK_1 kpurpc2 err=0 db=target proc=SYS.DBMS_BACKUP_RESTORE.BMRCANCEL excl: 0
DBGRPC:           krmxrpc - channel ORA_DISK_1 kpurpc2 err=0 db=target proc=SYS.DBMS_BACKUP_RESTORE.FLASHBACKCANCEL excl: 0
DBGRPC:           krmxrpc - channel ORA_DISK_1 kpurpc2 err=0 db=target proc=SYS.DBMS_BACKUP_RESTORE.CLEANUPPGACONTEXT excl: 0
DBGRPC:           krmxrpc - channel ORA_DISK_1 kpurpc2 err=0 db=target proc=SYS.DBMS_BACKUP_RESTORE.SETRMANSTATUSROWID excl: 0
DBGRPC:           krmxr - channel ORA_DISK_1 returned from peicnt
DBGRPC:           krmxr - channel ORA_DISK_1 finished step
DBGRPC:                  ENTERED krmqgns
krmqgns: looking for work for channel default (krmqgns)
DBGRPC:            krmqgns: commands remaining to be executed: (krmqgns)
DBGRPC:            CMD type=cleanup cmdid=1 status=NOT STARTED
DBGRPC:                  1 STEPstepid=1 cmdid=1 status=NOT STARTED
DBGRPC:            krmqgns: no work found for channel default (krmqgns)
DBGRPC:             (krmqgns)
DBGRPC:           EXITED krmqgns with status 1
DBGRPC:           ENTERED krmqgns
DBGRPC:            krmqgns: looking for work for channel ORA_DISK_1 (krmqgns)
DBGRPC:            krmqgns: commands remaining to be executed: (krmqgns)
DBGRPC:            CMD type=cleanup cmdid=1 status=NOT STARTED
DBGRPC:                  1 STEPstepid=1 cmdid=1 status=NOT STARTED
DBGRPC:            krmqgns: no work found for channel ORA_DISK_1 (krmqgns)
DBGRPC:             (krmqgns)
DBGRPC:           EXITED krmqgns with status 1
DBGRPC:           ENTERED krmqgns
DBGRPC:            krmqgns: looking for work for channel default (krmqgns)
DBGRPC:            krmqgns: commands remaining to be executed: (krmqgns)
DBGRPC:            CMD type=cleanup cmdid=1 status=NOT STARTED
DBGRPC:                  1 STEPstepid=1 cmdid=1 status=NOT STARTED
DBGRPC:            krmqgns: no work found for channel default (krmqgns)
DBGRPC:             (krmqgns)
DBGRPC:           EXITED krmqgns with status 1
DBGRPC:           ENTERED krmqgns
DBGRPC:            krmqgns: looking for work for channel ORA_DISK_1 (krmqgns)
DBGRPC:            krmqgns: commands remaining to be executed: (krmqgns)
DBGRPC:            CMD type=cleanup cmdid=1 status=NOT STARTED
DBGRPC:                  1 STEPstepid=1 cmdid=1 status=NOT STARTED
DBGRPC:            krmqgns: no work found for channel ORA_DISK_1 (krmqgns)
DBGRPC:             (krmqgns)
DBGRPC:           EXITED krmqgns with status 1
DBGRPC:           krmxr - all done
DBGRPC:           krmxr - exiting with 0
DBGMISC:         EXITED krmiexe with status 0 [12:55:48.400] elapsed time [00:00:00:00.049]
DBGMISC:         Finished cleanup at 14-MAR-22 [12:55:48.400]
DBGMISC:         ENTERED krmkjcl [12:55:48.400]
DBGMISC:         EXITED krmkjcl [12:55:48.400] elapsed time [00:00:00:00.000]
DBGMISC:        EXITED krmice [12:55:48.400] elapsed time [00:00:00:00.071]
Calling krmmpem from krmmexe
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-10031: RPC Error: ORA-19624  occurred during call to DBMS_BACKUP_RESTORE.RESTOREBACKUPPIECE
RMAN-03002: failure of recover command at 03/14/2022 12:55:47
RMAN-03009: failure of incremental backup restore command on ORA_DISK_2 channel at 03/14/2022 12:55:47
RMAN-10038: database session for channel ORA_DISK_2 terminated unexpectedly
DBGMISC:        ENTERED krmkursr [12:55:48.409]

DBGSQL:          TARGET> select decode(status, 'OPEN', 1, 0), decode(archiver, 'FAILED', 1, 0), decode(database_status, 'SUSPENDED', 1, 0) into :status, :archstuck, :dbsuspended from v$instance
DBGSQL:             sqlcode = 0
DBGSQL:              D :status = 0
DBGSQL:              D :archstuck = 0
DBGSQL:              D :dbsuspended = 0

DBGSQL:          TARGET> select value into :vcomp_txt from  v$parameter where name = 'compatible'
DBGSQL:             sqlcode = 0
DBGSQL:              D :vcomp_txt = 12.1.0.2.0

DBGSQL:          TARGET> declare dot1st number; dot2nd number; dot3rd number; comptxt varchar2(255) := :vcomp_txt; begin comptxt := comptxt || '.0.0'; dot1st := instr(comptxt, '.', 1, 1); dot2nd := instr(comptxt, '.', 1, 2); dot3rd := instr(comptxt, '.', 1, 3); comptxt :=  lpad(substr(comptxt, 1, dot1st - 1), 2, '0') || lpad(substr(comptxt, dot1st + 1, dot2nd - dot1st - 1), 2, '0')  || lpad(substr(comptxt, dot2nd + 1, dot3rd - dot2nd - 1), 2, '0');:vcomp_ub4 := to_number(comptxt); end;
DBGSQL:             sqlcode = 0
DBGSQL:              B :vcomp_ub4 = 120100
DBGSQL:              B :vcomp_txt = 12.1.0.2.0
DBGMISC:         krmkpdbs(): vcomp_txt:12.1.0.2.0 vcomp_ub4:120100 flags:0 [12:55:48.418]

DBGSQL:          TARGET> begin sys.dbms_backup_restore.updateRmanStatusRow( row_id    => :row_id, row_stamp => :row_stamp, status    => :status); end;
DBGSQL:             sqlcode = 0
DBGSQL:              B :row_id = 206017
DBGSQL:              B :row_stamp = 1099313585
DBGSQL:              B :status = 17
DBGMISC:        EXITED krmkursr [12:55:48.419] elapsed time [00:00:00:00.009]

^C

Regards,

Roshan

Reply | Threaded
Open this post in threaded view
|

Re: RMAN recover error

Roshan
I was doing an RMAN incremental restore.
Reply | Threaded
Open this post in threaded view
|

Re: RMAN recover error

ErmanArslansOracleBlog
Administrator
What do you have in alert log?
Reply | Threaded
Open this post in threaded view
|

Re: RMAN recover error

Roshan
ORA-07445: exception encountered: core dump [kcbhfh()+312] [SIGSEGV]

I searched on Oracle Support but could not find no document. I restored the entire DB.
Reply | Threaded
Open this post in threaded view
|

Re: RMAN recover error

ErmanArslansOracleBlog
Administrator
Actually we need to see the trace of that ORA-07445..
So, the actual reason is "ORA-07445: exception encountered: core dump [kcbhfh()+312] [SIGSEGV]"

This seems caused by a bug (saying this with %70 confidence :)

Applying Latest PSU or RU may fix this.. There is a patch for that as well -> patch# 22761995

Here is a similar bug, appearing on restore -> Bug 22761995 - ORA-7445 [KCBHFIX_TAIL()+31] [SIGSEGV] WHEN RUNNING RMAN RESTORE

We have kcbhfh there in the call stack....

There are some workarounds to be considered as well -> Bug 22761995 - ORA-7445 [kcbhfix_tail] When Running RMAN Restore (Doc ID 22761995.8)

Again! not the same function fails, but it is closely related.. I would apply patch 22761995 (or something like 12.1.0.2.190115 (Jan 2019) Database Proactive Bundle Patch) and retest.