Backup testing failed using data protector tool

[satish]

Dear erman,

Our environment

2 node Rac
Version 12.1.0.2

Data protector guy took backup of oracle Rac database and tried to restore it,but ended up with below errors.

He says we have to look into these errors.But I don’t I can check this.Need you confirmation please

Normal] From: [e-mail] ""  Time: 08-07-2021 10:49:30 AM
        Restore session 2021/07/08-24 started.

[Normal] From: [e-mail] ""  Time: 07/08/21 10:49:33
        Starting restore of target database.

        Net service name: TESTDB.
        Instance status: MOUNTED.
        Instance name: TESTDB1.
        Database DBID = 1487324113.
        Database control file type: BACKUP.
        Database log mode: ARCHIVELOG.


[Normal] From: [e-mail] ""  Time: 07/08/21 10:49:39
        Starting Oracle Recovery Manager.


Recovery Manager: Release 12.1.0.2.0 - Production on Thu Jul 8 10:49:39 2021

Copyright (c) 1982, 2014, Oracle and/or its affiliates.  All rights reserved.

RMAN> CONNECT TARGET *
2> HOST 'exit';
3> run {
4> allocate channel 'dev_0' type 'sbt_tape'
5> parms 'SBT_LIBRARY=/opt/omni/lib/libob2oracle8_64bit.so';
6>
7> send channel 'dev_0' 'OB2BARTYPE=Oracle8';
8> send channel 'dev_0' 'OB2APPNAME=TESTDB';
9> send channel 'dev_0' 'OB2BARLIST=1625721569';
10> send channel 'dev_0' 'OB2BARHOSTNAME=erpuat-scan.xss.com';
11> restore database;
12> recover database;
13> release channel 'dev_0';
14> }
15> run {
16> sql 'alter database open';
17> }
18> EXIT
RMAN-06568: connected to target database: TESTDB (DBID=1487324113, not open)
RMAN-06009: using target database control file instead of recovery catalog


RMAN-08030: allocated channel: dev_0
RMAN-08605: channel dev_0: SID=702 instance=TESTDB1 device type=SBT_TAPE
RMAN-08526: channel dev_0: Omniback/125

RMAN-06421: sent command to channel: dev_0

RMAN-06421: sent command to channel: dev_0

RMAN-06421: sent command to channel: dev_0

RMAN-06421: sent command to channel: dev_0

RMAN-03090: Starting restore at 08-JUL-21

RMAN-08016: channel dev_0: starting datafile backup set restore
RMAN-08089: channel dev_0: specifying datafile(s) to restore from backup set
RMAN-08610: channel dev_0: restoring datafile 00002 to +DATADG/TESTDB/DATAFILE/system.257.1023121689
RMAN-08610: channel dev_0: restoring datafile 00016 to +DATADG/TESTDB/DATAFILE/apps_ts_seed.263.1023121759
RMAN-08610: channel dev_0: restoring datafile 00017 to +DATADG/TESTDB/DATAFILE/apps_ts_interface.264.1023121785
RMAN-08610: channel dev_0: restoring datafile 00024 to +DATADG/TESTDB/DATAFILE/system.271.1023121969
RMAN-08610: channel dev_0: restoring datafile 00031 to +DATADG/TESTDB/DATAFILE/system.278.1023122123
RMAN-08610: channel dev_0: restoring datafile 00040 to +DATADG/TESTDB/DATAFILE/xxxss_data.287.1023122195
RMAN-08610: channel dev_0: restoring datafile 00054 to +DATADG/TESTDB/DATAFILE/apps_ts_media.301.1023122901
RMAN-08610: channel dev_0: restoring datafile 00352 to +DATADG/TESTDB/DATAFILE/system.309.1023123069
RMAN-08610: channel dev_0: restoring datafile 00393 to +DATADG/TESTDB/DATAFILE/apps_ts_tx_idx.314.1023123157
RMAN-08610: channel dev_0: restoring datafile 00400 to +DATADG/TESTDB/DATAFILE/apps_ts_media.321.1023123381
RMAN-08610: channel dev_0: restoring datafile 00401 to +DATADG/TESTDB/DATAFILE/apps_ts_tx_data.322.1023123407
RMAN-08003: channel dev_0: reading from backup piece scanuat_test<TESTDB_634:1031072794:1>.dbf
RMAN-08615: channel dev_0: ORA-19870: error while restoring backup piece scanuat_test<TESTDB_634:1031072794:1>.dbf
ORA-19507: failed to retrieve sequential file, handle="scanuat_test<TESTDB_634:1031072794:1>.dbf", parms=""
ORA-27029: skgfrtrv: sbtrestore returned error
ORA-19511: non RMAN, but media manager or vendor specific failure, error text:
   Vendor specific error: SBT_Query_for_objects(...) call failed
 ERR(0)

RMAN-08016: channel dev_0: starting datafile backup set restore
RMAN-08089: channel dev_0: specifying datafile(s) to restore from backup set
RMAN-08610: channel dev_0: restoring datafile 00022 to +DATADG/TESTDB/DATAFILE/system.269.1023121907
RMAN-08610: channel dev_0: restoring datafile 00029 to +DATADG/TESTDB/DATAFILE/system.276.1023122083
RMAN-08610: channel dev_0: restoring datafile 00035 to +DATADG/TESTDB/DATAFILE/apps_undots1.282.1023122133
RMAN-08610: channel dev_0: restoring datafile 00036 to +DATADG/TESTDB/DATAFILE/xxxss_data.283.1023122141
RMAN-08610: channel dev_0: restoring datafile 00042 to +DATADG/TESTDB/DATAFILE/apps_ts_media.289.1023122219
RMAN-08610: channel dev_0: restoring datafile 00046 to +DATADG/TESTDB/DATAFILE/apps_ts_tx_idx.293.1023122307
RMAN-08610: channel dev_0: restoring datafile 00288 to +DATADG/TESTDB/DATAFILE/system.305.1023123023
RMAN-08610: channel dev_0: restoring datafile 00351 to +DATADG/TESTDB/DATAFILE/system.308.1023123061
RMAN-08610: channel dev_0: restoring datafile 00353 to +DATADG/TESTDB/DATAFILE/system.310.1023123103
RMAN-08610: channel dev_0: restoring datafile 00395 to +DATADG/TESTDB/DATAFILE/apps_ts_interface.316.1023123181
RMAN-08610: channel dev_0: restoring datafile 00399 to +DATADG/TESTDB/DATAFILE/apps_ts_queues.320.1023123335
RMAN-08610: channel dev_0: restoring datafile 00406 to +DATADG/TESTDB/DATAFILE/apps_ts_tx_idx.327.1023123765
RMAN-08003: channel dev_0: reading from backup piece scanuat_test<TESTDB_632:1031072794:1>.dbf
RMAN-08615: channel dev_0: ORA-19870: error while restoring backup piece scanuat_test<TESTDB_632:1031072794:1>.dbf
ORA-19507: failed to retrieve sequential file, handle="scanuat_test<TESTDB_632:1031072794:1>.dbf", parms=""
ORA-27029: skgfrtrv: sbtrestore returned error
ORA-19511: non RMAN, but media manager or vendor specific failure, error text:
   Vendor specific error: SBT_Query_for_objects(...) call failed
 ERR(0)

RMAN-08016: channel dev_0: starting datafile backup set restore
RMAN-08089: channel dev_0: specifying datafile(s) to restore from backup set
RMAN-08610: channel dev_0: restoring datafile 00001 to +DATADG/TESTDB/DATAFILE/system.330.1023121689
RMAN-08610: channel dev_0: restoring datafile 00007 to +DATADG/TESTDB/DATAFILE/owapub.342.1023121721
RMAN-08610: channel dev_0: restoring datafile 00012 to +DATADG/TESTDB/DATAFILE/apps_ts_tools.260.1023121749
RMAN-08610: channel dev_0: restoring datafile 00018 to +DATADG/TESTDB/DATAFILE/sysaux.265.1023121809
RMAN-08610: channel dev_0: restoring datafile 00021 to +DATADG/TESTDB/DATAFILE/system.268.1023121881
RMAN-08610: channel dev_0: restoring datafile 00028 to +DATADG/TESTDB/DATAFILE/system.275.1023122047
RMAN-08610: channel dev_0: restoring datafile 00047 to +DATADG/TESTDB/DATAFILE/apps_ts_tx_data.294.1023122323
RMAN-08610: channel dev_0: restoring datafile 00056 to +DATADG/TESTDB/DATAFILE/xxadm_idx.303.1023123013
RMAN-08610: channel dev_0: restoring datafile 00295 to +DATADG/TESTDB/DATAFILE/system.306.1023123029
RMAN-08610: channel dev_0: restoring datafile 00396 to +DATADG/TESTDB/DATAFILE/apps_ts_summary.317.1023123225
RMAN-08610: channel dev_0: restoring datafile 00397 to +DATADG/TESTDB/DATAFILE/apps_ts_nologging.318.1023123233
RMAN-08610: channel dev_0: restoring datafile 00403 to +DATADG/TESTDB/DATAFILE/apps_ts_tx_idx.324.1023123517
RMAN-08003: channel dev_0: reading from backup piece scanuat_test<TESTDB_633:1031072794:1>.dbf
RMAN-08615: channel dev_0: ORA-19870: error while restoring backup piece scanuat_test<TESTDB_633:1031072794:1>.dbf
ORA-19507: failed to retrieve sequential file, handle="scanuat_test<TESTDB_633:1031072794:1>.dbf", parms=""
ORA-27029: skgfrtrv: sbtrestore returned error
ORA-19511: non RMAN, but media manager or vendor specific failure, error text:
   Vendor specific error: SBT_Query_for_objects(...) call failed
 ERR(0)

RMAN-08016: channel dev_0: starting datafile backup set restore
RMAN-08089: channel dev_0: specifying datafile(s) to restore from backup set
RMAN-08610: channel dev_0: restoring datafile 00005 to +DATADG/TESTDB/DATAFILE/system.328.1023121691
RMAN-08610: channel dev_0: restoring datafile 00009 to +DATADG/TESTDB/DATAFILE/odm.329.1023121729
RMAN-08610: channel dev_0: restoring datafile 00014 to +DATADG/TESTDB/DATAFILE/apps_ts_tx_data.261.1023121749
RMAN-08610: channel dev_0: restoring datafile 00015 to +DATADG/TESTDB/DATAFILE/apps_ts_tx_idx.262.1023121751
RMAN-08610: channel dev_0: restoring datafile 00020 to +DATADG/TESTDB/DATAFILE/system.267.1023121845
RMAN-08610: channel dev_0: restoring datafile 00027 to +DATADG/TESTDB/DATAFILE/system.274.1023122047
RMAN-08610: channel dev_0: restoring datafile 00034 to +DATADG/TESTDB/DATAFILE/apps_ts_seed.281.1023122133
RMAN-08610: channel dev_0: restoring datafile 00038 to +DATADG/TESTDB/DATAFILE/xxxss_data.285.1023122143
RMAN-08610: channel dev_0: restoring datafile 00053 to +DATADG/TESTDB/DATAFILE/xxtbr_idx.300.1023122897
RMAN-08610: channel dev_0: restoring datafile 00057 to +DATADG/TESTDB/DATAFILE/apps_ts_nologging.304.1023123021
RMAN-08610: channel dev_0: restoring datafile 00354 to +DATADG/TESTDB/DATAFILE/system.311.1023123105
RMAN-08610: channel dev_0: restoring datafile 00404 to +DATADG/TESTDB/DATAFILE/apps_ts_tx_idx.334.1023123613
RMAN-08003: channel dev_0: reading from backup piece scanuat_test<TESTDB_636:1031072794:1>.dbf
RMAN-08615: channel dev_0: ORA-19870: error while restoring backup piece scanuat_test<TESTDB_636:1031072794:1>.dbf
ORA-19507: failed to retrieve sequential file, handle="scanuat_test<TESTDB_636:1031072794:1>.dbf", parms=""
ORA-27029: skgfrtrv: sbtrestore returned error
ORA-19511: non RMAN, but media manager or vendor specific failure, error text:
   Vendor specific error: SBT_Query_for_objects(...) call failed
 ERR(0)

RMAN-08016: channel dev_0: starting datafile backup set restore
RMAN-08089: channel dev_0: specifying datafile(s) to restore from backup set
RMAN-08610: channel dev_0: restoring datafile 00003 to +DATADG/TESTDB/DATAFILE/system.336.1023121689
RMAN-08610: channel dev_0: restoring datafile 00010 to +DATADG/TESTDB/DATAFILE/olap.332.1023121731
RMAN-08610: channel dev_0: restoring datafile 00025 to +DATADG/TESTDB/DATAFILE/system.272.1023122005
RMAN-08610: channel dev_0: restoring datafile 00032 to +DATADG/TESTDB/DATAFILE/apps_ts_seed.279.1023122125
RMAN-08610: channel dev_0: restoring datafile 00037 to +DATADG/TESTDB/DATAFILE/xxxss_idx.284.1023122143
RMAN-08610: channel dev_0: restoring datafile 00039 to +DATADG/TESTDB/DATAFILE/xxxss_data.286.1023122169
RMAN-08610: channel dev_0: restoring datafile 00049 to +DATADG/TESTDB/DATAFILE/apps_ts_tx_idx.296.1023122553
RMAN-08610: channel dev_0: restoring datafile 00050 to +DATADG/TESTDB/DATAFILE/sysaux.297.1023122699
RMAN-08610: channel dev_0: restoring datafile 00055 to +DATADG/TESTDB/DATAFILE/xxadm_data.302.1023122987
RMAN-08610: channel dev_0: restoring datafile 00314 to +DATADG/TESTDB/DATAFILE/portal.307.1023123057
RMAN-08610: channel dev_0: restoring datafile 00392 to +DATADG/TESTDB/DATAFILE/apps_ts_tx_data.313.1023123121
RMAN-08610: channel dev_0: restoring datafile 00394 to +DATADG/TESTDB/DATAFILE/apps_ts_seed.315.1023123173
RMAN-08003: channel dev_0: reading from backup piece scanuat_test<TESTDB_637:1031072794:1>.dbf
RMAN-08615: channel dev_0: ORA-19870: error while restoring backup piece scanuat_test<TESTDB_637:1031072794:1>.dbf
ORA-19507: failed to retrieve sequential file, handle="scanuat_test<TESTDB_637:1031072794:1>.dbf", parms=""
ORA-27029: skgfrtrv: sbtrestore returned error
ORA-19511: non RMAN, but media manager or vendor specific failure, error text:
   Vendor specific error: SBT_Query_for_objects(...) call failed
 ERR(0)

RMAN-08016: channel dev_0: starting datafile backup set restore
RMAN-08089: channel dev_0: specifying datafile(s) to restore from backup set
RMAN-08610: channel dev_0: restoring datafile 00008 to +DATADG/TESTDB/DATAFILE/apps_ts_queues.331.1023121723
RMAN-08610: channel dev_0: restoring datafile 00011 to +DATADG/TESTDB/DATAFILE/sysaux.258.1023121733
RMAN-08610: channel dev_0: restoring datafile 00013 to +DATADG/TESTDB/DATAFILE/system.259.1023121749
RMAN-08610: channel dev_0: restoring datafile 00023 to +DATADG/TESTDB/DATAFILE/system.270.1023121943
RMAN-08610: channel dev_0: restoring datafile 00030 to +DATADG/TESTDB/DATAFILE/system.277.1023122099
RMAN-08610: channel dev_0: restoring datafile 00043 to +DATADG/TESTDB/DATAFILE/apps_ts_tx_data.290.1023122255
RMAN-08610: channel dev_0: restoring datafile 00044 to +DATADG/TESTDB/DATAFILE/apps_undots2.291.1023122281
RMAN-08610: channel dev_0: restoring datafile 00058 to +DATADG/TESTDB/DATAFILE/uatbackup.352.1030547157
RMAN-08610: channel dev_0: restoring datafile 00379 to +DATADG/TESTDB/DATAFILE/apps_undots1.312.1023123113
RMAN-08610: channel dev_0: restoring datafile 00405 to +DATADG/TESTDB/DATAFILE/apps_ts_tx_idx.337.1023123707
RMAN-08610: channel dev_0: restoring datafile 00407 to +DATADG/TESTDB/DATAFILE/apps_ts_seed.326.1023123911
RMAN-08003: channel dev_0: reading from backup piece scanuat_test<TESTDB_635:1031072794:1>.dbf
RMAN-08615: channel dev_0: ORA-19870: error while restoring backup piece scanuat_test<TESTDB_635:1031072794:1>.dbf
ORA-19507: failed to retrieve sequential file, handle="scanuat_test<TESTDB_635:1031072794:1>.dbf", parms=""
ORA-27029: skgfrtrv: sbtrestore returned error
ORA-19511: non RMAN, but media manager or vendor specific failure, error text:
   Vendor specific error: SBT_Query_for_objects(...) call failed
 ERR(0)

RMAN-08016: channel dev_0: starting datafile backup set restore
RMAN-08089: channel dev_0: specifying datafile(s) to restore from backup set
RMAN-08610: channel dev_0: restoring datafile 00004 to +DATADG/TESTDB/DATAFILE/system.325.1023121691
RMAN-08610: channel dev_0: restoring datafile 00019 to +DATADG/TESTDB/DATAFILE/system.266.1023121811
RMAN-08610: channel dev_0: restoring datafile 00026 to +DATADG/TESTDB/DATAFILE/system.273.1023122021
RMAN-08610: channel dev_0: restoring datafile 00033 to +DATADG/TESTDB/DATAFILE/apps_ts_seed.280.1023122125
RMAN-08610: channel dev_0: restoring datafile 00041 to +DATADG/TESTDB/DATAFILE/xxxss_data.288.1023122203
RMAN-08610: channel dev_0: restoring datafile 00045 to +DATADG/TESTDB/DATAFILE/sysaux.292.1023122281
RMAN-08610: channel dev_0: restoring datafile 00051 to +DATADG/TESTDB/DATAFILE/sysaux.298.1023122795
RMAN-08610: channel dev_0: restoring datafile 00052 to +DATADG/TESTDB/DATAFILE/xxtbr_data.299.1023122881
RMAN-08610: channel dev_0: restoring datafile 00398 to +DATADG/TESTDB/DATAFILE/apps_ts_archive.319.1023123279
RMAN-08610: channel dev_0: restoring datafile 00402 to +DATADG/TESTDB/DATAFILE/apps_ts_tx_data.323.1023123441
RMAN-08003: channel dev_0: reading from backup piece scanuat_test<TESTDB_638:1031072794:1>.dbf
RMAN-08615: channel dev_0: ORA-19870: error while restoring backup piece scanuat_test<TESTDB_638:1031072794:1>.dbf
ORA-19507: failed to retrieve sequential file, handle="scanuat_test<TESTDB_638:1031072794:1>.dbf", parms=""
ORA-27029: skgfrtrv: sbtrestore returned error
ORA-19511: non RMAN, but media manager or vendor specific failure, error text:
   Vendor specific error: SBT_Query_for_objects(...) call failed
 ERR(0)

RMAN-08016: channel dev_0: starting datafile backup set restore
RMAN-08089: channel dev_0: specifying datafile(s) to restore from backup set
RMAN-08610: channel dev_0: restoring datafile 00006 to +DATADG/TESTDB/DATAFILE/ctxd.341.1023121717
RMAN-08003: channel dev_0: reading from backup piece ScanUAT_Control<TESTDB_651:1031138400:1>.dbf
RMAN-08615: channel dev_0: ORA-19870: error while restoring backup piece ScanUAT_Control<TESTDB_651:1031138400:1>.dbf
ORA-19507: failed to retrieve sequential file, handle="ScanUAT_Control<TESTDB_651:1031138400:1>.dbf", parms=""
ORA-27029: skgfrtrv: sbtrestore returned error
ORA-19511: non RMAN, but media manager or vendor specific failure, error text:
   Vendor specific error: SBT_Query_for_objects(...) call failed
 ERR(0)

RMAN-08016: channel dev_0: starting datafile backup set restore
RMAN-08089: channel dev_0: specifying datafile(s) to restore from backup set
RMAN-08610: channel dev_0: restoring datafile 00048 to +DATADG/TESTDB/DATAFILE/ctxd.295.1023122549
RMAN-08003: channel dev_0: reading from backup piece ScanUAT_Control<TESTDB_650:1031138400:1>.dbf
RMAN-08615: channel dev_0: ORA-19870: error while restoring backup piece ScanUAT_Control<TESTDB_650:1031138400:1>.dbf
ORA-19507: failed to retrieve sequential file, handle="ScanUAT_Control<TESTDB_650:1031138400:1>.dbf", parms=""
ORA-27029: skgfrtrv: sbtrestore returned error
ORA-19511: non RMAN, but media manager or vendor specific failure, error text:
   Vendor specific error: SBT_Query_for_objects(...) call failed
 ERR(0)

RMAN-05016: failover to previous backup

RMAN-08031: released channel: dev_0
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03002: failure of restore command at 07/08/2021 10:49:53
RMAN-06026: some targets not found - aborting restore
RMAN-06023: no backup or copy of datafile 407 found to restore
RMAN-06023: no backup or copy of datafile 406 found to restore
RMAN-06023: no backup or copy of datafile 405 found to restore
RMAN-06023: no backup or copy of datafile 404 found to restore
RMAN-06023: no backup or copy of datafile 403 found to restore
RMAN-06023: no backup or copy of datafile 402 found to restore
RMAN-06023: no backup or copy of datafile 401 found to restore
RMAN-06023: no backup or copy of datafile 400 found to restore
RMAN-06023: no backup or copy of datafile 399 found to restore
RMAN-06023: no backup or copy of datafile 397 found to restore
RMAN-06023: no backup or copy of datafile 396 found to restore
RMAN-06023: no backup or copy of datafile 395 found to restore
RMAN-06023: no backup or copy of datafile 394 found to restore
RMAN-06023: no backup or copy of datafile 393 found to restore
RMAN-06023: no backup or copy of datafile 392 found to restore
RMAN-06023: no backup or copy of datafile 379 found to restore
RMAN-06023: no backup or copy of datafile 354 found to restore
RMAN-06023: no backup or copy of datafile 353 found to restore
RMAN-06023: no backup or copy of datafile 352 found to restore
RMAN-06023: no backup or copy of datafile 351 found to restore
RMAN-06023: no backup or copy of datafile 314 found to restore
RMAN-06023: no backup or copy of datafile 295 found to restore
RMAN-06023: no backup or copy of datafile 288 found to restore
RMAN-06023: no backup or copy of datafile 57 found to restore
RMAN-06023: no backup or copy of datafile 56 found to restore
RMAN-06023: no backup or copy of datafile 55 found to restore
RMAN-06023: no backup or copy of datafile 54 found to restore
RMAN-06023: no backup or copy of datafile 53 found to restore
RMAN-06023: no backup or copy of datafile 52 found to restore
RMAN-06023: no backup or copy of datafile 51 found to restore
RMAN-06023: no backup or copy of datafile 50 found to restore
RMAN-06023: no backup or copy of datafile 49 found to restore
RMAN-06023: no backup or copy of datafile 47 found to restore
RMAN-06023: no backup or copy of datafile 46 found to restore
RMAN-06023: no backup or copy of datafile 45 found to restore
RMAN-06023: no backup or copy of datafile 44 found to restore
RMAN-06023: no backup or copy of datafile 43 found to restore
RMAN-06023: no backup or copy of datafile 42 found to restore
RMAN-06023: no backup or copy of datafile 41 found to restore
RMAN-06023: no backup or copy of datafile 40 found to restore
RMAN-06023: no backup or copy of datafile 39 found to restore
RMAN-06023: no backup or copy of datafile 38 found to restore
RMAN-06023: no backup or copy of datafile 37 found to restore
RMAN-06023: no backup or copy of datafile 36 found to restore
RMAN-06023: no backup or copy of datafile 35 found to

[satish]

Missed to update,this is the session log shared by data protector guy.

[ErmanArslansOracleBlog]

Ensure that those required backup pieces are visible and accessible by the data protector.. Accessible in its internal database and ensure they are still protected.

You have ERR(0) there. that error is for rman SBT_Query_for_objects.

So, it seem that the data protector can not find those backup pieces...
Data Protector logs also can tell you something about this. But it seems it is in the Data Protector side..