RMAN backup failed with this error: RMAN-03009

[Roshan]

Hello,

we are getting the error below:
RMAN backup failed with this error: RMAN-03009

RMAN backup fails due to corrupt blocks found.

channel ORA_DISK_2: starting piece 1 at 20-MAY-16
RMAN-03009: failure of backup command on ORA_DISK_1 channel at 05/20/2016 19:39:46
continuing other job steps, job failed will not be re-run
ORA-19566: exceeded limit of 0 corrupt blocks for file /u01/oracle/PROD/db/apps_st/data/system09.dbf
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
Starting backup at 20-MAY-16
RMAN-03009: failure of backup command on ORA_DISK_1 channel at 05/20/2016 19:39:46
ORA-19566: exceeded limit of 0 corrupt blocks for file /u01/oracle/PROD/db/apps_st/data/system09.dbf



I run the following:

rman> backup validate check logical database;

File Status Marked Corrupt Empty Blocks Blocks Examined High SCN
---- ------ -------------- ------------ --------------- ----------
352 FAILED 0 45928 192128 5965214510244
File Name: /u01/oracle/PROD/db/apps_st/data/system09.dbf
Block Type Blocks Failing Blocks Processed
---------- -------------- ----------------
Data 0 77197
Index 0 40770
Other 26473 28233

RMAN> run {blockrecover corruption list;}

Starting recover at 22-MAY-16
using target database control file instead of recovery catalog
allocated channel: ORA_DISK_1
channel ORA_DISK_1: SID=813 device type=DISK
allocated channel: ORA_DISK_2
channel ORA_DISK_2: SID=1223 device type=DISK
searching flashback logs for block images
finished flashback log search, restored 0 blocks

RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03002: failure of recover command at 05/22/2016 08:11:41
RMAN-06026: some targets not found - aborting restore
RMAN-06023: no backup or copy of datafile 352 found to restore
RMAN-06023: no backup or copy of datafile 352 found to restore


I have also run the following:
RMAN> advise failure;

01/oracle/PROD/db/apps_st/data/system09.dbf' is media corrupt
26462. Please contact Oracle Support Services to resolve failure 159150: Block 192117 in datafile 352: '/u 01/oracle/PROD/db/apps_st/data/system09.dbf' is media corrupt
26463. Please contact Oracle Support Services to resolve failure 159156: Block 192118 in datafile 352: '/u 01/oracle/PROD/db/apps_st/data/system09.dbf' is media corrupt
26464. Please contact Oracle Support Services to resolve failure 159162: Block 192119 in datafile 352: '/u 01/oracle/PROD/db/apps_st/data/system09.dbf' is media corrupt
26465. Please contact Oracle Support Services to resolve failure 159168: Block 192120 in datafile 352: '/u 01/oracle/PROD/db/apps_st/data/system09.dbf' is media corrupt
26466. Please contact Oracle Support Services to resolve failure 159174: Block 192121 in datafile 352: '/u 01/oracle/PROD/db/apps_st/data/system09.dbf' is media corrupt
26467. Please contact Oracle Support Services to resolve failure 159180: Block 192122 in datafile 352: '/u 01/oracle/PROD/db/apps_st/data/system09.dbf' is media corrupt
26468. Please contact Oracle Support Services to resolve failure 159186: Block 192123 in datafile 352: '/u 01/oracle/PROD/db/apps_st/data/system09.dbf' is media corrupt
26469. Please contact Oracle Support Services to resolve failure 159192: Block 192124 in datafile 352: '/u 01/oracle/PROD/db/apps_st/data/system09.dbf' is media corrupt
26470. Please contact Oracle Support Services to resolve failure 159198: Block 192125 in datafile 352: '/u 01/oracle/PROD/db/apps_st/data/system09.dbf' is media corrupt
26471. Please contact Oracle Support Services to resolve failure 159204: Block 192126 in datafile 352: '/u 01/oracle/PROD/db/apps_st/data/system09.dbf' is media corrupt
26472. Please contact Oracle Support Services to resolve failure 159210: Block 192127 in datafile 352: '/u 01/oracle/PROD/db/apps_st/data/system09.dbf' is media corrupt
26473. Please contact Oracle Support Services to resolve failure 159216: Block 192128 in datafile 352: '/u 01/oracle/PROD/db/apps_st/data/system09.dbf' is media corrupt

Still did not solve the issue

Regards,
Roshan

[ErmanArslansOracleBlog]

if this is EBS 12.1, this may be normal.

Resize the system09.dbf and the issue will be fixed.
alter database datafile '<Install_loc>/db/apps_st/data/system09.dbf' resize 1000M;

if the issue continues, update me. If not again update me :)

[Roshan]

I will run it and let you know.

Thanks