安装RAC错误，急！！！！

显示全部楼层 · 2014-9-15 20:46:27

大虾们：求救
我现在有两台P740
AIX 版本为6100-07-000
安装ORACLE RAC版本为11.2.0.3
安装执行root.sh时，第一个节点没问题
##STATEFile Universal Id
File Name Disk group
------------------------
--------- ---------
1. ONLINE 66ad7bb519a54ff4bf325de520f7895f (/dev/rhdisk8) [DATA]
Located 1 voting disk(s).
CRS-2672: Attempting to start 'ora.asm' on 'eshoes_rac1'
CRS-2676: Start of 'ora.asm' on 'eshoes_rac1' succeeded
CRS-2672: Attempting to start 'ora.DATA.dg' on 'eshoes_rac1'
CRS-2676: Start of 'ora.DATA.dg' on 'eshoes_rac1' succeeded
CRS-2672: Attempting to start 'ora.registry.acfs' on 'eshoes_rac1'
CRS-2676: Start of 'ora.registry.acfs' on 'eshoes_rac1' succeeded
Configure Oracle Grid Infrastructure for a Cluster ... succeeded

但第二个执行root.sh时出错。
CRS-2676: Start of 'ora.cssd' on 'eshoes_rac2' succeeded
Mounting Disk Group DATA failed with the following message:
ORA-15032: not all alterations performed
ORA-15017: diskgroup "DATA" cannot be mounted
ORA-15063: ASM discovered an insufficient number of disks for diskgroup "DATA"
ORA-15080: synchronous I/O operation to a disk failed

Configuration of ASM ... failed
see asmca logs at /oracle/grid/cfgtoollogs/asmca for details
Did not succssfully configure and start ASM at /oracle/11.2/grid/crs/install/crsconfig_lib.pm line 6763.
/oracle/11.2/grid/perl/bin/perl -I/oracle/11.2/grid/perl/lib -I/oracle/11.2/grid/crs/install /oracle/11.2/grid/crs/install/rootcrs.pl execution failed

使用kfod查看第二个节点看不到rhdisk8
bash-4.2$ kfod asm_diskstring='/dev/rhdisk*' disks=all
--------------------------------------------------------------------------------
Disk
Size Path
User Group
================================================================================
1: 286102 Mb /dev/rhdisk0
root system
2: 286102 Mb /dev/rhdisk1
root system
3: 409600 Mb /dev/rhdisk10
grid oinstall
4:20480 Mb /dev/rhdisk9
grid oinstall
--------------------------------------------------------------------------------
ORACLE_SID ORACLE_HOME

================================================================================
+ASM1 /oracle/11.2/grid

bash-3.2$ kfod asm_diskstring='/dev/rhdisk*' disks=all
--------------------------------------------------------------------------------
Disk
Size Path
User Group
================================================================================
1: 409600 Mb /dev/rhdisk10
grid oinstall
2:20480 Mb /dev/rhdisk8
grid oinstall
3:20480 Mb /dev/rhdisk9
grid oinstall
--------------------------------------------------------------------------------
ORACLE_SID ORACLE_HOME

================================================================================
+ASM1 /oracle/11.2/grid

asmca日志

[main] [ 2014-09-15 20:46:27.208 CST ] [SQLEngine.initialize:325]Execing SQLPLUS/SVRMGR process...
[main] [ 2014-09-15 20:46:27.229 CST ] [SQLEngine.initialize:362]m_bReaderStarted: false
[main] [ 2014-09-15 20:46:27.230 CST ] [SQLEngine.initialize:366]Starting Reader Thread...
[main] [ 2014-09-15 20:46:27.273 CST ] [UsmcaLogger.logExit:124]Exiting oracle.sysman.assistants.usmca.backend.USMInstance Method
: createSQLEngine
[main] [ 2014-09-15 20:46:27.273 CST ] [OracleHome.getVersion:889]OracleHome.getVersion called.Current Version: null
[main] [ 2014-09-15 20:46:27.276 CST ] [InventoryUtil.getOUIInvSession:347]setting OUI READ level to ACCESSLEVEL_READ_LOCKLESS
[main] [ 2014-09-15 20:46:27.276 CST ] [OracleHome.getVersion:908]Homeinfo /oracle/11.2/grid,1
[main] [ 2014-09-15 20:46:27.350 CST ] [OracleHome.getVersion:957]Current Version From Inventory: null
[main] [ 2014-09-15 20:46:27.350 CST ] [OracleHome.getVersion:964]using sqlplus: /oracle/11.2/grid/bin/sqlplus
[main] [ 2014-09-15 20:46:27.350 CST ] [OracleHome.getVersion:996]adding oracle home to sqlplus env
[main] [ 2014-09-15 20:46:27.351 CST ] [OracleHome.getVersion:1000]LIBPATH=/oracle/11.2/grid/lib:/oracle/11.2/grid/jdk/jre/bin:/or
acle/11.2/grid/jdk/jre/bin:/oracle/11.2/grid/jdk/jre/bin/classic:/oracle/11.2/grid/jdk/jre/bin:/oracle/11.2/grid/lib:/oracle/11.2/gr
id/network/lib:/oracle/11.2/grid/jdk/jre/bin/j9vm:/usr/lib
[main] [ 2014-09-15 20:46:27.351 CST ] [OracleHome.getVersion:1000]ORACLE_HOME=/oracle/11.2/grid
[main] [ 2014-09-15 20:46:27.391 CST ] [OracleHome.getVersion:1005]/oracle/11.2/grid/bin/sqlplus Banner:
SQL*Plus: Release 11.2.0.3.0 Production
[main] [ 2014-09-15 20:46:27.392 CST ] [OracleHome.getVersion:1023]Current version from sqlplus: 11.2.0.3.0
[main] [ 2014-09-15 20:46:27.392 CST ] [UsmcaLogger.logInfo:143]Role SYSASM
[main] [ 2014-09-15 20:46:27.392 CST ] [UsmcaLogger.logInfo:143]OS Auth true
[main] [ 2014-09-15 20:46:32.634 CST ] [SQLEngine.done:2189]Done called
[main] [ 2014-09-15 20:46:32.634 CST ] [USMInstance.configureLocalASM:3033]ORA-15032: not all alterations performed
ORA-15017: diskgroup "DATA" cannot be mounted
ORA-15063: ASM discovered an insufficient number of disks for diskgroup "DATA"
ORA-15080: synchronous I/O operation to a disk failed
[main] [ 2014-09-15 20:46:32.634 CST ] [SQLEngine.reInitialize:738]Reinitializing SQLEngine...
[main] [ 2014-09-15 20:46:32.634 CST ] [OracleHome.getVersion:889]OracleHome.getVersion called.Current Version: 11.2.0.3.0
[main] [ 2014-09-15 20:46:32.635 CST ] [OracleHome.getVersion:957]Current Version From Inventory: 11.2.0.3.0
[main] [ 2014-09-15 20:46:32.635 CST ] [OracleHome.getVersion:889]OracleHome.getVersion called.Current Version: 11.2.0.3.0
[main] [ 2014-09-15 20:46:32.635 CST ] [OracleHome.getVersion:957]Current Version From Inventory: 11.2.0.3.0
[main] [ 2014-09-15 20:46:32.635 CST ] [OracleHome.getVersion:889]OracleHome.getVersion called.Current Version: 11.2.0.3.0
[main] [ 2014-09-15 20:46:32.635 CST ] [OracleHome.getVersion:957]Current Version From Inventory: 11.2.0.3.0
[main] [ 2014-09-15 20:46:32.635 CST ] [SQLPlusEngine.getCmmdParams:222]m_home 11.2.0.3.0
[main] [ 2014-09-15 20:46:32.635 CST ] [SQLPlusEngine.getCmmdParams:223]version > 112 true
[main] [ 2014-09-15 20:46:32.636 CST ] [SQLEngine.getEnvParams:555]Default NLS_LANG: AMERICAN_AMERICA.AL32UTF8
[main] [ 2014-09-15 20:46:32.636 CST ] [SQLEngine.getEnvParams:565]NLS_LANG: AMERICAN_AMERICA.AL32UTF8
[main] [ 2014-09-15 20:46:32.637 CST ] [SQLEngine.initialize:325]Execing SQLPLUS/SVRMGR process...
[main] [ 2014-09-15 20:46:32.649 CST ] [SQLEngine.initialize:362]m_bReaderStarted: false
[main] [ 2014-09-15 20:46:32.661 CST ] [SQLEngine.initialize:366]Starting Reader Thread...
[main] [ 2014-09-15 20:46:32.679 CST ] [SQLEngine.initialize:415]Waiting for m_bReaderStarted to be true
[main] [ 2014-09-15 20:46:32.841 CST ] [UsmcaLogger.logInfo:143]Instance running true
[main] [ 2014-09-15 20:46:32.841 CST ] [UsmcaLogger.logInfo:143]Diskgroup exists, mounting..
[main] [ 2014-09-15 20:46:32.847 CST ] [SQLEngine.doSQLSubstitution:2414]The substituted sql statement:=select state from v$asm_di
skgroup where name=upper('DATA')
[main] [ 2014-09-15 20:46:33.121 CST ] [SQLEngine.doSQLSubstitution:2414]The substituted sql statement:=alter diskgroup DATA MOUNT
[main] [ 2014-09-15 20:46:33.393 CST ] [SQLEngine.done:2189]Done called
[main] [ 2014-09-15 20:46:33.394 CST ] [UsmcaLogger.logException:173]SEVERE:method oracle.sysman.assistants.usmca.backend.USMDiskG
roupManager:mountDiskGroups
[main] [ 2014-09-15 20:46:33.394 CST ] [UsmcaLogger.logException:174]ORA-15032: not all alterations performed
ORA-15017: diskgroup "DATA" cannot be mounted
ORA-15063: ASM discovered an insufficient number of disks for diskgroup "DATA"
ORA-15080: synchronous I/O operation to a disk failed
[main] [ 2014-09-15 20:46:33.394 CST ] [UsmcaLogger.logException:175]oracle.sysman.assistants.util.sqlEngine.SQLFatalErrorExceptio
n: ORA-15032: not all alterations performed
ORA-15017: diskgroup "DATA" cannot be mounted
ORA-15063: ASM discovered an insufficient number of disks for diskgroup "DATA"
ORA-15080: synchronous I/O operation to a disk failed
oracle.sysman.assistants.util.sqlEngine.SQLEngine.executeImpl(SQLEngine.java:1658)
oracle.sysman.assistants.util.sqlEngine.SQLEngine.executeSql(SQLEngine.java:1925)
oracle.sysman.assistants.usmca.backend.USMDiskGroupManager.mountDiskGroup(USMDiskGroupManager.java:2156)
oracle.sysman.assistants.usmca.backend.USMDiskGroupManager.mountDiskGroups(USMDiskGroupManager.java:1305)
oracle.sysman.assistants.usmca.backend.USMInstance.configureLocalASM(USMInstance.java:3075)
oracle.sysman.assistants.usmca.service.UsmcaService.configureLocalASM(UsmcaService.java:1049)
oracle.sysman.assistants.usmca.model.UsmcaModel.performConfigureLocalASM(UsmcaModel.java:944)
oracle.sysman.assistants.usmca.model.UsmcaModel.performOperation(UsmcaModel.java:797)
oracle.sysman.assistants.usmca.Usmca.execute(Usmca.java:174)
oracle.sysman.assistants.usmca.Usmca.main(Usmca.java:369)
[main] [ 2014-09-15 20:46:33.394 CST ] [UsmcaLogger.logExit:124]Exiting oracle.sysman.assistants.usmca.backend.USMDiskGroupManager
Method : mountDiskGroups
[main] [ 2014-09-15 20:46:33.394 CST ] [UsmcaLogger.logInfo:143]Diskgroup mount is not successful.
[main] [ 2014-09-15 20:46:33.395 CST ] [UsmcaLogger.logExit:124]Exiting oracle.sysman.assistants.usmca.model.UsmcaModel Method : p
erformConfigureLocalASM
[main] [ 2014-09-15 20:46:33.395 CST ] [UsmcaLogger.logExit:124]Exiting oracle.sysman.assistants.usmca.model.UsmcaModel Method : p
erformOperation

千问 · 2014-9-15 20:46:27

两台机器看到的磁盘名字不一样吧，一个是8,9 一个是9,10，如果是的话，先把名字统一，mknod应该可以

千问 · 2014-9-15 20:46:27

1x1xqq_cu 发表于 2014-9-16 17:40
两台机器看到的磁盘名字不一样吧，一个是8,9 一个是9,10，如果是的话，先把名字统一，mknod应该可以
名字是一样的。挂了三个盘，8,9,10，10准备放数据的。
第二个节点少了8

千问 · 2014-9-15 20:46:27

节点2上 8和9有啥差别？权限？还是其他属性？比如reserve_lock之类的。 9能看到8看不到

千问 · 2014-9-15 20:46:27

1x1xqq_cu 发表于 2014-9-16 18:55
节点2上 8和9有啥差别？权限？还是其他属性？比如reserve_lock之类的。 9能看到8看不到
Owner上面贴出来的可以看到没问题了。都是777的权限了，都是no reserve

千问 · 2014-9-15 20:46:27

两个都是+ASM1 ?

千问 · 2014-9-15 20:46:27

ls -ltr /dev/rhdisk*
看看这个下面有没有8这个盘

千问 · 2014-9-15 20:46:27

你的磁盘管理使用的多路径软件么？如果不是，建议使用udev将磁盘绑定
还有要注意不是只修改权限，需要将磁盘的属组修改为grid

install 权限为660