windows server 2008安装ORACLE 11G RAC vip无法启动

[复制链接]
查看11 | 回复3 | 2013-1-7 16:36:11 | 显示全部楼层 |阅读模式
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1ONLINEONLINE node2
ora.node1.vip
1ONLINEINTERMEDIATE node2
FAILED OVER
ora.node2.vip
1ONLINEONLINE node2
ora.oc4j
1OFFLINE OFFLINE
ora.scan1.vip
1ONLINEONLINE node2

执行 CRSCTL RELOCATERES ORA.NODE1.VIP

CRSD中日志信息如下:



2014-01-23 10:06:08.874: [UiServer][5924] Container [ Name: UI_RELOCATE

CLIENT:

TextMessage[]

CLIENT_PRIMARY_GROUP:

TextMessage[]

FILTER:

TextMessage[((NAME==ora.node1.vip)&&((STATE==ONLINE)||(STATE==INTERMEDIATE)))]

FILTER_TAG:

TextMessage[1]

HOST:

TextMessage[]

HOST_TAG:

TextMessage[1]

LOCALE:

TextMessage[SIMPLIFIED CHINESE_CHINA.ZHS16GBK]

QUEUE_TAG:

TextMessage[1]
]
2014-01-23 10:06:08.874: [UiServer][5924] Sending message to PE. ctx= 000000000A35A500
2014-01-23 10:06:08.874: [ CRSPE][5916] Cmd : 0000000005C82C90 : flags: HOST_TAG | QUEUE_TAG
2014-01-23 10:06:08.874: [ CRSPE][5916] Processing PE command id=370. Description: [Relocate Resource : 0000000005C82C90]
2014-01-23 10:06:08.874: [ CRSPE][5916] Expression Filter : ((NAME == ora.node1.vip) AND ((STATE == ONLINE) OR (STATE == INTERMEDIATE)))
2014-01-23 10:06:08.874: [ CRSPE][5916] Expression Filter : ((NAME == ora.node1.vip) AND ((STATE == ONLINE) OR (STATE == INTERMEDIATE)))
2014-01-23 10:06:08.874: [ CRSPE][5916] Sending message to agfw: id = 4535
2014-01-23 10:06:08.874: [ CRSPE][5916] CRS-2673: 尝试停止 'ora.node1.vip' (在 'node2' 上)
2014-01-23 10:06:08.874: [CRSCCL][5872]clscsend completed:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 55 msglen = 2363 clschdr.size_clscmsgh= 2451 src= (1, 285123) dest= (2, 275996)
2014-01-23 10:06:08.874: [UiServer][5924] Container [ Name: ORDER

MESSAGE:

TextMessage[CRS-2673: 尝试停止 'ora.node1.vip' (在 'node2' 上)]

MSGTYPE:

TextMessage[3]

OBJID:

TextMessage[ora.node1.vip 1 1]

WAIT:

TextMessage[0]
]
2014-01-23 10:06:08.921: [CRSCCL][5868]clscreceive:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 53 msglen = 1854 clschdr.size_clscmsgh= 1942 src= (2, 275996) dest= (1, 285123)
2014-01-23 10:06:08.921: [ CRSPE][5916] Received reply to action [Stop] message ID: 4535
2014-01-23 10:06:09.436: [CRSCCL][5868]clscreceive:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 54 msglen = 1905 clschdr.size_clscmsgh= 1993 src= (2, 275996) dest= (1, 285123)
2014-01-23 10:06:09.436: [ CRSPE][5916] Received reply to action [Stop] message ID: 4535
2014-01-23 10:06:09.436: [ CRSPE][5916] RI [ora.node1.vip 1 1] new external state [OFFLINE] old value: [INTERMEDIATE] label = []
2014-01-23 10:06:09.436: [ CRSPE][5916] Set State Details to [] from [ FAILED OVER] for [ora.node1.vip 1 1]
2014-01-23 10:06:09.436: [CRSRPT][5920] Publishing event: Cluster Resource State Change Event for ora.node1.vip:node2 : 000000000A8EF200
2014-01-23 10:06:09.436: [CRSRPT][5920] Publish to eons buffered event : 000000000A8EF200
2014-01-23 10:06:09.436: [ CRSPE][5916] CRS-2677: 成功停止 'ora.node1.vip' (在 'node2' 上)
2014-01-23 10:06:09.436: [UiServer][5924] Container [ Name: ORDER

MESSAGE:

TextMessage[CRS-2677: 成功停止 'ora.node1.vip' (在 'node2' 上)]

MSGTYPE:

TextMessage[3]

OBJID:

TextMessage[ora.node1.vip 1 1]

WAIT:

TextMessage[0]
]
2014-01-23 10:06:09.436: [ CRSPE][5916] Sending message to agfw: id = 4543
2014-01-23 10:06:09.436: [AGFW][5896] Agfw Proxy Server received the message: RESOURCE_START[ora.node1.vip 1 1] ID 4098:4543
2014-01-23 10:06:09.436: [AGFW][5896] Agfw Proxy Server forwarding the message: RESOURCE_START[ora.node1.vip 1 1] ID 4098:4543 to the agent D:\app\11.2.0\grid\bin\orarootagent.exe_system
2014-01-23 10:06:09.436: [ CRSPE][5916] CRS-2672: 尝试启动 'ora.node1.vip' (在 'node1' 上)
2014-01-23 10:06:09.436: [UiServer][5924] Container [ Name: ORDER

MESSAGE:

TextMessage[CRS-2672: 尝试启动 'ora.node1.vip' (在 'node1' 上)]

MSGTYPE:

TextMessage[3]

OBJID:

TextMessage[ora.node1.vip 1 1]

WAIT:

TextMessage[0]
]
2014-01-23 10:06:16.721: [AGFW][5896] Received the reply to the message: RESOURCE_START[ora.node1.vip 1 1] ID 4098:4544 from the agent D:\app\11.2.0\grid\bin\orarootagent.exe_system
2014-01-23 10:06:16.721: [AGFW][5896] Agfw Proxy Server sending the reply to PE for message:RESOURCE_START[ora.node1.vip 1 1] ID 4098:4543
2014-01-23 10:06:16.721: [ CRSPE][5916] Received reply to action [Start] message ID: 4543
2014-01-23 10:06:17.236: [AGFW][5896] Received the reply to the message: RESOURCE_START[ora.node1.vip 1 1] ID 4098:4544 from the agent D:\app\11.2.0\grid\bin\orarootagent.exe_system
2014-01-23 10:06:17.236: [AGFW][5896] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_START[ora.node1.vip 1 1] ID 4098:4543
2014-01-23 10:06:17.236: [ CRSPE][5916] Received reply to action [Start] message ID: 4543
2014-01-23 10:06:17.236: [ CRSPE][5916] RI [ora.node1.vip 1 1] new external state [ONLINE] old value: [OFFLINE] on node1 label = []
2014-01-23 10:06:17.236: [CRSRPT][5920] Publishing event: Cluster Resource State Change Event for ora.node1.vip:node1 : 000000000A8EF200
2014-01-23 10:06:17.236: [CRSRPT][5920] Publish to eons buffered event : 000000000A8EF200
2014-01-23 10:06:17.236: [ CRSPE][5916] CRS-2676: 成功启动 'ora.node1.vip' (在 'node1' 上)
2014-01-23 10:06:17.236: [UiServer][5924] Container [ Name: ORDER

MESSAGE:

TextMessage[CRS-2676: 成功启动 'ora.node1.vip' (在 'node1' 上)]

MSGTYPE:

TextMessage[3]

OBJID:

TextMessage[ora.node1.vip 1 1]

WAIT:

TextMessage[0]
]
2014-01-23 10:06:17.236: [CRSOCR][5900] Multi Write Batch processing...
2014-01-23 10:06:17.298: [CRSOCR][5900] Multi Write Batch done.
2014-01-23 10:06:17.298: [ CRSPE][5916] Sending message to agfw: id = 4554
2014-01-23 10:06:17.298: [AGFW][5896] Agfw Proxy Server received the message: RESOURCE_START[ora.LISTENER.lsnr node1 1] ID 4098:4554
2014-01-23 10:06:17.298: [AGFW][5896] Agfw Proxy Server forwarding the message: RESOURCE_START[ora.LISTENER.lsnr node1 1] ID 4098:4554 to the agent D:\app\11.2.0\grid\bin\oraagent.exe_system
2014-01-23 10:06:17.298: [ CRSPE][5916] CRS-2672: 尝试启动 'ora.LISTENER.lsnr' (在 'node1' 上)
2014-01-23 10:06:17.298: [UiServer][5924] Container [ Name: ORDER

MESSAGE:

TextMessage[CRS-2672: 尝试启动 'ora.LISTENER.lsnr' (在 'node1' 上)]

MSGTYPE:

TextMessage[3]

OBJID:

TextMessage[ora.node1.vip 1 1]

WAIT:

TextMessage[0]
]
2014-01-23 10:06:21.588: [UiServer][5928] S(000000000A108F20): set Properties ( system,000000000A51A740)
2014-01-23 10:06:21.604: [UiServer][5924] processMessage called
2014-01-23 10:06:21.604: [UiServer][5924] Container [ Name: UI_START

ASYNC_TAG:

TextMessage[1]

CLIENT:

TextMessage[]

CLIENT_PRIMARY_GROUP:

TextMessage[]

EVENT_TAG:

TextMessage[1]

HOST:

TextMessage[node1]

HOST_TAG:

TextMessage[1]

LOCALE:

TextMessage[SIMPLIFIED CHINESE_CHINA.ZHS16GBK]

NO_WAIT_TAG:

TextMessage[1]

RESOURCE:

TextMessage[ora.LISTENER.lsnrUSR_ORA_OPI=true]
]
2014-01-23 10:06:21.604: [UiServer][5924] Sending message to PE. ctx= 000000000A1BECC0
2014-01-23 10:06:21.604: [ CRSPE][5916] Cmd : 0000000005C82A40 : flags: EVENT_TAG | HOST_TAG
2014-01-23 10:06:21.604: [ CRSPE][5916] Processing PE command id=371. Description: [Start Resource : 0000000005C82A40]
2014-01-23 10:06:21.604: [ CRSPE][5916] Attribute overrides for the command: USR_ORA_OPI = true;
2014-01-23 10:06:21.604: [ CRSPE][5916] PE Command [ Start Resource : 0000000005C82A40 ] has completed
2014-01-23 10:06:21.604: [ CRSPE][5916] UI Command [Start Resource : 0000000005C82A40] is replying to sender.
2014-01-23 10:06:21.604: [UiServer][5924] Container [ Name: ORDER

MESSAGE:

TextMessage[CRS-2545: 无法对 'ora.LISTENER.lsnr (已分配到 node1) 的实例' 执行操作。它已由 'administrator' (属于命令 '重新定位资源' (从 'node1' 发出)) 锁定]

MSGTYPE:

TextMessage[1]

OBJID:

TextMessage[ora.LISTENER.lsnr node1 1]

WAIT:

TextMessage[0]
]
2014-01-23 10:06:21.604: [ COMMCRS][5924]clscsendx: (000000000A51A740) Connection not active
2014-01-23 10:06:21.604: [UiServer][5924] S(000000000A108F20): Error sending msg over socket.6
2014-01-23 10:06:21.713: [UiServer][5924] Fatal exception sending reply back to client.FatalCommsException : Failed to send response to client.
(File: clsMessageStream.cpp, line: 275
2014-01-23 10:06:21.713: [UiServer][5924] Container [ Name: UI_DATA

ora.LISTENER.lsnr node1 1:

TextMessage[233]
]
2014-01-23 10:06:21.713: [UiServer][5924] S(000000000A108F20): No connection to client.6
2014-01-23 10:06:21.713: [UiServer][5924] Fatal exception sending reply back to client.FatalCommsException : Failed to send response to client.
(File: clsMessageStream.cpp, line: 275
2014-01-23 10:06:21.713: [UiServer][5924] Done for ctx=000000000A1BECC0
2014-01-23 10:06:21.728: [UiServer][5928] S(000000000A108F20): set Properties ( system,000000000A51A740)
2014-01-23 10:06:21.744: [UiServer][5924] processMessage called
2014-01-23 10:06:21.744: [UiServer][5924] Sending message to PE. ctx= 000000000A1BEA80
2014-01-23 10:06:21.744: [ CRSPE][5916] Processing PE command id=372. Description: [Stat Resource : 000000000A108B20]
2014-01-23 10:06:21.744: [ CRSPE][5916] PE Command [ Stat Resource : 000000000A108B20 ] has completed
2014-01-23 10:06:21.744: [ CRSPE][5916] UI Command [Stat Resource : 000000000A108B20] is replying to sender.
2014-01-23 10:06:21.744: [UiServer][5924] Done for ctx=000000000A1BEA80
2014-01-23 10:06:21.884: [UiServer][5928] S(000000000A108F20): set Properties ( system,000000000A51A740)
2014-01-23 10:06:21.900: [UiServer][5924] processMessage called
2014-01-23 10:06:21.900: [UiServer][5924] Sending message to PE. ctx= 000000000A1BEAE0
2014-01-23 10:06:21.900: [ CRSPE][5916] Processing PE command id=373. Description: [Stat Resource : 000000000A108B20]
2014-01-23 10:06:21.900: [ CRSPE][5916] PE Command [ Stat Resource : 000000000A108B20 ] has completed
2014-01-23 10:06:21.900: [ CRSPE][5916] UI Command [Stat Resource : 000000000A108B20] is replying to sender.
2014-01-23 10:06:21.900: [UiServer][5924] Done for ctx=000000000A1BEAE0
2014-01-23 10:06:22.040: [UiServer][5928] S(000000000A108F20): set Properties ( system,000000000A51A740)
2014-01-23 10:06:22.056: [UiServer][5924] processMessage called
2014-01-23 10:06:22.056: [UiServer][5924] Sending message to PE. ctx= 000000000A1BE9C0
2014-01-23 10:06:22.056: [ CRSPE][5916] Processing PE command id=374. Description: [Stat Resource : 000000000A108B20]
2014-01-23 10:06:22.056: [ CRSPE][5916] PE Command [ Stat Resource : 000000000A108B20 ] has completed
2014-01-23 10:06:22.056: [ CRSPE][5916] UI Command [Stat Resource : 000000000A108B20] is replying to sender.
2014-01-23 10:06:22.056: [UiServer][5924] Done for ctx=000000000A1BE9C0
2014-01-23 10:06:22.384: [AGFW][5896] Received the reply to the message: RESOURCE_START[ora.LISTENER.lsnr node1 1] ID 4098:4555 from the agent D:\app\11.2.0\grid\bin\oraagent.exe_system
2014-01-23 10:06:22.384: [AGFW][5896] Agfw Proxy Server sending the reply to PE for message:RESOURCE_START[ora.LISTENER.lsnr node1 1] ID 4098:4554
2014-01-23 10:06:22.384: [ CRSPE][5916] Received reply to action [Start] message ID: 4554
2014-01-23 10:06:22.898: [AGFW][5896] Received the reply to the message: RESOURCE_START[ora.LISTENER.lsnr node1 1] ID 4098:4555 from the agent D:\app\11.2.0\grid\bin\oraagent.exe_system
2014-01-23 10:06:22.898: [AGFW][5896] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_START[ora.LISTENER.lsnr node1 1] ID 4098:4554
2014-01-23 10:06:22.898: [ CRSPE][5916] Received reply to action [Start] message ID: 4554
2014-01-23 10:06:22.898: [ CRSPE][5916] RI [ora.LISTENER.lsnr node1 1] new external state [ONLINE] old value: [OFFLINE] on node1 label = []
2014-01-23 10:06:22.898: [CRSRPT][5920] Publishing event: Cluster Resource State Change Event for ora.LISTENER.lsnr:node1 : 000000000A8EF040
2014-01-23 10:06:22.898: [CRSRPT][5920] Publish to eons buffered event : 000000000A8EF040
2014-01-23 10:06:22.898: [ CRSPE][5916] CRS-2676: 成功启动 'ora.LISTENER.lsnr' (在 'node1' 上)
2014-01-23 10:06:22.898: [UiServer][5924] Container [ Name: ORDER

MESSAGE:

TextMessage[CRS-2676: 成功启动 'ora.LISTENER.lsnr' (在 'node1' 上)]

MSGTYPE:

TextMessage[3]

OBJID:

TextMessage[ora.node1.vip 1 1]

WAIT:

TextMessage[0]
]
2014-01-23 10:06:22.898: [ CRSPE][5916] PE Command [ Relocate Resource : 0000000005C82C90 ] has completed
2014-01-23 10:06:22.898: [AGFW][5896] Agfw Proxy Server received the message: CMD_COMPLETED[Proxy] ID 20482:4579
2014-01-23 10:06:22.898: [ CRSPE][5916] UI Command [Relocate Resource : 0000000005C82C90] is replying to sender.
2014-01-23 10:06:22.898: [AGFW][5896] Agfw Proxy Server replying to the message: CMD_COMPLETED[Proxy] ID 20482:4579
2014-01-23 10:06:22.898: [CRSCCL][5872]clscsend completed:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 56 msglen = 666 clschdr.size_clscmsgh= 754 src= (1, 285123) dest= (2, 275996)
2014-01-23 10:06:22.898: [UiServer][5924] Container [ Name: UI_DATA

ora.node1.vip 1 1:

TextMessage[0]
]
2014-01-23 10:06:22.898: [UiServer][5924] Done for ctx=000000000A35A500
2014-01-23 10:06:22.898: [CRSCCL][5868]clscreceive:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 55 msglen = 1033 clschdr.size_clscmsgh= 1121 src= (2, 275996) dest= (1, 285123)
2014-01-23 10:06:27.875: [AGFW][5896] Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:41008
2014-01-23 10:06:27.875: [AGFW][5896] Received state change for ora.node1.vip 1 1 [old state = ONLINE, new state = OFFLINE]
2014-01-23 10:06:27.875: [AGFW][5896] Agfw Proxy Server sending message to PE, Contents = [MIDTo:2|OpID:3|FromA:{Invalid|Node:0|Process:0|Type:0}|ToA:{Invalid|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:4587]
2014-01-23 10:06:27.875: [AGFW][5896] Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:41008
2014-01-23 10:06:27.875: [ CRSPE][5916] State change received from node1 for ora.node1.vip 1 1
2014-01-23 10:06:27.875: [ CRSPE][5916] Processing PE command id=375. Description: [Resource State Change (ora.node1.vip 1 1) : 0000000009FDC4A0]
2014-01-23 10:06:27.875: [ CRSPE][5916] RI [ora.node1.vip 1 1] new external state [OFFLINE] old value: [ONLINE] on node1 label = []
2014-01-23 10:06:27.875: [ CRSPE][5916] Resource Resource Instance ID[ora.node1.vip 1 1]. Values:
STATE=OFFLINE
TARGET=ONLINE
LAST_SERVER=node1
CURRENT_RCOUNT=0
LAST_RESTART=1390442782
FAILURE_COUNT=1
FAILURE_HISTORY=1390441449:node1
STATE_DETAILS=
INCARNATION=32
STATE_CHANGE_VERS=38
LAST_FAULT=1390441449
DEGREE_ID=1
ID=ora.node1.vip 1 1
CARDINALITY_ID=1
Lock Info:
Write Locks:none
ReadLocks:|STATE INITED| has failed!
2014-01-23 10:06:27.875: [CRSRPT][5920] Publishing event: Cluster Resource State Change Event for ora.node1.vip:node1 : 000000000A8EF200
2014-01-23 10:06:27.875: [CRSRPT][5920] Publish to eons buffered event : 000000000A8EF200
2014-01-23 10:06:27.875: [ CRSPE][5916] Processing unplanned state change for [ora.node1.vip 1 1]
2014-01-23 10:06:27.875: [ CRSPE][5916] No Local Restart of [ora.node1.vip 1 1], restart attempt exhausted
2014-01-23 10:06:27.875: [ CRSPE][5916] Will try to failover [ora.node1.vip 1 1]
2014-01-23 10:06:27.875: [CRSRPT][5920] Publishing event: Cluster Resource Not Restarting Event : 000000000A8EF200
2014-01-23 10:06:27.875: [CRSRPT][5920] Publish to eons buffered event : 000000000A8EF200
2014-01-23 10:06:27.890: [ CRSPE][5916] Sending message to agfw: id = 4593
2014-01-23 10:06:27.890: [AGFW][5896] Agfw Proxy Server received the message: RESOURCE_STOP[ora.LISTENER.lsnr node1 1] ID 4099:4593
2014-01-23 10:06:27.890: [AGFW][5896] Agfw Proxy Server forwarding the message: RESOURCE_STOP[ora.LISTENER.lsnr node1 1] ID 4099:4593 to the agent D:\app\11.2.0\grid\bin\oraagent.exe_system
2014-01-23 10:06:27.890: [ CRSPE][5916] CRS-2673: 尝试停止 'ora.LISTENER.lsnr' (在 'node1' 上)
2014-01-23 10:06:27.890: [AGFW][5896] Agfw Proxy Server received the message: RESOURCE_PROBE[ora.LISTENER.lsnr node1 1] ID 4097:4596
2014-01-23 10:06:27.890: [AGFW][5896] Agfw Proxy Server forwarding the message: RESOURCE_PROBE[ora.LISTENER.lsnr node1 1] ID 4097:4596 to the agent D:\app\11.2.0\grid\bin\oraagent.exe_system
2014-01-23 10:06:28.124: [UiServer][5928] S(000000000A108D20): set Properties ( system,0000000005B61C30)
2014-01-23 10:06:28.140: [UiServer][5924] processMessage called
2014-01-23 10:06:28.140: [UiServer][5924] Container [ Name: UI_STOP

CLIENT:

TextMessage[]

CLIENT_PRIMARY_GROUP:

TextMessage[]

EVENT_TAG:

TextMessage[1]

FILTER:

TextMessage[((NAME==ora.LISTENER.lsnr)&&(LAST_SERVER==node1))USR_ORA_OPI=true]

FILTER_TAG:

TextMessage[1]

LOCALE:

TextMessage[SIMPLIFIED CHINESE_CHINA.ZHS16GBK]

NO_WAIT_TAG:

TextMessage[1]
]
2014-01-23 10:06:28.140: [UiServer][5924] Sending message to PE. ctx= 000000000A1BE9C0
2014-01-23 10:06:28.140: [ CRSPE][5916] Cmd : 000000000A51A740 : flags: EVENT_TAG
2014-01-23 10:06:28.140: [ CRSPE][5916] Processing PE command id=376. Description: [Stop Resource : 000000000A51A740]
2014-01-23 10:06:28.140: [ CRSPE][5916] Expression Filter : ((NAME == ora.LISTENER.lsnr) AND (LAST_SERVER == node1))
2014-01-23 10:06:28.140: [ CRSPE][5916] Attribute overrides for the command: USR_ORA_OPI = true;
2014-01-23 10:06:28.140: [ CRSPE][5916] PE Command [ Stop Resource : 000000000A51A740 ] has completed
2014-01-23 10:06:28.140: [ CRSPE][5916] UI Command [Stop Resource : 000000000A51A740] is replying to sender.
2014-01-23 10:06:28.140: [UiServer][5924] Container [ Name: ORDER

MESSAGE:

TextMessage[CRS-2545: 无法对 'ora.LISTENER.lsnr (已分配到 node1) 的实例' 执行操作。它已由 'SYSTEM' (属于命令 '未计划资源状态更改 : ora.node1.vip') 锁定]

MSGTYPE:

TextMessage[1]

OBJID:

TextMessage[ora.LISTENER.lsnr node1 1]

WAIT:

TextMessage[0]
]
2014-01-23 10:06:28.140: [UiServer][5924] Container [ Name: UI_DATA

ora.LISTENER.lsnr node1 1:

TextMessage[233]
]
2014-01-23 10:06:28.140: [UiServer][5924] Done for ctx=000000000A1BE9C0
2014-01-23 10:06:28.249: [AGFW][5896] Received the reply to the message: RESOURCE_STOP[ora.LISTENER.lsnr node1 1] ID 4099:4594 from the agent D:\app\11.2.0\grid\bin\oraagent.exe_system
2014-01-23 10:06:28.249: [AGFW][5896] Agfw Proxy Server sending the reply to PE for message:RESOURCE_STOP[ora.LISTENER.lsnr node1 1] ID 4099:4593
2014-01-23 10:06:28.249: [ CRSPE][5916] Received reply to action [Stop] message ID: 4593
2014-01-23 10:06:28.483: [AGFW][5896] Received the reply to the message: RESOURCE_STOP[ora.LISTENER.lsnr node1 1] ID 4099:4594 from the agent D:\app\11.2.0\grid\bin\oraagent.exe_system
2014-01-23 10:06:28.483: [AGFW][5896] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_STOP[ora.LISTENER.lsnr node1 1] ID 4099:4593
2014-01-23 10:06:28.483: [ CRSPE][5916] Received reply to action [Stop] message ID: 4593
2014-01-23 10:06:28.483: [ CRSPE][5916] RI [ora.LISTENER.lsnr node1 1] new external state [OFFLINE] old value: [ONLINE] label = []
2014-01-23 10:06:28.483: [CRSRPT][5920] Publishing event: Cluster Resource State Change Event for ora.LISTENER.lsnr:node1 : 000000000A8EF200
2014-01-23 10:06:28.483: [CRSRPT][5920] Publish to eons buffered event : 000000000A8EF200
2014-01-23 10:06:28.483: [ CRSPE][5916] CRS-2677: 成功停止 'ora.LISTENER.lsnr' (在 'node1' 上)
2014-01-23 10:06:28.483: [ CRSPE][5916] Sending message to agfw: id = 4609
2014-01-23 10:06:28.483: [ CRSPE][5916] CRS-2672: 尝试启动 'ora.node1.vip' (在 'node2' 上)
2014-01-23 10:06:28.483: [CRSCCL][5872]clscsend completed:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 57 msglen = 4524 clschdr.size_clscmsgh= 4612 src= (1, 285123) dest= (2, 275996)
2014-01-23 10:06:28.998: [AGFW][5896] Received the reply to the message: RESOURCE_PROBE[ora.LISTENER.lsnr node1 1] ID 4097:4597 from the agent D:\app\11.2.0\grid\bin\oraagent.exe_system
2014-01-23 10:06:28.998: [AGFW][5896] ora.LISTENER.lsnr node1 1 received state from probe request. Old state = OFFLINE, New state = OFFLINE
2014-01-23 10:06:28.998: [AGFW][5896] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_PROBE[ora.LISTENER.lsnr node1 1] ID 4097:4596
2014-01-23 10:06:35.566: [CRSCCL][5868]clscreceive:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 56 msglen = 1452 clschdr.size_clscmsgh= 1540 src= (2, 275996) dest= (1, 285123)
2014-01-23 10:06:35.566: [ CRSPE][5916] Received reply to action [Start] message ID: 4609
2014-01-23 10:06:36.080: [CRSCCL][5868]clscreceive:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 57 msglen = 1523 clschdr.size_clscmsgh= 1611 src= (2, 275996) dest= (1, 285123)
2014-01-23 10:06:36.080: [ CRSPE][5916] Received reply to action [Start] message ID: 4609
2014-01-23 10:06:36.080: [ CRSPE][5916] RI [ora.node1.vip 1 1] new external state [INTERMEDIATE] old value: [OFFLINE] on node2 label = [FAILED OVER]
2014-01-23 10:06:36.080: [ CRSPE][5916] Set State Details to [FAILED OVER] from [ ] for [ora.node1.vip 1 1]
2014-01-23 10:06:36.080: [CRSRPT][5920] Publishing event: Cluster Resource State Change Event for ora.node1.vip:node2 : 000000000A8EF200
2014-01-23 10:06:36.080: [CRSRPT][5920] Publish to eons buffered event : 000000000A8EF200
2014-01-23 10:06:36.080: [ CRSPE][5916] CRS-2676: 成功启动 'ora.node1.vip' (在 'node2' 上)
回复

使用道具 举报

千问 | 2013-1-7 16:36:11 | 显示全部楼层
2014-01-23 14:37:22.461: [UiServer][4568] processMessage called
2014-01-23 14:37:22.461: [UiServer][4568] Sending message to PE. ctx= 0000000009F140F0
2014-01-23 14:37:22.461: [ CRSPE][4484] Processing PE command id=199. Description: [Stat Resource : 0000000009DA3AF0]
2014-01-23 14:37:22.461: [ CRSPE][4484] PE Command [ Stat Resource : 0000000009DA3AF0 ] has completed
2014-01-23 14:37:22.461: [ CRSPE][4484] UI Command [Stat Resource : 0000000009DA3AF0] is replying to sender.
2014-01-23 14:37:22.461: [UiServer][4568] Done for ctx=0000000009F140F0
2014-01-23 14:38:45.204: [CRSCCL][4468]clscreceive:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 32 msglen = 1160 clschdr.size_clscmsgh= 1248 src= (1, 254827) dest= (2, 261613)
2014-01-23 14:38:45.204: [ CRSPE][4484] Processing PE command id=113. Description: [Stat Resource : 0000000009DA3CF0]
2014-01-23 14:38:45.282: [ CRSPE][4484] PE Command [ Stat Resource : 0000000009DA3CF0 ] has completed
2014-01-23 14:38:45.282: [ CRSPE][4484] UI Command [Stat Resource : 0000000009DA3CF0] is replying to sender.
2014-01-23 14:38:45.282: [CRSCCL][4464]clscsend completed:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 39 msglen = 5111 clschdr.size_clscmsgh= 5199 src= (2, 261613) dest= (1, 254827)
2014-01-23 14:38:54.096: [CRSCCL][4468]clscreceive:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 33 msglen = 1062 clschdr.size_clscmsgh= 1150 src= (1, 254827) dest= (2, 261613)
2014-01-23 14:38:54.096: [ CRSPE][4484] Cmd : 0000000005A9EED0 : flags: QUEUE_TAG
2014-01-23 14:38:54.112: [ CRSPE][4484] Processing PE command id=114. Description: [Start Resource : 0000000005A9EED0]
2014-01-23 14:38:54.143: [ CRSPE][4484] RI [ora.node1.vip 1 1] new target state: [ONLINE] old value: [OFFLINE]
2014-01-23 14:38:54.143: [CRSOCR][4520] Multi Write Batch processing...
2014-01-23 14:38:54.143: [ CRSPE][4484] Sending message to agfw: id = 2573
2014-01-23 14:38:54.143: [ CRSPE][4484] CRS-2672: 尝试启动 'ora.node1.vip' (在 'node1' 上)
2014-01-23 14:38:54.143: [CRSCCL][4464]clscsend completed:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 40 msglen = 4890 clschdr.size_clscmsgh= 4978 src= (2, 261613) dest= (1, 254827)
2014-01-23 14:38:54.158: [CRSCCL][4464]clscsend completed:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 41 msglen = 833 clschdr.size_clscmsgh= 921 src= (2, 261613) dest= (1, 254827)
2014-01-23 14:38:54.205: [CRSOCR][4520] Multi Write Batch done.
2014-01-23 14:39:01.350: [CRSCCL][4468]clscreceive:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 34 msglen = 1746 clschdr.size_clscmsgh= 1834 src= (1, 254827) dest= (2, 261613)
2014-01-23 14:39:01.350: [ CRSPE][4484] Received reply to action [Start] message ID: 2573
2014-01-23 14:39:01.865: [CRSCCL][4468]clscreceive:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 35 msglen = 1797 clschdr.size_clscmsgh= 1885 src= (1, 254827) dest= (2, 261613)
2014-01-23 14:39:01.865: [ CRSPE][4484] Received reply to action [Start] message ID: 2573
2014-01-23 14:39:01.865: [ CRSPE][4484] RI [ora.node1.vip 1 1] new external state [ONLINE] old value: [OFFLINE] on node1 label = []
2014-01-23 14:39:01.865: [CRSRPT][4576] Publishing event: Cluster Resource State Change Event for ora.node1.vip:node1 : 0000000009F95B90
2014-01-23 14:39:01.865: [CRSRPT][4576] Publish to eons buffered event : 0000000009F95B90
2014-01-23 14:39:01.865: [ CRSPE][4484] CRS-2676: 成功启动 'ora.node1.vip' (在 'node1' 上)
2014-01-23 14:39:01.865: [CRSCCL][4464]clscsend completed:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 42 msglen = 833 clschdr.size_clscmsgh= 921 src= (2, 261613) dest= (1, 254827)
2014-01-23 14:39:01.865: [CRSOCR][4520] Multi Write Batch processing...
2014-01-23 14:39:01.912: [CRSOCR][4520] Multi Write Batch done.
2014-01-23 14:39:01.958: [ CRSPE][4484] PE Command [ Start Resource : 0000000005A9EED0 ] has completed
2014-01-23 14:39:01.958: [ CRSPE][4484] UI Command [Start Resource : 0000000005A9EED0] is replying to sender.
2014-01-23 14:39:01.958: [CRSCCL][4464]clscsend completed:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 43 msglen = 666 clschdr.size_clscmsgh= 754 src= (2, 261613) dest= (1, 254827)
2014-01-23 14:39:01.958: [CRSCCL][4464]clscsend completed:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 44 msglen = 744 clschdr.size_clscmsgh= 832 src= (2, 261613) dest= (1, 254827)
2014-01-23 14:39:01.958: [CRSCCL][4468]clscreceive:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 36 msglen = 1033 clschdr.size_clscmsgh= 1121 src= (1, 254827) dest= (2, 261613)
2014-01-23 14:39:21.630: [CRSCCL][4468]clscreceive:msgTag= 0xcccccccc version= 0 msgType= 0 msgId= 37 msglen = 774 clschdr.size_clscmsgh= 862 src= (1, 254827) dest= (2, 261613)
2014-01-23 14:39:21.630: [ CRSPE][4484] State change received from node1 for ora.node1.vip 1 1
2014-01-23 14:39:21.630: [ CRSPE][4484] Processing PE command id=115. Description: [Resource State Change (ora.node1.vip 1 1) : 0000000009E2C860]
2014-01-23 14:39:21.630: [ CRSPE][4484] RI [ora.node1.vip 1 1] new external state [OFFLINE] old value: [ONLINE] on node1 label = []
2014-01-23 14:39:21.630: [ CRSPE][4484] Resource Resource Instance ID[ora.node1.vip 1 1]. Values:
STATE=OFFLINE
TARGET=ONLINE
LAST_SERVER=node1
CURRENT_RCOUNT=0
LAST_RESTART=1390459141
FAILURE_COUNT=1
FAILURE_HISTORY=1390456859:node1
STATE_DETAILS=
INCARNATION=301
STATE_CHANGE_VERS=317
LAST_FAULT=1390456859
DEGREE_ID=1
ID=ora.node1.vip 1 1
CARDINALITY_ID=1
Lock Info:
Write Locks:none
ReadLocks:|STATE INITED| has failed!
2014-01-23 14:39:21.646: [ CRSPE][4484] Processing unplanned state change for [ora.node1.vip 1 1]
2014-01-23 14:39:21.646: [CRSRPT][4576] Publishing event: Cluster Resource State Change Event for ora.node1.vip:node1 : 0000000009F95B90
2014-01-23 14:39:21.646: [CRSRPT][4576] Publish to eons buffered event : 0000000009F95B90
2014-01-23 14:39:21.646: [ CRSPE][4484] No Local Restart of [ora.node1.vip 1 1], restart attempt exhausted
2014-01-23 14:39:21.646: [ CRSPE][4484] Will try to failover [ora.node1.vip 1 1]
2014-01-23 14:39:21.646: [CRSRPT][4576] Publishing event: Cluster Resource Not Restarting Event : 0000000009F95B90
2014-01-23 14:39:21.646: [CRSRPT][4576] Publish to eons buffered event : 0000000009F95B90
2014-01-23 14:39:21.661: [ CRSPE][4484] Sending message to agfw: id = 2605
2014-01-23 14:39:21.661: [AGFW][4544] Agfw Proxy Server received the message: RESOURCE_START[ora.node1.vip 1 1] ID 4098:2605
2014-01-23 14:39:21.661: [AGFW][4544] Agfw Proxy Server forwarding the message: RESOURCE_START[ora.node1.vip 1 1] ID 4098:2605 to the agent D:\app\11.2.0\grid\bin\orarootagent.exe_system
2014-01-23 14:39:21.661: [ CRSPE][4484] CRS-2672: 尝试启动 'ora.node1.vip' (在 'node2' 上)
2014-01-23 14:39:28.619: [AGFW][4544] Received the reply to the message: RESOURCE_START[ora.node1.vip 1 1] ID 4098:2606 from the agent D:\app\11.2.0\grid\bin\orarootagent.exe_system
2014-01-23 14:39:28.619: [AGFW][4544] Agfw Proxy Server sending the reply to PE for message:RESOURCE_START[ora.node1.vip 1 1] ID 4098:2605
2014-01-23 14:39:28.619: [ CRSPE][4484] Received reply to action [Start] message ID: 2605
2014-01-23 14:39:29.134: [AGFW][4544] Received the reply to the message: RESOURCE_START[ora.node1.vip 1 1] ID 4098:2606 from the agent D:\app\11.2.0\grid\bin\orarootagent.exe_system
2014-01-23 14:39:29.134: [AGFW][4544] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_START[ora.node1.vip 1 1] ID 4098:2605
2014-01-23 14:39:29.134: [ CRSPE][4484] Received reply to action [Start] message ID: 2605
2014-01-23 14:39:29.134: [ CRSPE][4484] RI [ora.node1.vip 1 1] new external state [INTERMEDIATE] old value: [OFFLINE] on node2 label = [FAILED OVER]
2014-01-23 14:39:29.134: [ CRSPE][4484] Set State Details to [FAILED OVER] from [ ] for [ora.node1.vip 1 1]
2014-01-23 14:39:29.134: [CRSRPT][4576] Publishing event: Cluster Resource State Change Event for ora.node1.vip:node2 : 0000000009F95B90
2014-01-23 14:39:29.134: [CRSRPT][4576] Publish to eons buffered event : 0000000009F95B90
2014-01-23 14:39:29.134: [ CRSPE][4484] CRS-2676: 成功启动 'ora.node1.vip' (在 'node2' 上)
起个VIP都PUBLIC网卡断。
回复

使用道具 举报

千问 | 2013-1-7 16:36:11 | 显示全部楼层
参考:
11gR2 RAC vip和network资源的依赖性与频繁failover
http://www.askmaclean.com/archiv ... twork-failover.html
应该是public网卡瞬断才是问题的关键。
回复

使用道具 举报

千问 | 2013-1-7 16:36:11 | 显示全部楼层
最终排查为网络问题。
参考:11gR2 RAC vip和network资源的依赖性与频繁failover
http://www.askmaclean.com/archiv ... twork-failover.html
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

主题

0

回帖

4882万

积分

论坛元老

Rank: 8Rank: 8

积分
48824836
热门排行