ORA-00600: [kebm_mmon_main_1], ORA-07445 [kgghtNumElements()+4]

显示全部楼层 · 2015-3-6 11:57:31

Oracle 11.2.0.1.0， Linux AS 5.364 bit .RAC , ASM, 2 节点

昨天开始，一直报错，在metalink 貌似还查询不到。 DBA做了一个动作，将redo log group中的另一个memeber文件
转移了其他磁盘组， standby 使用lgwr同步，后来也正常了。但是就一直报错。

Thu Jun 09 11:55:36 2011
Errors in file /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/trace/ccptdb1_lgwr_15519.trc:
ORA-16166: LGWR network server failed to send remote message
No action is required since the log file transfer will be attempted via ARCH
LGWR: Attempting destination LOG_ARCHIVE_DEST_2 network reconnect (16166)
LGWR: Destination LOG_ARCHIVE_DEST_2 network reconnect abandoned
Errors in file /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/trace/ccptdb1_lgwr_15519.trc:
ORA-16166: LGWR network server failed to send remote message
Error 16166 for archive log file 13 to 'ccptdbdg'
LGWR: Error 16164 disconnecting from destination LOG_ARCHIVE_DEST_2 standby host 'ccptdbdg'
Thu Jun 09 11:55:42 2011
Restarting dead background process LMHB
Thu Jun 09 11:55:42 2011
LMHB started with pid=18, OS id=17475
Thu Jun 09 11:55:55 2011
opidrv aborting process Q004 ospid (11645) as a result of ORA-28
Thu Jun 09 11:56:56 2011
Errors in file /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/trace/ccptdb1_mmon_15531.trc(incident=256273):
ORA-00600: internal error code, arguments: [kebm_mmon_main_1], [28], [], [], [], [], [], [], [], [], [], []
ORA-00028: your session has been killed
Incident details in: /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/incident/incdir_256273/ccptdb1_mmon_15531_i256273.trc
Thu Jun 09 11:56:59 2011
Trace dumping is performing id=[cdmp_20110609115659]
Thu Jun 09 11:57:04 2011
Restarting dead background process MMON
Thu Jun 09 11:57:04 2011
MMON started with pid=34, OS id=17685
Restarting dead background process MMNL
Thu Jun 09 11:57:05 2011
MMNL started with pid=35, OS id=17687
Restarting dead background process MARK
Thu Jun 09 11:57:07 2011
MARK started with pid=38, OS id=17690
NOTE: MARK has subscribed
Thu Jun 09 11:57:07 2011
Sweep [inc][256273]: completed
Sweep [inc2][256273]: completed
Restarting dead background process RSMN
Thu Jun 09 11:57:10 2011
RSMN started with pid=40, OS id=17704
Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2, kgghtNumElements()+4] [flags: 0x0, count: 1]
Errors in file /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/trace/ccptdb1_rsmn_17704.trc(incident=256321):
ORA-07445: exception encountered: core dump [kgghtNumElements()+4] [SIGSEGV] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2] [Address not mapped to object] []
Incident details in: /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/incident/incdir_256321/ccptdb1_rsmn_17704_i256321.trc
Thu Jun 09 11:57:15 2011
Trace dumping is performing id=[cdmp_20110609115715]
Thu Jun 09 11:57:16 2011
Restarting dead background process CJQ0
Thu Jun 09 11:57:16 2011
CJQ0 started with pid=40, OS id=17723
Thu Jun 09 11:58:08 2011
。。。。。。。

Fri Jun 10 15:13:59 2011
Restarting dead background process RSMN
Fri Jun 10 15:13:59 2011
RSMN started with pid=106, OS id=26173
Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2, kgghtNumElements()+4] [flags: 0x0, count: 1]
Errors in file /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/trace/ccptdb1_rsmn_26173.trc(incident=256851):
ORA-07445: exception encountered: core dump [kgghtNumElements()+4] [SIGSEGV] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2] [Address not mapped to object] []
Fri Jun 10 15:14:05 2011
Sweep [inc][256851]: completed
Fri Jun 10 15:18:27 2011
Restarting dead background process RSMN
Fri Jun 10 15:18:27 2011
RSMN started with pid=105, OS id=26928
Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2, kgghtNumElements()+4] [flags: 0x0, count: 1]
Errors in file /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/trace/ccptdb1_rsmn_26928.trc(incident=256841):
ORA-07445: exception encountered: core dump [kgghtNumElements()+4] [SIGSEGV] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2] [Address not mapped to object] []
Fri Jun 10 15:18:33 2011
Sweep [inc][256841]: completed
Fri Jun 10 15:23:15 2011
Restarting dead background process RSMN
Fri Jun 10 15:23:15 2011
RSMN started with pid=105, OS id=27731
Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2, kgghtNumElements()+4] [flags: 0x0, count: 1]
Errors in file /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/trace/ccptdb1_rsmn_27731.trc(incident=256842):
ORA-07445: exception encountered: core dump [kgghtNumElements()+4] [SIGSEGV] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2] [Address not mapped to object] []
Fri Jun 10 15:23:20 2011
Sweep [inc][256842]: completed
Fri Jun 10 15:24:17 2011
LGWR: Standby redo logfile selected for thread 1 sequence 5956 for destination LOG_ARCHIVE_DEST_2
Thread 1 advanced to log sequence 5956 (LGWR switch)
Current log# 13 seq# 5956 mem# 0: +DATA/ccptdb/onlinelog/redo13a.log
Current log# 13 seq# 5956 mem# 1: +INDX/ccptdb/onlinelog/redo13b.log
Fri Jun 10 15:24:18 2011
Archived Log entry 15334 added for thread 1 sequence 5955 ID 0xbdc4bf83 dest 1:
Fri Jun 10 15:27:33 2011
Restarting dead background process RSMN
Fri Jun 10 15:27:33 2011
RSMN started with pid=108, OS id=28376
Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2, kgghtNumElements()+4] [flags: 0x0, count: 1]
Errors in file /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/trace/ccptdb1_rsmn_28376.trc(incident=256865):
ORA-07445: exception encountered: core dump [kgghtNumElements()+4] [SIGSEGV] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2] [Address not mapped to object] []
Fri Jun 10 15:27:40 2011
Sweep [inc][256865]: completed

千问 · 2015-3-6 11:57:31

trace file 內容如下：
Trace file /u01/product/oracle/diag/rdbms/ccptdb/ccptdb1/trace/ccptdb1_rsmn_12552.trc
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, Oracle Label Security,
OLAP, Data Mining, Oracle Database Vault and Real Application Testing option
ORACLE_HOME = /u01/product/oracle/11.2.0/db_1
System name:Linux
Node name:xxrac01
Release:2.6.18-128.el5
Version:#1 SMP Wed Dec 17 11:41:38 EST 2008
Machine:x86_64
Instance name: ccptdb1
Redo thread mounted by this instance: 1
Oracle process number: 63
Unix process pid: 12552, image: [email=oracle@xxrac01]oracle@xxrac01[/email] (RSMN)
*** 2011-06-10 13:52:23.482
*** SESSION ID1513.12457) 2011-06-10 13:52:23.482
*** CLIENT ID) 2011-06-10 13:52:23.482
*** SERVICE NAMESYS$BACKGROUND) 2011-06-10 13:52:23.482
*** MODULE NAME) 2011-06-10 13:52:23.482
*** ACTION NAME) 2011-06-10 13:52:23.482
KSXPCINI: kjxgnpub KSXP 9.1.0RSMN 10, 0
*** 2011-06-10 13:52:26.585
Exception [type: SIGSEGV, Address not mapped to object] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2, kgghtNumElements()+4] [flags: 0x0, count: 1]
DDE: Problem Key 'ORA 7445 [kgghtNumElements()+4]' was flood controlled (0x4) (incident: 264204)
ORA-07445: exception encountered: core dump [kgghtNumElements()+4] [SIGSEGV] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2] [Address not mapped to object] []
ssexhd: crashing the process...
Background_Core_Dump = PARTIAL

千问 · 2015-3-6 11:57:31

ORA-00600: internal error code, arguments: [kebm_mmon_main_1], [28], [], [], [], [], [], [], [], [], [], []
8642529 External errors can cause OERI [kebm_mmon_main_1]
参考：http://www.myoraclesupports.com/ ... -fixes-problem-type

但是ORA-07445: exception encountered: core dump [kgghtNumElements()+4] [SIGSEGV] [ADDR:0x2AD70DCE8A20] [PC:0x6AE22B2] [Address not mapped to object] []
一直查询不到

千问 · 2015-3-6 11:57:31

When you can't find the function on MOS, you can search using function names in the call stack. Check your trace file. Use the function or functions whose next function is an error handling routine (usually beginning with kge, kse, ksf, etc).
Yong Huang