帮忙看看“os thread startup” wait event 是何原因导致

[复制链接]
查看11 | 回复9 | 2011-10-24 10:43:14 | 显示全部楼层 |阅读模式
本帖最后由 ccd_19801003 于 2012-1-3 11:46 编辑




oracle_20120102.rar(20.62 KB, 下载次数: 26)2012-1-3 11:45 上传点击文件名下载附件




rac1_ora_10979.rar(250.85 KB, 下载次数: 45)2012-1-3 11:45 上传点击文件名下载附件

新上线的一台机器,linux centor 5.6 oracle 10g 10.0.2.1 ,目前跑的数据很少session 就是60个左右,但是不知道为啥一直出现 os thread startup 的wait event,而且还是top 1 event。能帮忙解析一下这个wait event 的来源吗?以前很少碰到这个wait event。上网找了写别人写的资料,但是看了还是觉得不是很明白是什么回事,请大师们指教一下。谢谢
AWR 报告贴了一部分,没贴全(详细的AWR情看附近):
Snap Id Snap Time Sessions Cursors/Session
Begin Snap: 1262 30-Dec-11 00:01:03 75 2.1
End Snap: 1302 31-Dec-11 16:00:43 75 1.4
Elapsed: 2,399.66 (mins)
DB Time: 16.24 (mins)

Report Summary
Cache Sizes
Begin End
Buffer Cache: 1,056M 1,056M Std Block Size: 8K
Shared Pool Size: 1,008M 1,008M Log Buffer: 14,408K

Load Profile
Per Second Per Transaction
Redo size: 5,178.10 4,705.22
Logical reads: 114.60 104.13
Block changes: 9.95 9.04
Physical reads: 0.00 0.00
Physical writes: 0.64 0.58
User calls: 13.01 11.82
Parses: 5.44 4.94
Hard parses: 0.01 0.01
Sorts: 0.81 0.73
Logons: 0.03 0.03
Executes: 6.56 5.96
Transactions: 1.10

% Blocks changed per Read: 8.68 Recursive Call %: 47.07
Rollback per transaction %: 0.00 Rows per Sort: 70.88

Instance Efficiency Percentages (Target 100%)
Buffer Nowait %: 100.00 Redo NoWait %: 100.00
Buffer Hit %: 100.00 In-memory Sort %: 100.00
Library Hit %: 99.79 Soft Parse %: 99.86
Execute to Parse %: 17.13 Latch Hit %: 100.00
Parse CPU to Parse Elapsd %: 29.97 % Non-Parse CPU: 99.40

Shared Pool Statistics
Begin End
Memory Usage %: 56.54 57.66
% SQL with executions>1: 98.25 98.39
% Memory for SQL w/exec>1: 88.87 91.74

Top 5 Timed Events
Event Waits Time(s) Avg Wait(ms) % Total Call Time Wait Class
os thread startup 4,230 3,675 869 377.2 Concurrency
CPU time 781 80.2
log file sync 150,410 607 4 62.3 Commit
log file parallel write 166,065 601 4 61.7 System I/O
latch free 40 68 1,703 7.0 Other

Main Report
Report Summary
Wait Events Statistics
SQL Statistics
Instance Activity Statistics
IO Stats
Buffer Pool Statistics
Advisory Statistics
Wait Statistics
Undo Statistics
Latch Statistics
Segment Statistics
Dictionary Cache Statistics
Library Cache Statistics
Memory Statistics
Streams Statistics
Resource Limit Statistics
init.ora Parameters
Back to Top
Wait Events Statistics
Time Model Statistics
Wait Class
Wait Events
Background Wait Events
Operating System Statistics
Service Statistics
Service Wait Class Stats
Back to Top
Time Model Statistics
Total time in database user-calls (DB Time): 974.2s
Statistics including the word "background" measure background process time, and so do not contribute to the DB time statistic
Ordered by % or DB time desc, Statistic name
Statistic Name Time (s) % of DB Time
DB CPU 780.93 80.16
sql execute elapsed time 298.24 30.62
parse time elapsed 35.57 3.65
PL/SQL execution elapsed time 19.48 2.00
hard parse elapsed time 3.21 0.33
hard parse (sharing criteria) elapsed time 0.91 0.09
repeated bind elapsed time 0.36 0.04
hard parse (bind mismatch) elapsed time 0.20 0.02
sequence load elapsed time 0.09 0.01
connection management call elapsed time 0.07 0.01
PL/SQL compilation elapsed time 0.03 0.00
failed parse elapsed time 0.00 0.00
DB time 974.16
background elapsed time 4,581.51
background cpu time 255.91
Back to Wait Events Statistics
Back to Top

Wait Class
s - second
cs - centisecond - 100th of a second
ms - millisecond - 1000th of a second
us - microsecond - 1000000th of a second
ordered by wait time desc, waits desc
Wait Class Waits %Time -outs Total Wait Time (s) Avg wait (ms) Waits /txn
Concurrency 4,230 49.98 3,675 869 0.03
System I/O 285,854 0.00 636 2 1.80
Commit 150,410 0.00 607 4 0.95
Other 320 0.00 72 226 0.00
Network 1,287,120 0.00 5 0 8.12
User I/O 822 0.00 0 1 0.01
Configuration 9 0.00 0 3 0.00
Application 49 0.00 0 0 0.00
Back to Wait Events Statistics
Back to Top

Wait Events
s - second
cs - centisecond - 100th of a second
ms - millisecond - 1000th of a second
us - microsecond - 1000000th of a second
ordered by wait time desc, waits desc (idle events last)
Event Waits %Time -outs Total Wait Time (s) Avg wait (ms) Waits /txn
os thread startup 4,230 49.98 3,675 869 0.03
log file sync 150,410 0.00 607 4 0.95
log file parallel write 166,065 0.00 601 4 1.05
latch free 40 0.00 68 1703 0.00
control file parallel write 48,180 0.00 31 1 0.30
enq: PR - contention 3 0.00 4 1326 0.00
SQL*Net message to client 1,199,987 0.00 3 0 7.57
Log archive I/O 1,038 0.00 2 2 0.01
SQL*Net more data from client 84,970 0.00 1 0 0.54
control file sequential read 69,617 0.00 1 0 0.44
log file sequential read 950 0.00 1 1 0.01
db file sequential read 654 0.00 0 1 0.00
rdbms ipc reply 167 0.00 0 1 0.00
SQL*Net more data to client 2,163 0.00 0 0 0.01
db file scattered read 48 0.00 0 1 0.00
log file switch completion 2 0.00 0 13 0.00
reliable message 34 0.00 0 0 0.00
SQL*Net break/reset to client 38 0.00 0 0 0.00
log file single write 4 0.00 0 1 0.00
enq: RO - fast object reuse 11 0.00 0 0 0.00
LGWR wait for redo copy 74 0.00 0 0 0.00
latch: redo writing 7 0.00 0 0 0.00
direct path write 52 0.00 0 0 0.00
direct path write temp 42 0.00 0 0 0.00
direct path read 26 0.00 0 0 0.00
latch: redo allocation 2 0.00 0 0 0.00
SQL*Net message from client 1,199,987 0.00 7,003,709 5836 7.57
Streams AQ: qmn slave idle wait 5,142 0.00 140,175 27261 0.03
Streams AQ: qmn coordinator idle wait 10,284 50.00 140,175 13630 0.06
virtual circuit status 4,799 100.00 140,119 29197 0.03
jobq slave wait 43,553 99.49 127,411 2925 0.27
Streams AQ: waiting for time management or cleanup tasks 33 100.00 65,443 1983113 0.00
class slave wait 77 100.00 376 4885 0.00
Back to Wait Events Statistics
Back to Top

Background Wait Events
ordered by wait time desc, waits desc (idle events last)
Event Waits %Time -outs Total Wait Time (s) Avg wait (ms) Waits /txn
os thread startup 4,230 49.98 3,675 869 0.03
log file parallel write 166,065 0.00 601 4 1.05
control file parallel write 48,180 0.00 31 1 0.30
events in waitclass Other 116 0.00 4 34 0.00
Log archive I/O 1,038 0.00 2 2 0.01
log file sequential read 950 0.00 1 1 0.01
control file sequential read 41,288 0.00 1 0 0.26
log file sync 2 0.00 0 3 0.00
log file single write 4 0.00 0 1 0.00
latch: redo writing 7 0.00 0 0 0.00
direct path read 26 0.00 0 0 0.00
direct path write 26 0.00 0 0 0.00
rdbms ipc message 631,228 73.26 1,508,724 2390 3.98
pmon timer 48,218 100.00 140,534 2915 0.30
Streams AQ: qmn slave idle wait 5,142 0.00 140,175 27261 0.03
Streams AQ: qmn coordinator idle wait 10,284 50.00 140,175 13630 0.06
smon timer 577 81.80 136,052 235792 0.00
Streams AQ: waiting for time management or cleanup tasks 33 100.00 65,443 1983113 0.00
Back to Wait Events Statistics
Back to Top

Operating System Statistics
Statistic Total
BUSY_TIME 658,064
IDLE_TIME 114,223,269
NICE_TIME 1,555
SYS_TIME 517,780
USER_TIME 138,729
LOAD 0
RSRC_MGR_CPU_WAIT_TIME 0
PHYSICAL_MEMORY_BYTES 805,196
NUM_CPUS 8
NUM_CPU_SOCKETS 8
Back to Wait Events Statistics
Back to Top

Service Statistics
ordered by DB Time
Service Name DB Time (s) DB CPU (s) Physical Reads Logical Reads
SYS$USERS 974.20 780.90 454 15,004,168
SYS$BACKGROUND 0.00 0.00 120 1,496,429
oracle 0.00 0.00 0 0
oracleXDB 0.00 0.00 0 0
Back to Wait Events Statistics
Back to Top

Service Wait Class Stats
Wait Class info for services in the Service Statistics section.
Total Waits and Time Waited displayed for the following wait classes: User I/O, Concurrency, Administrative, Network
Time Waited (Wt Time) in centisecond (100th of a second)
Service Name User I/O Total Wts User I/O Wt Time Concurcy Total Wts Concurcy Wt Time Admin Total Wts Admin Wt Time Network Total Wts Network Wt Time
SYS$USERS 130 13 0 0 0 0 1287071 479
SYS$BACKGROUND 692 32 4230 367497 0 0 0 0
Back to Wait Events Statistics


回复

使用道具 举报

千问 | 2011-10-24 10:43:14 | 显示全部楼层
http://karlarao.wordpress.com/2009/04/06/os-thread-startup/
查一下DNS

http://asktom.oracle.com/pls/ask ... ON_ID:1191435335912

“This wait event might be seen if the database server is executing on a platform that supports multi-threading. We enter this waiting state while a thread is starting up and leave the wait state when the thread has started or the startup request is cancelled.
This indicates some high contention at OS level avoiding even new process startup.
Issue is related to OS please involve system admin to solve same.”

回复

使用道具 举报

千问 | 2011-10-24 10:43:14 | 显示全部楼层
网络慢看不了附件
回复

使用道具 举报

千问 | 2011-10-24 10:43:14 | 显示全部楼层
是不是OS方面设置导致?我的系统内核参数:
# Kernel sysctl configuration file for Red Hat Linux
#
# For binary values, 0 is disabled, 1 is enabled.See sysctl(8) and
# sysctl.conf(5) for more details.
# Controls IP packet forwarding
net.ipv4.ip_forward = 0
# Controls source route verification
net.ipv4.conf.default.rp_filter = 1
# Do not accept source routing
net.ipv4.conf.default.accept_source_route = 0
# Controls the System Request debugging functionality of the kernel
kernel.sysrq = 0
# Controls whether core dumps will append the PID to the core filename
# Useful for debugging multi-threaded applications
kernel.core_uses_pid = 1
# Controls the use of TCP syncookies
net.ipv4.tcp_syncookies = 1
# Controls the maximum size of a message, in bytes
kernel.msgmnb = 65536
# Controls the default maxmimum size of a mesage queue
kernel.msgmax = 65536
# Controls the maximum shared segment size, in bytes
#kernel.shmmax = 68719476736
# Controls the maximum number of shared memory segments, in pages
#kernel.shmall = 4294967296

kernel.shmmax=3004836480
kernel.sem=250 32000 100 128
kernel.shmall=2097152
kernel.shmmni=4096
fs.file-max=65536
net.ipv4.ip_local_port_range=1024 65000
net.core.rmem_default=262144
net.core.wmem_default=262144
net.core.rmem_max=262144
net.core.wmem_max=262144
回复

使用道具 举报

千问 | 2011-10-24 10:43:14 | 显示全部楼层
Service Wait Class Stats
Wait Class info for services in the Service Statistics section.
Total Waits and Time Waited displayed for the following wait classes: User I/O, Concurrency, Administrative, Network
Time Waited (Wt Time) in centisecond (100th of a second)
Service Name User I/O Total Wts User I/O Wt Time Concurcy Total Wts Concurcy Wt Time Admin Total Wts Admin Wt Time Network Total Wts Network Wt Time
SYS$USERS 28 3 0 0 0 0 71724 29
SYS$BACKGROUND 33 10 310 23433 0 0 0 0 oracle 0 0 0 0 0 0 0 0
Back to Wait Events Statistics
从上面可以看到wait event 都是和os后台的并发配置有关,难道是os问题吗?

回复

使用道具 举报

千问 | 2011-10-24 10:43:14 | 显示全部楼层
版主在吗?帮忙看看啊
回复

使用道具 举报

千问 | 2011-10-24 10:43:14 | 显示全部楼层
你这个系统基本没什么负载,os thread waiting 看看wait等待是哪个会话在做等待,做个进程dump和systemstat dump发出来看看
回复

使用道具 举报

千问 | 2011-10-24 10:43:14 | 显示全部楼层
是不是有大量的死进程之类的 ?来个systemstate dump 看看
回复

使用道具 举报

千问 | 2011-10-24 10:43:14 | 显示全部楼层
什么负荷都没有,你关注个鸟啊!
回复

使用道具 举报

千问 | 2011-10-24 10:43:14 | 显示全部楼层
以前看过一个文档~应该是DNS解析的问题
让SA看看相关的etc/resolv.conf什么的
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

主题

0

回帖

4882万

积分

论坛元老

Rank: 8Rank: 8

积分
48824836
热门排行