OGG 状态正常但是数据不同步

显示全部楼层 · 2017-11-26 22:00:00

rac 环境OGG 状态正常但是数据不同步
查看ggserr.log 没有发现报错，但是数据就是不同步
ext进程
> view param ext_slsc
EXTRACT ext_slsc
setenv (ORACLE_HOME = "/u01/app/oracle/product/11.2.0/db_1")
setenv (NLS_LANG=AMERICAN_AMERICA.ZHS16GBK)
userid goldengate,password goldengate
TRANLOGOPTIONS ASMUSER SYS@ASM,ASMPASSWORD oracle
REPORTCOUNT EVERY 1 MINUTES, RATE
numfiles 5000
--HANDLECOLLISIONS
DISCARDFILE ./dirrpt/ext_slsc.dsc,APPEND,MEGABYTES 1000
DISCARDROLLOVER AT 3:00
exttrail ./dirdat/r2,megabytes 512
dynamicresolution
TRANLOGOPTIONS EXCLUDEUSER goldengate
THREADOPTIONS PROCESSTHREADS SELECT 2
TABLE dbsl.AAAA;

dpe进程
> view param dpe_slsc
extract dpe_slsc
dynamicresolution
passthru
rmthost 172.xxx, mgrport 7839, compress
rmttrail ./dirdat/s2
numfiles 5000
TABLE dbsl.AAAA;

rep进程
> view param rep_s2

REPLICAT rep_s2
setenv (ORACLE_HOME = "/u02/app/oracle/product/11.2.0/dbhome_1")
SETENV (NLS_LANG = "AMERICAN_AMERICA.ZHS16GBK")
USERID goldengate,PASSWORD goldengate
REPORTCOUNT EVERY 30 MINUTES, RATE
REPERROR DEFAULT, ABEND
numfiles 5000
--HANDLECOLLISIONS
assumetargetdefs
DISCARDFILE ./dirrpt/rep_s2.dsc, APPEND, MEGABYTES 1000
ALLOWNOOPUPDATES
MAP xxx

rep_s2 根本没工作，checkpointtable已经创建了
> info rep_s2,detail
REPLICAT REP_S2Last Started 2016-10-10 11:20 Status RUNNING
Checkpoint Lag 00:00:00 (updated 00:00:06 ago)
Log Read CheckpointFile ./dirdat/s2000000

First RecordRBA 0
Extract Source
Begin
End

./dirdat/s2000000
* Initialized * First Record
./dirdat/s2000000
* Initialized * First Record
./dirdat/s2000000
* Initialized * First Record
./dirdat/s2000000
* Initialized * First Record

Current directory/home/goldengate
Report file
/home/goldengate/dirrpt/REP_S2.rpt
Parameter file /home/goldengate/dirprm/rep_s2.prm
Checkpoint file/home/goldengate/dirchk/REP_S2.cpr
Checkpoint table goldengate.rep_s2_ckpt
Process file /home/goldengate/dirpcs/REP_S2.pcr
Stdout file
/home/goldengate/dirout/REP_S2.out
Error log
/home/goldengate/ggserr.log

log
2016-10-10 11:08:30INFOOGG-00987Oracle GoldenGate Command Interpreter for Oracle:GGSCI command (oracle):start rep_s2 aftercsn 6381008361101.
2016-10-10 11:08:30INFOOGG-00963Oracle GoldenGate Manager for Oracle, mgr.prm:Command received from GGSCI on host wsscdb1 (START REPLICAT REP_S2 AFTERCSN 6381008361101).
2016-10-10 11:08:30INFOOGG-00975Oracle GoldenGate Manager for Oracle, mgr.prm:REPLICAT REP_S2 starting.
2016-10-10 11:08:30INFOOGG-00995Oracle GoldenGate Delivery for Oracle, rep_s2.prm:REPLICAT REP_S2 starting.
2016-10-10 11:08:30INFOOGG-03035Oracle GoldenGate Delivery for Oracle, rep_s2.prm:Operating system character set identified as UTF-8. Locale: en_US, LC_ALL:.
2016-10-10 11:08:30INFOOGG-01815Oracle GoldenGate Delivery for Oracle, rep_s2.prm:Virtual Memory Facilities for: COM
anon alloc: mmap(MAP_ANON)anon free: munmap
file alloc: mmap(MAP_SHARED)file free: munmap
target directories:
/home/goldengate/dirtmp.
2016-10-10 11:08:30INFOOGG-00996Oracle GoldenGate Delivery for Oracle, rep_s2.prm:REPLICAT REP_S2 started.
2016-10-10 11:08:39INFOOGG-00963Oracle GoldenGate Manager for Oracle, mgr.prm:Command received from EXTRACT on host (START SERVER CPU -1 PRI -1TIMEOUT 300 PARAMS ).
2016-10-10 11:08:39INFOOGG-01677Oracle GoldenGate Collector for Oracle:Waiting for connection (started dynamically).
2016-10-10 11:08:39INFOOGG-00963Oracle GoldenGate Manager for Oracle, mgr.prm:Command received from SERVER on host localhost (REPORT 17620 7843).
2016-10-10 11:08:39INFOOGG-00974Oracle GoldenGate Manager for Oracle, mgr.prm:Manager started collector process (Port 7843).
2016-10-10 11:08:39INFOOGG-01228Oracle GoldenGate Collector for Oracle:Timeout in 300 seconds.
2016-10-10 11:08:44INFOOGG-00987Oracle GoldenGate Command Interpreter for Oracle:GGSCI command (oracle): send replicat rep_s2 report.
2016-10-10 11:08:44INFOOGG-01229Oracle GoldenGate Collector for Oracle:Connected to :28708.
2016-10-10 11:08:44INFOOGG-01669Oracle GoldenGate Collector for Oracle:Opening ./dirdat/s2000162 (byte -1, current EOF 1465).
2016-10-10 11:08:44INFOOGG-01670Oracle GoldenGate Collector for Oracle:Closing ./dirdat/s2000162.
2016-10-10 11:08:44INFOOGG-01669Oracle GoldenGate Collector for Oracle:Opening ./dirdat/s2000162 (byte 1465, current EOF 1465).
2016-10-10 11:08:44INFOOGG-01735Oracle GoldenGate Collector for Oracle:Synchronizing ./dirdat/s2000162 to disk.
2016-10-10 11:08:44INFOOGG-01735Oracle GoldenGate Collector for Oracle:Synchronizing ./dirdat/s2000162 to disk.
2016-10-10 11:08:44INFOOGG-01670Oracle GoldenGate Collector for Oracle:Closing ./dirdat/s2000162.
2016-10-10 11:08:44INFOOGG-01669Oracle GoldenGate Collector for Oracle:Opening ./dirdat/s2000163 (byte -1, current EOF 0).
2016-10-10 11:08:45INFOOGG-01021Oracle GoldenGate Delivery for Oracle, rep_s2.prm:Command received from GGSCI: REPORT.
2016-10-10 11:20:25INFOOGG-00987Oracle GoldenGate Command Interpreter for Oracle:GGSCI command (oracle): stop rep_s2.
2016-10-10 11:20:26INFOOGG-01021Oracle GoldenGate Delivery for Oracle, rep_s2.prm:Command received from GGSCI: STOP.
2016-10-10 11:20:26INFOOGG-00994Oracle GoldenGate Delivery for Oracle, rep_s2.prm:REPLICAT REP_S2 stopped normally.
2016-10-10 11:20:35INFOOGG-00987Oracle GoldenGate Command Interpreter for Oracle:GGSCI command (oracle):start rep_s2 aftercsn 6381008361101.
2016-10-10 11:20:35INFOOGG-00963Oracle GoldenGate Manager for Oracle, mgr.prm:Command received from GGSCI on host wsscdb1 (START REPLICAT REP_S2 AFTERCSN 6381008361101).
2016-10-10 11:20:35INFOOGG-00975Oracle GoldenGate Manager for Oracle, mgr.prm:REPLICAT REP_S2 starting.
2016-10-10 11:20:35INFOOGG-00995Oracle GoldenGate Delivery for Oracle, rep_s2.prm:REPLICAT REP_S2 starting.
2016-10-10 11:20:35INFOOGG-03035Oracle GoldenGate Delivery for Oracle, rep_s2.prm:Operating system character set identified as UTF-8. Locale: en_US, LC_ALL:.
2016-10-10 11:20:35INFOOGG-01815Oracle GoldenGate Delivery for Oracle, rep_s2.prm:Virtual Memory Facilities for: COM
anon alloc: mmap(MAP_ANON)anon free: munmap
file alloc: mmap(MAP_SHARED)file free: munmap
target directories:
/home/goldengate/dirtmp.
2016-10-10 11:20:35INFOOGG-00996Oracle GoldenGate Delivery for Oracle, rep_s2.prm:REPLICAT REP_S2 started.
2016-10-10 11:20:41INFOOGG-00987Oracle GoldenGate Command Interpreter for Oracle:GGSCI command (oracle): send replicat rep_s2 report.
2016-10-10 11:20:41INFOOGG-01021Oracle GoldenGate Delivery for Oracle, rep_s2.prm:Command received from GGSCI: REPORT.

千问 · 2017-11-26 22:00:00

补充extract信息
> info all
Program StatusGroup Lag at ChkptTime Since Chkpt
MANAGER RUNNING

EXTRACT RUNNING DPE_SLSC00:00:0000:00:05
EXTRACT RUNNING EXT_SLSC00:00:0000:00:04
......
> info ext_slsc showch
EXTRACTEXT_SLSCLast Started 2016-10-10 11:14 Status RUNNING
Checkpoint Lag 00:00:00 (updated 00:00:06 ago)
Log Read CheckpointOracle Redo Logs

2016-10-10 09:39:39Thread 1, Seqno 0, RBA 0

SCN 0.0 (0)
Log Read CheckpointOracle Redo Logs

2016-10-10 11:47:54Thread 2, Seqno 51768, RBA 167633408

SCN 1485.2983242469 (6381009677029)

Current Checkpoint Detail:
Read Checkpoint #1
Oracle Threaded Redo Log
Startup Checkpoint (starting position in the data source):
Thread #: 1
Sequence #: 0
RBA: 0
Timestamp: 2016-10-10 09:39:39.000000
SCN: Not available
Redo File:
Recovery Checkpoint (position of oldest unprocessed transaction in the data source):
Thread #: 1
Sequence #: 0
RBA: 0
Timestamp: 2016-10-10 09:39:39.000000
SCN: Not available
Redo File:
Current Checkpoint (position of last record read in the data source):
Thread #: 1
Sequence #: 0
RBA: 0
Timestamp: 2016-10-10 09:39:39.000000
SCN: Not available
Redo File:
Read Checkpoint #2
Oracle Threaded Redo Log
Startup Checkpoint (starting position in the data source):
Thread #: 2
Sequence #: 51763
RBA: 236001808
Timestamp: 2016-10-10 10:39:26.000000
SCN: 1485.2981816223 (6381008250783)
Redo File: Not Available
Recovery Checkpoint (position of oldest unprocessed transaction in the data source):
Thread #: 2
Sequence #: 51768
RBA: 131175440
Timestamp: 2016-10-10 11:29:41.000000
SCN: 1485.2982798344 (6381009232904)
Redo File: Not Available
Current Checkpoint (position of last record read in the data source):
Thread #: 2
Sequence #: 51768
RBA: 167633408
Timestamp: 2016-10-10 11:47:54.000000
SCN: 1485.2983242469 (6381009677029)
Redo File: +DATA/sdsldb/onlinelog/group8
Write Checkpoint #1
GGS Log Trail
Current Checkpoint (current write position):
Sequence #: 173
RBA: 97143943
Timestamp: 2016-10-10 11:45:11.776032
Extract Trail: ./dirdat/r2
CSN state information:
CRC: 87-47-61-37
CSN: Not available
Header:
Version = 2
Record Source = A
Type = 11
# Input Checkpoints = 2
# Output Checkpoints = 1
File Information:
Block Size = 2048
Max Blocks = 100
Record Length = 4096
Current Offset = 0
Configuration:
Data Source = 3
Transaction Integrity = 1
Task Type = 0
Status:
Start Time = 2016-10-10 11:14:14
Last Update Time = 2016-10-10 11:45:11
Stop Status = A
Last Result = 400

2016-10-10 11:14:12INFOOGG-01815Virtual Memory Facilities for: BR
anon alloc: mmap(MAP_ANON)anon free: munmap
file alloc: mmap(MAP_SHARED)file free: munmap
target directories:
/home/goldengate/BR/EXT_SLSC.
Bounded Recovery Parameter:
BRINTERVAL = 4HOURS
BRDIR= /home/goldengate
2016-10-10 11:14:12INFOOGG-01815Virtual Memory Facilities for: COM
anon alloc: mmap(MAP_ANON)anon free: munmap
file alloc: mmap(MAP_SHARED)file free: munmap
target directories:
/home/goldengate/dirtmp.
CACHEMGR virtual memory values (may have been adjusted)
CACHESIZE:
64G
CACHEPAGEOUTSIZE (normal):
8M
PROCESS VM AVAIL FROM OS (min): 128G
CACHESIZEMAX (strict force to disk): 96G
Database Version:
Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
PL/SQL Release 11.2.0.3.0 - Production
CORE11.2.0.3.0Production
TNS for Linux: Version 11.2.0.3.0 - Production
NLSRTL Version 11.2.0.3.0 - Production
Database Language and Character Set:
NLS_LANG = "AMERICAN_AMERICA.ZHS16GBK"
NLS_LANGUAGE = "AMERICAN"
NLS_TERRITORY= "AMERICA"
NLS_CHARACTERSET = "ZHS16GBK"
Maximum supported ASM read buffer size is 28 KB
2016-10-10 11:14:12WARNING OGG-01423No valid default archive log destination directory found for thread 1.
Maximum supported ASM read buffer size is 28 KB
2016-10-10 11:14:13WARNING OGG-01423No valid default archive log destination directory found for thread 2.
2016-10-10 11:14:13INFOOGG-00546Default thread stack size: 104857600.
2016-10-10 11:14:13INFOOGG-01513Positioning to (Thread 2) Sequence 51763, RBA 236001808, SCN 1485.2981816223.
2016-10-10 11:14:14INFOOGG-01516Positioned to (Thread 2) Sequence 51763, RBA 236001808, SCN 1485.2981816223, Oct 10, 2016 10:39:26 AM.
2016-10-10 11:14:14INFOOGG-01055Recovery initialization completed for target file ./dirdat/r2000172, at RBA 51506.
2016-10-10 11:14:14INFOOGG-01478Output file ./dirdat/r2 is using format RELEASE 11.2.
2016-10-10 11:14:14INFOOGG-01026Rolling over remote file ./dirdat/r2000172.
2016-10-10 11:14:14INFOOGG-01053Recovery completed for target file ./dirdat/r2000173, at RBA 1087.
2016-10-10 11:14:14INFOOGG-01057Recovery completed for all targets.

2016-10-10 11:14:14INFOOGG-01517Position of first record processed for Thread 2, Sequence 51763, RBA 236001808, SCN 1485.2981816216, Oct 10, 2016 10:39:26 AM.
2016-10-10 11:14:15WARNING OGG-00723Record with class# 25074, slt# 28, at seqno 51763, rba 241109008 SCN 1485.2981869790 (6381008304350) has secondary transaction
ID that is duplicate of existing open uncommitted transaction.
2016-10-10 11:14:15WARNING OGG-00715[Thread #2] Purging transaction (transaction id: 12529.28.55557, start time: 2016-10-10 10:39:50, start seqno: 51763, start RBA
: 237667856).
2016-10-10 11:14:15WARNING OGG-00712Updating I/O checkpoint after purging orphaned transactions on thread 2 with current position (Seq#: 51763, RBA: 241110068).
TABLE resolved (entry dbsl.T_KCSL):
TABLE "DBSL"."T_KCSL";
Using the following key columns for source table DBSL.T_KCSL: ID, KFBH, YWBMBH.

2016-10-10 11:14:55WARNING OGG-00723Record with class# 25052, slt# 25, at seqno 51766, rba 45242384 SCN 1485.2982054445 (6381008489005) has secondary transaction I
D that is duplicate of existing open uncommitted transaction.
2016-10-10 11:14:55WARNING OGG-00715[Thread #2] Purging transaction (transaction id: 12518.25.29090, start time: 2016-10-10 10:39:54, start seqno: 51763, start RBA
: 237962768).
2016-10-10 11:14:55WARNING OGG-00712Updating I/O checkpoint after purging orphaned transactions on thread 2 with current position (Seq#: 51766, RBA: 45247620).
2016-10-10 11:14:57WARNING OGG-00723Record with class# 25048, slt# 0, at seqno 51766, rba 70665232 SCN 1485.2982102417 (6381008536977) has secondary transaction ID
that is duplicate of existing open uncommitted transaction.
2016-10-10 11:14:57WARNING OGG-00715[Thread #2] Purging transaction (transaction id: 12516.0.35315, start time: 2016-10-10 10:39:26, start seqno: 51763, start RBA:
236001808).
2016-10-10 11:14:57WARNING OGG-00712Updating I/O checkpoint after purging orphaned transactions on thread 2 with current position (Seq#: 51766, RBA: 70671572).
2016-10-10 11:14:59WARNING OGG-00723Record with class# 24912, slt# 24, at seqno 51766, rba 89262096 SCN 1485.2982140895 (6381008575455) has secondary transaction I
D that is duplicate of existing open uncommitted transaction.
然后就是很多的OGG-00723 OGG-00712 OGG-00715网上说是不支持分布式事物什么的

千问 · 2017-11-26 22:00:00

你看看源端的dirdat和目标端的这个目录下的队列文件都有生成吗？

千问 · 2017-11-26 22:00:00

jieyancai 发表于 2016-10-10 12:02
你看看源端的dirdat和目标端的这个目录下的队列文件都有生成吗？
我把 ext dpe rep进程和队列文件都干掉了，所有的都推到重做的，目前还没发现错误
估计是dpe进程没把队列文件传送过去

千问 · 2017-11-26 22:00:00

./dirrpt/rep_s2.dsc 这个文件应该有数据吧？

千问 · 2017-11-26 22:00:00

我也遇到过你类似的问题，大批量跑批，进程状态正常，但是数据没有投递出去，重启进程就好了

千问 · 2017-11-26 22:00:00

查看一下数据库的补全日志，各个表的补全日志有没有加
查看一下抽取进程有没有生成文件
查看一下 pump进程有没有把文件传到目标端

千问 · 2017-11-26 22:00:00

huanjihou 发表于 2016-10-11 15:01
我也遇到过你类似的问题，大批量跑批，进程状态正常，但是数据没有投递出去，重启进程就好了
OGG对大事务支持不够人性

千问 · 2017-11-26 22:00:00

xie3ks 发表于 2016-10-12 17:31
OGG对大事务支持不够人性
对的！