本站文章除注明转载外，均为本站原创： 转载自love wife & love life —Roger 的Oracle技术博客
本文链接地址: ORA-03137: TTC protocol internal error : [3113] in 11.2.0.4
端午节刚过，下午本来是想vpn登录客户刚迁移的系统，看看最近是否正常的，突然发现之前迁移的一套系统，在我们打了几个patch之后，这次发现alert log又出现了新的错误，不过这个错误并不致命。如下是alert log的信息：
Fri Jun 19 16:19:01 2015 Errors in file /u01/app/oracle/diag/rdbms/acct/xxxx/trace/xxxx_ora_18010.trc (incident=1239675): ORA-03137: TTC protocol internal error : [3113] [] [] [] [] [] [] [] Incident details in: /u01/app/oracle/diag/rdbms/acct/xxxx/incident/incdir_1239675/xxxx_ora_18010_i1239675.trc Fri Jun 19 16:19:04 2015 Dumping diagnostic data in directory=[cdmp_20150619161904], requested by (instance=1, osid=18010), summary=[incident=1239675]. Fri Jun 19 16:19:06 2015 Sweep [inc][1239675]: completed Sweep [inc2][1239675]: completed ..... ..... Sat Jun 20 04:32:59 2015 Archived Log entry 15345 added for thread 1 sequence 5089 ID 0xffffffffe3634d75 dest 1: Sat Jun 20 04:34:50 2015 Errors in file /u01/app/oracle/diag/rdbms/acct/xxxx/trace/xxxx_ora_40578.trc (incident=1233619): ORA-03137: TTC protocol internal error : [3113] [] [] [] [] [] [] [] Incident details in: /u01/app/oracle/diag/rdbms/acct/xxxx/incident/incdir_1233619/xxxx_ora_40578_i1233619.trc Sat Jun 20 04:34:53 2015 Dumping diagnostic data in directory=[cdmp_20150620043453], requested by (instance=1, osid=40578), summary=[incident=1233619]. Sat Jun 20 04:34:55 2015 Sweep [inc][1233619]: completed Sweep [inc2][1233619]: completed ..... ..... Sat Jun 20 22:58:56 2015 Errors in file /u01/app/oracle/diag/rdbms/acct/xxxx/trace/xxxx_ora_16040.trc (incident=1238339): ORA-03137: TTC protocol internal error : [3113] [] [] [] [] [] [] [] Incident details in: /u01/app/oracle/diag/rdbms/acct/xxxx/incident/incdir_1238339/xxxx_ora_16040_i1238339.trc Sat Jun 20 22:59:00 2015 Dumping diagnostic data in directory=[cdmp_20150620225900], requested by (instance=1, osid=16040), summary=[incident=1238339]. Sat Jun 20 22:59:04 2015 Sweep [inc][1238339]: completed Sweep [inc2][1238339]: completed Sat Jun 20 22:59:41 2015 ..... ..... Sun Jun 21 06:02:35 2015 Archived Log entry 15548 added for thread 1 sequence 5213 ID 0xffffffffe3634d75 dest 1: Sun Jun 21 06:05:11 2015 Errors in file /u01/app/oracle/diag/rdbms/acct/xxxx/trace/xxxx_ora_10611.trc (incident=1249547): ORA-03137: TTC protocol internal error : [3113] [] [] [] [] [] [] [] Incident details in: /u01/app/oracle/diag/rdbms/acct/xxxx/incident/incdir_1249547/xxxx_ora_10611_i1249547.trc Sun Jun 21 06:05:14 2015 Dumping diagnostic data in directory=[cdmp_20150621060514], requested by (instance=1, osid=10611), summary=[incident=1249547]. Sun Jun 21 06:05:17 2015 Sweep [inc][1249547]: completed Sweep [inc2][1249547]: completed Sun Jun 21 06:19:26 2015 ..... ..... Archived Log entry 15700 added for thread 1 sequence 5316 ID 0xffffffffe3634d75 dest 1: Mon Jun 22 02:35:23 2015 Errors in file /u01/app/oracle/diag/rdbms/acct/xxxx/trace/xxxx_ora_25443.trc (incident=1249843): ORA-03137: TTC protocol internal error : [3113] [] [] [] [] [] [] [] Incident details in: /u01/app/oracle/diag/rdbms/acct/xxxx/incident/incdir_1249843/xxxx_ora_25443_i1249843.trc Mon Jun 22 02:35:26 2015 Dumping diagnostic data in directory=[cdmp_20150622023526], requested by (instance=1, osid=25443), summary=[incident=1249843]. Mon Jun 22 02:35:28 2015 Sweep [inc][1249843]: completed Sweep [inc2][1249843]: completed Mon Jun 22 02:42:18 2015
开始看日志的时间戳，感觉似乎是差了8个小时，后面仔细核对发现又不完全符合，如下是trace的call stack信息：
*** ACTION NAME:() 2015-06-22 02:35:23.697
Dump continued from file: /u01/app/oracle/diag/rdbms/acct/xxxx/trace/xxxx_ora_25443.trc
ORA-03137: TTC protocol internal error : [3113] [] [] [] [] [] [] []
========= Dump for incident 1249843 (ORA 3137 [3113]) ========
*** 2015-06-22 02:35:23.700
dbkedDefDump(): Starting incident default dumps (flags=0x2, level=3, mask=0x0)
----- SQL Statement (None) -----
Current SQL information unavailable - no cursor.
----- Call Stack Trace -----
calling call entry argument values in hex
location type point (? means dubious value)
-------------------- -------- -------------------- ----------------------------
ksedst1()+124 CALL skdstdst() FFFFFFFF7FFF1AD0 ?
000000002 ? 10D670528 ?
000000000 ?
FFFFFFFF7FFC8E40 ?
000000000 ?
ksedst()+52 CALL ksedst1() 00010D800 ? 00010D800 ?
10DB0F000 ? 00010DB17 ?
10DB0F0D0 ? 10DB1704C ?
dbkedDefDump()+1984 CALL ksedst() 000000000 ? 10DB39000 ?
00010DB39 ? 10DB17000 ?
00010D800 ? 00010DB17 ?
dbgexPhaseII()+1340 PTR_CALL dbkedDefDump() 000000004 ? 00010DB39 ?
000000003 ? 000000000 ?
000000001 ? 00010D800 ?
dbgexProcessError() CALL dbgexPhaseII() 10DD07E40 ?
+2072 FFFFFFFF7CE6A4B0 ?
10DDDF9D0 ? 100A1B2E0 ?
10DB05168 ? 000000000 ?
dbgePostErrorKGE()+ CALL dbgeExecuteForError 000000024 ? 10DB0F5E0 ?
2188 () 000000000 ? 10DD07E40 ?
FFFFFFFF7CE6A4B0 ?
10DB05168 ?
dbkePostKGE_kgsf()+ CALL dbgePostErrorKGE() 000000000 ? 10DD07E40 ?
48 FFFFFFFF7CE664B0 ?
000001D48 ? 000000C41 ?
FFFFFFFF7CE79AA8 ?
kgeade()+548 PTR_CALL dbkePostKGE_kgsf() 10DB0F420 ?
FFFFFFFF7CE78E20 ?
000000C41 ? 000002878 ?
10BE7A000 ? 00010BE7A ?
kgerelv()+240 CALL kgeade() 000000000 ?
FFFFFFFF7CE78E20 ?
000000000 ? 000000C41 ?
000000000 ? 000000000 ?
kgerev()+64 CALL kgerelv() 10DB0F420 ?
FFFFFFFF7CE78E20 ?
000000C41 ? 10D664020 ?
FFFFFFFF7FFFAC48 ?
000000001 ?
opiierr()+584 CALL kgerev() 10DB0F420 ?
FFFFFFFFFFB5EEB8 ?
000000C41 ? 000000001 ?
FFFFFFFF7FFFAC48 ?
0004A1000 ?
opiodr()+9528 CALL opiierr() 00010DB0F ? 000000001 ?
000000001 ? 10DB0F000 ?
0000001B0 ? 10CFF6E00 ?
ttcpip()+932 PTR_CALL opiodr() 00010D800 ? 10DB0F5E0 ?
000000000 ? 000000074 ?
000000000 ? 00010DB35 ?
opitsk()+1728 CALL ttcpip() FFFFFFFF7FFFC340 ?
000000040 ? 000000001 ?
10DB0F420 ?
FFFFFFFF7FFFD928 ?
000000000 ?
opiino()+924 CALL opitsk() 000000000 ? 10BE5D7E4 ?
000000000 ? 000000001 ?
00000000A ? 000001768 ?
opiodr()+1176 PTR_CALL opiino() 10DB31878 ?
FFFFFFFF7FFFECE0 ?
000000001 ? 000000000 ?
0000000D8 ? 10DD0B778 ?
opidrv()+1032 CALL opiodr() 000010000 ? 10DB0F5E0 ?
000000000 ? 00000003C ?
000000000 ? 10C0F3120 ?
sou2o()+88 CALL opidrv() 10DB13000 ? 000000000 ?
10DB31878 ? 00000003C ?
000000000 ?
FFFFFFFF7FFFECE0 ?
opimai_real()+316 CALL sou2o() FFFFFFFF7FFFECB8 ?
00000003C ? 000000004 ?
FFFFFFFF7FFFECE0 ?
10DB363E0 ? 00010D800 ?
ssthrdmain()+324 PTR_CALL opimai_real() 000000002 ?
FFFFFFFF7FFFEF68 ?
FFFFFFFF7F201340 ?
FFFFFFFF7F201340 ?
00537C944 ? 000000001 ?
main()+316 CALL ssthrdmain() 00010D800 ? 00010DB41 ?
10DB41000 ? 000000002 ?
00010DB41 ? 10DCFBD60 ?
_start()+380 CALL main() 000000002 ? 000000000 ?
000000000 ?
FFFFFFFF7FFFEF78 ?
FFFFFFFF7FFFF088 ?
000002800 ?
查询Oracle metalink,确认是Oracle bug 20309829导致。比较遗憾的是该bug 目前尚未出相关的patch。
说明：经过查询该bug call stack与上述trace 完全一致,虽然该bug的描述是针对Linux 平台，而且使用内部账户查询相关的SR，也提到了另外2个相关的bug，因此我确认是这个bug 无疑。
可惜都没有相关的patch。还好，这个bug不致命，基本上可以忽略之。请参考：
Bug 20309829 : ORA-3137: TTC PROTOCOL INTERNAL ERROR: [3113] [] [] [] [] [] [] []
Related posts:
