It seems, we get "bad AD file" for long time.
And not only on sparc but on x86 and amd64 also.
May be something wrong with matcher?

/net/jano/export/disk05/hotspot/bin/hs_err --jvm=/tmp/kvn/libjvm.so /net/vmsqe/export/nightly/mantis/DTWS/results/03-03-06/ServerVM/linux-i386/comp/C2_Baseline/nsk.stress-NIGHTLY-C2_Baseline-ServerVM-comp-linux-i386-2006-03-04-03-10-45/hs_err_pid9471.log | more

#o7536 Binary === _ o6601 o6219 [[o6600 ]]
#VM option '-PrintVMOptions'
#VM option 'CompileThreshold=100'
#
#--N: o7536 Binary === _ o6601 o6219 [[o6600 ]]
#
# --N: o6601 Phi === o6570 o6219 o6545 [[o7536 ]] #bool
# EREGI 0 EREGI
# XREGI 0 XREGI
# EAXREGI 0 EAXREGI
# EBXREGI 0 EBXREGI
# ECXREGI 0 ECXREGI
# EDXREGI 0 EDXREGI
# EDIREGI 0 EDIREGI
# NAXREGI 0 NAXREGI
# NADXREGI 0 NADXREGI
# NCXREGI 0 NCXREGI
# ESIREGI 0 ESIREGI
# STACKSLOTI 100 storeSSI
#
# --N: o6219 Bool === _ o6220 [[o6601 o7536 ]] [le]
# CMPOP 0 CMPOP
# CMPOPU 0 CMPOPU
# CMPOP_FCMOV 0 CMPOP_FCMOV
# CMPOP_COMMUTE 0 CMPOP_COMMUTE
#
#
# An unexpected error has been detected by Java Runtime Environment:
#
# Internal Error (/PrtBuildDir/workspace/src/share/vm/opto/matcher.cpp, 1319),pid=9471, tid=1625820080
#
# Java VM: Java HotSpot(TM) Server VM (20060303114842.never.vtable-debug compiled mode)
#
# Error: assert(false,"bad AD file")
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
#

--------------- T H R E A D ---------------

Current thread (0x0811bc00): JavaThread "CompilerThread1" daemon [_thread_in_native, id=9481]

Stack: [0x60e00000,0x60e81000), sp=0x60e7f870, free space=510k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.so+0x8e8778];; _ZN7VMError14report_and_dieEv+0x258
V [libjvm.so+0x404df5];; _Z24report_assertion_failurePKciS0_+0x55
V [libjvm.so+0x70a8f5];; _ZN7Matcher10Label_RootEPK4NodeP5StatePS0_S2_+0x145
V [libjvm.so+0x70ab2a];; _ZN7Matcher10Label_RootEPK4NodeP5StatePS0_S2_+0x37a
V [libjvm.so+0x70a319];; _ZN7Matcher10match_treeEPK4Node+0x189
V [libjvm.so+0x709461];; _ZN7Matcher5xformEP4Nodei+0x971
V [libjvm.so+0x70685e];; _ZN7Matcher5matchEv+0x60e
V [libjvm.so+0x3b76b8];; _ZN7Compile8Code_GenEv+0xf8
V [libjvm.so+0x3b2c2a];; _ZN7CompileC1EP5ciEnvP10C2CompilerP8ciMethodib+0x95a
V [libjvm.so+0x30c4f6];; _ZN10C2Compiler14compile_methodEP5ciEnvP8ciMethodi+0x46
V [libjvm.so+0x3c00fc];; _ZN13CompileBroker25invoke_compiler_on_methodEP11CompileTask+0x47c
V [libjvm.so+0x3bf6e7];; _ZN13CompileBroker20compiler_thread_loopEv+0x327
V [libjvm.so+0x8900ac];; _ZN10JavaThread17thread_main_innerEv+0xcc
V [libjvm.so+0x772542];; _Z10java_startP6Thread+0x122
readelf: Error: Cannot stat input file /lib/tls/libpthread.so.0.
nm: /lib/tls/libpthread.so.0: No such file or directory
C [libpthread.so.0+0x59ed]Warning: /lib/tls/libpthread.so.0 does not exist or it has been stripped

Current CompileTask:
opto:3511 b sun.awt.geom.AreaOp.pruneEdges(Ljava/util/Vector;)Ljava/util/Vector; (1075 bytes)

===================================================================================================
/net/jano/export/disk05/hotspot/bin/hs_err --jvm=/tmp/kvn/libjvm.so /net/vmsqe/export/nightly/mantis/DTWS/results/03-15-06/ServerVM/64BITLINUX-AMD64/comp/C2_Baseline/nsk.stress-NIGHTLY-C2_Baseline-ServerVM-comp-64BITLINUX-AMD64-2006-03-16-08-46-25/hs_err_pid18842.log | more
#o7020 Binary === _ o6216 o5826 [[o6215 ]]
#VM option '-PrintVMOptions'
#VM option 'CompileThreshold=100'
#
#--N: o7020 Binary === _ o6216 o5826 [[o6215 ]]
#
# --N: o6216 Phi === o6183 o5826 o6159 [[o7020 ]] #bool
# RREGI 0 RREGI
# RAX_REGI 0 RAX_REGI
# RBX_REGI 0 RBX_REGI
# RCX_REGI 0 RCX_REGI
# RDX_REGI 0 RDX_REGI
# RDI_REGI 0 RDI_REGI
# NO_RCX_REGI 0 NO_RCX_REGI
# NO_RAX_RDX_REGI 0 NO_RAX_RDX_REGI
# STACKSLOTI 100 storeSSI
#
# --N: o5826 Bool === _ o5827 [[o6216 o7020 ]] [le]
# CMPOP 0 CMPOP
# CMPOPU 0 CMPOPU
#
#
# An unexpected error has been detected by Java Runtime Environment:
#
# Internal Error (/PrtBuildDir/workspace/src/share/vm/opto/matcher.cpp, 1324),pid=18842, tid=1083386208
#
# Java VM: Java HotSpot(TM) 64-Bit Server VM (20060315120121.never.vtable-debugcompiled mode)
#
# Error: assert(false,"bad AD file")
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
#

--------------- T H R E A D ---------------

Current thread (0x0000002abea95c00): JavaThread "CompilerThread0" daemon [_thread_in_native, id=18853]

Stack: [0x0000000040832000,0x0000000040933000), sp=0x00000000409302b0, free space=1016k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.so+0x92505f];; _ZN7VMError14report_and_dieEv+0x23f
V [libjvm.so+0x34403e];; _Z24report_assertion_failurePKciS0_+0x6e
V [libjvm.so+0x6cb015];; _ZN7Matcher10Label_RootEPK4NodeP5StatePS0_S2_+0x175
V [libjvm.so+0x6cb251];; _ZN7Matcher10Label_RootEPK4NodeP5StatePS0_S2_+0x3b1
V [libjvm.so+0x6ca9ce];; _ZN7Matcher10match_treeEPK4Node+0x18e
V [libjvm.so+0x6c9a0e];; _ZN7Matcher5xformEP4Nodei+0xa0e
V [libjvm.so+0x6c67f2];; _ZN7Matcher5matchEv+0x692
V [libjvm.so+0x2ee6e4];; _ZN7Compile8Code_GenEv+0x134
V [libjvm.so+0x2e9310];; _ZN7CompileC1EP5ciEnvP10C2CompilerP8ciMethodib+0x850
V [libjvm.so+0x232196];; _ZN10C2Compiler14compile_methodEP5ciEnvP8ciMethodi+0x66
V [libjvm.so+0x2f7f9c];; _ZN13CompileBroker25invoke_compiler_on_methodEP11CompileTask+0x40c
V [libjvm.so+0x2f756c];; _ZN13CompileBroker20compiler_thread_loopEv+0x3dc
V [libjvm.so+0x8cb283];; _Z21compiler_thread_entryP10JavaThreadP6Thread+0x13
V [libjvm.so+0x8c23c5];; _ZN10JavaThread17thread_main_innerEv+0xd5
V [libjvm.so+0x8c227d];; _ZN10JavaThread3runEv+0x11d
V [libjvm.so+0x73c244];; _Z10java_startP6Thread+0x154

Current CompileTask:
opto:3490 b sun.awt.geom.AreaOp.pruneEdges(Ljava/util/Vector;)Ljava/util/Vector; (1075 bytes)











Vladimir Kozlov wrote:

> I looked through all hiden hs_err files (passe after rerun).
> And found next 2 failures during this month:
> "bad AD file" and error during revoke_bias (frame_sparc.cpp, 462)
>
> /net/vmsqe/export/nightly/mantis/DTWS/results/04-04-06/ServerVM/64BITSOLSPARC/comp/C2_Baseline/nsk.stress-NIGHTLY-C2_Baseline-ServerVM-comp-64BITSOLSPARC-2006-04-04-21-17-55/hs_err_pid10523.log
>
> #o7748 Binary === _ o6628 o6192 [[o6627 ]]
> #VM option '-PrintVMOptions'
> #VM option 'CompileThreshold=100'
> #
> #--N: o7748 Binary === _ o6628 o6192 [[o6627 ]]
> #
> # --N: o6628 Phi === o6596 o6192 o6571 [[o7748 ]] #bool
> # IREGI 1 IREGI
> # NOTEMP_IREGI 1 NOTEMP_IREGI
> # G1REGI 2 G1REGI
> # O0REGI 2 O0REGI
> # G3REGI 2 G3REGI
> # G4REGI 2 G4REGI
> # O7REGI 2 O7REGI
> # IREGISAFE 1 IREGISAFE
> # NOG3_IREGI_64BIT_SAFE 1 NOG3_IREGI_64BIT_SAFE
> # STACKSLOTI 200 regI_to_stkI
> #
> # --N: o6192 Bool === _ o6193 [[o6628 o7748 ]] [le]
> # CMPOP 1 CMPOP
> # CMPOPU 1 CMPOPU
> # CMPOPP 1 CMPOPP
> # CMPOP_REG 1 CMPOP_REG
> # CMPOPF 1 CMPOPF
> # CMPOP_COMMUTE 1 CMPOP_COMMUTE
>
> #
> # An unexpected error has been detected by Java Runtime Environment:
> #
> # Internal Error (/net/prt-solsparc-q1-10/tmp/PrtBuildDir/workspace/src/share/vm/opto/matcher.cpp, 1324 [ Patched ]), pid=10523, tid=7
> #
> # Java VM: Java HotSpot(TM) 64-Bit Server VM (20060403084257.rasbold.c2_baseline2-debug compiled mode)
> #
> # Error: assert(false,"bad AD file")
> # If you would like to submit a bug report, please visit:
> # http://java.sun.com/webapps/bugreport/crash.jsp
> #
>
> --------------- T H R E A D ---------------
>
> Current thread (0x00000001002c3000): JavaThread "CompilerThread0" daemon [_thread_in_native, id=7]
>
> Stack: [0xffffffff6c200000,0xffffffff6c300000), sp=0xffffffff6c2fc130, free space=1008k
> Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
> V [libjvm.so+0xfaae0c] void VMError::report_and_die() + 0x7ac
> V [libjvm.so+0x493c4c] void report_assertion_failure(const char*,int,const char*) + 0x74
> V [libjvm.so+0xbb25e8] Node*Matcher::Label_Root(const Node*,State*,Node*,constNode*) + 0xb40
> V [libjvm.so+0xbb23f0] Node*Matcher::Label_Root(const Node*,State*,Node*,constNode*) + 0x948
> V [libjvm.so+0xbb11bc] MachNode*Matcher::match_tree(const Node*) + 0x2e4
> V [libjvm.so+0xbaef00] Node*Matcher::xform(Node*,int) + 0x3b0
> V [libjvm.so+0xbac29c] void Matcher::match() + 0xa0c
> V [libjvm.so+0x3fbcac] void Compile::Code_Gen() + 0x294
> V [libjvm.so+0x3f5484] Compile::Compile(ciEnv*,C2Compiler*,ciMethod*,int,bool)+ 0x1dd4
> V [libjvm.so+0x272ac0] void C2Compiler::compile_method(ciEnv*,ciMethod*,int) +0x68
> V [libjvm.so+0x40e774] void CompileBroker::invoke_compiler_on_method(CompileTask*) + 0x1cf4
> V [libjvm.so+0x40bd8c] void CompileBroker::compiler_thread_loop() + 0xc44
> V [libjvm.so+0xeb6404] void JavaThread::thread_main_inner() + 0x224
> V [libjvm.so+0xeb61bc] void JavaThread::run() + 0x624
> V [libjvm.so+0xc831c0] java_start + 0x188
>
>
> Current CompileTask:
> opto:3686 b sun.awt.geom.AreaOp.pruneEdges(Ljava/util/Vector;)Ljava/util/Vector; (1075 bytes)
>
> ===================================================================================================
>
> /net/vmsqe/export/nightly/mantis/DTWS/results/04-05-06/ServerVM/SOLARIS-NIAGARA/mixed/Main_Baseline/nsk.stress-06-NIGHTLY-Main_Baseline-ServerVM-mixed-SOLARIS-NIAGARA-2006-04-06-05-39-41/hs_err_pid8209.log
> #
> # An unexpected error has been detected by Java Runtime Environment:
> #
> # Internal Error (4652414D453F53504152430E43505001CE 01), pid=8209, tid=200
> #
> # Java VM: Java HotSpot(TM) Server VM (20060330082440.kbr.compiler_b79_merge mixed mode)
> # If you would like to submit a bug report, please visit:
> # http://java.sun.com/webapps/bugreport/crash.jsp
> #
> --------------- T H R E A D ---------------
>
> Current thread (0x0055f400): JavaThread "Thread-157" [_thread_in_vm, id=200]
>
> Stack: [0xac500000,0xac580000), sp=0xac57e0a0, free space=504k
> Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
> V [libjvm.so+0x616538] void VMError::report_and_die() + 0x734
> V [libjvm.so+0x3102fc] void report_fatal(const char*,int,const char*) + 0x2c
> V [libjvm.so+0x806f4] void JavaFrameAnchor::make_walkable(JavaThread*) + 0x98
> V [libjvm.so+0xee8ec] void RegisterMap::pd_clear() + 0x28
> V [libjvm.so+0x28fc2c] GrowableArray<MonitorInfo*>*get_or_compute_monitor_info(JavaThread*) + 0x84
> V [libjvm.so+0x2901b8] BiasedLocking::Condition revoke_bias(oopDesc*,bool,bool,JavaThread*) + 0x340
> V [libjvm.so+0x2910a0] BiasedLocking::Condition BiasedLocking::revoke_and_rebias(Handle,bool,Thread*) + 0x258
> V [libjvm.so+0x5c3540] void ObjectSynchronizer::fast_enter(Handle,BasicLock*,bool,Thread*) + 0x70
> V [libjvm.so+0x59a300] void SharedRuntime::complete_monitor_locking_C(oopDesc*,BasicLock*,JavaThread*) + 0x9c
> v ~RuntimeStub::_complete_monitor_locking_Java
> J java.util.Hashtable.get(Ljava/lang/Object;)Ljava/lang/Object;
> j javax.swing.text.html.HTML.getTag(Ljava/lang/String;)Ljavax/swing/text/html/HTML$Tag;+4
>