C2 compiler enters an infinite loop consuming all native heap and finally
crashes. This is reproducible with 6u13+ including 6u18b02. 6u01 does
not have this bug. The issue hence was introduced after 6u01 but before 6u14.
This bug is reproducible with a non-trivial test case from a customer.
When running a 6u18b02 fastdebug we get an assertion:
# Internal Error (/BUILD_AREA/jdk6_18/hotspot/src/share/vm/opto/phaseX.cpp:1015), pid=23563, tid=1911593872
# Error: assert(loop_count < K,"infinite loop in PhaseIterGVN::transform")
# JRE version: 6.0_18-b02
# Java VM: Java HotSpot(TM) Server VM (16.0-b09-fastdebug mixed mode linux-x86 )
I attach hotspot.log and hs_err_pid23563.log