The issue is with os::free_memory() changes made in 7060842 when the ???madvise??? call was replaced with ???mmap???. This is the reason of exhaustive memory consumption. Seems when we need to remap some memory we need to do it using the same flags as we mapped it initially, particularly with ???MAP_HUGETLB???. Otherwise system maps 4k pages instead of already reserved huge pages.