Error occurred during initialization of VM

 Upgraded from 11.5.10.2 to 12.1.3 on Oracle Linux 5 on vmware.  We are a month into testing and no major problems except this.  When running Journal Entries Report, request errors with the below:

XLAJELINESRPT module: Journal Entries Report
+---------------------------------------------------------------------------+

Current system time is 04-OCT-2012 16:13:52

+---------------------------------------------------------------------------+

Error occurred during initialization of VM
Could not reserve enough space for object heap
*** glibc detected *** /u01/oracle/r12/apps/tech_st/10.1.3/appsutil/jdk/bin/java: free(): invalid pointer: 0xb78c4290 ***

Physical memory 12GB

Swap 5GB

Increased sawp to 13GB and bounced server.  Now we get the below:

XLAJELINESRPT module: Journal Entries Report
+---------------------------------------------------------------------------+

Current system time is 05-OCT-2012 08:45:51

+---------------------------------------------------------------------------+

Error occurred during initialization of VM
Could not reserve enough space for object heap
#
# An unexpected error has been detected by Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x466f0afc, pid=19402, tid=3077901200
#
# Java VM: Java HotSpot(TM) Client VM (10.0-b23 mixed mode linux-x86)
# Problematic frame:
# C  [libc.so.6+0x69afc]  cfree+0x4c
#
# An error report file with more information is saved as:
# /u01/oracle/r12/inst/apps/devfin12_devfinappr12/logs/appl/conc/log/hs_err_pid19402.log
#
# If you would like to submit a bug report, please visit:
#