ADOP fs_clone failed during "Detach home" phase with java.lang.OutOfMemoryError: Java heap space
Hello all,
I'm running EBS 12.2.5. Recently I did an adop session with some EBS one-off patches, along with some WebLogic Server 10.3.6.0.190716 PSU, Oracle Fusion Middleware (FMW) - oracle_common 11.1.1.9.0, Oracle Fusion Middleware (FMW) - Web Tier 11.1.1.9.0 patches then did a successful cutover.
During next adop prepare, i was expecting the old run file system (current patch file system) to have above changes but it didn't. So i decided to run adop fs_clone. It error out during
Running: /u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin/runInstaller -detachhome -silent ORACLE_HOME=/u02/apptrain/fs1/FMW_Home/oracle_common -invPtrLoc /etc/oraInst.loc -debug -waitforcompletion
Starting Oracle Universal Installer...
Checking swap space: must be greater than 500 MB. Actual 16102 MB Passed
LD_LIBRARY_PATH environment variable :
-------------------------------------------------------
Total args: 26
Command line argument array elements ...
Arg:0:/u02/apptrain/fs2/FMW_Home/webtier/jdk/jre/bin/java:
Arg:1:-Doracle.installer.library_loc=../lib/linux64:
Arg:2:-Doracle.installer.oui_loc=/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin/..:
Arg:3:-Doracle.installer.bootstrap=FALSE:
Arg:4:-Doracle.installer.startup_location=/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin:
Arg:5:-Doracle.installer.jre_loc=../../jre:
Arg:6:-Doracle.installer.nlsEnabled="TRUE":
Arg:7:-Doracle.installer.prereqConfigLoc= :
Arg:8:-Doracle.installer.unixVersion=2.6.32-754.11.1.el6.x86_64:
Arg:9:-mx160m:
Arg:10:-cp:
Arg:11:/tmp/OraInstall2020-01-16_02-47-16PM::/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/log-config.xml:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/ojdl-log4j.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/ojdl.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/ojdl2.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/message.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/oneclick.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/glassfish.jaxb.xjc_1.0.0.0_2-1-12.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/template.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/glassfish.jaxb.xjc_1.2.0.0_2-1-14.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/dms.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/osdt_core.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/xmlparserv2.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/glassfish.jaxb_1.1.0.0_2-1-14.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/enginehelp.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/xml.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/glassfish.jaxb_1.0.0.0_2-1-12.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/install.properties:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/oneofftool.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/ccrQueries.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/ojdbc5.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/webtiercd.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/engine.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/commonutils.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/wtinstallhelp.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/footprint.xml:../jlib/OraInstaller.jar:../jlib/oneclick.jar:../jlib/xmlparserv2.jar:../jlib/share.jar:../jlib/OraInstallerNet.jar:../jlib/emocmutl.jar:../jlib/emCfg.jar:../jlib/OraPrereq.jar:../jlib/jsch.jar:../jlib/ssh.jar:../jlib/remoteinterfaces.jar:../jlib/http_client.jar:../jlib/OraSuiteInstaller.jar:../jlib/opatch.jar:../jlib/opatchactions.jar:../jlib/opatchprereq.jar:../jlib/opatchutil.jar:../jlib/InstImages.jar:../jlib/InstHelp.jar:../jlib/InstHelp_de.jar:../jlib/InstHelp_es.jar:../jlib/InstHelp_fr.jar:../jlib/InstHelp_it.jar:../jlib/InstHelp_ja.jar:../jlib/InstHelp_ko.jar:../jlib/InstHelp_pt_BR.jar:../jlib/InstHelp_zh_CN.jar:../jlib/InstHelp_zh_TW.jar:../jlib/oracle_ice.jar:../jlib/help4.jar:../jlib/help4-nls.jar:../jlibThe inventory pointer is located at /etc/oraInst.loc
The inventory is located at /opt/oracle/oraInventory
SEVERE:Abnormal program termination. An internal error has occured. Please provide the following files to Oracle Support :
"/opt/oracle/oraInventory/logs/DetachHome2020-01-16_02-47-16PM.log"
"/opt/oracle/oraInventory/logs/oraInstall2020-01-16_02-47-16PM.err"
"/opt/oracle/oraInventory/logs/oraInstall2020-01-16_02-47-16PM.out"
'DetachHome' failed.
/opt/oracle/oraInventory/logs/oraInstall2020-01-16_02-47-16PM.err
Exception java.lang.OutOfMemoryError: Java heap space occurred..
Exception in thread "Thread-1" java.lang.OutOfMemoryError: Java heap space
at oracle.sysman.oii.oiii.OiiiPatchSetInstallID.<init>(OiiiPatchSetInstallID.java:55)
at oracle.sysman.oii.oiii.OiiiCompIDPool.get(OiiiCompIDPool.java:173)
at oracle.sysman.oii.oiii.OiiiObjectInputStream.resolveObject(OiiiObjectInputStream.java:43)
at java.io.ObjectInputStream.checkResolve(ObjectInputStream.java:1398)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)
java.lang.OutOfMemoryError: Java heap space
at sun.nio.cs.US_ASCII.newEncoder(US_ASCII.java:58)
at java.lang.StringCoding$StringEncoder.<init>(StringCoding.java:282)
at java.lang.StringCoding$StringEncoder.<init>(StringCoding.java:273)
at java.lang.StringCoding.encode(StringCoding.java:338)
at java.lang.String.getBytes(String.java:916)
at java.io.UnixFileSystem.setLastModifiedTime(Native Method)
at java.io.File.setLastModified(File.java:1429)
at oracle.sysman.oii.oiit.OiitLockHeartbeat.touchFile(OiitLockHeartbeat.java:270)
at oracle.sysman.oii.oiit.OiitLockHeartbeat.update(OiitLockHeartbeat.java:288)
at oracle.sysman.oii.oiit.OiitLockHeartbeat$HeartBeatThread.run(OiitLockHeartbeat.java:136)
'DetachHome' failed.
Now I can't move forward with my EBS patching.
I tried this 12.2 EBS adop phase=fs_clone fails during wlsT2PApply on unpack.sh with error "Java Heap Space"/"java.lang.OutOfMemoryError: GC overhead limit exceeded" (Doc ID 2429369.1)
even though i know it was for different phase of fs_clone.
Any help or input would be greatly appreciated.