1 Reply Latest reply on Jan 17, 2020 1:39 PM by boracIe

    ADOP fs_clone failed during "Detach home" phase with java.lang.OutOfMemoryError: Java heap space

    boracIe

      Hello all,

                  I'm running EBS 12.2.5. Recently I did an adop session with some EBS one-off patches, along with some WebLogic Server 10.3.6.0.190716 PSU, Oracle Fusion Middleware (FMW) - oracle_common 11.1.1.9.0, Oracle Fusion Middleware (FMW) - Web Tier 11.1.1.9.0 patches then did a successful cutover.

       

      During next adop prepare, i was expecting the old run file system (current patch file system) to have above changes but it didn't. So i decided to run adop fs_clone. It error out during

       

      Running: /u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin/runInstaller -detachhome -silent ORACLE_HOME=/u02/apptrain/fs1/FMW_Home/oracle_common -invPtrLoc /etc/oraInst.loc -debug -waitforcompletion

      Starting Oracle Universal Installer...

      Checking swap space: must be greater than 500 MB.   Actual 16102 MB    Passed

       

       

      LD_LIBRARY_PATH environment variable :

      -------------------------------------------------------

      Total args: 26

      Command line argument array elements ...

      Arg:0:/u02/apptrain/fs2/FMW_Home/webtier/jdk/jre/bin/java:

      Arg:1:-Doracle.installer.library_loc=../lib/linux64:

      Arg:2:-Doracle.installer.oui_loc=/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin/..:

      Arg:3:-Doracle.installer.bootstrap=FALSE:

      Arg:4:-Doracle.installer.startup_location=/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin:

      Arg:5:-Doracle.installer.jre_loc=../../jre:

      Arg:6:-Doracle.installer.nlsEnabled="TRUE":

      Arg:7:-Doracle.installer.prereqConfigLoc= :

      Arg:8:-Doracle.installer.unixVersion=2.6.32-754.11.1.el6.x86_64:

      Arg:9:-mx160m:

      Arg:10:-cp:

      Arg:11:/tmp/OraInstall2020-01-16_02-47-16PM::/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/log-config.xml:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/ojdl-log4j.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/ojdl.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/ojdl2.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/message.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/oneclick.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/glassfish.jaxb.xjc_1.0.0.0_2-1-12.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/template.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/glassfish.jaxb.xjc_1.2.0.0_2-1-14.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/dms.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/osdt_core.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/xmlparserv2.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/glassfish.jaxb_1.1.0.0_2-1-14.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/enginehelp.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/xml.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/glassfish.jaxb_1.0.0.0_2-1-12.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/install.properties:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/oneofftool.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/ccrQueries.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/ojdbc5.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/webtiercd.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/engine.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/commonutils.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/wtinstallhelp.jar:/u02/apptrain/fs2/FMW_Home/oracle_common/oui/bin//../../inventory/Scripts/ext/jlib/footprint.xml:../jlib/OraInstaller.jar:../jlib/oneclick.jar:../jlib/xmlparserv2.jar:../jlib/share.jar:../jlib/OraInstallerNet.jar:../jlib/emocmutl.jar:../jlib/emCfg.jar:../jlib/OraPrereq.jar:../jlib/jsch.jar:../jlib/ssh.jar:../jlib/remoteinterfaces.jar:../jlib/http_client.jar:../jlib/OraSuiteInstaller.jar:../jlib/opatch.jar:../jlib/opatchactions.jar:../jlib/opatchprereq.jar:../jlib/opatchutil.jar:../jlib/InstImages.jar:../jlib/InstHelp.jar:../jlib/InstHelp_de.jar:../jlib/InstHelp_es.jar:../jlib/InstHelp_fr.jar:../jlib/InstHelp_it.jar:../jlib/InstHelp_ja.jar:../jlib/InstHelp_ko.jar:../jlib/InstHelp_pt_BR.jar:../jlib/InstHelp_zh_CN.jar:../jlib/InstHelp_zh_TW.jar:../jlib/oracle_ice.jar:../jlib/help4.jar:../jlib/help4-nls.jar:../jlibThe inventory pointer is located at /etc/oraInst.loc

      The inventory is located at /opt/oracle/oraInventory

      SEVERE:Abnormal program termination. An internal error has occured. Please provide the following files to Oracle Support :

       

       

      "/opt/oracle/oraInventory/logs/DetachHome2020-01-16_02-47-16PM.log"

      "/opt/oracle/oraInventory/logs/oraInstall2020-01-16_02-47-16PM.err"

      "/opt/oracle/oraInventory/logs/oraInstall2020-01-16_02-47-16PM.out"

      'DetachHome' failed.

       

       

       

      /opt/oracle/oraInventory/logs/oraInstall2020-01-16_02-47-16PM.err

      Exception java.lang.OutOfMemoryError: Java heap space occurred..

      Exception in thread "Thread-1" java.lang.OutOfMemoryError: Java heap space

              at oracle.sysman.oii.oiii.OiiiPatchSetInstallID.<init>(OiiiPatchSetInstallID.java:55)

              at oracle.sysman.oii.oiii.OiiiCompIDPool.get(OiiiCompIDPool.java:173)

              at oracle.sysman.oii.oiii.OiiiObjectInputStream.resolveObject(OiiiObjectInputStream.java:43)

              at java.io.ObjectInputStream.checkResolve(ObjectInputStream.java:1398)

              at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)

              at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)

              at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)

      java.lang.OutOfMemoryError: Java heap space

              at sun.nio.cs.US_ASCII.newEncoder(US_ASCII.java:58)

              at java.lang.StringCoding$StringEncoder.<init>(StringCoding.java:282)

              at java.lang.StringCoding$StringEncoder.<init>(StringCoding.java:273)

              at java.lang.StringCoding.encode(StringCoding.java:338)

              at java.lang.String.getBytes(String.java:916)

              at java.io.UnixFileSystem.setLastModifiedTime(Native Method)

              at java.io.File.setLastModified(File.java:1429)

              at oracle.sysman.oii.oiit.OiitLockHeartbeat.touchFile(OiitLockHeartbeat.java:270)

              at oracle.sysman.oii.oiit.OiitLockHeartbeat.update(OiitLockHeartbeat.java:288)

              at oracle.sysman.oii.oiit.OiitLockHeartbeat$HeartBeatThread.run(OiitLockHeartbeat.java:136)

      'DetachHome' failed.

       

       

       

      Now I can't move forward with my EBS patching.
      I tried this 12.2 EBS adop phase=fs_clone fails during wlsT2PApply on unpack.sh with error "Java Heap Space"/"java.lang.OutOfMemoryError: GC overhead limit exceeded" (Doc ID 2429369.1)

      even though i know it was for different phase of fs_clone.

       

      Any help or input would be greatly appreciated.

        • 1. Re: ADOP fs_clone failed during "Detach home" phase with java.lang.OutOfMemoryError: Java heap space
          boracIe

          I don't know why this would work but it did. I noticed since it was failing on "DetachHome" phase of fs_clone during oracle common home. I stumble across $FMW_HOME/oracle_common/oui/oraparam.ini

          I took a backup of the original then change the following parameter.

          JRE_MEMORY_OPTIONS=" -mx160m"

          to

          JRE_MEMORY_OPTIONS=" -mx2048m"

           

          Then rerun fs_clone

           

          INFO: 1/16/20 3:32:31 PM EST: Done calling doOperation.

          INFO: 1/16/20 3:32:31 PM EST: Ending the inventory Session

          INFO: 1/16/20 3:32:31 PM EST: *********************START*******************************

          INFO: 1/16/20 3:32:31 PM EST:

          oracle.sysman.oii.oiic.OiicStandardInventorySession.endSession(OiicStandardInventorySession.java:346)

          oracle.sysman.oii.oiic.OiicBaseInventoryApp.main_helper(OiicBaseInventoryApp.java:891)

          oracle.sysman.oii.oiic.OiicDetachHome.main(OiicDetachHome.java:300)

          INFO: 1/16/20 3:32:31 PM EST: *********************END*******************************

          INFO: 1/16/20 3:32:31 PM EST: Disposing the install area control objects

          INFO: 1/16/20 3:32:31 PM EST: 'DetachHome' was successful

           

          After many moons later

          The fs_clone phase completed successfully.

          adop exiting with status = 0 (Success)