1 2 Previous Next 27 Replies Latest reply on Aug 13, 2014 10:58 PM by DarrenAg

    JumpStartKit install hangs at 87% complete during database creation / instance configuration

    DarrenAg

      Hello folks, I'm wanting to evaluate Oracle WebCenter Portal 11.1.1.8 (huge improvement over 11.1.1.7, which I have already gave a quick try in the VDI provided by Oracle).

       

       

       

       

      So I found out about this Jump Start Kit, which installs each required piece once you've got a properly configured Linux environment. I had some fun with the prereqs but now that's all completed and I got SO EXCITED to make it past "STEP 4".

       

       

       

       

      So now I'm encountering the same issue during installation -- in STEP 6 of 22 Configuration of Database Instance (Completing Database Creation) it gets to 87% complete and then nothing seems to happen, it never gets beyond that point even if I wait 10 more hours:

       

       

      ***

      NOTE: I suspect my issue is not specific to the "Jump Start Kit", but rather it is something others have encountered during the Database creation/configuration step of the Oracle Universal Installer in general. And hopefully others have solved it.

      ***

       

      "/opt/oracle/portal" is my INSTALL_DIR ; I had launched the JSK installer with this command:

      ./runme INSTANCE_PASSWORD=apwd ROOT_PASSWORD=rpwd DOWNLOAD_DIR=/media/sf_Downloads/JSKfiles INSTALL_DIR=/opt/oracle/portal

       

       

      - The installer makes it this far, before it seems to get "stuck" -- even after many hours there is no change, HD is not doing anything, CPU stays at <5% usage:

      rtkit.main.JSKStarter - launchScript:172 - Tue Jun 10 15:41:38 MDT 2014: BEGIN STEP 6 of 22: Configuration of Database Instance. Estimated time is around 5 minutes. Please wait..

      10/06/2014 15:41:38.545 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 -

      10/06/2014 15:41:48.222 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - Copying database files

      10/06/2014 15:41:48.413 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 1% complete

      10/06/2014 15:41:52.894 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 3% complete

      10/06/2014 15:41:52.915 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 11% complete

      10/06/2014 15:42:02.917 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 18% complete

      10/06/2014 15:42:32.920 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 26% complete

      10/06/2014 15:42:42.638 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 37% complete

      10/06/2014 15:42:42.640 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - Creating and starting Oracle instance

      10/06/2014 15:42:48.568 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 40% complete

      10/06/2014 15:42:56.827 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 45% complete

      10/06/2014 15:42:57.357 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 46% complete

      10/06/2014 15:42:57.526 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 47% complete

      10/06/2014 15:42:57.627 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 48% complete

      10/06/2014 15:42:57.834 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 49% complete

      10/06/2014 15:44:42.915 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 54% complete

      10/06/2014 15:44:42.963 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 59% complete

      10/06/2014 15:44:43.036 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 60% complete

      10/06/2014 15:44:43.452 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 61% complete

      10/06/2014 15:44:43.452 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 64% complete

      10/06/2014 15:44:43.453 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - Completing Database Creation

      10/06/2014 15:44:43.493 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 68% complete

      10/06/2014 15:44:43.510 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 72% complete

      10/06/2014 15:44:43.571 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 76% complete

      10/06/2014 15:45:01.516 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 87% complete

       

       

       

       

      I am using VirtualBox on Windows 7, I have tried it multiple times, first with the guest OS as Oracle Linux 6, and then Oracle Linux 5 (fun learning about updating the version of Java!).

       

       

      It always gets to the same point and then it just seems to do nothing -- no progress, but no error message on-screen (see log files below). But it seems to be using less than 5% CPU usage... and waiting 10 hours makes no difference.

       

       

      Based on what I found in tons of Google searching, I tried increasing my swap file, adding more memory and HD space (12GB RAM and 10GB sap and 20GB free hard drive space) but still nothing changed.

       

       

       

       

       

       

      In post #2 of this thread I will separately provide the logging details, which I hope will be helpful.

       

       

      Thanks in advance!

      Darren.

       

       

      PS: moderator, I attempted to create this thread in other Spaces because I did not know about this "Portal JSK" specific one -- was that why my thread was rejected? NO REASON WAS GIVEN. If that WAS the reason, I have to say that it will be nearly impossible for anyone who is able to help me to actually FIND this thread here because as I said I do not think it specific to ONLY the Portal JSK. (But I will post it only here just in case that's the reason for the previous rejections)

        • 2. Re: JumpStartKit install hangs at 87% complete during database creation / instance configuration
          DarrenAg

          First off, thank you very much for not just deleting the other 2 threads -- I intentionally created them in the other 2 spaces that MIGHT find a set of eyes that can help -- but in both I linked to THIS thread because this is the specific product. So this is the only place replies will be found therefore no "duplication" to worry about... but as I said this is likely not specific to PortalJSK since others on the internet have described a similar problem during the Oracle database installation.

           

           

           

           

          Second of all. here we go, the log contents...

           

           

          ...So in the hope that I could troubleshoot based on some error logging, I had a look inside "/opt/oracle/portal/db/OraInventory/logs/"...

           

           

           

           

           

           

           

           

          - "/opt/oracle/portal/db/OraInventory/logs/oraInstall2014-06-10_03-27-37PM.err" is empty (0 bytes),

           

           

           

           

          - "/opt/oracle/portal/db/OraInventory/logs/installActions2014-06-10_03-27-37PM.log" * (2.3MB) ends with...

          INFO: Terminating all background operations

          INFO: Terminated all background operations

          INFO: Successfully executed the flow in SILENT mode

          INFO: Finding the most appropriate exit status for the current application

          INFO: Exit Status is 0

          INFO: Shutdown Oracle Database 11g Release 2 Installer

          INFO: Unloading Setup Driver

          [eof]

           

           

           

           

           

           

           

           

          I am not sure of the value of the additional log files inside "/opt/oracle/run/logs/", here is what they contain...

           

           

           

           

          - all of the "/opt/oracle/run/logs/xyz_NofN.zip.unzip.out" files are empty (0 bytes).

           

           

           

           

          - "/opt/oracle/run/logs/install_commands.log" is tiny, it just has this:

          /media/sf_Downloads/JSKfiles/DB/database/runInstaller -invPtrLoc /opt/oracle/run/linux64/dborainst.loc  -ignoreSysPrereqs  -ignorePrereq -force -silent -waitforcompletion -responseFile /opt/oracle/run/linux64/db_generated.rsp

          /opt/oracle/portal/db/ohome/bin/netca /orahome /opt/oracle/portal/db/ohome /orahnam orcl /instype typical /inscomp client,oraclenet,javavm,server,ano /insprtcl tcp /cfg local /authadp NO_VALUE /responseFile /opt/oracle/run/linux64/netca.rsp /silent

          /opt/oracle/portal/db/ohome/bin/dbca -silent -responseFile /opt/oracle/run/linux64/dbca.rsp  -sampleSchema true -oratabLocation ORATAB

           

           

           

           

           

           

           

           

          - "webtier_prereqs.log" and "ecm_prereqs.log" and "wcprereqs.log" all say that all tests passed.

          (Tests for HD and RAM space and swap size and # of processes etc. are all SUCCESS; and all required packages are installed and high enough version, etc.)

           

           

           

           

           

           

           

           

          - "/opt/oracle/run/logs/dbprereqs_log.txt" says this:

          Starting Oracle Universal Installer...

          Checking Temp space: must be greater than 120 MB.   Actual 8855 MB    Passed

          Checking swap space: must be greater than 150 MB.   Actual 4031 MB    Passed

          Preparing to launch Oracle Universal Installer from /opt/oracle/portal/tmpdir/OraInstall2014-06-10_03-26-23PM. Please wait ...[WARNING] [INS-13014] Target environment do not meet some optional requirements.

             CAUSE: Some of the optional prerequisites are not met. See logs for details. /opt/oracle/portal/db/OraInventory/logs/installActions2014-06-10_03-26-23PM.log

             ACTION: Identify the list of failed prerequisite checks from the log: /opt/oracle/portal/db/OraInventory/logs/installActions2014-06-10_03-26-23PM.log. Then either from the log file or from installation manual find the appropriate configuration to meet the prerequisites and fix it manually.

           

           

           

           

           

           

           

           

          - "/opt/oracle/run/logs/wls-install.log" is the most confusing, maybe this is the reason for getting "stuck"?

          2014-06-10 15:24:38,139 WARN  [home] com.bea.cie.gpr.internal.model.JvmTargetManagerImpl - Property value for linux32_jdk160_29b11.zip not found..

          2014-06-10 15:24:38,143 WARN  [home] com.bea.cie.gpr.internal.model.JvmTargetManagerImpl - Property value for linux_ia32_jrockit_160_29_D1.2.0-10_jdk.zip not found..

          2014-06-10 15:24:38,206 WARN  [home] com.bea.cie.gpr.internal.model.JvmTargetManagerImpl - Property value for linux32_jdk160_29b11.zip not found..

          2014-06-10 15:24:38,209 WARN  [home] com.bea.cie.gpr.internal.model.JvmTargetManagerImpl - Property value for linux_ia32_jrockit_160_29_D1.2.0-10_jdk.zip not found..

          2014-06-10 15:24:38,225 WARN  [home] com.bea.plateng.wizard.installer.silent.tasks.SilentBEAHomeTask - /opt/oracle/portal/fmw directory is not empty. Proceed with installation?

          2014-06-10 15:24:39,223 WARN  [ocmCredVerify] com.bea.plateng.wizard.installer.helpers.OCMInstallHelper - Failed test connection

          java.lang.reflect.InvocationTargetException

            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

            at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

            at java.lang.reflect.Method.invoke(Method.java:597)

            at com.bea.plateng.wizard.installer.helpers.OCMInstallHelper.testConnection(OCMInstallHelper.java:92)

            at com.bea.plateng.wizard.installer.silent.tasks.OCMCredVerifySilentTask.execute(OCMCredVerifySilentTask.java:35)

            at com.bea.plateng.wizard.silent.tasks.AbstractSilentTask.run(AbstractSilentTask.java:28)

            at java.lang.Thread.run(Thread.java:662)

          Caused by: com.bea.plateng.wizard.installer.helpers.OCMException: Connection failed in SSL peer verificaition.

            at com.bea.plateng.wizard.installer.helpers.OCMHelper.testSimpleConnection(OCMHelper.java:54)

            at com.bea.plateng.wizard.installer.helpers.OCMHelper.testConnection(OCMHelper.java:145)

            ... 8 more

          2014-06-10 15:24:39,228 WARN  [ocmCredVerify] com.bea.plateng.wizard.installer.silent.tasks.OCMCredVerifySilentTask - OCMInstallException:

          com.bea.plateng.wizard.installer.helpers.OCMInstallException

            at com.bea.plateng.wizard.installer.helpers.OCMInstallHelper.testConnection(OCMInstallHelper.java:96)

            at com.bea.plateng.wizard.installer.silent.tasks.OCMCredVerifySilentTask.execute(OCMCredVerifySilentTask.java:35)

            at com.bea.plateng.wizard.silent.tasks.AbstractSilentTask.run(AbstractSilentTask.java:28)

            at java.lang.Thread.run(Thread.java:662)

          ...

          2014-06-10 15:25:49,347 INFO  [Thread-13] com.oracle.cie.domain.TemplateImporter - Domain Extension Successful!

          2014-06-10 15:25:49,350 INFO  [runScript] com.oracle.cie.domain.script.ScriptExecutor - close template

          2014-06-10 15:25:49,351 INFO  [runScript] com.oracle.cie.domain.script.ScriptExecutor - succeed: close template

          2014-06-10 15:25:49,351 INFO  [runScript] com.oracle.cie.domain.script.ScriptExecutor - read domain from "/opt/oracle/portal/fmw/wlserver_10.3/samples/domains/medrec-spring"

          2014-06-10 15:25:49,405 INFO  [runScript] com.oracle.cie.domain.script.ScriptExecutor - succeed: read domain from "/opt/oracle/portal/fmw/wlserver_10.3/samples/domains/medrec-spring"

          2014-06-10 15:25:49,405 INFO  [runScript] com.oracle.cie.domain.script.ScriptExecutor - succeed: update domain

          2014-06-10 15:25:49,406 INFO  [runScript] com.oracle.cie.domain.script.ScriptExecutor - close template

          2014-06-10 15:25:49,406 INFO  [runScript] com.oracle.cie.domain.script.ScriptExecutor - succeed: close template

          2014-06-10 15:25:49,743 INFO  [WizardController] com.bea.plateng.wizard.silent.tasks.LogTask - The installation was successfull!

          ^ ^ ^ BUT IT SEEMS TO END AS A "SUCCESS"!?

           

           

           

           

           

           

           

           

          - "install_setup.log" ends with the following -- and so does "JSKDownloader.log" (the "master log"? it contains basically what shows up on-screen)

          rtkit.main.JSKStarter - launchScript:172 - Tue Jun 10 15:41:38 MDT 2014: BEGIN STEP 6 of 22: Configuration of Database Instance. Estimated time is around 5 minutes. Please wait..

          10/06/2014 15:41:38.545 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 -

          10/06/2014 15:41:48.222 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - Copying database files

          10/06/2014 15:41:48.413 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 1% complete

          10/06/2014 15:41:52.894 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 3% complete

          10/06/2014 15:41:52.915 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 11% complete

          10/06/2014 15:42:02.917 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 18% complete

          10/06/2014 15:42:32.920 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 26% complete

          10/06/2014 15:42:42.638 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 37% complete

          10/06/2014 15:42:42.640 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - Creating and starting Oracle instance

          10/06/2014 15:42:48.568 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 40% complete

          10/06/2014 15:42:56.827 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 45% complete

          10/06/2014 15:42:57.357 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 46% complete

          10/06/2014 15:42:57.526 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 47% complete

          10/06/2014 15:42:57.627 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 48% complete

          10/06/2014 15:42:57.834 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 49% complete

          10/06/2014 15:44:42.915 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 54% complete

          10/06/2014 15:44:42.963 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 59% complete

          10/06/2014 15:44:43.036 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 60% complete

          10/06/2014 15:44:43.452 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 61% complete

          10/06/2014 15:44:43.452 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 64% complete

          10/06/2014 15:44:43.453 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - Completing Database Creation

          10/06/2014 15:44:43.493 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 68% complete

          10/06/2014 15:44:43.510 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 72% complete

          10/06/2014 15:44:43.571 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 76% complete

          10/06/2014 15:45:01.516 -(3)- JSK Starter Thread - oracle.webcenter.jumpstartkit.main.JSKStarter - launchScript:172 - 87% complete

           

           

           

           

           

           

           

           

           

           

           

           

          * Here are the final 261 lines of "/opt/oracle/portal/db/OraInventory/logs/installActions2014-06-10_03-27-37PM.log"...

          --------------------------------------------------------------------------------

          INFO: Start output from spawned process:

          INFO: ----------------------------------

          INFO:

           

           

           

           

          INFO: SaveInvWCCE JRE files in Scratch

          INFO: oracle.installer.mandatorySetup property is set to false, so skipping the execution of additional tools

          INFO: oracle.installer.installUpdates property is set to false, so skipping the checking of updates

          INFO: Config Initialize JRE files in Scratch

          INFO: stage loc: /opt/oracle/portal/tmpdir/OraInstall2014-06-10_03-27-37PM/

          INFO: Copying Aggr XML for: Oracle Configuration Manager

          INFO: stage loc: /opt/oracle/portal/tmpdir/OraInstall2014-06-10_03-27-37PM/

          INFO: Copying Aggr XML for: HAS Common Files

          INFO: stage loc: /opt/oracle/portal/tmpdir/OraInstall2014-06-10_03-27-37PM/

          INFO: Copying Aggr XML for: Oracle Netca Client

          INFO: stage loc: /opt/oracle/portal/tmpdir/OraInstall2014-06-10_03-27-37PM/

          INFO: Copying Aggr XML for: Database Configuration and Upgrade Assistants

          INFO: stage loc: /opt/oracle/portal/tmpdir/OraInstall2014-06-10_03-27-37PM/

          INFO: Copying Aggr XML for: Oracle Enterprise Manager Console DB

          INFO: stage loc: /opt/oracle/portal/tmpdir/OraInstall2014-06-10_03-27-37PM/

          INFO: Copying Aggr XML for: Oracle Database 11g

          INFO: The Top level Aggreage File = /opt/oracle/portal/db/ohome/inventory/ContentsXML/ConfigXML/oracle.server.11_2_0_1_0.xml

          INFO: OUI_CAPlugIn is not found in XML

          INFO: no. of tools to supress: 0 for comp: Oracle Enterprise Manager Console DB

          INFO: cf session will be created for OH: /opt/oracle/portal/db/ohome/ TLAggr: oracle.server instancePath: inventory/ContentsXML/ConfigXML/

          INFO: cf session for OH: /opt/oracle/portal/db/ohome/ TL Aggr: [oracle.server] instancePath: inventory/ContentsXML/ConfigXML/

          INFO: aggr ref length : 6

          INFO: cf session hashcode: 620301082

          INFO: cf session saved with key: OraDb11g_home1 oracle.server

          INFO: cf session is ok

          INFO: created and saved cf session for oh: OraDb11g_home1

          INFO: passing params to cf

          INFO: Handling the storing of variables for aggr name  oracle.sysman.ccr

          INFO: This variable s_OPSNodeInfoString is not added to the global context map

          INFO: This variable b_isUNIX is not added to the global context map

          INFO: This variable b_createResponseFile is not added to the global context map

          INFO: This variable s_ps is not added to the global context map

          INFO: This variable s_oraName is not added to the global context map

          INFO: This variable s_ccrJarDestination is not added to the global context map

          INFO: This variable b_localInstall is not added to the global context map

          INFO: This variable b_doConfigCCR is not added to the global context map

          INFO: This variable b_ccrUpgrade is not added to the global context map

          INFO: This variable s_rspFilePath is not added to the global context map

          INFO: This variable PROD_HOME is not added to the global context map

          INFO: for oracle.has.common no aggregate found by cf: no configuration

          INFO: Handling the storing of variables for aggr name  oracle.assistants.netca.client

          INFO: This variable s_swingallName is not added to the global context map

          INFO: This variable s_shareName is not added to the global context map

          INFO: This variable s_runtimeLib is not added to the global context map

          INFO: This variable s_runTimeJar is not added to the global context map

          INFO: This variable s_responseFileName is not added to the global context map

          INFO: This variable s_operatingSystem is not added to the global context map

          INFO: This variable s_netcfgName is not added to the global context map

          INFO: This variable s_netcahelpName is not added to the global context map

          INFO: This variable s_netcaUpgradeFlag is not added to the global context map

          INFO: This variable s_netcaClass is not added to the global context map

          INFO: This variable s_netCA_Args is not added to the global context map

          INFO: This variable s_netCAInstalledProtocols is not added to the global context map

          INFO: This variable s_netAPIName is not added to the global context map

          INFO: This variable s_ldapclnt9 is not added to the global context map

          INFO: This variable s_ldapclnt11 is not added to the global context map

          INFO: This variable s_ldapclnt10 is not added to the global context map

          INFO: This variable s_jreLocation is not added to the global context map

          INFO: This variable s_jreJarFile is not added to the global context map

          INFO: This variable s_jreJar is not added to the global context map

          INFO: This variable s_jewtName is not added to the global context map

          INFO: This variable s_installTypeForLaunchNETCA is not added to the global context map

          INFO: This variable s_icebrowserName is not added to the global context map

          INFO: This variable s_helpName is not added to the global context map

          INFO: This variable s_ewtcompatName is not added to the global context map

          INFO: This variable s_ewtName is not added to the global context map

          INFO: This variable s_ewtFile is not added to the global context map

          INFO: This variable s_ewtCompat is not added to the global context map

          INFO: This variable s_cfgMethod is not added to the global context map

          INFO: This variable s_caHelpZhTwJar is not added to the global context map

          INFO: This variable s_caHelpZhCnJar is not added to the global context map

          INFO: This variable s_caHelpPtBRJar is not added to the global context map

          INFO: This variable s_caHelpKoJar is not added to the global context map

          INFO: This variable s_caHelpJar is not added to the global context map

          INFO: This variable s_caHelpJaJar is not added to the global context map

          INFO: This variable s_caHelpItJar is not added to the global context map

          INFO: This variable s_caHelpFrJar is not added to the global context map

          INFO: This variable s_caHelpEsJar is not added to the global context map

          INFO: This variable s_caHelpDeJar is not added to the global context map

          INFO: This variable s_authAdaptors is not added to the global context map

          INFO: This variable ps_netCA_Args_OverRide is not added to the global context map

          INFO: This variable b_net8ServerInstalling is not added to the global context map

          INFO: This variable b_javavmIsInstalling is not added to the global context map

          INFO: This variable b_isWindows is not added to the global context map

          INFO: This variable b_isUNIX is not added to the global context map

          INFO: This variable b_cmanIsInstalling is not added to the global context map

          INFO: This variable b_anoIsInstalling is not added to the global context map

          INFO: This variable s_xmlparservLoc is not added to the global context map

          INFO: This variable s_ouiJlibDir is not added to the global context map

          INFO: This variable s_opsmJlib is not added to the global context map

          INFO: This variable s_ntwkTools is not added to the global context map

          INFO: This variable s_netjlibDir is not added to the global context map

          INFO: This variable s_netcahelpLocation is not added to the global context map

          INFO: This variable s_netcaJlibDir is not added to the global context map

          INFO: This variable s_netcaDocDir is not added to the global context map

          INFO: This variable s_netPropertiesFile is not added to the global context map

          INFO: This variable s_netCA is not added to the global context map

          INFO: This variable s_net8caFileToInstantiate is not added to the global context map

          INFO: This variable s_jre15Location is not added to the global context map

          INFO: This variable s_jlibDir is not added to the global context map

          INFO: This variable s_inventoryPrereqOui is not added to the global context map

          INFO: This variable s_emdwLibDir is not added to the global context map

          INFO: This variable s_caHelpDir is not added to the global context map

          INFO: This variable s_assistantJlibDir is not added to the global context map

          INFO: This variable s_JavaFlag is not added to the global context map

          INFO: This variable b_isOPS is not added to the global context map

          INFO: This variable s_windowsCommandLine is not added to the global context map

          INFO: This variable s_net8caExecutable is not added to the global context map

          INFO: This variable s_netcaUserDirArg is not added to the global context map

          INFO: This variable s_installTypeForNetCA is not added to the global context map

          INFO: This variable s_netcaSilentFlag is not added to the global context map

          INFO: This variable s_netCAInstalledProducts is not added to the global context map

          INFO: This variable s_netcaClasspath is not added to the global context map

          INFO: This variable PROD_HOME is not added to the global context map

          INFO: ORACLE_HOME is not settable, hence not setting the value

          INFO: Handling the storing of variables for aggr name  oracle.assistants.server

          INFO: This variable s_operatingSystem is not added to the global context map

          INFO: This variable s_jreLocation is not added to the global context map

          INFO: This variable pn_dboffset is not added to the global context map

          INFO: This variable cs_swingName is not added to the global context map

          INFO: This variable cs_komodoName is not added to the global context map

          INFO: This variable cs_kodiakName is not added to the global context map

          INFO: This variable cs_jewtName is not added to the global context map

          INFO: This variable cs_iceBrowserName is not added to the global context map

          INFO: This variable cs_ewtcompatName is not added to the global context map

          INFO: This variable cs_ewtName is not added to the global context map

          INFO: This variable cs_baliShareName is not added to the global context map

          INFO: This variable b_orabaseContainsOrahome is not added to the global context map

          INFO: This variable b_isWINDOWS is not added to the global context map

          INFO: This variable b_isUNIX is not added to the global context map

          INFO: This variable sl_dbmaParameterListForIcon is not added to the global context map

          INFO: This variable sl_dbcaParameterListForIcon is not added to the global context map

          INFO: This variable s_xmlparservLoc is not added to the global context map

          INFO: This variable s_ouiJlibLocation is not added to the global context map

          INFO: This variable s_oratabLocation is not added to the global context map

          INFO: This variable s_opsmLocation is not added to the global context map

          INFO: This variable s_dbuaLocation is not added to the global context map

          INFO: This variable s_dbcaLocation is not added to the global context map

          INFO: This variable s_OracleBinLocation is not added to the global context map

          INFO: This variable s_dbcaInstLaunchFile is not added to the global context map

          INFO: This variable s_dbcaLaunchFile is not added to the global context map

          INFO: This variable s_dbmaLaunchFile is not added to the global context map

          INFO: This variable s_dbmaInstLaunchFile is not added to the global context map

          INFO: This variable PROD_HOME is not added to the global context map

          INFO: ORACLE_HOME is not settable, hence not setting the value

          INFO: Handling the storing of variables for aggr name  oracle.sysman.console.db

          INFO: This variable s_sid is not added to the global context map

          INFO: This variable s_serverInstallType is not added to the global context map

          INFO: This variable s_platform is not added to the global context map

          INFO: HashMap added with the key oracle.sysman.console.db and an empty variable Vector

          INFO: Adding the variable s_obfOc4jAdmPasswd to the aggregate oracle.sysman.console.db

          INFO: Adding the variable s_obfOc4jAdmPasswd to the global context map for the aggregate oracle.sysman.console.db

          INFO: Adding the variable s_obfJtaAdmPasswd to the aggregate oracle.sysman.console.db

          INFO: Adding the variable s_obfJtaAdmPasswd to the global context map for the aggregate oracle.sysman.console.db

          INFO: This variable s_nlsLang is not added to the global context map

          INFO: This variable s_emailServer is not added to the global context map

          INFO: This variable s_emailAddress is not added to the global context map

          INFO: This variable s_cfgtyperet is not added to the global context map

          INFO: Adding the variable s_JtaAdmPasswd to the aggregate oracle.sysman.console.db

          INFO: Adding the variable s_JtaAdmPasswd to the global context map for the aggregate oracle.sysman.console.db

          INFO: This variable n_uploadInterval is not added to the global context map

          INFO: This variable localhost is not added to the global context map

          INFO: This variable b_launchTools is not added to the global context map

          INFO: This variable b_launchBrowser is not added to the global context map

          INFO: This variable b_isUNIX is not added to the global context map

          INFO: This variable b_centralConsole is not added to the global context map

          INFO: This variable USE_HTTP_PROXY is not added to the global context map

          INFO: This variable USE_DB_CONSOLE is not added to the global context map

          INFO: This variable SET_CONSOLE_MODE is not added to the global context map

          INFO: This variable SA_SETUP is not added to the global context map

          INFO: This variable OC4JLOC is not added to the global context map

          INFO: This variable NO_PC_MODE is not added to the global context map

          INFO: This variable LOGGING_LEVEL is not added to the global context map

          INFO: This variable JRE_HOME is not added to the global context map

          INFO: This variable ISQLPLUS_PROTOCOL is not added to the global context map

          INFO: This variable ISQLPLUS_PORT is not added to the global context map

          INFO: This variable HOST_SID_OFFSET_ENABLED is not added to the global context map

          INFO: This variable HOSTNAME is not added to the global context map

          INFO: This variable EM_UPLOAD_DISABLE is not added to the global context map

          INFO: This variable EM_UIX_DEBUG_FLAG is not added to the global context map

          INFO: This variable EMPRODVER is not added to the global context map

          INFO: This variable CONSOLE_MODE is not added to the global context map

          INFO: This variable CONSOLE_CFG is not added to the global context map

          INFO: This variable sl_oraclehomes is not added to the global context map

          INFO: This variable s_oc4jDir is not added to the global context map

          INFO: This variable s_oc4jAppsDir is not added to the global context map

          INFO: This variable s_jreHome is not added to the global context map

          INFO: This variable s_configcommand is not added to the global context map

          INFO: This variable b_isRAC is not added to the global context map

          INFO: This variable b_UNIX is not added to the global context map

          INFO: This variable OJSP_JAR_LOC is not added to the global context map

          INFO: This variable OJSPUTIL_JAR_LOC is not added to the global context map

          INFO: This variable LDAP_JAR_LOC is not added to the global context map

          INFO: This variable JAVA_HOME is not added to the global context map

          INFO: This variable ISQLPLUS_HOST is not added to the global context map

          INFO: This variable EM_UIX_LOCATION is not added to the global context map

          INFO: This variable EM_REPOS_HOST is not added to the global context map

          INFO: This variable EM_PING_COMMAND is not added to the global context map

          INFO: This variable EM_OC4J_HOME is not added to the global context map

          INFO: This variable EM_EAR_LOC is not added to the global context map

          INFO: This variable EMDROOT is not added to the global context map

          INFO: Adding the variable s_oc4jAdmPasswd to the aggregate oracle.sysman.console.db

          INFO: Adding the variable s_oc4jAdmPasswd to the global context map for the aggregate oracle.sysman.console.db

          INFO: This variable s_launchBrowserClasspath is not added to the global context map

          INFO: This variable s_javapOracleHome is not added to the global context map

          INFO: This variable PROD_HOME is not added to the global context map

          INFO: {Parameter:TOPLEVEL_COMPONENT in {Aggregate:OuiConfigVariables:1.0.0.0.0:common}}: Parameter data type is not compatible with the provided String Array.

          INFO: passing params to cf done

          INFO: done saving info by cf

          INFO: This is a shared oracle home or remote nodes are null. No copy required.

          INFO: Checkpoint:Failed Checkpoint found returning it for getAllFailedCheckPoints.

          INFO: Checkpoint:Failed Checkpoint found returning null for getLastFailedCheckPoint.

          INFO: Checkpoint:Index file written and updated

          INFO: Checkpoint:Transfer of file done from remote node

          INFO: Adding iterator oracle.sysman.oii.oiif.oiifw.OiifwRootShWCDE

          INFO: Updating the global context

          INFO: Path To 'globalcontext.xml' = /opt/oracle/portal/db/ohome/install/chainedInstall/globalcontext

          INFO: Since operation was successful, move the current OiicAPISessionDetails to installed list

          INFO: Number of root scripts to be executed = 1

          INFO: isSuccessfullInstallation: true

          INFO: isSuccessfullRemoteInstallation: true

          INFO: Adding ExitStatus SUCCESS to the exit status set

          INFO: Completed setting up InstallDB

          INFO: Number of root scripts to be executed = 1

          INFO: Shutting down OUISetupDriver.JobExecutorThread

          INFO: Cleaning up, please wait...

          INFO: Dispose the install area control object

          INFO: Update the state machine to STATE_CLEAN

          INFO: All forked task are completed at state setup

          INFO: Completed background operations

          INFO: Moved to state <setup>

          INFO: Waiting for completion of background operations

          INFO: Completed background operations

          INFO: Validating state <setup>

          WARNING: Validation disabled for the state setup

          INFO: Completed validating state <setup>

          INFO: Verifying route success

          INFO: Waiting for completion of background operations

          INFO: Completed background operations

          INFO: Executing action at state finish

          INFO: FinishAction Actions.execute called

          INFO: Completed executing action at state <finish>

          INFO: Waiting for completion of background operations

          INFO: Completed background operations

          INFO: Moved to state <finish>

          INFO: Waiting for completion of background operations

          INFO: Completed background operations

          INFO: Validating state <finish>

          WARNING: Validation disabled for the state finish

          INFO: Completed validating state <finish>

          INFO: Terminating all background operations

          INFO: Terminated all background operations

          INFO: Successfully executed the flow in SILENT mode

          INFO: Finding the most appropriate exit status for the current application

          INFO: Exit Status is 0

          INFO: Shutdown Oracle Database 11g Release 2 Installer

          INFO: Unloading Setup Driver

           

           

          ----------that is all----------

           

           

           

           

           

           

           

           

          re. PROCESSES/TASKS at the ending:

          Also I had a look in System Monitor and noticed there a TON of processes ("Sleeping") that show up in System Monitor at this time of "freezing" or "hanging" or whatever you want to call it (where nothing is visibly happening anymore).

           

           

          -The most recent shell script is "install_db_instance.sh" (not surprising) with Waiting Channel "do_wait".

          [[[

          #!/bin/bash

           

           

           

           

           

           

          export JSK_DIR=${PWD}

           

           

          . $JSK_DIR/setup_env.sh

           

           

          export ORACLE_HOME=$DB_ORACLE_HOME

           

           

          export ORACLE_BASE=$DB_ORACLE_BASE

           

           

          echo ""

           

           

          #$DB_ORACLE_HOME/bin/dbca -createDatabase -templateName $JSK_DIR/General_Purpose.dbc -gdbName orcl -sid orcl -sysPassword $SCHEMA_PASSWORD -systemPassword $SCHEMA_PASSWORD -emConfiguration LOCAL -dbsnmpPassword $SCHEMA_PASSWORD -sysmanPassword $SCHEMA_PASSWORD -datafileJarLocation $DB_ORACLE_HOME/assistants/dbca/templates/ -storageType FS -datafileDestination $DB_ORACLE_DATA -responseFile NO_VALUE -characterset AL32UTF8 -obfuscatedPasswords false -sampleSchema true -oratabLocation ORATAB -recoveryAreaDestination NO_VALUE -silent

           

           

          echo "$ORACLE_HOME/bin/dbca -silent -responseFile $JSK_DIR/dbca.rsp  -sampleSchema true -oratabLocation ORATAB" >> $LOGS_DIR/install_commands.log

           

           

          $ORACLE_HOME/bin/dbca -silent -responseFile $JSK_DIR/dbca.rsp  -sampleSchema true -oratabLocation ORATAB

           

           

          cat $JSK_DIR/dbca.rsp | grep -v -i PASSWORD > $JSK_DIR/dbca_saved_no_passwords.rsp

           

           

          rm -f $JSK_DIR/dbca.rsp

           

           

          echo ""

          ]]]

          -Immediately after that is "java" with this Command Line:

          /opt/oracle/portal/db/ohome/jdk/jre/bin/java -DORACLE_HOME=/opt/oracle/portal/db/ohome [parameters] -DJDBC_PROTOCOL=thin -mx128m -classpath /opt/oracle/portal/db/ohome/assistants/dbca/jlib/dbca.jar:[otherJarFiles]:/opt/oracle/portal/db/ohome/dv/jlib/dvca.jar oracle.sysman.assistants.dbca.Dbca -silent -responseFile /opt/oracle/run/linux64/dbca.rsp -sampleSchema true -oratabLocation ORATAB

           

           

          -There are 7 named "oracleorcl" where the Command Line is simply "oracleorcl (LOCAL=NO)" or "oracleorcl (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))" -- Waiting Channel is "sk_wait_data".

          -There are 52 named "oracle" with various similar-looking Command Lines. The Waiting Channel for these varies: "poll_schedule_timeout", or "hrtimer_nanosleep", or "sys_semtimedop" (the 2 highest ProcessIDs -- aka most recent -- have this, with Command Line "ora_w000_orcl" and "xe_w000_XE").

          -There are 3 named "sqlplus", their Command Lines are "/opt/oracle/portal/db/ohome/bin/sqlplus -S -N" (the oldest 2), or "/opt/oracle/portal/db/ohome/bin/sqlplus" (the most recent) -- Waiting Channel is "pipe_wait".

           

          Message was edited by: DarrenAg (added PROCESSES/TASKS info)

          • 3. Re: JumpStartKit install hangs at 87% complete during database creation / instance configuration
            Srini Chavali-Oracle

            INFO: Successfully executed the flow in SILENT mode

            INFO: Finding the most appropriate exit status for the current application

            INFO: Exit Status is 0

            INFO: Shutdown Oracle Database 11g Release 2 Installer

            INFO: Unloading Setup Driver

            As per the database logs, it looks like the installation of the database is successful - the hiccup in your process is likely after the database install. Since I do not have expertise in the portal software, I suggest you open an SR with Support for this issue

            • 4. Re: JumpStartKit install hangs at 87% complete during database creation / instance configuration
              DarrenAg

              I don't think the database installaiton is actually truly "successful". Are you saying that a normal "successful" installation of the Oracle database would say "76% ... 87%" but then never show "100%"? And also I did not see "END STEP 6 of 22: Configuration of Database Instance".


               

              So I don't think the DB installation is actually completing successfully.



              Remember, *I never see a % higher than 87%* -- even if the log file I included says it was "successful". But every other successful step before this, which showed a few different "%" values, ended with showing "100%" when it completed. Perhaps it is failing in some kind of UN-HANDLED WAY so the "exit code" does not appear to be a fail and thus the logging shows an APPARENT success, even though it's not completed.

               

              Also, OTHERS have encountered a similar "stops before 100%, not visibly doing anything" issue with the Oracle database installation -- separate from the Portal Jump Start Kit:

              https://community.oracle.com/thread/3572812

              "Oracle 11g installation hangs at 95% in HP-UX Itanium 64 bit OS"

               

               

              In fact, if you type into Google "oracle 11g installation " and wait a second, you'll see it auto-complete with "stuck at 85%" or "hangs" -- it's a common issue.

               

               


              You answered quickly, but please can you take a moment to look at the PROCESSES/TASKS that I summarized above? Their names and statuses seem to imply that it is truly "stuck" before finishing the DB installation.



              Thanks for taking the time...

               

               

               

              PS: since this is the JUMP START KIT installation that means it is unsupported (we don't currently have a license for PORTAL, because we are right now wishing to EVALUATE it -- I am attempting to get Portal 11.1.1.8 running in this VirtualBox environment to evaluate it, as I have tried the VDI provided by Oracle that includes 11.1.1.7 (and which relies on JDeveloper, etc.) and have been told that 11.1.1.8 is much easier to use and customize etc.)


              • 5. Re: JumpStartKit install hangs at 87% complete during database creation / instance configuration
                Srini Chavali-Oracle

                Pl post the last 100 lines from the database alert log - if there are any errors during the database creation, they will be in the alert log.

                 

                http://docs.oracle.com/cd/E11882_01/server.112/e25494/diag.htm#ADMIN11267

                • 6. Re: JumpStartKit install hangs at 87% complete during database creation / instance configuration
                  DarrenAg

                  Is the "database alert log" something additional to the files I excerpted above?

                   

                  Where would it be located if my Linux 64-bit installation got that far?

                   

                  PS: when I looked at the link it appears the DAL is something that is available AFTER the database is installed and running, am I correct? Because it's not running, as far as I can tell (otherwise I would have seen it hit "100%" in the step listed above).

                  • 7. Re: JumpStartKit install hangs at 87% complete during database creation / instance configuration
                    Srini Chavali-Oracle

                    Is the "database alert log" something additional to the files I excerpted above?

                    Yes - you have not posted it's contents

                    Where would it be located if my Linux 64-bit installation got that far?

                    See link above - typically in $ORACLE_HOME/diag/rdbms/<SID>/<SID>/alert

                     

                    PS: when I looked at the link it appears the DAL is something that is available AFTER the database is installed and running, am I correct? Because it's not running, as far as I can tell (otherwise I would have seen it hit "100%" in the step listed above).

                    DAL is created as soon as a database is created

                    • 8. Re: JumpStartKit install hangs at 87% complete during database creation / instance configuration
                      DarrenAg

                      okay so since "$ORACLE_HOME" is "/opt/oracle/portal/db/" in my case, I should look inside "/opt/oracle/portal/db/diag/rdbms/orcl/orcl/alert/" -- sure enough there is "log.xml".

                       

                      According to the link you provided, there is also a "text-formatted version of the alert log", would it normally be in the path "../trace/" relative to the .XML file? I am guessing this because of the description of the results for "SELECT * FROM V$DIAG_INFO;"...

                       

                            1 Diag Trace            /u01/oracle/diag/rdbms/orclbi/orclbi/trace

                            1 Diag Alert            /u01/oracle/diag/rdbms/orclbi/orclbi/alert

                      Diag Trace Location of background process trace files, server process trace files, SQL trace files, and the text-formatted version of the alert log

                      Diag Alert Location of the XML-formatted version of the alert log

                       

                       

                       

                      Okay, I opened up the "../trace/" sibling folder and see the file "alert_orcl.log", which appears to have the same contents as the .XML from start-to-finish.

                       

                       

                      So if you want the last couple hundred lines from that file, here you go...

                       

                      [oracle@soabpm-vm orcl]$ cd ../trace

                       

                       

                      [oracle@soabpm-vm trace]$ pwd

                      /opt/oracle/portal/db/diag/rdbms/orcl/orcl/trace

                       

                       

                      [oracle@soabpm-vm trace]$ tail -200 alert_orcl.log

                      APEX_030200.WWV_FLOW_PROCESSING (PROCESS_SQL_CLOB) - CLOB representation altered

                      APEX_030200.WWV_FLOW_INSTALL (DEINSTALL_SCRIPT) - CLOB representation altered

                      APEX_030200.WWV_FLOW_STEP_PROCESSING (PROCESS_SQL_CLOB) - CLOB representation altered

                      APEX_030200.WWV_FLOW_TEMPLATES (HEADER_TEMPLATE) - CLOB representation altered

                      APEX_030200.WWV_FLOW_TEMPLATES (FOOTER_TEMPLATE) - CLOB representation altered

                      APEX_030200.WWV_FLOW_TEMPLATES (BOX) - CLOB representation altered

                      APEX_030200.WWV_FLOW_LIST_TEMPLATES (LIST_TEMPLATE_CURRENT) - CLOB representation altered

                      APEX_030200.WWV_FLOW_LIST_TEMPLATES (LIST_TEMPLATE_NONCURRENT) - CLOB representation altered

                      APEX_030200.WWV_FLOW_LIST_TEMPLATES (SUB_LIST_ITEM_CURRENT) - CLOB representation altered

                      APEX_030200.WWV_FLOW_LIST_TEMPLATES (SUB_LIST_ITEM_NONCURRENT) - CLOB representation altered

                      APEX_030200.WWV_FLOW_LIST_TEMPLATES (ITEM_TEMPLATE_CURR_W_CHILD) - CLOB representation altered

                      APEX_030200.WWV_FLOW_LIST_TEMPLATES (ITEM_TEMPLATE_NONCURR_W_CHILD) - CLOB representation altered

                      APEX_030200.WWV_FLOW_LIST_TEMPLATES (SUB_TEMPLATE_CURR_W_CHILD) - CLOB representation altered

                      APEX_030200.WWV_FLOW_LIST_TEMPLATES (SUB_TEMPLATE_NONCURR_W_CHILD) - CLOB representation altered

                      APEX_030200.WWV_FLOW_REGION_REPORT_COLUMN (PK_COL_SOURCE) - CLOB representation altered

                      APEX_030200.WWV_FLOW_ROW_TEMPLATES (ROW_TEMPLATE1) - CLOB representation altered

                      APEX_030200.WWV_FLOW_ROW_TEMPLATES (ROW_TEMPLATE2) - CLOB representation altered

                      APEX_030200.WWV_FLOW_ROW_TEMPLATES (ROW_TEMPLATE3) - CLOB representation altered

                      APEX_030200.WWV_FLOW_ROW_TEMPLATES (ROW_TEMPLATE4) - CLOB representation altered

                      APEX_030200.WWV_FLOW_SHORTCUTS (SHORTCUT) - CLOB representation altered

                      APEX_030200.WWV_FLOW_STEPS (HELP_TEXT) - CLOB representation altered

                      Wed Jun 11 11:43:57 2014

                      Thread 1 cannot allocate new log, sequence 5

                      Checkpoint not complete

                        Current log# 1 seq# 4 mem# 0: /opt/oracle/portal/db/oradata/orcl/redo01.log

                      Wed Jun 11 11:43:58 2014

                      APEX_030200.WWV_FLOW_STEPS (HTML_PAGE_HEADER) - CLOB representation altered

                      APEX_030200.WWV_FLOW_WORKSHEETS (SQL_QUERY) - CLOB representation altered

                      APEX_030200.WWV_FLOW_CUSTOM_AUTH_SETUPS (PAGE_SENTRY_FUNCTION) - CLOB representation altered

                      APEX_030200.WWV_FLOW_CUSTOM_AUTH_SETUPS (SESS_VERIFY_FUNCTION) - CLOB representation altered

                      APEX_030200.WWV_FLOW_CUSTOM_AUTH_SETUPS (PRE_AUTH_PROCESS) - CLOB representation altered

                      APEX_030200.WWV_FLOW_CUSTOM_AUTH_SETUPS (AUTH_FUNCTION) - CLOB representation altered

                      APEX_030200.WWV_FLOW_CUSTOM_AUTH_SETUPS (POST_AUTH_PROCESS) - CLOB representation altered

                      APEX_030200.WWV_FLOW_FLASH_CHARTS (CHART_XML) - CLOB representation altered

                      APEX_030200.WWV_FLOW_FLASH_CHART_SERIES (SERIES_QUERY) - CLOB representation altered

                      Thread 1 advanced to log sequence 5 (LGWR switch)

                        Current log# 2 seq# 5 mem# 0: /opt/oracle/portal/db/oradata/orcl/redo02.log

                      Refreshing type attributes with new character set information

                      Completed: alter database character set INTERNAL_CONVERT AL32UTF8

                      Wed Jun 11 11:44:23 2014

                      Shutting down instance (immediate)

                      Stopping background process SMCO

                      Shutting down instance: further logons disabled

                      Wed Jun 11 11:44:34 2014

                      Stopping background process QMNC

                      Stopping background process MMNL

                      Stopping background process MMON

                      License high water mark = 1

                      All dispatchers and shared servers shutdown

                      ALTER DATABASE CLOSE NORMAL

                      Wed Jun 11 11:44:37 2014

                      SMON: disabling tx recovery

                      SMON: disabling cache recovery

                      Wed Jun 11 11:44:43 2014

                      Shutting down archive processes

                      Archiving is disabled

                      Archive process shutdown avoided: 0 active

                      Thread 1 closed at log sequence 5

                      Successful close of redo thread 1

                      Completed: ALTER DATABASE CLOSE NORMAL

                      ALTER DATABASE DISMOUNT

                      Completed: ALTER DATABASE DISMOUNT

                      ARCH: Archival disabled due to shutdown: 1089

                      Shutting down archive processes

                      Archiving is disabled

                      Archive process shutdown avoided: 0 active

                      Wed Jun 11 11:44:44 2014

                      ARCH: Archival disabled due to shutdown: 1089

                      Shutting down archive processes

                      Archiving is disabled

                      Archive process shutdown avoided: 0 active

                      Wed Jun 11 11:44:44 2014

                      Stopping background process VKTM:

                      Wed Jun 11 11:44:46 2014

                      Instance shutdown complete

                      Wed Jun 11 11:44:46 2014

                      Starting ORACLE instance (normal)

                      LICENSE_MAX_SESSION = 0

                      LICENSE_SESSIONS_WARNING = 0

                      Picked latch-free SCN scheme 3

                      Using LOG_ARCHIVE_DEST_1 parameter default value as USE_DB_RECOVERY_FILE_DEST

                      Autotune of undo retention is turned on.

                      IMODE=BR

                      ILAT =167

                      LICENSE_MAX_USERS = 0

                      SYS auditing is disabled

                      Starting up:

                      Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production

                      With the Partitioning, OLAP, Data Mining and Real Application Testing options.

                      Using parameter settings in server-side spfile /opt/oracle/portal/db/ohome/dbs/spfileorcl.ora

                      System parameters with non-default values:

                        processes                = 1000

                        memory_target            = 3344M

                        control_files            = "/opt/oracle/portal/db/oradata/orcl/control01.ctl"

                        control_files            = "/opt/oracle/portal/db/flash_recovery_area/orcl/control02.ctl"

                        db_block_size            = 8192

                        compatible               = "11.2.0.0.0"

                        db_recovery_file_dest    = "/opt/oracle/portal/db/flash_recovery_area"

                        db_recovery_file_dest_size= 3882M

                        undo_tablespace          = "UNDOTBS1"

                        remote_login_passwordfile= "EXCLUSIVE"

                        db_domain                = ""

                        dispatchers              = "(PROTOCOL=TCP) (SERVICE=orclXDB)"

                        local_listener           = "LISTENER_ORCL"

                        audit_file_dest          = "/opt/oracle/portal/db/admin/orcl/adump"

                        audit_trail              = "DB"

                        db_name                  = "orcl"

                        open_cursors             = 500

                        diagnostic_dest          = "/opt/oracle/portal/db"

                      Wed Jun 11 11:44:47 2014

                      PMON started with pid=2, OS id=10553

                      Wed Jun 11 11:44:47 2014

                      VKTM started with pid=3, OS id=10555

                      VKTM running at (100ms) precision

                      Wed Jun 11 11:44:47 2014

                      GEN0 started with pid=4, OS id=10559

                      Wed Jun 11 11:44:47 2014

                      DIAG started with pid=5, OS id=10561

                      Wed Jun 11 11:44:47 2014

                      DBRM started with pid=6, OS id=10563

                      Wed Jun 11 11:44:47 2014

                      PSP0 started with pid=7, OS id=10565

                      Wed Jun 11 11:44:47 2014

                      DIA0 started with pid=8, OS id=10567

                      Wed Jun 11 11:44:47 2014

                      MMAN started with pid=9, OS id=10569

                      Wed Jun 11 11:44:47 2014

                      DBW0 started with pid=10, OS id=10571

                      Wed Jun 11 11:44:47 2014

                      LGWR started with pid=11, OS id=10573

                      Wed Jun 11 11:44:47 2014

                      CKPT started with pid=12, OS id=10575

                      Wed Jun 11 11:44:47 2014

                      SMON started with pid=13, OS id=10577

                      Wed Jun 11 11:44:47 2014

                      RECO started with pid=14, OS id=10579

                      Wed Jun 11 11:44:47 2014

                      MMON started with pid=15, OS id=10581

                      Wed Jun 11 11:44:47 2014

                      MMNL started with pid=16, OS id=10583

                      starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...

                      starting up 1 shared server(s) ...

                      ORACLE_BASE from environment = /opt/oracle/portal/db

                      Wed Jun 11 11:44:47 2014

                      ALTER DATABASE   MOUNT

                      Successful mount of redo thread 1, with mount id 1377747759

                      Database mounted in Exclusive Mode

                      Lost write protection disabled

                      Completed: ALTER DATABASE   MOUNT

                      Wed Jun 11 11:44:52 2014

                      ALTER DATABASE OPEN

                      Thread 1 opened at log sequence 5

                        Current log# 2 seq# 5 mem# 0: /opt/oracle/portal/db/oradata/orcl/redo02.log

                      Successful open of redo thread 1

                      MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set

                      SMON: enabling cache recovery

                      Successfully onlined Undo Tablespace 2.

                      Verifying file header compatibility for 11g tablespace encryption..

                      Verifying 11g file header compatibility for tablespace encryption completed

                      SMON: enabling tx recovery

                      Database Characterset is AL32UTF8

                      No Resource Manager plan active

                      replication_dependency_tracking turned off (no async multimaster replication found)

                      Starting background process QMNC

                      Wed Jun 11 11:44:52 2014

                      QMNC started with pid=20, OS id=10687

                      Completed: ALTER DATABASE OPEN

                      Wed Jun 11 11:44:53 2014

                      db_recovery_file_dest_size of 3882 MB is 0.00% used. This is a

                      user-specified limit on the amount of space that will be used by this

                      database for recovery-related files, and does not reflect the amount of

                      space available in the underlying filesystem or ASM diskgroup.

                      Starting background process CJQ0

                      Wed Jun 11 11:44:53 2014

                      CJQ0 started with pid=23, OS id=10727

                      Wed Jun 11 11:44:58 2014

                      Starting background process SMCO

                      Wed Jun 11 11:44:58 2014

                      SMCO started with pid=21, OS id=10800

                      Wed Jun 11 11:45:17 2014

                      Thread 1 advanced to log sequence 6 (LGWR switch)

                        Current log# 3 seq# 6 mem# 0: /opt/oracle/portal/db/oradata/orcl/redo03.log

                      Wed Jun 11 22:00:41 2014

                      Thread 1 advanced to log sequence 7 (LGWR switch)

                        Current log# 1 seq# 7 mem# 0: /opt/oracle/portal/db/oradata/orcl/redo01.log

                      Wed Jun 11 23:00:00 2014

                      Setting Resource Manager plan SCHEDULER[0x3005]:DEFAULT_MAINTENANCE_PLAN via scheduler window

                      Setting Resource Manager plan DEFAULT_MAINTENANCE_PLAN via parameter

                      Wed Jun 11 23:00:00 2014

                      Starting background process VKRM

                      Wed Jun 11 23:00:00 2014

                      VKRM started with pid=29, OS id=19086

                      Wed Jun 11 23:00:00 2014

                      Begin automatic SQL Tuning Advisor run for special tuning task  "SYS_AUTO_SQL_TUNING_TASK"

                      End automatic SQL Tuning Advisor run for special tuning task  "SYS_AUTO_SQL_TUNING_TASK"

                      Thu Jun 12 03:00:00 2014

                      Clearing Resource Manager plan via parameter

                      Thu Jun 12 03:00:01 2014

                      Thread 1 advanced to log sequence 8 (LGWR switch)

                        Current log# 2 seq# 8 mem# 0: /opt/oracle/portal/db/oradata/orcl/redo02.log

                      [oracle@soabpm-vm trace]$

                      • 9. Re: JumpStartKit install hangs at 87% complete during database creation / instance configuration
                        Srini Chavali-Oracle

                        Thanks - the contents of the alert log do indeed confirm that the database was created successfully and is up and running normally.

                         

                        Completed: ALTER DATABASE OPEN

                        The issue lies somewhere after the database creation process

                        • 10. Re: JumpStartKit install hangs at 87% complete during database creation / instance configuration
                          DarrenAg

                          Okay well I still find it strange that all other previous steps that on the screen it showed "X% complete" but never shows "100% complete" before moving on to the next step.

                           

                          But even presuming the database creation and instance configuration step is actually complete*, how can I find out exactly what code is next? It seems like the majority of the actions taken in the Jump Start Kit are buried within Java .JAR files and class method calls, instead of being easy to sift through in .sh shell script files

                           

                           

                           

                           

                          * when it is "complete" successfully, does it normally fill up 3 log files with 51MB of data each?


                          [root@soabpm-vm oracle]# cd /opt/oracle/portal/db/oradata/orcl

                          [root@soabpm-vm orcl]# ls -lah *.log

                          -rw-r----- 1 oracle oracle 51M Jun 17 20:00 redo01.log

                          -rw-r----- 1 oracle oracle 51M Jun 17 23:00 redo02.log

                          -rw-r----- 1 oracle oracle 51M Jun 18 08:30 redo03.log

                          [root@soabpm-vm orcl]#

                           

                          And notice the TIME of these files, it seems that after 3 hours of getting stuck doing nothing, then "redo02.log" got created.

                           

                           

                           

                          Also, a reminder, it is not the INSTALLATION of the database where it appears to be stopping at 87%, it is the "INSTANCE CONFIGURATION" process ("STEP 6") -- see below.

                           

                          Tue Jun 17 10:14:39 MDT 2014: BEGIN STEP 6 of 22: Configuration of Database Instance. Estimated time is around 5 minutes. Please wait..

                           

                          ^ this "STEP 6" began at 10:14am. The "redo01.log" was last modified at 8pm, 10 hours after that step began. What exactly are those "redoXX.log" files anyway?

                           

                           

                           

                          ...

                          Tue Jun 17 10:14:35 MDT 2014: END STEP 4 of 22: Installation of Oracle Database 11g (11.2.0.1)

                           

                           

                          Tue Jun 17 10:14:35 MDT 2014: BEGIN STEP 5 of 22: Configuration of TNS Listener

                           

                           

                          Parsing command line arguments:

                              Parameter "orahome" = /opt/oracle/portal/db/ohome

                              Parameter "orahnam" = orcl

                              Parameter "instype" = typical

                              Parameter "inscomp" = client,oraclenet,javavm,server,ano

                              Parameter "insprtcl" = tcp

                              Parameter "cfg" = local

                              Parameter "authadp" = NO_VALUE

                              Parameter "responsefile" = /opt/oracle/run/linux64/netca.rsp

                              Parameter "silent" = true

                          Done parsing command line arguments.

                          Oracle Net Services Configuration:

                          Profile configuration complete.

                          Oracle Net Listener Startup:

                              Running Listener Control:

                                /opt/oracle/portal/db/ohome/bin/lsnrctl start LISTENER

                              Listener Control complete.

                              Listener started successfully.

                          Listener configuration complete.

                          Oracle Net Services configuration successful. The exit code is 0

                           

                           

                          Tue Jun 17 10:14:39 MDT 2014: END STEP 5 of 22: Configuration of TNS Listener

                           

                           

                          Tue Jun 17 10:14:39 MDT 2014: BEGIN STEP 6 of 22: Configuration of Database Instance. Estimated time is around 5 minutes. Please wait..

                           

                           

                          Copying database files

                          1% complete

                          3% complete

                          11% complete

                          18% complete

                          26% complete

                          37% complete

                          Creating and starting Oracle instance

                          40% complete

                          45% complete

                          46% complete

                          47% complete

                          48% complete

                          49% complete

                          54% complete

                          59% complete

                          60% complete

                          61% complete

                          64% complete

                          Completing Database Creation

                          68% complete

                          72% complete

                          76% complete

                          87% complete

                          [nothing after this]

                          • 11. Re: JumpStartKit install hangs at 87% complete during database creation / instance configuration
                            Srini Chavali-Oracle

                            Ah this clarifies a bit ! Looks like after the database is created, there are some scripts being run that do something in the database (create schemas and insert data perhaps ?) - seems to be hanging there. If that is truly he end of the database alert log, there are no issues logged in there. The redo logs are part of the database install and an absolute requirement - http://docs.oracle.com/cd/E11882_01/server.112/e25494/onlineredo.htm

                             

                            Unfortunately I am unable to help further as I have no idea what this installer does. Are there any other log files created that detail what scripts are being executed after the database is created ?

                            • 12. Re: JumpStartKit install hangs at 87% complete during database creation / instance configuration
                              foxnet

                              Hey, Darren --

                               

                              This might just be a shot in the dark (it's late and I'm exhausted), but are you sure it isn't a disk space issue?  Reason I ask is that after successfully installing the JSK, for me, disk space used is at 40GB.  Pretty sure you stated earlier that you had allocated 20GB.  Granted, I did install X and Gnome, but that should only be a gig or two (if that).  Unless you're mounting the INSTALL_DIR location remotely, this is still my best guess...

                               

                              --Ed

                              • 13. Re: JumpStartKit install hangs at 87% complete during database creation / instance configuration
                                DarrenAg

                                Thank you for not giving up on me, although this is frustrating I have not given up** on this problem yet!

                                 

                                 

                                So what you asked for, that is where I am stuck -- I don't know of any other log files that I have not already examined, in which I might finally discover the the Actual Point Of Failure (or "freezing", or looping endlessly, or whatever it is doing that doesn't get finished).

                                 

                                 

                                The "BEGIN STEP 6 of 22" log line comes from a "master" script that calls all the others ("jsk_webcenter_portal.sh") ; here is an excerpt:

                                ...

                                      echo "$(date): END STEP 3 of 22: Running Software requirement checks"

                                      echo ""

                                      echo "$(date): BEGIN STEP 4 of 22: Installation of Oracle Database 11g (11.2.0.1). Estimated time is around 5 minutes. Please wait.."

                                      $JSK_DIR/install_db.sh

                                      echo "$(date): END STEP 4 of 22: Installation of Oracle Database 11g (11.2.0.1)"

                                      echo ""

                                      echo "$(date): BEGIN STEP 5 of 22: Configuration of TNS Listener"

                                      $JSK_DIR/install_db_listener.sh

                                      echo "$(date): END STEP 5 of 22: Configuration of TNS Listener"

                                      echo ""

                                      echo "$(date): BEGIN STEP 6 of 22: Configuration of Database Instance. Estimated time is around 5 minutes. Please wait.."

                                      $JSK_DIR/install_db_instance.sh

                                      echo "$(date): END STEP 6 of 22: Configurion of Database Instance"

                                      echo ""

                                      echo "$(date): BEGIN STEP 7 of 22: Creation of WebCenter and Content Schemas using RCU.

                                ...

                                 

                                As you can see, once this step ("6 of 22") finishes, it SHOULD then say "END STEP 6 of 22" but of course I never see that ... so that is why I was so adamant that it is not finishing this step and then failing as it begins the next one.

                                 

                                I decided this week to try to figure out exactly where the log line comes from:

                                Completing Database Creation

                                 

                                And that way I *might* have a chance at looking at the code (whether it is Java or bash script) to maybe figure out what exact action is not finishing -- and that is why I also posted a list of some processes above -- one or more of those processes are not-quite-finished.

                                 

                                I did a text search of all folders that contain script files and came up empty (both the "/run/" folder and the new folders that get unzipped). So my guess is that it's most likely some Java call that is not failing but not succeeding (perhaps caught in a loop), or else it is buried deep within the Oracle Universal Installer itself (or based on the configuration info for this particular OUI run).

                                 

                                 

                                ** So I'm not completely giving up yet; just this morning I decided to just start at the beginning script "runme" and trace start-to-finish the execution path of the scripts/Java, eventually I think I might have gotten to the likely candidate, named "install_db_instance.sh" -- so I looked inside...

                                 

                                $ORACLE_HOME/bin/dbca -silent -responseFile $JSK_DIR/dbca.rsp  -sampleSchema true -oratabLocation ORATAB

                                cat $JSK_DIR/dbca.rsp | grep -v -i PASSWORD > $JSK_DIR/dbca_saved_no_passwords.rsp

                                rm -f $JSK_DIR/dbca.rsp

                                 

                                (me) ...okay so that means inside "/opt/oracle/portal/db/ohome/bin/" there is something being launched called "dbca". (CONFIRMED!)

                                # Directory Variables

                                SRVM_JLIB_DIR=/opt/oracle/portal/db/ohome/jlib

                                JRE_DIR=/opt/oracle/portal/db/ohome/jdk/jre

                                JLIB_DIR=$OH/jlib

                                DBCA_JLIB_DIR=$OH/assistants/dbca/jlib

                                DBCA_HELP_DIR=$OH/assistants/dbca/doc

                                INSTALLER_JLIB_DIR=/opt/oracle/portal/db/ohome/oui/jlib

                                ASSISTANTS_JLIB_DIR=$OH/assistants/jlib

                                #call platform_common script

                                . $ORACLE_HOME/bin/platform_common

                                JRE_OPTIONS="${JRE_OPTIONS} -DSET_LAF=${SET_LAF} -Dsun.java2d.font.DisableAlgorithmicStyles=true -Dice.pilots.html4.ignoreNonGenericFonts=true  -DDISPLAY=${DISPLAY} -DJDBC_PROTOCOL=thin -mx128m"

                                # Run DBCA

                                exec $JRE_DIR/bin/java  $JRE_OPTIONS  $DEBUG_STRING -classpath $CLASSPATH oracle.sysman.assistants.dbca.Dbca $ARGUMENTS

                                (me)... so also have a look inside all of "db/ohome/jlib "db/ohome/assistants" "db/ohome/bin/platform_common"

                                (me)... but MAINLY to find "oracle.sysman.assistants.dbca.Dbca" and see what that Java code actually does...

                                 

                                 

                                Therefore the next place I will have to dig inside is the "Dbca" Java class, as well as the epic giant script called simply "dbca". Looking at it after lunch.

                                 

                                 

                                 

                                PS: sadly no it is not a lack of hard drive space nor RAM -- I have boosted both of those, currently have >21GB of free hard drive space in the install path's partition -- and this is right now AFTER it gets "stuck" -- and only 1GB of 10.5GB of RAM is currently in use (and the swap file never gets used during the installation process; I watched the System Monitor as it got up to the freezing point, and after.) All running on what SHOULD BE the most compatible OS: Oracle VirtualBox with guest = ORACLE Linux 6  64-bit within Oracle VirtualBox (on host = Windows7, not that it should matter).

                                 

                                I made the "DOWNLOAD_DIR" be on the host machine's 200GB hard drive, I shared it so it is visible to the guest OS -- to reduce the chance of issues with free HD space:

                                ./runme INSTANCE_PASSWORD=apwd ROOT_PASSWORD=rpwd DOWNLOAD_DIR=/media/sf_Downloads/JSKfiles INSTALL_DIR=/opt/oracle/portal

                                1 2 Previous Next