7 Replies Latest reply: Apr 17, 2013 2:53 AM by ngsankar RSS

    Out of memory Exception in webcenter sites

    RajendarRaj
      Hi experts,
      I installed webcenter sites 11gR1 on weblogic with Jrocket.
      In development system ,if no.of users accessing at a time its getting down.
      Could some one help me to resolve this issue.
      For Ref. in sites.log i found
      [2013-03-21 15:20:33,777] [fatwire.logging.cs.request] Exception including resource /jsp/cs_deployed/Page/MainNav.jsp
      javax.servlet.ServletException: java.lang.OutOfMemoryError: allocLargeObjectOrArray: [I, size 262160
           at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:342)
           at weblogic.servlet.internal.RequestDispatcherImpl.include(RequestDispatcherImpl.java:447)
           at COM.FutureTense.Servlet.ServletRequest.include(ServletRequest.java:1411)
           at COM.FutureTense.Servlet.FRequestObj.include(FRequestObj.java:1429)
           at COM.FutureTense.Servlet.JSPServices.runJSP(JSPServices.java:102)
           at COM.FutureTense.Platform.FileSystem.FILESYSTEMJSPManager.runJSP(FILESYSTEMJSPManager.java:463)
           at COM.FutureTense.Servlet.JSPServices.runJSPObject(JSPServices.java:50)
           at COM.FutureTense.Platform.FileSystem.FILESYSTEMJSPManager$JSPDataFile.run(FILESYSTEMJSPManager.java:190)
           at COM.FutureTense.Common.ContentServer.jspExecute(ContentServer.java:2923)
           at COM.FutureTense.Common.ContentServer.evalTemplate(ContentServer.java:2517)
           at COM.FutureTense.Common.ContentServer.generatePage(ContentServer.java:1536)
           at COM.FutureTense.Common.ContentServer.evalPage(ContentServer.java:1247)
           at COM.FutureTense.Common.ContentServer.execute(ContentServer.java:455)
           at COM.FutureTense.Common.ContentServer.runManager(ContentServer.java:3339)
           at COM.FutureTense.Common.CS.getPage(CS.java:1361)
           at COM.FutureTense.Common.CS.ReadPage(CS.java:1307)
           at com.openmarket.Satellite.CoResidentContentServerEh._handlePage(CoResidentContentServerEh.java:200)
           at com.openmarket.Satellite.CoResidentContentServerEh.fetchCacheObject(CoResidentContentServerEh.java:131)
           at com.openmarket.Satellite.AbstractContentServer$CacheObjectFetchFunction.doWork(AbstractContentServer.java:413)
           at com.openmarket.Satellite.AbstractContentServer.getCacheObject(AbstractContentServer.java:220)
           at com.openmarket.Satellite.AbstractContentServerEh.getCacheObject(AbstractContentServerEh.java:168)
           at com.openmarket.Satellite.CoResidentContentServerEh.getCacheObject(CoResidentContentServerEh.java:31)
           at com.openmarket.Satellite.PagePiece.stream(DataPiece.java:307)
           at com.openmarket.Satellite.ComplexList.stream(DataPiece.java:565)
           at com.openmarket.Satellite.CacheObjectImpl.stream(CacheObjectImpl.java:653)
           at com.openmarket.Satellite.WrapperAwareResponder.respond(WrapperAwareResponder.java:42)
           at com.openmarket.Satellite.PagePiece.stream(DataPiece.java:330)
           at com.openmarket.Satellite.ComplexList.stream(DataPiece.java:565)
           at com.openmarket.Satellite.CacheObjectImpl.stream(CacheObjectImpl.java:653)
           at com.openmarket.Satellite.WrapperAwareResponder.respond(WrapperAwareResponder.java:42)
           at com.openmarket.Satellite.PagePiece.stream(DataPiece.java:330)
           at com.openmarket.Satellite.CacheObjectImpl.stream(CacheObjectImpl.java:653)
           at com.openmarket.Satellite.Http11Responder.respondForWrapper(Http11Responder.java:143)
           at com.openmarket.Satellite.WrapperAwareResponder.respond(WrapperAwareResponder.java:36)
           at com.openmarket.Satellite.SatelliteServer.execute(SatelliteServer.java:85)
           at com.openmarket.Satellite.servlet.BaseServlet.doGet(BaseServlet.java:118)
           at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
           at javax.servlet.http.HttpServlet.service(HttpServlet.java:821)
           at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
           at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:301)
           at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:27)
           at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:57)
           at com.fatwire.gst.foundation.httpstatus.HttpResponseStatusFilter.doFilter(HttpResponseStatusFilter.java:83)
           at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:57)
           at com.fatwire.wem.sso.cas.filter.CASFilter.doFilter(CASFilter.java:557)
           at com.fatwire.wem.sso.SSOFilter.doFilter(SSOFilter.java:51)

      Thanks
      Rajendar.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           
        • 1. Re: Out of memory Exception in webcenter sites
          ngsankar
          Rajendar, try to increase the JVM Memory size/Managed server memory arguments,
          share what are the current values?
          • 2. Re: Out of memory Exception in webcenter sites
            RajendarRaj
            MEM_PERM_SIZE_64BIT="-XX:PermSize=512m"
            export MEM_PERM_SIZE_64BIT

            MEM_PERM_SIZE_32BIT="-XX:PermSize=512m"
            export MEM_PERM_SIZE_32BIT

            if [ "${JAVA_USE_64BIT}" = "true" ] ; then
                 MEM_PERM_SIZE="${MEM_PERM_SIZE_64BIT}"
                 export MEM_PERM_SIZE
            else
                 MEM_PERM_SIZE="${MEM_PERM_SIZE_32BIT}"
                 export MEM_PERM_SIZE
            fi

            MEM_MAX_PERM_SIZE_64BIT="-XX:MaxPermSize=2048m"
            export MEM_MAX_PERM_SIZE_64BIT

            MEM_MAX_PERM_SIZE_32BIT="-XX:MaxPermSize=2048m"
            • 3. Re: Out of memory Exception in webcenter sites
              ngsankar
              better increase the RAM size for your managed server if possible, add the below code with your manged server, so that it will consume 4GB of RAM to run the Managed server


              if [ "${SERVER_NAME}" == "YOUR MANAGED SERVER NAME" ] ; then
              XMS_JROCKIT_64BIT="4096"
              export XMS_JROCKIT_64BIT
              XMX_JROCKIT_64BIT="6144"
              export XMX_JROCKIT_64BIT
              fi
              • 4. Re: Out of memory Exception in webcenter sites
                RajendarRaj
                Hi Sankar,
                Thanks for your response.
                In my Environment there is no Managed Server. Webcenter Sites software is running on to the Admin server only.

                I am sending you the complete SetDomainEnv.sh file, please verify the file and let me know where I have to place the code.

                Note: If I restart the server it's working good for some time like 6 to 8 hrs and again the same problem is repeating. what might be the cause ?
                --------------------
                # --- Start Functions ---

                BP=100
                SP=$BP

                pushd()
                {
                     if [ -z "$1" ]
                     then
                          return
                     fi

                     SP=`expr $SP - 1`
                     eval _stack$SP=`pwd`
                     cd $1
                     return
                }

                popd()
                {
                     if [ $SP -eq $BP ]
                     then
                          return
                     fi
                     eval cd \${_stack$SP}
                     SP=`expr $SP + 1`
                     return
                }


                # --- End Functions ---

                # *************************************************************************
                # This script is used to setup the needed environment to be able to start Weblogic Server in this domain.
                #
                # This script initializes the following variables before calling commEnv to set other variables:
                #
                # WL_HOME - The BEA home directory of your WebLogic installation.
                # JAVA_VM - The desired Java VM to use. You can set this environment variable before calling
                # this script to switch between Sun or BEA or just have the default be set.
                # JAVA_HOME - Location of the version of Java used to start WebLogic
                # Server. Depends directly on which JAVA_VM value is set by default or by the environment.
                # USER_MEM_ARGS - The variable to override the standard memory arguments
                # passed to java.
                # PRODUCTION_MODE - The variable that determines whether Weblogic Server is started in production mode.
                # DOMAIN_PRODUCTION_MODE
                # - The variable that determines whether the workshop related settings like the debugger,
                # testconsole or iterativedev should be enabled. ONLY settable using the
                # command-line parameter named production
                # NOTE: Specifying the production command-line param will force
                # the server to start in production mode.
                #
                # Other variables used in this script include:
                # SERVER_NAME - Name of the weblogic server.
                # JAVA_OPTIONS - Java command-line options for running the server. (These
                # will be tagged on to the end of the JAVA_VM and
                # MEM_ARGS)
                #
                # For additional information, refer to "Managing Server Startup and Shutdown for Oracle WebLogic Server"
                # (http://download.oracle.com/docs/cd/E23943_01/web.1111/e13708/overview.htm).
                # *************************************************************************

                WL_HOME="/tac/tst/middleware/wlserver_10.3"
                export WL_HOME

                BEA_JAVA_HOME="/tac/tst/middleware/jrockit-jdk1.6.0_33-R28.2.4-4.1.0"
                export BEA_JAVA_HOME

                SUN_JAVA_HOME=""
                export SUN_JAVA_HOME

                if [ "${JAVA_VENDOR}" = "Oracle" ] ; then
                     JAVA_HOME="${BEA_JAVA_HOME}"
                     export JAVA_HOME
                else
                     if [ "${JAVA_VENDOR}" = "Sun" ] ; then
                          JAVA_HOME="${SUN_JAVA_HOME}"
                          export JAVA_HOME
                     else
                          JAVA_VENDOR="Oracle"
                          export JAVA_VENDOR
                          JAVA_HOME="/tac/tst/middleware/jrockit-jdk1.6.0_33-R28.2.4-4.1.0"
                          export JAVA_HOME
                     fi
                fi

                # We need to reset the value of JAVA_HOME to get it shortened AND
                # we can not shorten it above because immediate variable expansion will blank it

                JAVA_HOME="${JAVA_HOME}"
                export JAVA_HOME

                SAMPLES_HOME="${WL_HOME}/samples"
                export SAMPLES_HOME

                DOMAIN_HOME="/tac/tst/middleware/user_projects/domains/csDomain"
                export DOMAIN_HOME

                LONG_DOMAIN_HOME="/tac/tst/middleware/user_projects/domains/csDomain"
                export LONG_DOMAIN_HOME

                if [ "${DEBUG_PORT}" = "" ] ; then
                     DEBUG_PORT="8453"
                     export DEBUG_PORT
                fi

                if [ "${SERVER_NAME}" = "" ] ; then
                     SERVER_NAME="AdminServer"
                     export SERVER_NAME
                fi

                DERBY_FLAG="false"
                export DERBY_FLAG

                enableHotswapFlag=""
                export enableHotswapFlag

                PRODUCTION_MODE=""
                export PRODUCTION_MODE

                doExitFlag="false"
                export doExitFlag
                verboseLoggingFlag="false"
                export verboseLoggingFlag
                while [ $# -gt 0 ]
                do
                     case $1 in
                     nodebug)
                          debugFlag="false"
                          export debugFlag
                          ;;
                     production)
                          DOMAIN_PRODUCTION_MODE="true"
                          export DOMAIN_PRODUCTION_MODE
                          ;;
                     notestconsole)
                          testConsoleFlag="false"
                          export testConsoleFlag
                          ;;
                     noiterativedev)
                          iterativeDevFlag="false"
                          export iterativeDevFlag
                          ;;
                     noLogErrorsToConsole)
                          logErrorsToConsoleFlag="false"
                          export logErrorsToConsoleFlag
                          ;;
                     noderby)
                          DERBY_FLAG="false"
                          export DERBY_FLAG
                          ;;
                     doExit)
                          doExitFlag="true"
                          export doExitFlag
                          ;;
                     noExit)
                          doExitFlag="false"
                          export doExitFlag
                          ;;
                     verbose)
                          verboseLoggingFlag="true"
                          export verboseLoggingFlag
                          ;;
                     enableHotswap)
                          enableHotswapFlag="-javaagent:${WL_HOME}/server/lib/diagnostics-agent.jar"
                          export enableHotswapFlag
                          ;;
                     *)
                          PROXY_SETTINGS="${PROXY_SETTINGS} $1"
                          export PROXY_SETTINGS
                          ;;
                     esac
                     shift
                done


                MEM_DEV_ARGS=""
                export MEM_DEV_ARGS

                if [ "${DOMAIN_PRODUCTION_MODE}" = "true" ] ; then
                     PRODUCTION_MODE="${DOMAIN_PRODUCTION_MODE}"
                     export PRODUCTION_MODE
                fi

                if [ "${PRODUCTION_MODE}" = "true" ] ; then
                     debugFlag="false"
                     export debugFlag
                     testConsoleFlag="false"
                     export testConsoleFlag
                     iterativeDevFlag="false"
                     export iterativeDevFlag
                     logErrorsToConsoleFlag="false"
                     export logErrorsToConsoleFlag
                fi

                # If you want to override the default Patch Classpath, Library Path and Path for this domain,
                # Please uncomment the following lines and add a valid value for the environment variables
                # set PATCH_CLASSPATH=[myPatchClasspath] (windows)
                # set PATCH_LIBPATH=[myPatchLibpath] (windows)
                # set PATCH_PATH=[myPatchPath] (windows)
                # PATCH_CLASSPATH=[myPatchClasspath] (unix)
                # PATCH_LIBPATH=[myPatchLibpath] (unix)
                # PATCH_PATH=[myPatchPath] (unix)

                . ${WL_HOME}/common/bin/commEnv.sh

                WLS_HOME="${WL_HOME}/server"
                export WLS_HOME

                if [ "${JAVA_VENDOR}" = "Sun" ] ; then
                     WLS_MEM_ARGS_64BIT="-Xms256m -Xmx512m"
                     export WLS_MEM_ARGS_64BIT
                     WLS_MEM_ARGS_32BIT="-Xms256m -Xmx512m"
                     export WLS_MEM_ARGS_32BIT
                else
                     WLS_MEM_ARGS_64BIT="-Xms512m -Xmx512m"
                     export WLS_MEM_ARGS_64BIT
                     WLS_MEM_ARGS_32BIT="-Xms512m -Xmx512m"
                     export WLS_MEM_ARGS_32BIT
                fi

                MEM_ARGS_64BIT="${WLS_MEM_ARGS_64BIT}"
                export MEM_ARGS_64BIT

                MEM_ARGS_32BIT="${WLS_MEM_ARGS_32BIT}"
                export MEM_ARGS_32BIT

                if [ "${JAVA_USE_64BIT}" = "true" ] ; then
                     MEM_ARGS="${MEM_ARGS_64BIT}"
                     export MEM_ARGS
                else
                     MEM_ARGS="${MEM_ARGS_32BIT}"
                     export MEM_ARGS
                fi

                MEM_PERM_SIZE_64BIT="-XX:PermSize=512m"
                export MEM_PERM_SIZE_64BIT

                MEM_PERM_SIZE_32BIT="-XX:PermSize=512m"
                export MEM_PERM_SIZE_32BIT

                if [ "${JAVA_USE_64BIT}" = "true" ] ; then
                     MEM_PERM_SIZE="${MEM_PERM_SIZE_64BIT}"
                     export MEM_PERM_SIZE
                else
                     MEM_PERM_SIZE="${MEM_PERM_SIZE_32BIT}"
                     export MEM_PERM_SIZE
                fi

                MEM_MAX_PERM_SIZE_64BIT="-XX:MaxPermSize=2048m"
                export MEM_MAX_PERM_SIZE_64BIT

                MEM_MAX_PERM_SIZE_32BIT="-XX:MaxPermSize=2048m"
                export MEM_MAX_PERM_SIZE_32BIT

                if [ "${JAVA_USE_64BIT}" = "true" ] ; then
                     MEM_MAX_PERM_SIZE="${MEM_MAX_PERM_SIZE_64BIT}"
                     export MEM_MAX_PERM_SIZE
                else
                     MEM_MAX_PERM_SIZE="${MEM_MAX_PERM_SIZE_32BIT}"
                     export MEM_MAX_PERM_SIZE
                fi



                if [ "${JAVA_VENDOR}" = "Sun" ] ; then
                     if [ "${PRODUCTION_MODE}" = "" ] ; then
                          MEM_DEV_ARGS="-XX:CompileThreshold=8000 ${MEM_PERM_SIZE} "
                          export MEM_DEV_ARGS
                     fi
                fi

                # Had to have a separate test here BECAUSE of immediate variable expansion on windows

                if [ "${JAVA_VENDOR}" = "Sun" ] ; then
                     MEM_ARGS="${MEM_ARGS} ${MEM_DEV_ARGS} ${MEM_MAX_PERM_SIZE}"
                     export MEM_ARGS
                fi

                if [ "${JAVA_VENDOR}" = "HP" ] ; then
                     MEM_ARGS="${MEM_ARGS} ${MEM_MAX_PERM_SIZE}"
                     export MEM_ARGS
                fi

                if [ "${JAVA_VENDOR}" = "Apple" ] ; then
                     MEM_ARGS="${MEM_ARGS} ${MEM_MAX_PERM_SIZE}"
                     export MEM_ARGS
                fi

                # IF USER_MEM_ARGS the environment variable is set, use it to override ALL MEM_ARGS values

                if [ "${USER_MEM_ARGS}" != "" ] ; then
                     MEM_ARGS="${USER_MEM_ARGS}"
                     export MEM_ARGS
                fi

                JAVA_PROPERTIES="-Dplatform.home=${WL_HOME} -Dwls.home=${WLS_HOME} -Dweblogic.home=${WLS_HOME} "
                export JAVA_PROPERTIES

                # To use Java Authorization Contract for Containers (JACC) in this domain,
                # please uncomment the following section. If there are multiple machines in
                # your domain, be sure to edit the setDomainEnv in the associated domain on
                # each machine.
                #
                # -Djava.security.manager
                # -Djava.security.policy=location of weblogic.policy
                # -Djavax.security.jacc.policy.provider=weblogic.security.jacc.simpleprovider.SimpleJACCPolicy
                # -Djavax.security.jacc.PolicyConfigurationFactory.provider=weblogic.security.jacc.simpleprovider.PolicyConfigurationFactoryImpl
                # -Dweblogic.security.jacc.RoleMapperFactory.provider=weblogic.security.jacc.simpleprovider.RoleMapperFactoryImpl

                JAVA_PROPERTIES="${JAVA_PROPERTIES} ${EXTRA_JAVA_PROPERTIES}"
                export JAVA_PROPERTIES

                ARDIR="${WL_HOME}/server/lib"
                export ARDIR

                pushd ${LONG_DOMAIN_HOME}

                # Clustering support (edit for your cluster!)

                if [ "${ADMIN_URL}" = "" ] ; then
                     # The then part of this block is telling us we are either starting an admin server OR we are non-clustered
                     CLUSTER_PROPERTIES="-Dweblogic.management.discover=true"
                     export CLUSTER_PROPERTIES
                else
                     CLUSTER_PROPERTIES="-Dweblogic.management.discover=false -Dweblogic.management.server=${ADMIN_URL}"
                     export CLUSTER_PROPERTIES
                fi

                if [ "${LOG4J_CONFIG_FILE}" != "" ] ; then
                     JAVA_PROPERTIES="${JAVA_PROPERTIES} -Dlog4j.configuration=file:${LOG4J_CONFIG_FILE}"
                     export JAVA_PROPERTIES
                fi

                JAVA_PROPERTIES="${JAVA_PROPERTIES} ${CLUSTER_PROPERTIES}"
                export JAVA_PROPERTIES

                JAVA_DEBUG=""
                export JAVA_DEBUG

                if [ "${debugFlag}" = "true" ] ; then
                     JAVA_DEBUG="-Xdebug -Xnoagent -Xrunjdwp:transport=dt_socket,address=${DEBUG_PORT},server=y,suspend=n -Djava.compiler=NONE"
                     export JAVA_DEBUG
                     JAVA_OPTIONS="${JAVA_OPTIONS} ${enableHotswapFlag} -ea -da:com.bea... -da:javelin... -da:weblogic... -ea:com.bea.wli... -ea:com.bea.broker... -ea:com.bea.sbconsole..."
                     export JAVA_OPTIONS
                else
                     JAVA_OPTIONS="${JAVA_OPTIONS} ${enableHotswapFlag} -da"
                     export JAVA_OPTIONS
                fi

                if [ ! -d ${JAVA_HOME}/lib ] ; then
                     echo "The JRE was not found in directory ${JAVA_HOME}. (JAVA_HOME)"
                     echo "Please edit your environment and set the JAVA_HOME"
                     echo "variable to point to the root directory of your Java installation."
                     popd
                     read _val
                     exit
                fi

                if [ "${DERBY_FLAG}" = "true" ] ; then
                     DATABASE_CLASSPATH="${DERBY_CLASSPATH}"
                     export DATABASE_CLASSPATH
                else
                     DATABASE_CLASSPATH="${DERBY_CLIENT_CLASSPATH}"
                     export DATABASE_CLASSPATH
                fi

                if [ "${DATABASE_CLASSPATH}" != "" ] ; then
                     if [ "${POST_CLASSPATH}" != "" ] ; then
                          POST_CLASSPATH="${POST_CLASSPATH}${CLASSPATHSEP}${DATABASE_CLASSPATH}"
                          export POST_CLASSPATH
                     else
                          POST_CLASSPATH="${DATABASE_CLASSPATH}"
                          export POST_CLASSPATH
                     fi
                fi

                if [ "${ARDIR}" != "" ] ; then
                     if [ "${POST_CLASSPATH}" != "" ] ; then
                          POST_CLASSPATH="${POST_CLASSPATH}${CLASSPATHSEP}${ARDIR}/xqrl.jar"
                          export POST_CLASSPATH
                     else
                          POST_CLASSPATH="${ARDIR}/xqrl.jar"
                          export POST_CLASSPATH
                     fi
                fi

                # PROFILING SUPPORT

                JAVA_PROFILE=""
                export JAVA_PROFILE

                SERVER_CLASS="weblogic.Server"
                export SERVER_CLASS

                JAVA_PROPERTIES="${JAVA_PROPERTIES} ${WLP_JAVA_PROPERTIES}"
                export JAVA_PROPERTIES

                JAVA_OPTIONS="${JAVA_OPTIONS} ${JAVA_PROPERTIES} -Dwlw.iterativeDev=${iterativeDevFlag} -Dwlw.testConsole=${testConsoleFlag} -Dwlw.logErrorsToConsole=${logErrorsToConsoleFlag}"
                export JAVA_OPTIONS

                if [ "${PRODUCTION_MODE}" = "true" ] ; then
                     JAVA_OPTIONS=" -Dweblogic.ProductionModeEnabled=true ${JAVA_OPTIONS}"
                     export JAVA_OPTIONS
                fi

                # -- Setup properties so that we can save stdout and stderr to files

                if [ "${WLS_STDOUT_LOG}" != "" ] ; then
                     echo "Logging WLS stdout to ${WLS_STDOUT_LOG}"
                     JAVA_OPTIONS="${JAVA_OPTIONS} -Dweblogic.Stdout=${WLS_STDOUT_LOG}"
                     export JAVA_OPTIONS
                fi

                if [ "${WLS_STDERR_LOG}" != "" ] ; then
                     echo "Logging WLS stderr to ${WLS_STDERR_LOG}"
                     JAVA_OPTIONS="${JAVA_OPTIONS} -Dweblogic.Stderr=${WLS_STDERR_LOG}"
                     export JAVA_OPTIONS
                fi

                # ADD EXTENSIONS TO CLASSPATHS
                PRE_CLASSPATH="/tac/tst/middleware/user_projects/domains/CS/WEB-INF/lib/antlr-3.4-complete.jar:$PRE_CLASSPATH"
                PRE_CLASSPATH="/tac/tst/middleware/user_projects/domains/CS/WEB-INF/lib/commons-lang-2.4.jar:$PRE_CLASSPATH"
                #PRE_CLASSPATH="/tac/tst/middleware/modules/org.apache.ant_1.7.1/lib/ant-antlr.jar:$PRE_CLASSPATH"
                export PRE_CLASSPATH
                # PRE_CLASSPATH="/tac/tst/middleware/user_projects/domains/CS/WEB-INF/lib/commons-lang-2.4.jar;/tac/tst/middleware/user_projects/domains/CS/WEB-INF/lib/log4j-1.2.16.jar;/tac/tst/middleware/user_projects/domains/cas/WEB-INF/lib/quartz-1.5.2.jar;/tac/tst/middleware/user_projects/domains/CS/WEB-INF/lib/jstl-api-1.2.jar;/tac/tst/middleware/webcenter/sites/MSXML.jar:$PRE_CLASSPATH"

                if [ "${EXT_PRE_CLASSPATH}" != "" ] ; then
                     if [ "${PRE_CLASSPATH}" != "" ] ; then
                          PRE_CLASSPATH="${EXT_PRE_CLASSPATH}${CLASSPATHSEP}${PRE_CLASSPATH}"
                          export PRE_CLASSPATH
                     else
                          PRE_CLASSPATH="${EXT_PRE_CLASSPATH}"
                          export PRE_CLASSPATH
                     fi
                fi

                if [ "${EXT_POST_CLASSPATH}" != "" ] ; then
                     if [ "${POST_CLASSPATH}" != "" ] ; then
                          POST_CLASSPATH="${POST_CLASSPATH}${CLASSPATHSEP}${EXT_POST_CLASSPATH}"
                          export POST_CLASSPATH
                     else
                          POST_CLASSPATH="${EXT_POST_CLASSPATH}"
                          export POST_CLASSPATH
                     fi
                fi

                if [ "${WEBLOGIC_EXTENSION_DIRS}" != "" ] ; then
                     JAVA_OPTIONS="${JAVA_OPTIONS} -Dweblogic.ext.dirs=${WEBLOGIC_EXTENSION_DIRS}"
                     export JAVA_OPTIONS
                fi

                JAVA_OPTIONS="${JAVA_OPTIONS}"
                export JAVA_OPTIONS

                # SET THE CLASSPATH

                if [ "${WLP_POST_CLASSPATH}" != "" ] ; then
                     if [ "${CLASSPATH}" != "" ] ; then
                          CLASSPATH="${WLP_POST_CLASSPATH}${CLASSPATHSEP}${CLASSPATH}"
                          export CLASSPATH
                     else
                          CLASSPATH="${WLP_POST_CLASSPATH}"
                          export CLASSPATH
                     fi
                fi

                if [ "${POST_CLASSPATH}" != "" ] ; then
                     if [ "${CLASSPATH}" != "" ] ; then
                          CLASSPATH="${POST_CLASSPATH}${CLASSPATHSEP}${CLASSPATH}"
                          export CLASSPATH
                     else
                          CLASSPATH="${POST_CLASSPATH}"
                          export CLASSPATH
                     fi
                fi

                if [ "${WEBLOGIC_CLASSPATH}" != "" ] ; then
                     if [ "${CLASSPATH}" != "" ] ; then
                          CLASSPATH="${WEBLOGIC_CLASSPATH}${CLASSPATHSEP}${CLASSPATH}"
                          export CLASSPATH
                     else
                          CLASSPATH="${WEBLOGIC_CLASSPATH}"
                          export CLASSPATH
                     fi
                fi

                if [ "${PRE_CLASSPATH}" != "" ] ; then
                     CLASSPATH="${PRE_CLASSPATH}${CLASSPATHSEP}${CLASSPATH}"
                     export CLASSPATH
                fi

                if [ "${JAVA_VENDOR}" != "BEA" ] ; then
                     JAVA_VM="${JAVA_VM} ${JAVA_DEBUG} ${JAVA_PROFILE}"
                     export JAVA_VM
                else
                     JAVA_VM="${JAVA_VM} ${JAVA_DEBUG} ${JAVA_PROFILE}"
                     export JAVA_VM
                fi
                # PRE_CLASSPATH="<webapplication_stage_directory>/<webcenter_sites_webapplication>/WEB-INF/lib/commons-lang-2.4.jar:$PRE_CLASSPATH"
                CLASSPATH="/tac/tst/middleware/webcenter/sites/bin:$CLASSPATH"
                CLASSPATH="/tac/tst/middleware/user_projects/domains/CS/WEB-INF/lib:$CLASSPATH"
                CLASSPATH="/tac/tst/middleware/user_projects/domains/cas/WEB-INF/lib:$CLASSPATH"
                LD_LIBRARY_PATH="/tac/tst/middleware/webcenter/sites/bin:$LD_LIBRARY_PATH"
                export CLASSPATH
                export LD_LIBRARY_PATH
                ----------------

                Thanks,
                Rajendar.
                • 5. Re: Out of memory Exception in webcenter sites
                  ngsankar
                  rajendar,

                  chage the below entries

                  Default entries:

                  MEM_ARGS="-Xms256m -Xmx512m"
                  export MEM_ARGS
                  MEM_PERM_SIZE="-XX:PermSize=48m"
                  export MEM_PERM_SIZE
                  MEM_MAX_PERM_SIZE="-XX:MaxPermSize=128m"
                  export MEM_MAX_PERM_SIZE

                  Change it with the below to overcome java out of memory Exception
                  Customized entries:

                  MEM_ARGS="-Xms2024m -Xmx3036m"
                  export MEM_ARGS
                  MEM_PERM_SIZE="-XX:PermSize=128m"
                  export MEM_PERM_SIZE
                  MEM_MAX_PERM_SIZE="-XX:MaxPermSize=512m"
                  export MEM_MAX_PERM_SIZE

                  Regards,
                  ngsankar
                  • 6. Re: Out of memory Exception in webcenter sites
                    RajendarRaj
                    Hi Sankar,
                    Thank for your Response and support.
                    In my environment webcentersites application is getting down frequently.
                    every day we are facing this issue when multiple users are working with the application.
                    and my system configurations are
                    8GB RAM, UNIX-OS, WebCenterSites11gR1 and weblogic 10.3.6 with JRocket.

                    Could you please help me to resolve this problem.


                    I found the following error in CAS.log..

                    -----------
                    2013-04-15 02:52:36,306 ERROR [org.jgroups] - uncaught exception in Thread[Timer,null,null,5,Timers] (thread group=org.jgroups.util.Util$1[name=JGroups,maxpri=10] )
                    java.lang.OutOfMemoryError
                    2013-04-15 02:52:56,318 ERROR [org.jgroups] - uncaught exception in Thread[UDP mcast,TreeCache-Cluster,172.25.125.100:34273,10,JGroups] (thread group=org.jgroups.util.Util$1[name=JGroups,maxpri=10] )
                    java.lang.OutOfMemoryError
                    2013-04-15 02:52:58,163 ERROR [org.jgroups] - uncaught exception in Thread[Timer,TreeCache-Cluster,172.25.125.100:34273,5,Timers] (thread group=org.jgroups.util.Util$1[name=JGroups,maxpri=10] )
                    java.lang.OutOfMemoryError: getNewTla
                         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.addConditionWaiter(AbstractQueuedSynchronizer.java:1801)
                         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2016)
                         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
                         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
                         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
                         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
                         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
                         at java.lang.Thread.run(Thread.java:662)
                    -----------
                    ------------

                    in csDomain.log file i found the following error

                    ####<Apr 16, 2013 1:42:23 AM EDT> <Error> <WebLogicServer> <tacfmwmt02.dibos02.di-cloud.com> <AdminServer> <[STANDBY] ExecuteThread: '197' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1366090943133> <BEA-000337> <[STUCK] ExecuteThread: '71' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "667" seconds working on the request "Workmanager: default, Version: 1, Scheduled=true, Started=true, Started time: 667524 ms
                    [
                    GET /cs/ContentServer?action=getPubTargetStatus&target=1347209048668&pagename=OpenMarket%2FXcelerate%2FPrologActions%2FPublish%2FAdvPub%2FPublishingStatController HTTP/1.1
                    Referer: http://owcstest.taconic.com/cs/ContentServer?id=1347209048668&action=details&cs_environment=standard&pagename=OpenMarket%2FXcelerate%2FAdmin%2FPublish%2FDestEdit&cs_formmode=WCM
                    X-Requested-With: XMLHttpRequest
                    X-Prototype-Version: 1.5.1.1
                    Accept: text/javascript, text/html, application/xml, text/xml, */*
                    Accept-Language: en-us
                    User-Agent: Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0)
                    Cookie: contentPaneTreeSaveStateCookie=paneRoot; myWorkPaneTreeSaveStateCookie=paneRoot%2CCSTree%40History___history_; sitePaneTreeSaveStateCookie=paneRoot%2C0%40PlacedPages%2CPlacedPages%401347208698531; BIGipServerpool_tac_owcs_test=2311461292.22811.0000; JSESSIONID=gJ83RsfLTtFNKJCf0h688sKdWQxFXGKSJYf1Plpf9yRvbDt4hvyw!-260764669; fw_cookienames_cookie=
                    X-Forwarded-For: 14.140.150.250, 172.25.10.26
                    ECID-Context: 1.004qbEeioSsCSsnMwmicMG0007GE00001U;kXjE1ZDLIPGIj3RSj3JRiKTPiKVK_IUT_IS
                    X-Forwarded-Host: owcstest.taconic.com
                    X-Forwarded-Server: owcstest.taconic.com
                    Connection: Keep-Alive

                    ]", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
                    Thread-20539 "[STUCK] ExecuteThread: '71' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, suspended, waiting, priority=1, DAEMON> {
                    -- Waiting for notification on: com.openmarket.xcelerate.locks.LockObject@1e24e3bf[fat lock]
                    java.lang.Object.wait(Object.java:485)
                    com.openmarket.xcelerate.locks.LockObject.enterWriteLock(LockObject.java:63)
                    com.openmarket.xcelerate.locks.LockManager.enterWriteLock(LockManager.java:193)
                    com.openmarket.xcelerate.publish.PubSessionManager.createSession(PubSessionManager.java:213)
                    com.fatwire.realtime.PubMain.testConnection(PubMain.java:159)
                    com.fatwire.realtime.messaging.PubsessionStatusFacade.testConnection(PubsessionStatusFacade.java:390)
                    jsp_servlet._jsp._cs_deployed._openmarket._xcelerate._prologactions._publish._advpub.__publishingstatcontroller._jspService(__publishingstatcontroller.java:75)
                    weblogic.servlet.jsp.JspBase.service(JspBase.java:34)
                    weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:224)
                    weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:108)
                    weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:207)
                    weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:184)
                    weblogic.servlet.internal.RequestDispatcherImpl.invokeServlet(RequestDispatcherImpl.java:520)
                    weblogic.servlet.internal.RequestDispatcherImpl.include(RequestDispatcherImpl.java:350)
                    COM.FutureTense.Servlet.ServletRequest.include(ServletRequest.java:1385)
                    COM.FutureTense.Servlet.FRequestObj.include(FRequestObj.java:1426)
                    COM.FutureTense.Servlet.JSPServices.runJSP(JSPServices.java:77)
                    COM.FutureTense.Platform.FileSystem.FILESYSTEMJSPManager.runJSP(FILESYSTEMJSPManager.java:463)
                    COM.FutureTense.Servlet.JSPServices.runJSPObject(JSPServices.java:39)
                    COM.FutureTense.Platform.FileSystem.FILESYSTEMJSPManager$JSPDataFile.run(FILESYSTEMJSPManager.java:190)
                    COM.FutureTense.Common.ContentServer.jspExecute(ContentServer.java:2752)
                    COM.FutureTense.Common.ContentServer.evalTemplate(ContentServer.java:2392)
                    COM.FutureTense.Common.ContentServer.generatePage(ContentServer.java:1450)
                    COM.FutureTense.Common.ContentServer.evalPage(ContentServer.java:1083)
                    COM.FutureTense.Common.ContentServer.execute(ContentServer.java:419)
                    COM.FutureTense.Servlet.FTServlet.execute(FTServlet.java:69)
                    COM.FutureTense.Servlet.FTServlet.doGet(FTServlet.java:53)
                    javax.servlet.http.HttpServlet.service(HttpServlet.java:700)
                    javax.servlet.http.HttpServlet.service(HttpServlet.java:815)
                    weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:224)
                    weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:108)
                    weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:207)
                    weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
                    weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
                    com.fatwire.wem.sso.cas.filter.CASFilter.doFilter(CASFilter.java:122)
                    com.fatwire.wem.sso.SSOFilter.doFilter(SSOFilter.java:48)
                    weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
                    com.fatwire.cs.ui.framework.UIFilter.doFilter(UIFilter.java:73)
                    weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
                    weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3702)
                    weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3696)
                    weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:308)
                    weblogic.security.service.SecurityManager.runAs(SecurityManager.java:116)
                    weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2209)
                    weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2131)
                    weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1457)
                    weblogic.work.ExecuteThread.execute(ExecuteThread.java:250)
                    weblogic.work.ExecuteThread.run(ExecuteThread.java:213)
                    }

                    >
                    -------------------------
                    ---------------
                    -----------
                    in Sites.log i found following Exceptions

                    [2013-04-15 03:14:04,196] [fatwire.logging.cs.db] SQLException loading table definition for GSTUrlRegistry with state 99999: Protocol violation: [100]
                    java.sql.SQLException: Protocol violation: [100]
                         at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:464)
                         at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:192)
                         at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531)
                         at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
                         at oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:884)
                         at oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1167)
                         at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1289)
                         at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3593)
                         at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3637)
                         at oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:1495)
                         at oracle.jdbc.driver.OracleDatabaseMetaData.getColumnsWithWildcards(OracleDatabaseMetaData.java:331)
                         at oracle.jdbc.driver.OracleDatabaseMetaData.getColumns(OracleDatabaseMetaData.java:125)
                         at weblogic.jdbc.wrapper.DatabaseMetaData_oracle_jdbc_driver_OracleDatabaseMetaData.getColumns(Unknown Source)
                         at COM.FutureTense.Servlet.JDBCTable.load(JDBCTable.java:1908)
                         at COM.FutureTense.Servlet.JDBCTable.get_trans(JDBCTable.java:701)
                         at COM.FutureTense.Servlet.JDBCTable.get(JDBCTable.java:611)
                         at COM.FutureTense.Servlet.JDBCTable.<init>(JDBCTable.java:288)
                         at COM.FutureTense.Servlet.JDBCConn.GetTable(JDBCConn.java:1333)
                         at COM.FutureTense.Common.ftDBTable.getconn(ftDBTable.java:3899)
                         at COM.FutureTense.Common.ftDBTable.grab(ftDBTable.java:982)
                         at COM.FutureTense.ContentServer.ObjectCatalog.grab(ObjectCatalog.java:71)
                         at COM.FutureTense.CatalogManager.CatalogEngine.newTable(CatalogEngine.java:415)
                         at COM.FutureTense.CatalogManager.CatalogEngine.newTable(CatalogEngine.java:227)
                         at COM.FutureTense.CatalogManager.CatalogEngine.executeStatement(CatalogEngine.java:5040)
                         at COM.FutureTense.Common.CS.SQL(CS.java:1163)
                         at com.fatwire.gst.foundation.facade.sql.SqlHelper.select(SqlHelper.java:161)
                         at com.fatwire.gst.foundation.url.db.UrlRegistry.resolveAsset(UrlRegistry.java:112)
                         at com.fatwire.gst.foundation.controller.BaseRenderPage.resolveAssetId(BaseRenderPage.java:316)
                         at com.fatwire.gst.foundation.controller.BaseRenderPage.renderPage(BaseRenderPage.java:282)
                         at com.fatwire.gst.foundation.controller.action.RenderPage.handleRequest(RenderPage.java:38)
                         at com.fatwire.gst.foundation.controller.action.AbstractActionController.doExecute(AbstractActionController.java:70)
                         at com.fatwire.gst.foundation.controller.AbstractController.Execute(AbstractController.java:74)
                         at COM.FutureTense.XML.Template.CallJava.execute(CallTag.java:190)
                         at COM.FutureTense.XML.Template.BlockTag.execute(BlockTag.java:144)
                         at COM.FutureTense.XML.Template.BlockTag.execute(BlockTag.java:120)
                         at COM.FutureTense.XML.Template.Root.execute(BlockTag.java:365)
                         at COM.FutureTense.XML.Template.XMLEval.run(XMLEval.java:331)
                         at COM.FutureTense.Common.ContentServer.evalTheXML(ContentServer.java:3186)
                         at COM.FutureTense.Common.ContentServer.evalTemplate(ContentServer.java:2447)
                         at COM.FutureTense.Common.ContentServer.generatePage(ContentServer.java:1536)
                         at COM.FutureTense.Common.ContentServer.evalPage(ContentServer.java:1247)
                         at COM.FutureTense.Common.ContentServer.execute(ContentServer.java:453)
                         at COM.FutureTense.Common.ContentServer.runManager(ContentServer.java:3338)
                         at COM.FutureTense.Common.CS.getPage(CS.java:1361)
                         at COM.FutureTense.Common.CS.ReadPage(CS.java:1307)
                         at com.openmarket.Satellite.CoResidentContentServerEh._handlePage(CoResidentContentServerEh.java:200)
                         at com.openmarket.Satellite.CoResidentContentServerEh.fetchCacheObject(CoResidentContentServerEh.java:131)
                         at com.openmarket.Satellite.AbstractContentServer$CacheObjectFetchFunction.doWork(AbstractContentServer.java:413)
                         at com.openmarket.Satellite.AbstractContentServer.getCacheObject(AbstractContentServer.java:220)
                         at com.openmarket.Satellite.AbstractContentServerEh.getCacheObject(AbstractContentServerEh.java:168)
                         at com.openmarket.Satellite.CoResidentContentServerEh.getCacheObject(CoResidentContentServerEh.java:31)
                         at com.openmarket.Satellite.SatelliteServer.execute(SatelliteServer.java:83)
                         at com.openmarket.Satellite.servlet.BaseServlet.doGet(BaseServlet.java:118)
                         at javax.servlet.http.HttpServlet.doHead(HttpServlet.java:281)
                         at javax.servlet.http.HttpServlet.service(HttpServlet.java:724)
                         at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
                         at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
                         at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
                         at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:301)
                         at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
                         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
                         at com.fatwire.gst.foundation.httpstatus.HttpResponseStatusFilter.doFilter(HttpResponseStatusFilter.java:81)
                         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
                         at com.fatwire.wem.sso.cas.filter.CASFilter.doFilter(CASFilter.java:557)
                         at com.fatwire.wem.sso.SSOFilter.doFilter(SSOFilter.java:51)
                         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
                         at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3730)
                         at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3696)
                         at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
                         at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
                         at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2273)
                         at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2179)
                         at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1490)
                         at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256)
                         at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
                    -------------------------


                    [2013-04-15 03:13:38,247] [fatwire.logging.cs.db] Exception in query of ElementCatalog with where clause elementname = GST/ErrorHandler/500
                    java.lang.NullPointerException
                         at COM.FutureTense.Common.ftDBTable.selectTo(ftDBTable.java:2224)
                         at COM.FutureTense.CatalogManager.ElementCatalog._getElementData(ElementCatalog.java:383)
                         at COM.FutureTense.CatalogManager.ElementCatalog._get(ElementCatalog.java:366)
                         at COM.FutureTense.CatalogManager.ElementCatalog.get(ElementCatalog.java:276)
                         at COM.FutureTense.CatalogManager.ElementCatalog.isElement(ElementCatalog.java:484)
                         at COM.FutureTense.Common.CS.IsElement(CS.java:522)
                         at com.fatwire.gst.foundation.controller.AbstractController.sendError(AbstractController.java:159)
                         at com.fatwire.gst.foundation.controller.action.AbstractActionController.handleException(AbstractActionController.java:99)
                         at com.fatwire.gst.foundation.controller.AbstractController.Execute(AbstractController.java:76)
                         at COM.FutureTense.XML.Template.CallJava.execute(CallTag.java:190)
                         at COM.FutureTense.XML.Template.BlockTag.execute(BlockTag.java:144)
                         at COM.FutureTense.XML.Template.BlockTag.execute(BlockTag.java:120)
                         at COM.FutureTense.XML.Template.Root.execute(BlockTag.java:365)
                         at COM.FutureTense.XML.Template.XMLEval.run(XMLEval.java:331)
                         at COM.FutureTense.Common.ContentServer.evalTheXML(ContentServer.java:3186)
                         at COM.FutureTense.Common.ContentServer.evalTemplate(ContentServer.java:2447)
                         at COM.FutureTense.Common.ContentServer.generatePage(ContentServer.java:1536)
                         at COM.FutureTense.Common.ContentServer.evalPage(ContentServer.java:1247)
                         at COM.FutureTense.Common.ContentServer.execute(ContentServer.java:453)
                         at COM.FutureTense.Common.ContentServer.runManager(ContentServer.java:3338)
                         at COM.FutureTense.Common.CS.getPage(CS.java:1361)
                         at COM.FutureTense.Common.CS.ReadPage(CS.java:1307)
                         at com.openmarket.Satellite.CoResidentContentServerEh._handlePage(CoResidentContentServerEh.java:200)
                         at com.openmarket.Satellite.CoResidentContentServerEh.fetchCacheObject(CoResidentContentServerEh.java:131)
                         at com.openmarket.Satellite.AbstractContentServer$CacheObjectFetchFunction.doWork(AbstractContentServer.java:413)
                         at com.openmarket.Satellite.AbstractContentServer.getCacheObject(AbstractContentServer.java:220)
                         at com.openmarket.Satellite.AbstractContentServerEh.getCacheObject(AbstractContentServerEh.java:168)
                         at com.openmarket.Satellite.CoResidentContentServerEh.getCacheObject(CoResidentContentServerEh.java:31)
                         at com.openmarket.Satellite.SatelliteServer.execute(SatelliteServer.java:83)
                         at com.openmarket.Satellite.servlet.BaseServlet.doGet(BaseServlet.java:118)
                         at javax.servlet.http.HttpServlet.doHead(HttpServlet.java:281)
                         at javax.servlet.http.HttpServlet.service(HttpServlet.java:724)
                         at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
                         at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
                         at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
                         at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:301)
                         at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
                         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
                         at com.fatwire.gst.foundation.httpstatus.HttpResponseStatusFilter.doFilter(HttpResponseStatusFilter.java:81)
                         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
                         at com.fatwire.wem.sso.cas.filter.CASFilter.doFilter(CASFilter.java:557)
                         at com.fatwire.wem.sso.SSOFilter.doFilter(SSOFilter.java:51)
                         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
                         at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3730)
                         at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3696)
                         at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
                         at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
                         at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2273)
                         at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2179)
                         at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1490)
                         at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256)
                         at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
                    -----------------------

                    [2013-04-15 03:14:08,222] [fatwire.logging.cs.db] SQLException loading table definition for SystemItemCache with state 99999: Protocol violation: [116]
                    java.sql.SQLException: Protocol violation: [116]
                         at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:464)
                         at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:192)
                         at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531)
                         at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
                         at oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:884)
                         at oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1167)
                         at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1289)
                         at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3593)
                         at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3637)
                         at oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:1495)
                         at oracle.jdbc.driver.OracleDatabaseMetaData.getColumnsWithWildcards(OracleDatabaseMetaData.java:331)
                         at oracle.jdbc.driver.OracleDatabaseMetaData.getColumns(OracleDatabaseMetaData.java:125)
                         at weblogic.jdbc.wrapper.DatabaseMetaData_oracle_jdbc_driver_OracleDatabaseMetaData.getColumns(Unknown Source)
                         at COM.FutureTense.Servlet.JDBCTable.load(JDBCTable.java:1908)
                         at COM.FutureTense.Servlet.JDBCTable.get_trans(JDBCTable.java:701)
                         at COM.FutureTense.Servlet.JDBCTable.get(JDBCTable.java:611)
                         at COM.FutureTense.Servlet.JDBCTable.<init>(JDBCTable.java:288)
                         at COM.FutureTense.Servlet.JDBCConn.GetTable(JDBCConn.java:1333)
                         at COM.FutureTense.Common.ftDBTable.getconn(ftDBTable.java:3899)
                         at COM.FutureTense.Common.ftDBTable.grab(ftDBTable.java:982)
                         at COM.FutureTense.Common.ContentServer.getSysItem(ContentServer.java:246)
                         at COM.FutureTense.Common.ContentServer.recordBlobList(ContentServer.java:1745)
                         at COM.FutureTense.Common.ContentServer.generatePage(ContentServer.java:1659)
                         at COM.FutureTense.Common.ContentServer.evalPage(ContentServer.java:1247)
                         at COM.FutureTense.Common.ContentServer.execute(ContentServer.java:453)
                         at COM.FutureTense.Common.ContentServer.runManager(ContentServer.java:3338)
                         at COM.FutureTense.Common.CS.getPage(CS.java:1361)
                         at COM.FutureTense.Common.CS.ReadPage(CS.java:1307)
                         at com.openmarket.Satellite.CoResidentContentServerEh._handlePage(CoResidentContentServerEh.java:200)
                         at com.openmarket.Satellite.CoResidentContentServerEh.fetchCacheObject(CoResidentContentServerEh.java:131)
                         at com.openmarket.Satellite.AbstractContentServer$CacheObjectFetchFunction.doWork(AbstractContentServer.java:413)
                         at com.openmarket.Satellite.AbstractContentServer.getCacheObject(AbstractContentServer.java:220)
                         at com.openmarket.Satellite.AbstractContentServerEh.getCacheObject(AbstractContentServerEh.java:168)
                         at com.openmarket.Satellite.CoResidentContentServerEh.getCacheObject(CoResidentContentServerEh.java:31)
                         at com.openmarket.Satellite.SatelliteServer.execute(SatelliteServer.java:83)
                         at com.openmarket.Satellite.servlet.BaseServlet.doGet(BaseServlet.java:118)
                         at javax.servlet.http.HttpServlet.doHead(HttpServlet.java:281)
                         at javax.servlet.http.HttpServlet.service(HttpServlet.java:724)
                         at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
                         at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
                         at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
                         at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:301)
                         at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
                         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
                         at com.fatwire.gst.foundation.httpstatus.HttpResponseStatusFilter.doFilter(HttpResponseStatusFilter.java:81)
                         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
                         at com.fatwire.wem.sso.cas.filter.CASFilter.doFilter(CASFilter.java:557)
                         at com.fatwire.wem.sso.SSOFilter.doFilter(SSOFilter.java:51)
                         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
                         at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3730)
                         at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3696)
                         at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
                         at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
                         at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2273)
                         at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2179)
                         at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1490)
                         at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256)
                         at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
                         -----------------------------

                         [2013-04-15 03:14:28,564] [fatwire.logging.cs.db] SQLException loading table definition for SystemUsers with state 99999: Protocol violation: [105]
                    java.sql.SQLException: Protocol violation: [105]
                         at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:464)
                         at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:192)
                         at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531)
                         at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
                         at oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:884)
                         at oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1167)
                         at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1289)
                         at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3593)
                         at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3637)
                         at oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:1495)
                         at oracle.jdbc.driver.OracleDatabaseMetaData.getColumnsWithWildcards(OracleDatabaseMetaData.java:331)
                         at oracle.jdbc.driver.OracleDatabaseMetaData.getColumns(OracleDatabaseMetaData.java:125)
                         at weblogic.jdbc.wrapper.DatabaseMetaData_oracle_jdbc_driver_OracleDatabaseMetaData.getColumns(Unknown Source)
                         at COM.FutureTense.Servlet.JDBCTable.load(JDBCTable.java:1908)
                         at COM.FutureTense.Servlet.JDBCTable.get_trans(JDBCTable.java:701)
                         at COM.FutureTense.Servlet.JDBCTable.get(JDBCTable.java:611)
                         at COM.FutureTense.Servlet.JDBCTable.<init>(JDBCTable.java:288)
                         at COM.FutureTense.Servlet.JDBCConn.GetTable(JDBCConn.java:1333)
                         at COM.FutureTense.Common.ftDBTable.getconn(ftDBTable.java:3899)
                         at COM.FutureTense.Common.ftDBTable.grab(ftDBTable.java:982)
                         at COM.FutureTense.Access.StandardUsers.grab(ftUsers.java:362)
                         at COM.FutureTense.Access.AccessEngine.doLogin(AccessEngine.java:391)
                         at COM.FutureTense.Access.AccessEngine.doLogin(AccessEngine.java:381)
                         at COM.FutureTense.Common.ftAppLogic.checkLogin(ftAppLogic.java:3256)
                         at COM.FutureTense.Common.ContentServer.standaloneInit(ContentServer.java:786)
                         at COM.FutureTense.Servlet.FRequestObj.init(FRequestObj.java:974)
                         at COM.FutureTense.Servlet.FRequestObj.<init>(FRequestObj.java:271)
                         at COM.FutureTense.Servlet.FRequestObj.newInstance(FRequestObj.java:231)
                         at COM.FutureTense.Servlet.FRequestObj.newInstance(FRequestObj.java:218)
                         at COM.FutureTense.CS.Factory.newCS(Factory.java:66)
                         at com.openmarket.Satellite.RequestContext.getICS(RequestContext.java:1026)
                         at com.openmarket.Satellite.RequestContext.captureInputCoResident(RequestContext.java:518)
                         at com.openmarket.Satellite.RequestContext.<init>(RequestContext.java:428)
                         at com.openmarket.Satellite.servlet.BaseServlet.doGet(BaseServlet.java:112)
                         at javax.servlet.http.HttpServlet.doHead(HttpServlet.java:281)
                         at javax.servlet.http.HttpServlet.service(HttpServlet.java:724)
                         at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
                         at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
                         at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
                         at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:301)
                         at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
                         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
                         at com.fatwire.gst.foundation.httpstatus.HttpResponseStatusFilter.doFilter(HttpResponseStatusFilter.java:81)
                         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
                         at com.fatwire.wem.sso.cas.filter.CASFilter.doFilter(CASFilter.java:557)
                         at com.fatwire.wem.sso.SSOFilter.doFilter(SSOFilter.java:51)
                         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
                         at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3730)
                         at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3696)
                         at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
                         at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
                         at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2273)
                         at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2179)
                         at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1490)
                         at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256)
                         at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
                    • 7. Re: Out of memory Exception in webcenter sites
                      ngsankar
                      Rajendar,
                      StuckThreadMaxTime) of "600" seconds---increase it to 1800 in the weblogic console
                      and increase the spaces managed server ram in the config files