11 Replies Latest reply: May 2, 2012 7:22 PM by user2619849 RSS

    Found TLA outside of heap

    696746
      Seeing this error when running under R28.1.3, JRockit just quits.

      [ERROR] Found TLA outside of heap (0xfebe3610)
      JRockit aborted: Unspecified error (52)
        • 1. Re: Found TLA outside of heap
          muitg
          Hi,

          Did you find the reason for this error? Because we have the same error, once a month......
          configuartion:
          vmware esx4
          oracle unbreakable unix
          oracle weblogic server

          Thanks!
          Regards,
          Joop
          • 2. Re: Found TLA outside of heap
            696746
            No we did not.

            Physical (non virtualized) servers + JRockit 1.6.0.17 - Did not see any issues

            Couple of weeks ago, we moved to VM ware + JRockit 1.6.0.24 immediately after which we are seeing this problem and also core-dumps with Illegal Memory Access error. We are uncertain if VMware or JRockit version is causing this problem.

            Which version of JDK are you running and did you start seeing this problem after any upgrades? How long have you been running on VMWare + JRockit + Oracle Weblogic Server?

            We are planning to revert JDK version and see if this problem goes away.
            • 3. Re: Found TLA outside of heap
              René van Wijk
              We have VMware-VMvisor-4.1.0 running with RHEL 5 and JRockit R28 (1.6.0_20) with no problems.

              Of course what you are experiencing is very difficult to analyze, somewhere along the line (JVM, OS, hypervisor)
              some addressing goes down the drain.

              What you can try to do is add the -XXdumpFullState (http://download.oracle.com/docs/cd/E15289_01/doc.40/e15062/optionxx.htm#i1012561) option to JVM parameters
              that might give some insight in what is going on.

              Also our OS is configured with swappiness set to zero. In /etc/sysctl.conf the parameter: vm.swappiness = 0 is added.
              As swapping was killing performance on the system.

              I know it is not much help, but maybe it leads to something.
              • 4. Re: Found TLA outside of heap
                muitg
                We are running version:
                # /awls/weblogic/jrockit-jdk1.6.0/bin/java -version
                java version "1.6.0_20"
                Java(TM) SE Runtime Environment (build 1.6.0_20-b02)
                Oracle JRockit(R) (build R28.1.0-123-138454-1.6.0_20-20101014-1350-linux-x86_64, compiled mode)

                Last May we moved from BlueStack to RedStack, so before May we don't use JRockit at all. The error comes up 6 time till now (last 3 time in the last 3 days....)

                But what I saw is that the memory options set via the WebLogic Admin console are not picked up when the WebLogic services are started via shell scripts.... So it wass using the kind of default settings: "-Xms512m -Xmx512m"

                Since yesterday I applied a memory setting to the WebLogic startup scripts:
                su -c "nohup /awls/weblogic/wls_1032/Middleware/user_projects/domains/prod_domain/bin/startManagedWebLogic.sh WEB_PD811_01 http://abcd:7001 -Xms1536m -Xmx1536m &" - weblogic

                Via the WebLogic Admin console I see this setting are active.
                So I hope this is solved now, we will see the next weeks!
                • 5. Re: Found TLA outside of heap
                  user734005
                  Did you ever get this resolved? We are seeing it with R28.1.3.
                  • 6. Re: Found TLA outside of heap
                    muitg
                    adding -Xms1536m -Xmx1536m did not solve the problem, yesterday the java process stopped again...
                    • 7. Re: Found TLA outside of heap
                      696746
                      We have backed-up JRockit from 1.6.0.24 to 1.6.0.17 since that is the version that we used earlier and so far (two weeks) we have not seen the problem re-occur. The other variable in this issue was that we move to VMWare recently but running 1.6.0.17 on VMWare so far looks ok.
                      • 8. Re: Found TLA outside of heap
                        628157
                        Hi, I'm wondering if Oracle can chime in here as we are seeing this same error now too.

                        We're running physical HP servers:
                        o RedHat ( 2.6.18-238.el5 #1 SMP Sun Dec 19 14:22:44 EST 2010 x86_64 x86_64 x86_64 GNU/Linux)
                        o JRockit (java version "1.6.0_20"
                        Java(TM) SE Runtime Environment (build 1.6.0_20-b02)
                        Oracle JRockit(R) (build R28.1.0-123-138454-1.6.0_20-20101014-1350-linux-x86_64, compiled mode)
                        )
                        o WebLogic Server 11g (10g r3 + PS 2)

                        It's happened two days in a row with no other symptoms. We've made no recent changes (since before the holidays, so 2 weeks+) and it just started happening.

                        Thanks,
                        David
                        • 9. Re: Found TLA outside of heap
                          muitg
                          Hi all,

                          FYI

                          We did a downgrade beginning this year. We didn't face the error anymore!

                          java version "1.6.0_14"
                          Java(TM) SE Runtime Environment (build 1.6.0_14-b08)
                          BEA JRockit(R) (build R27.6.5-32_o-121899-1.6.0_14-20091001-2113-linux-x86_64

                          Regards, Joop
                          • 10. Re: Found TLA outside of heap
                            Mattis Castegren-Oracle
                            Hi

                            Two questions:

                            1) Did anyone reproduce this outside of VMWare. We don't test JRockit on VMWare, and have seen issues on it in the past.
                            2) If you managed to reproduce this on a physical machine, does anyone have any reproducer, or does this just happen intermittently? Without any way to reproduce this in-house, it will be very hard to debug

                            Kind Regards
                            /Mattis Castegren, JVM Sustaining Engineering
                            • 11. Re: Found TLA outside of heap
                              user2619849
                              We have seen this error for the first time today.

                              [ERROR] Found TLA outside of heap (0xa2c4eef8)
                              JRockit aborted: Unspecified error (52)
                              <May 2, 2012 2:28:46 PM> <FINEST> <NodeManager> <Waiting for the process to die: 2804>
                              <May 2, 2012 2:28:46 PM> <INFO> <NodeManager> <Server failed so attempting to restart (restart count = 1)>


                              We are runnnig:
                              java version "1.6.0_24"
                              Java(TM) SE Runtime Environment (build 1.6.0_24-b07)
                              Oracle JRockit(R) (build R28.1.3-11-141760-1.6.0_24-20110301-1432-linux-x86_64, compiled mode)

                              OEL 5.7
                              2.6.32-300.7.1.el5uek

                              OVM 3.0.3

                              JDE Tools 9.1

                              Still looking for cause or fix....