4 Replies Latest reply on Jun 23, 2008 5:44 PM by 113594

    Problem with enterprise manager. dbconsole doesnt start.

    499866
      Hi all
      I have a machine runing AIX 5.3. The oracle software we have installed is 10.2.0.3.0.
      Dbconsole was configured and runing till today, when i stoped it, i cant started it again.


      emctl start dbconsole
      Oracle Enterprise Manager 10g Database Control Release 10.2.0.3.0
      Copyright (c) 1996, 2006 Oracle Corporation. All rights reserved.
      http://rbcndbs00:1158/em/console/aboutApplication
      ps: 0509-048 Flag -o was used with invalid list.
      ps: Not a recognized flag: -
      Usage: ps [-ANPaedfklmMZ] [-n namelist] [-F Format] [-o specifier[=header],...]
      [-p proclist][-G|-g grouplist] [-t termlist] [-U|-u userlist] [-c classlist] [ -T pid] [ -L pidlist]
      Usage: ps [aceglnsuvwxU] [t tty] [processnumber]
      Starting Oracle Enterprise Manager 10g Database Control ..........................
      ................................................................... failed.


      The emdb.nohup shows:
      ----- Wed Jun 11 17:49:24 2008::DBConsole. Monitoring Agent+Console -----
      ----- Wed Jun 11 17:49:24 2008::Console Launched with PID 1060878 at time Wed Jun 11 17:49:24 2008 -----
      08/06/11 16:49:28 Error starting ORMI-Server. Unable to bind socket: The socket name is already in use.
      ----- Wed Jun 11 17:51:00 2008::The agentTZRegion value in /u01/app/oracle/product/10.2/rbcndbs00_rentapro/sysman/config/emd.propert
      ies is not in agreement with what agent thinks it should be.Please verify your environment to make sure that TZ setting has not chan
      ged since the last start of the agent.
      If you modified the timezone setting in the environment, please stop the agent and exectute 'emctl resetTZ agent' and also execute t
      he script 'mgmt_target.set_agent_tzrgn' to get the value propagated to repository -----



      The emdctl.trc shows:
      2008-06-11 17:49:23 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:49:31 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:49:38 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:49:45 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:49:51 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:49:58 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:50:05 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:50:11 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:50:18 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:50:25 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:50:31 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:50:38 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:50:45 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:50:51 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:50:58 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:50:59 Thread-1 ERROR main: nmectl.c: nmectl_validateTZRegion, agentTZoffset =120,and testTZoffset for +01:00:60 do not
      match
      2008-06-11 17:51:00 Thread-1 ERROR main: nmectl.c: nmectl_validateTZRegion, agentTZoffset =120,and testTZoffset for +01:00:60 do not
      match
      2008-06-11 17:51:05 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:51:12 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:51:18 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:51:25 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:51:32 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:51:38 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:51:45 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)
      2008-06-11 17:51:51 Thread-1 WARN http: snmehl_connect: connect failed to (rbcndbs00:3938): A remote host refused an attempted conn
      ect operation. (error = 79)

      I done netstat -a |grep 1158
      netstat -a |grep 1158
      tcp4 0 0 *.1158 *.* LISTEN


      I have read some posts about TZ problem.
      I done echo $TZ:
      CET-1CEST,M3.5.0,M10.5.0

      and checked agent tz:
      emctl config agent getTZ
      GMT+01:00

      Have checked too:
      $ORACLE_HOME/install/portlist.ini
      Enterprise Manager Console HTTP Port (rentapro) = 1158
      Enterprise Manager Agent Port (rentapro) = 3938

      And the agentTZRegion in emd.properties:
      more emd.properties|grep agentTZ
      agentTZRegion=+01:00


      Checked the tzmappings:
      /u01/app/oracle/product/10.2/jdk/jre/lib>more tzmappings |grep CET
      CET Europe/Paris
      CET-1CET-2 Europe/Paris

      Seems TZ exists.
      This is for a standalone bbdd-agent, dont using grid.

      Must i update agent to CET-1CET-2 TZ? recreate repos?

      Any clue will be appreciate.
        • 1. Re: Problem with enterprise manager. dbconsole doesnt start.
          oraclemagician
          You need to set the time zones for both the agent and dbconsole to use the same time zone. Then stop and re-start both the agent and dbconsole for Enterprise Manager.

          To fix this issue, you may also need to apply both an AIX OS patch and Oracle patch for your database server. Do you have access to Oracle Metalink?

          See here for a useful note that covers this issue in detail:

          DST: Workaround to EM Agent Restart Problem Due to a Daylight Savings Change
          Metalink Note: 401834.1

          Regards,
          Ben Prusinski
          http://oracle-magician.blogspot.com/
          • 2. Re: Problem with enterprise manager. dbconsole doesnt start.
            Madrid
            Check the time zone really corresponds to what is declared at the host. "The error: A remote host refused an attempted connect operation. " is due to the agent part that is required to access the database. You don't need an explicit agent like the way it is configured when you install the grid control agent, but a simple db control shares some configuration. Take a look at the $ORACLE_HOME/sysman/admin/supportedtzs.lst and verify the timezone declared at the $ORACLE_HOME/sysman/config/emd.properties at the agentTZRegion entry matches one of the listed at the supported time zones.

            ~ Madrid
            http://hrivera99.blogspot.com
            • 3. Re: Problem with enterprise manager. dbconsole doesnt start.
              orafad
              Starting Oracle Enterprise Manager 10g Database
              Control ..........................
              ......................................................
              ............. failed.
              Since this is on AIX and your TZ setting and above sloooow start, this is very likely one of the infamous time zone problems with EM.

              PID 1060878 at time Wed Jun 11 17:49:24 2008 -----
              08/06/11 16:49:28 Error starting ORMI-Server. Unable
              There's one right there.

              ----- Wed Jun 11 17:51:00 2008::The agentTZRegion
              value in
              /u01/app/oracle/product/10.2/rbcndbs00_rentapro/sysman/config/emd.propert
              ies is not in agreement with what agent thinks it should be.
              And there it is spelled out loud an clear :)
              please stop the agent and exectute
              'emctl resetTZ agent' and also execute t
              he script 'mgmt_target.set_agent_tzrgn' to get the
              value propagated to repository -----
              Follow these instructions.

              You might also use TZ=<sometzvalue> emctl start/stop dbconsole as a workaround.


              008-06-11 17:51:00 Thread-1 ERROR main: nmectl.c:
              nmectl_validateTZRegion, agentTZoffset =120,and
              testTZoffset for +01:00:60 do not match
              Isn't that another "typical" symptom?
              • 4. Re: Problem with enterprise manager. dbconsole doesnt start.
                113594
                We had similar problems on AIX Oracle 10gR2 RAC.
                Regardless of TZ problems, Oracle was unable to start agents and dbconsole in secure mode itself.
                Finally we unsecured them by issuing commands:
                emctl unsecure agent
                emctl unsecure dbconsole
                and started agents and dbconsole in unsecure mode.