Enterprise Manager

Announcement

For appeals, questions and feedback about Oracle Forums, please email oracle-forums-moderators_us@oracle.com. Technical questions should be asked in the appropriate category. Thank you!

Oracle Cloud Control 13.3, Cannot Connect to Weblogic admin server

User_O496VApr 3 2021

Hello all! Recently I have performed a fresh installation of Oracle Cloud Control 13.3. The first thing I have noticed was that the Weblogic admin server appears to be down according to Cloud Control.

When querying via "emctl status oms -details" everything seems ok:

[oracle@ora-cloud-control nodemanager]$ emctl status oms -details
Oracle Enterprise Manager Cloud Control 13c Release 3
Copyright (c) 1996, 2018 Oracle Corporation. All rights reserved.
Enter Enterprise Manager Root (SYSMAN) Password :
Console Server Host : ora-cloud-control.localdomain
HTTP Console Port : 7788
HTTPS Console Port : 7803
HTTP Upload Port : 4889
HTTPS Upload Port : 4903
EM Instance Home : /u01/app/oracle/gc_inst/em/EMGC_OMS1
OMS Log Directory Location : /u01/app/oracle/gc_inst/em/EMGC_OMS1/sysman/log
OMS is not configured with SLB or virtual hostname
Agent Upload is locked.
OMS Console is locked.
Active CA ID: 1
Console URL: https://ora-cloud-control.localdomain:7803/em
Upload URL: https://ora-cloud-control.localdomain:4903/empbs/upload

WLS Domain Information
Domain Name : GCDomain
Admin Server Host : ora-cloud-control.localdomain
Admin Server HTTPS Port: 7102
Admin Server is RUNNING

Oracle Management Server Information
Managed Server Instance Name: EMGC_OMS1
Oracle Management Server Instance Host: ora-cloud-control.localdomain
WebTier is Up
Oracle Management Server is Up
JVMD Engine is Up

BI Publisher Server Information
BI Publisher Managed Server Name: BIP
BI Publisher Server is Up

BI Publisher HTTP Managed Server Port : 9701
BI Publisher HTTPS Managed Server Port : 9803
BI Publisher HTTP OHS Port : 9788
BI Publisher HTTPS OHS Port : 9851
BI Publisher is locked.
BI Publisher Server named 'BIP' running at URL: https://ora-cloud-control.localdomain:9851/xmlpserver/servlet/home
BI Publisher Server Logs: /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/servers/BIP/logs/
BI Publisher Log : /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/servers/BIP/logs/bipublisher/bipublisher.log

However, the admin server cannot be reached at: https://ora-cloud-control.localdomain:7102/console nor via WLST:

wls:/offline> connect('weblogic','*******','t3s://ora-cloud-control.localdomain:7102')
Connecting to t3s://ora-cloud-control.localdomain:7102 with userid weblogic ...
<Apr 1, 2021 10:02:29 PM CEST> <Info> <Security> <BEA-090905> <Disabling the CryptoJ JCE Provider self-integrity check for better startup performance. To enable this check, specify -Dweblogic.security.allowCryptoJDefaultJCEVerification=true.>
<Apr 1, 2021 10:02:29 PM CEST> <Info> <Security> <BEA-090906> <Changing the default Random Number Generator in RSA CryptoJ from ECDRBG128 to FIPS186PRNG. To disable this change, specify -Dweblogic.security.allowCryptoJDefaultPRNG=true.>
<Apr 1, 2021 10:02:29 PM CEST> <Info> <Security> <BEA-090908> <Using the default WebLogic SSL Hostname Verifier implementation.>
Traceback (innermost last):
File "<console>", line 1, in ?
File "<iostream>", line 19, in connect
File "<iostream>", line 552, in raiseWLSTException
WLSTException: Error occurred while performing connect : Cannot connect via t3s or https. If using demo certs, verify that the -Dweblogic.security.TrustKeyStore=DemoTrust system property is set. : t3s://ora-cloud-control.localdomain:7102: Destination 127.0.0.1, 7102 unreachable; nested exception is:
javax.net.ssl.SSLHandshakeException: General SSLEngine problem; No available router to destination
Use dumpStack() to view the full stacktrace :

dumpStack follows:

wls:/offline> dumpStack()
This Exception occurred at Thu Apr 01 22:02:30 CEST 2021.
javax.naming.CommunicationException: t3s://ora-cloud-control.localdomain:7102: Destination 127.0.0.1, 7102 unreachable; nested exception is:
javax.net.ssl.SSLHandshakeException: General SSLEngine problem; No available router to destination [Root exception is java.net.ConnectException: t3s://ora-cloud-control.localdomain:7102: Destination 127.0.0.1, 7102 unreachable; nested exception is:
javax.net.ssl.SSLHandshakeException: General SSLEngine problem; No available router to destination]
at weblogic.jndi.internal.ExceptionTranslator.toNamingException(ExceptionTranslator.java:40)
at weblogic.jndi.WLInitialContextFactoryDelegate.toNamingException(WLInitialContextFactoryDelegate.java:808)
at weblogic.jndi.WLInitialContextFactoryDelegate.getInitialContext(WLInitialContextFactoryDelegate.java:363)
at weblogic.jndi.Environment.getContext(Environment.java:319)
at weblogic.jndi.Environment.getContext(Environment.java:288)
at weblogic.jndi.WLInitialContextFactory.getInitialContext(WLInitialContextFactory.java:117)
at javax.naming.spi.NamingManager.getInitialContext(NamingManager.java:684)
at javax.naming.InitialContext.getDefaultInitCtx(InitialContext.java:307)
at javax.naming.InitialContext.init(InitialContext.java:242)
at javax.naming.InitialContext.<init>(InitialContext.java:216)
at weblogic.management.scripting.WLSTHelper.populateInitialContext(WLSTHelper.java:519)
at weblogic.management.scripting.WLSTHelper.initDeprecatedConnection(WLSTHelper.java:570)
at weblogic.management.scripting.WLSTHelper.initConnections(WLSTHelper.java:310)
at weblogic.management.scripting.WLSTHelper.connect(WLSTHelper.java:200)
at weblogic.management.scripting.WLScriptContext.connect(WLScriptContext.java:67)
at weblogic.management.scripting.utils.WLSTUtil.initializeOnlineWLST(WLSTUtil.java:188)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.python.core.PyReflectedFunction.__call__(Unknown Source)
at org.python.core.PyMethod.__call__(Unknown Source)
at org.python.core.PyObject.__call__(Unknown Source)
at org.python.core.PyObject.invoke(Unknown Source)
at org.python.pycode._pyx7.connect$1(<iostream>:13)
at org.python.pycode._pyx7.call_function(<iostream>)
at org.python.core.PyTableCode.call(Unknown Source)
at org.python.core.PyTableCode.call(Unknown Source)
at org.python.core.PyTableCode.call(Unknown Source)
at org.python.core.PyFunction.__call__(Unknown Source)
at org.python.pycode._pyx87.f$0(<console>:1)
at org.python.pycode._pyx87.call_function(<console>)
at org.python.core.PyTableCode.call(Unknown Source)
at org.python.core.PyCode.call(Unknown Source)
at org.python.core.Py.runCode(Py.java:1226)
at org.python.core.Py.exec(Py.java:1252)
at org.python.util.PythonInterpreter.exec(Unknown Source)
at org.python.util.InteractiveInterpreter.runcode(Unknown Source)
at org.python.util.InteractiveInterpreter.runsource(Unknown Source)
at org.python.util.InteractiveInterpreter.runsource(Unknown Source)
at weblogic.management.scripting.utils.WLSTInterpreter.runsource(WLSTInterpreter.java:910)
at weblogic.management.scripting.WLST.main(WLST.java:217)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at weblogic.WLST.main(WLST.java:29)
Caused by: java.net.ConnectException: t3s://ora-cloud-control.localdomain:7102: Destination 127.0.0.1, 7102 unreachable; nested exception is:
javax.net.ssl.SSLHandshakeException: General SSLEngine problem; No available router to destination
at weblogic.rjvm.RJVMFinder.findOrCreateInternal(RJVMFinder.java:241)
at weblogic.rjvm.RJVMFinder.findOrCreate(RJVMFinder.java:169)
at weblogic.rjvm.ServerURL.findOrCreateRJVM(ServerURL.java:177)
at weblogic.jndi.WLInitialContextFactoryDelegate$1.run(WLInitialContextFactoryDelegate.java:342)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:146)
at weblogic.jndi.WLInitialContextFactoryDelegate.getInitialContext(WLInitialContextFactoryDelegate.java:337)
... 44 more
Caused by: java.rmi.ConnectException: Destination 127.0.0.1, 7102 unreachable; nested exception is:
javax.net.ssl.SSLHandshakeException: General SSLEngine problem; No available router to destination
at weblogic.rjvm.ConnectionManager.bootstrap(ConnectionManager.java:489)
at weblogic.rjvm.ConnectionManager.bootstrap(ConnectionManager.java:327)
at weblogic.rjvm.RJVMManager.findOrCreateRemoteInternal(RJVMManager.java:309)
at weblogic.rjvm.RJVMManager.findOrCreate(RJVMManager.java:213)
at weblogic.rjvm.RJVMFinder.findOrCreateRemoteServer(RJVMFinder.java:263)
at weblogic.rjvm.RJVMFinder.findOrCreateInternal(RJVMFinder.java:225)
... 50 more

javax.naming.CommunicationException: t3s://ora-cloud-control.localdomain:7102: Destination 127.0.0.1, 7102 unreachable; nested exception is:
javax.net.ssl.SSLHandshakeException: General SSLEngine problem; No available router to destination [Root exception is java.net.ConnectException: t3s://ora-cloud-control.localdomain:7102: Destination 127.0.0.1, 7102 unreachable; nested exception is:
javax.net.ssl.SSLHandshakeException: General SSLEngine problem; No available router to destination]
wls:/offline>

I have tried three things to resolve the issue according to what I have found browsing the web:

-appending **-Dweblogic.security.TrustKeyStore=DemoTrust** to JAVA_OPTIONS string in /u01/app/oracle/gc_inst/user_projects/domains/GCDomain/bin/startWebLogic.sh file

-extracting the SSL certificate from https://ora-cloud-control.localdomain:7803 and importing it into the following keystores using [[https://stackoverflow.com/questions/11617210/how-to-properly-import-a-selfsigned-certificate-into-java-keystore-that-is-avail][1]](https://stackoverflow.com/questions/11617210/how-to-properly-import-a-selfsigned-certificate-into-java-keystore-that-is-avail][1]) as a reference:

/u01/app/oracle/middleware/oracle_common/jdk/jre/lib/security/cacerts

/u01/app/oracle/middleware/wlserver/server/lib/cacerts

/u01/app/oracle/agent/agent_13.3.0.0.0/oracle_common/jdk/jre/lib/security/cacerts

-importing the same certificate into /u01/app/oracle/middleware/wlserver/server/lib/DemoTrust.jks trustore

I have tried to restart the whole OMS stack after each of the actions described above but with no luck, still getting the very same error message :-(

Any ideas please?

Kind regards,
Michal

This post has been answered by User_O496V on Apr 16 2021

Jump to Answer

Hoek

Just use the search box on the upper left on this page: Oracle Database Online Documentation 11g Release 2 (11.2)

Frank Kulash

Hi,

Post your answers, and specific questions about them. (For example, if you're not sure what the question means, or how to find the answer, or if your answer really applies to all situations).

Let's take the last question you posted, for example:
"39. how many hints are there provided by oracle?"

You might wonder if they really expect an exact number, or if an approximation is good enough. You might not know which manual contains the answer, or what keyword(s) to look up in the index to find the answer.

SomeoneElse

> please give me the answers for all.

You're kidding, right?

Chris Hunt

Please give me the answers for all.

Sure. Please give me all the money you get from the job, since it's me that'll be answering all the interview questions.

SomeoneElse

Actually, if I were to present these questions to a potential candidate the answer I'd want to hear is "wow, what a bunch of shitty questions".

3 people found this helpful

Frank Kulash

Hi,

SomeoneElse wrote:

Actually, if I were to present these questions to a potential candidate the answer I'd want to hear is "wow, what a bunch of shitty questions".

Not entirely.

Some certainly are poor questions. Some require clarification; they might have meant something reasonable.

Some aren't bad interview questions. For example:

"6. what is mutating table error? how can you solve that problem?"

I think this question is okay. It is a common enough problem; and there are different ways (some good, some terrible) to deal with the problem. How the candidate answers this question can tell you a lot about the candidate's experience and intelligence.

Hoek

Yup, most of those questions are outdated, from the previous century, or badly phrased....now "shall we create a table in the procedure"?

Mike Kutz

SomeoneElse

I partly agree with you, but I'd be more interested in hearing the person's reason on why they are bad questions.

On the other hand, if a person with zero(0) knowledge asks the questions, the local guru can then judge the candidate's capability of communicating Oracle concepts (to others) based on how much the interviewee has learned.

In that sense, the questions are perfect.

(except some of the syntax related ones)

1 person found this helpful

bandarupalli

yes these bunch of shitty questions are been asked by the interviewers....

because people like me are kids and people like you are dinosaurs in sql,pl/sql i thought...

but this is the platform which is connecting masters like you and learners like me so i'm requesting you to get answered ....

please help us .. if you can...

thanks in advance

SomeoneElse

> learners like me so i'm requesting you to get answered ....

OK, but are you really interested in learning or just memorizing some answers to get through the next interview?

EdStevens

Where did you get this list?

A good interviewer doesn't necessarily ask questions as if it is a multiple choice or true/false test, but rather to see how the interviewee handles the question ... they aren't looking to see if you have a memorized answer but rather to evaluate how you go about solving a problem or if you are at least familiar with the resources available to help solve a problem. I've even been known to pose a question that implies/assumes a falsehood, specifically to see if the candidate could catch it or if they would try to blow smoke.

It should be perfectly acceptable to respond with "that is a detail I can look up in <name the manual> when needed."

=================================================

Learning how to look things up in the documentation is time well spent investing in your career. To that end, you should drop everything else you are doing and do the following:

Go to docs.oracle.com.

Locate the link for your Oracle product and version, and click on it.

You are now at the entire documentation set for your selected Oracle product and version.

BOOKMARK THAT LOCATION

Spend a few minutes just getting familiar with what is available here. Take special note of the "books" and "search" tabs. Under the "books" tab (for 10.x) or the "Master Book List" link (for 11.x) you will find the complete documentation library.

Spend a few minutes just getting familiar with what kind of documentation is available there by simply browsing the titles under the "Books" tab.

Open the Reference Manual and spend a few minutes looking through the table of contents to get familiar with what kind of information is available there.

Do the same with the SQL Reference Manual.

Do the same with the Utilities manual.

You don't have to read the above in depth. They are reference manuals. Just get familiar with what is there to be referenced. Ninety percent of the questions asked on this forum can be answered in less than 5 minutes by simply searching one of the above manuals.

Then set yourself a plan to dig deeper.

- *Read a chapter a day from the Concepts Manual*.

- Take a look in your alert log. One of the first things listed at startup is the initialization parms with non-default values. Read up on each one of them (listed in your alert log) in the Reference Manual.

- Take a look at your listener.ora, tnsnames.ora, and sqlnet.ora files. Go to the Network Administrators manual and read up on everything you see in those files.

- *When you have finished reading the Concepts Manual, do it again*.

Give a man a fish and he eats for a day. Teach a man to fish and he eats for a lifetime.

=================================

5 people found this helpful

bandarupalli

i wanna know them not answers but the concepts ....

reading some hundreds of pages is different to get explained..

i thought it was the right platform to learn, it is not big deal of interview but they are not getting satisfied with my answers because i have to learn something else not from books...

thats why i put almost all questions( even silly ones)

Thankyou

Frank Kulash

Hi,

This forum is a great place for people to ask questions and get them answered. That doesn't mean it's the best place to get all questions answered. Forums like this work best for specific, focused questions. I gave some examples earlier of some specific, focused things you might ask about those interview questions. "Answer these 39 questions." isn't a specific, focused question. For one thing, it invites answers that cover things you already know, and don't help with what you need to learn. Some examples of specific focused questions that can help you learn are:

"When they ask ... do they mean ... or do they mean ...?"
"For this interview question ...is this a good answer: ...? I'm not confident about ..."
"How would I find the answer to ...? What buzzwords whould I look for?"
"For this interview question ... I looked up ... where it says... Is that right? It seems wrong to me because ..."
"Why would they ask something like ... on an interview? Are they looking for an aswere such as ...?"
"Where can I learn more about ...? I tried ... but ..."

Most people who answer questions on this forum are interested in helping you learn. "If you give a man he fish, he will eat for a single day. If you show him how to fish, he may eat for a lifetime." Many people whould add "If you beat him over the head with a fish, he'll quit asking you for handouts."

2 people found this helpful

Billy Verreynne

bandarupalli wrote:

yes these bunch of shitty questions are been asked by the interviewers....

because people like me are kids and people like you are dinosaurs in sql,pl/sql i thought...

but this is the platform which is connecting masters like you and learners like me so i'm requesting you to get answered ....

please help us .. if you can...

thanks in advance

The questions are shitty because.. well they are. They do not measure PL/SQL or Oracle expertise in any way. Here's my answers to a few of these interview questions.

5. what is the third parameter of the raise_application_error()?

Look it up in the fricken manual idiot. Besides. not wrapping a system call like that in an application wrapper is the problem.

6. what is mutating table error? how can you solve that problem?

The problem is solved by putting brain in gear before doing a physical database design of the logical data model, instead of using triggers as sticky tape to glue cr@p together.

27. shall we create a table in the package?

Yes we can - as all packages are not application interfaces and an API can be a system level API and deal with data management. There are no such rule of "Thou shalt not use DDL in PL/SQL", except for in the mind of the ignorant.

And this is why the questions are shitty. It pretend to measure expertise, but are horribly flawed as these questions are based on assumptions and exceptions, and presuppositions, with a poor understanding of what technical expertise is, and a very limited understanding of actual Oracle technologies.

In other words, these are random interview questions pulled from blogs about Oracle and Oracle related problems - and not even good blogs... (never mind using the fricken Concepts Guide to probe the understanding of the person being interviewed of Oracle fundamentals).

I would not take kindly to being asked such questions in an interview.

1 person found this helpful

BluShadow

Billy, you're hired!

Billy Verreynne

The single most critical question - what is the availability of filter coffee at workplace like? And if not 99.9999% during the hours of 6AM to 4PM, then no thanks.

BluShadow

Each department has it's own kitchen so you can make whatever drinks you like for yourself.

Plus the canteen has a Costa (lotta) Coffee facility.

Me personally, I'm not a coffee drinker.

1 - 17

Added on Apr 3 2021

#enterprisemanager, #java, #ssl, #weblogic

1 comment

1,741 views

Enterprise Manager

Oracle Cloud Control 13.3, Cannot Connect to Weblogic admin server

Comments

Post Details