How can I move OBIEE 12C BI server from Starting in ADMIN mode to RUNNING

Martijn Ceelen, iConsultancy, OBIEE Consultant · Sep 15, 2017 6:10PM

Last week (5th of september) we succesfully deployed a new rpd and catalog with a BAR file, switching from our Oracle 10 Database to Oracle 12 Database (on a OBIEE12 linux production server working smoothly for 3 months)

- For 3 days, we had no problems and the system was working fine with the new database connections

- Saturday 9th of september we restarted web logic after deploying some customMessages files

- Since than the Bi server does not leave the ADMIN mode.

- We have tried lots of things, and finally restored the VMWare backup of Friday and than wednesday, nothing helped.

- We also tried to deploy an rpd with initilization blocks disabled, without any succes.

Can anybody give me a clue on how to prcoeed ?

Business Intelligence Server Enterprise Edition
Product Version	12.2.1.1.0
Operating System	Linux x86-64
OS Version	SLES-12

Information From the bi_server1.log

####<Sep 12, 2017, 4:56:05,982 PM CEST> <Info> <Deployer> <XXXXXX> <bi_server1> <[ACTIVE] ExecuteThread: '21' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <3d8b6d10-0ec6-43a6-af4b-0237fc199824-00000043> <1505228165982> <[severity-value: 64] [rid: 0] [partition-id: 0] [partition-name: DOMAIN] > <BEA-149060> <Module empty.jar of application analytics successfully transitioned from STATE_PREPARED to STATE_NEW on server bi_server1.>

####<Sep 12, 2017, 4:56:06,45 PM CEST> <Error> <Deployer> <XXXXXX> <bi_server1> <[ACTIVE] ExecuteThread: '21' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <3d8b6d10-0ec6-43a6-af4b-0237fc199824-00000043> <1505228166045> <[severity-value: 8] [rid: 0] [partition-id: 0] [partition-name: DOMAIN] > <BEA-149205> <Failed to initialize the application "analytics" due to error weblogic.utils.ErrorCollectionException:

There are 2 nested errors:

java.lang.OutOfMemoryError: Java heap space

at java.util.ArrayList.<init>(ArrayList.java:152)

at weblogic.application.utils.annotation.ClassInfoImpl.readClassNameList(ClassInfoImpl.java:310)

at weblogic.application.utils.annotation.ClassInfoImpl.readExternal(ClassInfoImpl.java:287)

at weblogic.application.utils.annotation.ClassfinderClassInfos$Cache.readInfos(ClassfinderClassInfos.java:746)

at weblogic.application.utils.annotation.ClassfinderClassInfos$Cache.access$500(ClassfinderClassInfos.java:731)

at weblogic.application.utils.annotation.ClassfinderClassInfos.readExternal(ClassfinderClassInfos.java:547)

at java.io.ObjectInputStream.readExternalData(ObjectInputStream.java:1849)

at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1806)

at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1353)

at java.io.ObjectInputStream.readObject(ObjectInputStream.java:373)

at weblogic.application.metadatacache.PersistentMetadataEntry.readObject(PersistentMetadataEntry.java:29)

at weblogic.application.metadatacache.Cache.lookupCachedObject(Cache.java:168)

at weblogic.application.metadatacache.Cache.initCache(Cache.java:91)

at weblogic.application.utils.annotation.ClassInfoFinderFactory.newInstance(ClassInfoFinderFactory.java:192)

at weblogic.servlet.internal.War.initializeClassInfosIfNecessary(War.java:477)

at weblogic.servlet.internal.War.getHandlesImpls(War.java:437)

at weblogic.jaxrs.server.extension.DeployHelper.isJaxRsApplication(DeployHelper.java:63)

at weblogic.jaxrs.server.extension.DeployHelper.isJaxRsApplication(DeployHelper.java:50)

at weblogic.jaxrs.server.extension.JaxRsModuleExtensionFactory.create(JaxRsModuleExtensionFactory.java:49)

at weblogic.application.internal.ExtensibleModuleWrapper.createModuleExtensions(ExtensibleModuleWrapper.java:264)

at weblogic.application.internal.ExtensibleModuleWrapper.initDrivenObjectArray(ExtensibleModuleWrapper.java:232)

at weblogic.application.internal.ExtensibleModuleWrapper.prepare(ExtensibleModuleWrapper.java:107)

at weblogic.application.internal.flow.ModuleListenerInvoker.prepare(ModuleListenerInvoker.java:100)

at weblogic.application.internal.flow.ModuleStateDriver$1.next(ModuleStateDriver.java:192)

at weblogic.application.internal.flow.ModuleStateDriver$1.next(ModuleStateDriver.java:187)

at weblogic.application.utils.StateMachineDriver$ParallelChange.run(StateMachineDriver.java:83)

at weblogic.work.ContextWrap.run(ContextWrap.java:46)

at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:666)

at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:348)

at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:333)

at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:54)

at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)

and