1 Reply Latest reply on Aug 22, 2019 2:51 PM by Akocic-Oracle

    Oracle Stream Analytics 18.1.0.0.0 OSA-01265 Pipeline deployment has failed.

    VitalyVer

      Hello!

       

      I have Cloudera CDH 6.2. and OSA 18.1.0.0.0.

      When I try to deploy Pipeline  I have the following error:

       

      16:33:35 INFO  StreamingRuntimeSpark:206 - ----------------------------------------------------------------

      16:33:35 INFO  StreamingRuntimeSpark:225 - Fresh deployment for sx_MyPipe_8F189FEF_77BD_4E4D_9BE6_4D97496EE0BD_6FBZw0wt_draft

      16:33:35 INFO  FileSystemUtils:307 - CRC for /opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/spark/jars: bf8a12dd

      16:33:35 INFO  SparkClientBase:466 - Using target folder:  hdfs://192.168.17.63:8020/spark-deploy/Q0KLk5jr/lib

      16:33:35 INFO  SparkClientBase:39 - Hadoop user was set to 'yarn' yarn (auth:SIMPLE)

      16:33:35 INFO  SparkClientBase:207 - AUTH_TYPE = simple

      16:33:35 INFO  SparkClientBase:473 - Copy skipped for existing resource: hdfs://192.168.17.63:8020/spark-deploy/Q0KLk5jr/lib/35d2dda5-spark-archive.jar

      16:33:35 INFO  SparkClientBase:466 - Using target folder:  hdfs://192.168.17.63:8020/spark-deploy/Q0KLk5jr/lib

      16:33:35 INFO  SparkClientBase:473 - Copy skipped for existing resource: hdfs://192.168.17.63:8020/spark-deploy/Q0KLk5jr/lib/fa7e9133-spark-osa.jar

      16:33:35 INFO  SparkClientBase:189 - Configuration was created as: /tmp/__osa_config__8420443592498137592.jar

      16:33:35 INFO  SparkClientBase:39 - Hadoop user was set to 'yarn' yarn (auth:SIMPLE)

      16:33:35 ERROR StreamingRuntimeSpark:271 - Starting application failed: org.apache.spark.deploy.yarn.Client.<init>(Lorg/apache/spark/deploy/yarn/ClientArguments;Lorg/apache/hadoop/conf/Configuration;Lorg/apache/spark/SparkConf;)V

      java.lang.NoSuchMethodError: org.apache.spark.deploy.yarn.Client.<init>(Lorg/apache/spark/deploy/yarn/ClientArguments;Lorg/apache/hadoop/conf/Configuration;Lorg/apache/spark/SparkConf;)V

          at oracle.wlevs.strex.spark.client.impl.SparkYarnClient.submit(SparkYarnClient.java:137) ~[?:?]

          at oracle.wlevs.strex.spark.client.spi.SparkBackend.submit(SparkBackend.java:153) ~[osa.spark-integration.client-spi.jar:12.2.1]

          at oracle.wlevs.strex.spark.client.spi.SparkBackend.submit(SparkBackend.java:135) ~[osa.spark-integration.client-spi.jar:12.2.1]

          at oracle.wlevs.strex.common.rts.spark.SXSparkAppRedeployer.deployApplication(SXSparkAppRedeployer.java:226) ~[osa.web.common.jar:12.2.1]

          at oracle.wlevs.strex.common.rts.spark.SXSparkAppRedeployer.deployApplication(SXSparkAppRedeployer.java:57) ~[osa.web.common.jar:12.2.1]

          at oracle.wlevs.strex.common.rts.spark.StreamingRuntimeSpark.deployApplication(StreamingRuntimeSpark.java:5) ~[osa.web.common.jar:12.2.1]

          at oracle.wlevs.strex.common.core.OsaApplicationManager.deployApplication(OsaApplicationManager.java:2281) ~[osa.web.common.jar:12.2.1]

          at oracle.wlevs.strex.common.core.OsaApplicationManager.access$1100(OsaApplicationManager.java:60) ~[osa.web.common.jar:12.2.1]

          at oracle.wlevs.strex.common.core.OsaApplicationManager$AsynchDeployment.fullDeploy(OsaApplicationManager.java:1227) ~[osa.web.common.jar:12.2.1]

          at oracle.wlevs.strex.common.core.OsaApplicationManager.fullDeploy(OsaApplicationManager.java:1012) ~[osa.web.common.jar:12.2.1]

          at oracle.wlevs.strex.common.core.OsaApplicationManager.access$400(OsaApplicationManager.java:60) ~[osa.web.common.jar:12.2.1]

          at oracle.wlevs.strex.common.core.OsaApplicationManager$DeploymentQueue.lambda$submitFullDeploy$2(OsaApplicationManager.java:985) ~[osa.web.common.jar:12.2.1]

          at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_181]

          at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_181]

          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_181]

          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_181]

          at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]

      16:33:35 INFO  StreamingRuntimeSpark:548 - Undeploy Spark application: 'PDeploymentInfo[id=null|appName=sx_MyPipe_8F189FEF_77BD_4E4D_9BE6_4D97496EE0BD_6FBZw0wt_draft|submissionId=null|stagingFolder=null|snapshotFolder=null|kafkaTopics=-|assignee=0]'

      16:33:35 INFO  SparkBackendContext:27 - Initializing for OSA_HOME=/u01/OSA-18.1.0.0.0/osa-base/resources, SPARK_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/spark

      16:33:35 INFO  OsaApplicationManager:1229 - Full deploy failed:

      oracle.wlevs.strex.common.errors.OSAException: OSA-01265 Pipeline deployment has failed.

          at oracle.wlevs.strex.common.rts.spark.SXSparkAppRedeployer.deployApplication(SXSparkAppRedeployer.java:274) ~[osa.web.common.jar:12.2.1]

          at oracle.wlevs.strex.common.rts.spark.SXSparkAppRedeployer.deployApplication(SXSparkAppRedeployer.java:57) ~[osa.web.common.jar:12.2.1]

          at oracle.wlevs.strex.common.rts.spark.StreamingRuntimeSpark.deployApplication(StreamingRuntimeSpark.java:5) ~[osa.web.common.jar:12.2.1]

          at oracle.wlevs.strex.common.core.OsaApplicationManager.deployApplication(OsaApplicationManager.java:2281) ~[osa.web.common.jar:12.2.1]

          at oracle.wlevs.strex.common.core.OsaApplicationManager.access$1100(OsaApplicationManager.java:60) ~[osa.web.common.jar:12.2.1]

          at oracle.wlevs.strex.common.core.OsaApplicationManager$AsynchDeployment.fullDeploy(OsaApplicationManager.java:1227) ~[osa.web.common.jar:12.2.1]

          at oracle.wlevs.strex.common.core.OsaApplicationManager.fullDeploy(OsaApplicationManager.java:1012) ~[osa.web.common.jar:12.2.1]

          at oracle.wlevs.strex.common.core.OsaApplicationManager.access$400(OsaApplicationManager.java:60) ~[osa.web.common.jar:12.2.1]

          at oracle.wlevs.strex.common.core.OsaApplicationManager$DeploymentQueue.lambda$submitFullDeploy$2(OsaApplicationManager.java:985) ~[osa.web.common.jar:12.2.1]

          at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_181]

          at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_181]

          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_181]

          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_181]

          at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]

      16:33:35 INFO  SXContext:343 - oracle.wlevs.strex.common.rts.StreamingSystem@2744890f Full deploy OsaApplicationManager.DeploymentRequest[appId=8F189FEF-77BD-4E4D-9BE6-4D97496EE0BD,editorId=385CD7D0-22AF-49F0-BC03-40C847AAA870,deploymentCounter=23] - 237ms

      16:33:35 INFO  SXContext:343 - oracle.wlevs.strex.common.rts.StreamingSystem@2744890f Fast deploy OsaApplicationManager.DeploymentRequest[appId=8F189FEF-77BD-4E4D-9BE6-4D97496EE0BD,editorId=385CD7D0-22AF-49F0-BC03-40C847AAA870,deploymentCounter=23] - 268ms

      16:33:36 INFO  JpsFilter:44 - Request: /osa/services/resources/v0.1/visualizations/fetchAll;

       

      How to solve this problem?

       

      Best regards, Vitaly