E-Business Suite

Announcement

For appeals, questions and feedback about Oracle Forums, please email oracle-forums-moderators_us@oracle.com. Technical questions should be asked in the appropriate category. Thank you!

Urgent FS_CLONE Failed R12.2.7

RamarajuApr 23 2019 — edited Feb 9 2021

EBS R12.2.7 & DB: 12.1.0.2

We do not have appl directory under fs2/EBSapps/

FS_CLONE failed with following error.

[oracle@dev APPS(fs1)-DEV EBSapps]$ adop phase=fs_clone

Enter the APPS password:

Enter the SYSTEM password:

Enter the WLSADMIN password:

Validating credentials.

Initializing.

Run Edition context : /u01/app/oracle/apps/fs1/inst/apps/DEV_dev/appl/admin/DEV_dev.xml

Patch edition context: /u01/app/oracle/apps/fs2/inst/apps/DEV_dev/appl/admin/DEV_dev.xml

Patch file system free space: 379.42 GB

Validating system setup.

Node registry is valid.

[WARNING] SYS.DUAL table has incorrect privileges

Shut down the application tier services and then run the following commands in the order shown

sqlplus apps/<APPS_Password> @ $AD_TOP/patch/115/sql/ADFIXUSER.sql

sqlplus apps/<APPS_Password> @ $AD_TOP/sql/adutlrcmp.sql

Checking for existing adop sessions.

No pending session exists.

Starting new adop session.

===========================================================================

ADOP (C.Delta.10)

Session ID: 90

Node: dev

Phase: fs_clone

Log: /u01/app/oracle/apps/fs_ne/EBSapps/log/adop/90/20190423_050918/adop.log

===========================================================================

Validating configuration on node: [dev].

Log: /u01/app/oracle/apps/fs_ne/EBSapps/log/adop/90/20190423_050918/fs_clone/validate/dev

[WARNING]: There could be issues while validating the ports used for E-Business Suite instance against ports used in /etc/services. Refer the log file for more details.

[WARNING]: Found invalid cross references in OHS config files.

[WARNING]: Found invalid cross references in node manager and domain config files.

Checking for pending cleanup actions.

No pending cleanup actions found.

Blocking managed server ports.

Log: /u01/app/oracle/apps/fs_ne/EBSapps/log/adop/90/20190423_050918/fs_clone/dev/txkCloneAcquirePort.log

Performing CLONE steps.

Log: /u01/app/oracle/apps/fs_ne/EBSapps/log/adop/90/20190423_050918/fs_clone/dev

Beginning application tier FSCloneApply - Tue Apr 23 05:13:53 2019

/u01/app/oracle/apps/fs1/EBSapps/comn/adopclone_dev/FMW/t2pjdk/bin/java -Xmx600M -DCONTEXT_VALIDATED=false -Doracle.installer.oui_loc=/oui -classpath /u01/app/oracle/apps/fs1/EBSapps/comn/adopclone_dev/jlib/xmlparserv2.jar:/u01/app/oracle/apps/fs1/EBSapps/comn/adopclone_dev/jlib/ojdbc6.jar:/u01/app/oracle/apps/fs1/EBSapps/comn/adopclone_dev/jlib/java:/u01/app/oracle/apps/fs1/EBSapps/comn/adopclone_dev/jlib/oui/OraInstaller.jar:/u01/app/oracle/apps/fs1/EBSapps/comn/adopclone_dev/jlib/oui/ewt3.jar:/u01/app/oracle/apps/fs1/EBSapps/comn/adopclone_dev/jlib/oui/share.jar:/u01/app/oracle/apps/fs1/FMW_Home/webtier/../Oracle_EBS-app1/oui/jlib/srvm.jar:/u01/app/oracle/apps/fs1/EBSapps/comn/adopclone_dev/jlib/ojmisc.jar:/u01/app/oracle/apps/fs1/FMW_Home/wlserver_10.3/server/lib/weblogic.jar:/u01/app/oracle/apps/fs1/EBSapps/comn/adopclone_dev/jlib/obfuscatepassword.jar oracle.apps.ad.clone.FSCloneApplyAppsTier -e /u01/app/oracle/apps/fs1/inst/apps/DEV_dev/appl/admin/DEV_dev.xml -targ /u01/app/oracle/apps/fs2/inst/apps/DEV_dev/appl/admin/DEV_dev.xml -stage /u01/app/oracle/apps/fs1/EBSapps/comn/adopclone_dev -tmp /tmp -nodbac -component appsTier -nopromptmsg

Log file located at /u01/app/oracle/apps/fs1/inst/apps/DEV_dev/admin/log/clone/FSCloneApplyAppsTier_04230513.log

Enabling EBS_LOGON trigger

ERROR while running FSCloneApply...

Tue Apr 23 05:14:50 2019

*******FATAL ERROR*******

PROGRAM : (/u01/app/oracle/apps/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl)

TIME : Tue Apr 23 05:14:50 2019

FUNCTION: main::runFSCloneApply [ Level 1 ]

ERRORMSG: /u01/app/oracle/apps/fs1/EBSapps/comn/adopclone_dev/bin/adclone.pl did not go through successfully.

[UNEXPECTED]Error occurred running "perl /u01/app/oracle/apps/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/u01/app/oracle/apps/fs1/inst/apps/DEV_dev/appl/admin/DEV_dev.xml -patchcontextfile=/u01/app/oracle/apps/fs2/inst/apps/DEV_dev/appl/admin/DEV_dev.xml -promptmsg=hide -console=off -mode=create -sync_mode=copy -sessionid=90 -timestamp=20190423_050918 -outdir=/u01/app/oracle/apps/fs_ne/EBSapps/log/adop/90/20190423_050918/fs_clone/dev"

[UNEXPECTED]occurred during CLONE Patch File System from Run File System, running command: "perl /u01/app/oracle/apps/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl -contextfile=/u01/app/oracle/apps/fs1/inst/apps/DEV_dev/appl/admin/DEV_dev.xml -patchcontextfile=/u01/app/oracle/apps/fs2/inst/apps/DEV_dev/appl/admin/DEV_dev.xml -promptmsg=hide -console=off -mode=create -sync_mode=copy -sessionid=90 -timestamp=20190423_050918 -outdir=/u01/app/oracle/apps/fs_ne/EBSapps/log/adop/90/20190423_050918/fs_clone/dev".

Releasing managed server ports.

Log: /u01/app/oracle/apps/fs_ne/EBSapps/log/adop/90/20190423_050918/fs_clone/dev/txkCloneAcquirePort.log

Stopping services on patch file system.

Stopping admin server.

You are running adadminsrvctl.sh version 120.10.12020000.10

Environment file /u01/app/oracle/apps/fs2/EBSapps/appl/APPSDEV_dev.env is not found.

/u01/app/oracle/apps/fs2/inst/apps/DEV_dev/admin/scripts/adadminsrvctl.sh: line 161: $LOGFILE: ambiguous redirect

[UNEXPECTED]Error occurred running "sh /u01/app/oracle/apps/fs2/inst/apps/DEV_dev/admin/scripts/adadminsrvctl.sh stop -nopromptmsg"

[UNEXPECTED]Error running adadminsrvctl command

[STATEMENT] Please run adopscanlog utility, using the command

"adopscanlog -latest=yes"

to get the list of the log files along with snippet of the error message corresponding to each log file.

adop exiting with status = 2 (Fail)

real 5m33.467s

user 1m35.822s

sys 0m12.703s

[oracle@dev APPS(fs1)-DEV EBSapps]$ adopscanlog -latest=yes

Scanning /u01/app/oracle/apps/fs_ne/EBSapps/log/adop/90/ directory ...

/u01/app/oracle/apps/fs_ne/EBSapps/log/adop/90/20190423_050918/fs_clone/dev/TXK_SYNC_create/txkADOPPreparePhaseSynchronize.log:

-------------------------------------------------------------------------------------------------------------------------------------

Lines #(312-314):

TIME : Tue Apr 23 05:14:50 2019

FUNCTION: main::runFSCloneApply [ Level 1 ]

ERRORMSG: /u01/app/oracle/apps/fs1/EBSapps/comn/adopclone_dev/bin/adclone.pl did not go through successfully.

/u01/app/oracle/apps/fs_ne/EBSapps/log/adop/90/20190423_050918/fs_clone/dev/TXK_SYNC_create/fsclone_apply/FSCloneApplyAppsTier_04230513.log:

--------------------------------------------------------------------------------------------------------------------------------------------------

Lines #(164-168):

ERROR: RC-50410: Fatal: OUI Registration failed with an Abnormal Termination error during call from ouicli.pl. Please check the log file /u01/app/oracle/apps/fs2/inst/apps/DEV_dev/admin/log/ohclone.log for more details.

Raised by oracle.apps.ad.clone.ApplyAppsTechStack

Lines #(167-171):

Raised by oracle.apps.ad.clone.ApplyAppsTechStack

WARNING: RC-50208: Warning: Exception in method deepOUICheck

instantiate file:

Lines #(214-221):

AutoConfig is exiting with status 1

ERROR: RC-50013: Fatal: Instantiate driver did not complete successfully.

/u01/app/oracle/apps/fs2/EBSapps/10.1.2/appsutil/driver/regclone.drv

ERROR: RC-50004: Fatal: Error occurred in ApplyAppsTechStack:

RC-50013: Fatal: Failed to instantiate driver /u01/app/oracle/apps/fs2/EBSapps/10.1.2/appsutil/driver/regclone.drv

START: Inside exitClone....

/u01/app/oracle/apps/fs_ne/EBSapps/log/adop/90/20190423_050918/adop.log:

------------------------------------------------------------------------

Lines #(109-114):

[PROCEDURE] Calling: /u01/app/oracle/apps/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl

[EVENT] Log: /u01/app/oracle/apps/fs_ne/EBSapps/log/adop/90/20190423_050918/fs_clone/dev

[EVENT] Releasing managed server ports.

[PROCEDURE] [START 2019/04/23 05:14:50] Releasing ports

Lines #(130-135):

[PROCEDURE] [START 2019/04/23 05:14:51] Check and stop patch Admin Server

[PROCEDURE] [START 2019/04/23 05:14:52] Check and Stop patch FS Admin Server

[UNEXPECTED]Error occurred running "sh /u01/app/oracle/apps/fs2/inst/apps/DEV_dev/admin/scripts/adadminsrvctl.sh stop -nopromptmsg"

[UNEXPECTED]Error running adadminsrvctl command

[PROCEDURE] [START 2019/04/23 05:14:52] Unlocking sessions table

[STATEMENT] Unlocking ad_adop_sessions table for dev with wait interval of 60 seconds and number of tries 2

Thanks,

Ramaraju

This post has been answered by Ramaraju on Apr 30 2019

Jump to Answer

Gaz in Oz

What is your perl version?

What is your Oracle database version?

What is your Oracle:::DBD version?

What tool did you use to come to the conclusion that "empty parameter is passed to function"?

How are you declaring the 2MB "string" that you pass to function?

Does your function have an EXCEPTION block that swallows Oracle errors?

Please create a simple, small code snippet that reproduces the problem and can be run by others to help analyse the issue...

1 person found this helpful

Billy Verreynne

Likely caused by not explicitly treating the bind variable explicitly as a CLOB, in Perl.

Keep in mind that a LOB variable is actually a locator (pointer) variable.

1 person found this helpful

2810868

Hi Gaz in Oz.

Thanks for replying. Much apologize for incomplete definition.

1. What is your perl version?

Will update as soon as will get information from Perl developers.

2. What is your Oracle database version?

11.2.0.4 EE.

3. What is your Oracle:::DBD version?

Will update as soon as will get information from Perl developers.

4. What tool did you use to come to the conclusion that "empty parameter is passed to function"?

As was_captured column in v$sql_bind_capture shown 'NO' for query passed from Perl we captured traffic with tcpdump and calculated size of the parameter in test function.

In case of passing value to function (through binding in Perl) it was 0 and 0 respectively.

In case of inserting value into the table (through binding in Perl) value presented in tcpdump output and correct length of the variable in test function.

5. How are you declaring the 2MB "string" that you pass to function?

In PL/SQL function it was declared as clob. In Perl variable was declared as described in https://metacpan.org/pod/DBD::Oracle#Binding-for-Updates-and-Inserts-for-CLOBs-and-BLOBs (adapted to our case)

my $in_blob = <was passed from simple Web interface>;

$SQL='insert into test_lob3@tpgtest (id,clob1,clob2, blob1,blob2) values(?,?,?,?,?)';

$sth=$dbh->prepare($SQL );

$sth->bind_param(1,3);

$sth->bind_param(2,$in_clob,{ora_type=>SQLT_CHR});

$sth->bind_param(3,$in_clob,{ora_type=>SQLT_CHR});

$sth->bind_param(4,$in_blob,{ora_type=>SQLT_BIN});

$sth->bind_param(5,$in_blob,{ora_type=>SQLT_BIN});

$sth->execute();

6. Does your function have an EXCEPTION block that swallows Oracle errors?

No at a moment. But an error was in the tcpdump. If I correctly recall it was ora-01403 no data found.

Please create a simple, small code snippet that reproduces the problem and can be run by others to help analyse the issue...

PL/SQL part:

create table tmp_tmp (

str clob

);

create or replace function fn_HDedup_Start (

s_Id in varchar2,

s_Time in varchar2,

c_Str in clob

) return integer

authid definer

pragma autonomous_transaction;

begin

insert

into tmp_tmp

values (c_Str);

return 0;

end fn_HDedup_Start;

I will upload Perl code when get it from Perl developers.

2810868

Hi Billy~Verreynne.

Thanks for replying.

Billy~Verreynne wrote:

Likely caused by not explicitly treating the bind variable explicitly as a CLOB, in Perl.

Keep in mind that a LOB variable is actually a locator (pointer) variable.

Perl developers used https://metacpan.org/pod/DBD::Oracle#Binding-for-Updates-and-Inserts-for-CLOBs-and-BLOBs to code Perl part. The disappointing thing for us is that we were able to pass clob value on insert but same technique used to pass value to the function failed.

Cookiemonster76

Not your current problem, but you'll hit it when you fix your current problem:

Autonomous transactions need to end with either commit or rollback. If they don't oracle will throw an error.

Your function has neither.

1 person found this helpful

2810868

You are absolutely correct Cookiemonster76.

Original code does have commit at the end. I cut too much preparing code snippet. Sorry for confusing.

2810868

1. v5.16.3,

RHEL 7.4 (Maipo), 2.6.9-89.0.0.0.1.ELxenU

2. Instant client : 11.2.0.3.0

$DBD::Oracle::VERSION = '1.74';

DBI version $VERSION = "1.637"

5. Perl code:

foreach my $parameter (@parameter_names) {

if ($parameter_type =~ /clob/i) {

eval {

$sth->bind_param(':' . $parameter, $parameters{$parameter}, {ora_type=>ORA_CLOB})

};

}

elsif ($parameter_type =~ /blob/i) {

eval {

$sth->bind_param(':' . $parameter, $parameters{$parameter}, {ora_type=>ORA_BLOB})

};

}

else {

eval {

$sth->bind_param(':' . $parameter, $parameters{$parameter})

};

}

If works for insert but does not work for function.

Code from the reference did not work for us for both insert and pass.

Working code:

insert into test_table values(:str_clob);

Code that does not work:

SELECT remaining_id FROM TABLE(

fn_function(:id,:time_stamp,:str_clob)

)

6. Perl snippet:

if ($max_clob_length == 0) {

$sth = $dbh->prepare($query_configuration->{'query'})

or return $this->_process_error('DB', $DBI::errstr);

}

else {

$dbh->{LongReadLen} = $max_clob_length;

$sth = $dbh->prepare($query_configuration->{'query'}, {ora_pers_lob=>1})

or return $this->_process_error('DB', $DBI::errstr);

}

foreach my $parameter (@parameter_names) {

if ($parameters_type{$parameter} =~ /^clob$/i) {

eval {

$sth->bind_param(':' . $parameter, $parameters{$parameter}, {ora_type=>ORA_CLOB})

};

}

elsif ($parameters_type{$parameter} =~ /^blob$/i) {

eval {

$sth->bind_param(':' . $parameter, $parameters{$parameter}, {ora_type=>ORA_BLOB})

};

}

else {

eval {

$sth->bind_param(':' . $parameter, $parameters{$parameter})

};

}

return $this->_process_error($@) if $@;

}

unless ($sth->execute()) {

my $errstr = $DBI::errstr;

$dbh->rollback;

return $this->_process_error('DB', $errstr);

}

Cookiemonster76

The problem is probably in the perl side, and quite probably in the code you omitted.

Simplify things and build up.

Can you get a function with a single varchar2 parameter to work?

If you can try a single clob parameter (so no other parameters)

then add the other parameters.

2810868

It works as expected when we are passing varchar from Perl side (it was clob in Oracle side). But in this case the limit is 4000 symbols only that is not enough for us.

We simplified code on both sides just to call function on Perl side and print length of the variable passed on the Oracle side. Unfortunately that did not work.

Cookiemonster76

So post a full set of perl code that works, a full set of perl code that doesn't work and the error message.

You're giving us lots of code snippets that don't add up to a complete picture.

2810868

Finally it was a time of the source code. According with Perl developer's investigation looks clob could be passed only for insert/update statements. For function it is expected to have begin : p := f(:clob) end construction.

1 - 11

Added on Apr 23 2019

#general-ebs-discussion

5 comments

1,319 views

E-Business Suite

Urgent FS_CLONE Failed R12.2.7

Comments

Post Details