This discussion is archived
8 Replies Latest reply: Aug 6, 2013 6:12 AM by ab8926 RSS

How to find the characterset of a Lossy data mentioned in csscan, to be specific

SreeGanesh8900 Newbie
Currently Being Moderated

when we are doing csscan we used to mention from_char and to_char

 

for eg:

My database character is US7ASCII

from_char - US7ASCII to_char - US7ASCII, in the csscan i found the lossy data, that means there are some data which does not belong to the US7ASCII, so please help me to find the character set of the lossy data.

  • 1. Re: How to find the characterset of a Lossy data mentioned in csscan, to be specific
    Srini Chavali-Oracle Oracle ACE Director
    Currently Being Moderated

    Pl post OS and database versions, along with the portions of the report that show the lossy data

     

    HTH
    Srini

  • 2. Re: How to find the characterset of a Lossy data mentioned in csscan, to be specific
    SreeGanesh8900 Newbie
    Currently Being Moderated

    Database version - 11.1.0.7.0

    Application Version - 12.1.1

     

    OS version -

    Red Hat Enterprise Linux Server release 5.5 (Tikanga) 64 bit

     

    Portion of lossy data.

     

    Portion of csscan.err

     

    AACN4cAAdAAIzFLAAA lossy conversion      PARANá
    AACN4cAAdAAIzIAAAy lossy conversion      ÃSTERBRO
    AACN4cAAdAAIzMqAAs lossy conversion      A CORUÃA
    AACN4cAAdAAIzNGAAw lossy conversion      SKÃÂ¥NE
    AACN4cAAdAAIzOkAAR lossy conversion      SJÃLLAND
    AACN4cAAdAAIzQrAAa lossy conversion      SÃO PAULO
    AACN4cAAdAAIzRhAAX lossy conversion      SÃDERMANLANDS LÃ
                                                             N
    AACN4cAAdAAIzUWAAO lossy conversion      REÃACA
    AACN4cAAdAAIzVOAAQ lossy conversion      SãO PAULO
    AACN4cAAdAAIzYUAAT lossy conversion      SãO PAULOTOSÃ
    AACN4cAAdAAIzZKAAp lossy conversion      CASTILLA Y LEÃN
    AACN4cAAdAAIzZZAAh lossy conversion      NORD- TRÃNDELAG
    AACN4cAAdAAIzfmAAY lossy conversion      PARANÃ
    AACN4cAAdAAIzhdAAJ lossy conversion      VäRMLAND
    AACN4cAAdAAIzhyAAX lossy conversion      SÃO PAULO
    AACN4cAAdAAIziCAAB lossy conversion      SãO PAULO
    AACN4cAAdAAIzimAAk lossy conversion      SÃDERMANLAND
    AACN4cAAdAAIzjwAAl lossy conversion      CÃRDOBA
    AACN4cAAdAAIzkIAAZ lossy conversion      SÃO PAULO
    AACN4cAAdAAIzmyAAJ lossy conversion      SÃO PAULO
    AACN4cAAdAAIznsAAp lossy conversion      SÃO PAULO
    AACN4cAAdAAIzqqAAf lossy conversion      GRAUBüNDEN
    AACN4cAAdAAIzv2AAD lossy conversion      SWEDEN VäSTERBOTTEN
    AACN4cAAdAAIzw+AAw lossy conversion      REGIóN METROPOLITANA
    AACN4cAAdAAIzw4AAX lossy conversion     

    CÃDIZ

     

    Portion of cscscan.txt

     

    Application Data:

     

    USER.TABLE|COLUMN                                       Convertible       Truncation            Lossy

    -------------------------------------------------- ---------------- ---------------- ----------------

    AP.AP_INVOICE_DISTRIBUTIONS_ALL|DESCRIPTION                       0                0                2

    AP.AP_INVOICE_LINES_ALL|DESCRIPTION                               0                0                1

    AP.AP_INVOICE_LINES_ALL|ITEM_DESCRIPTION                          0                0                1

    AP.AP_NOTES|NOTES_DETAIL                                         24                0                0

    APPLSYS.BISM_OBJECTS|SYS_NC00023$                                 4                0                0

    APPLSYS.DR$FND_LOBS_CTX$I|TOKEN_TEXT                              0            1,698        9,144,011

    APPLSYS.FND_CONC_PROG_ANNOTATIONS|PROGRAM_ANNOTAT               277                0                0

    APPLSYS.FND_DOCUMENTS_LONG_TEXT|LONG_TEXT                         0                0              296

    APPLSYS.FND_DOCUMENTS_SHORT_TEXT|SHORT_TEXT                       0                2              817

    APPLSYS.FND_DOCUMENTS_TL|DESCRIPTION                              0                0               33

    APPLSYS.FND_DOCUMENTS_TL|TITLE                                    0                0               27

    APPLSYS.FND_FLEX_VALUES|FLEX_VALUE                                0                0                1

    APPLSYS.FND_FLEX_VALUES_TL|DESCRIPTION                            0                0                1

    APPLSYS.FND_FLEX_VALUES_TL|FLEX_VALUE_MEANING                     0                0                2

    APPLSYS.FND_FORM_FUNCTIONS|IREP_DESCRIPTION                   8,421                0                0

    APPLSYS.FND_IREP_CLASSES|DESCRIPTION                          2,857                0                0

    APPLSYS.FND_IREP_CLASSES|XML_DESCRIPTION                         41                0                0

    APPLSYS.FND_IREP_FUNCTION_FLAVORS|DESCRIPTION                 8,772                0                0

    APPLSYS.FND_LOG_MESSAGES|CALLSTACK                          159,756                0                0

    APPLSYS.FND_LOG_MESSAGES|ERRORSTACK                           2,304                0                0

    APPLSYS.FND_LOG_MESSAGES|MESSAGE_TEXT                             0                0                1

    APPLSYS.FND_OAM_CONTEXT_FILES|TEXT                                7                0                0

    APPLSYS.FND_OAM_DOC_LINK|DOC_LINK_INFO                            1                0                0

    APPLSYS.FND_OBJECTS|IREP_DESCRIPTION                            975                0                0

    APPLSYS.FND_OBJECTS|IREP_XML_DESCRIPTION                        399                0                0

    APPLSYS.FND_OBJECT_DEFINITIONS|SYS_NC00017$                       3                0                0

    APPLSYS.FND_OBJECT_DEFINITIONS|SYS_NC00019$                       3                0                0

    APPLSYS.WF_ITEM_ATTRIBUTE_VALUES|SYS_NC00012$                     0                0              572

    APPLSYS.WF_ITEM_ATTRIBUTE_VALUES|SYS_NC00015$            14,900,351                0                0

    APPLSYS.WF_ITEM_ATTRIBUTE_VALUES|TEXT_VALUE                       0                0              572

    APPLSYS.WF_LOCAL_ROLES|DESCRIPTION                                0                0            4,375

    APPLSYS.WF_LOCAL_ROLES|DISPLAY_NAME                               0                0            4,170

    APPLSYS.WF_LOCAL_ROLES|EMAIL_ADDRESS                              0                0               42

    APPS.PLAN_TABLE|OTHER_XML                                        74                0                0

     

    Regards,

    SreeGanesh

  • 3. Re: How to find the characterset of a Lossy data mentioned in csscan, to be specific
    Srini Chavali-Oracle Oracle ACE Director
    Currently Being Moderated

    The data that you have posted certainly is not US7ASCII - are you sure the database characterset is US7ASCII ? How has this data been inserted into the database ?

     

    Srini

  • 4. Re: How to find the characterset of a Lossy data mentioned in csscan, to be specific
    SreeGanesh8900 Newbie
    Currently Being Moderated

    Hi Srini,

     

    Yes the database characterset is US7ASCII, these are the lossy data's from the CSSCAN report.

     

    how to find the characterset of these lossy data's and what is your suggestion?

     

    Regards,

    SreeGanesh

  • 5. Re: How to find the characterset of a Lossy data mentioned in csscan, to be specific
    SreeGanesh8900 Newbie
    Currently Being Moderated

    Sorry srini,

     

    This report is for to_char - AL32UTF8

  • 6. Re: How to find the characterset of a Lossy data mentioned in csscan, to be specific
    Srini Chavali-Oracle Oracle ACE Director
    Currently Being Moderated

    How was this data inserted into a database with the US7ASCII characterset ?

  • 7. Re: How to find the characterset of a Lossy data mentioned in csscan, to be specific
    Sergiusz Wolicki (Oracle) Expert
    Currently Being Moderated

    The scan report shows something that looks like a mixture of WE8ISO8859P1/WE8MSWIN1252 and AL32UTF8 data. It will be difficult to clean up. As you have posted only a small portion of scan.err, there may be other character sets as well. One of the best methods to find out the character set is to analyze the source country of the data. Your fragment shows location names in Latin America and Western Europe. If you have other locations as well, e.g. from Central Europe, you may also have other character sets in the database, e.g. EE8MSWIN1250/EE8ISO8859P2.

    Interestingly, your lossy data seems to be in eBS tables. Current internet architecture should not allow such data to be entered.

     

    Thanks

    Sergiusz

  • 8. Re: How to find the characterset of a Lossy data mentioned in csscan, to be specific
    ab8926 Newbie
    Currently Being Moderated

    Srini_Chavali wrote:

     

    How was this data inserted into a database with the US7ASCII characterset ?

    Check this link

    Invalid Data That Results from Setting the Client's NLS_LANG Parameter Incorrectly

     

    When the Client has nls parameter setting same as the  Database, Oracle assumes that there is no need for conversion, and this may lead to invalid data entered into the database.

Legend

  • Correct Answers - 10 points
  • Helpful Answers - 5 points