8 Replies Latest reply: Aug 6, 2013 8:12 AM by A.Ebenezer RSS

    How to find the characterset of a Lossy data mentioned in csscan, to be specific

    SreeGanesh8900

      when we are doing csscan we used to mention from_char and to_char

       

      for eg:

      My database character is US7ASCII

      from_char - US7ASCII to_char - US7ASCII, in the csscan i found the lossy data, that means there are some data which does not belong to the US7ASCII, so please help me to find the character set of the lossy data.

        • 1. Re: How to find the characterset of a Lossy data mentioned in csscan, to be specific
          Srini Chavali-Oracle

          Pl post OS and database versions, along with the portions of the report that show the lossy data

           

          HTH
          Srini

          • 2. Re: How to find the characterset of a Lossy data mentioned in csscan, to be specific
            SreeGanesh8900

            Database version - 11.1.0.7.0

            Application Version - 12.1.1

             

            OS version -

            Red Hat Enterprise Linux Server release 5.5 (Tikanga) 64 bit

             

            Portion of lossy data.

             

            Portion of csscan.err

             

            AACN4cAAdAAIzFLAAA lossy conversion      PARANá
            AACN4cAAdAAIzIAAAy lossy conversion      ÃSTERBRO
            AACN4cAAdAAIzMqAAs lossy conversion      A CORUÃA
            AACN4cAAdAAIzNGAAw lossy conversion      SKÃÂ¥NE
            AACN4cAAdAAIzOkAAR lossy conversion      SJÃLLAND
            AACN4cAAdAAIzQrAAa lossy conversion      SÃO PAULO
            AACN4cAAdAAIzRhAAX lossy conversion      SÃDERMANLANDS LÃ
                                                                     N
            AACN4cAAdAAIzUWAAO lossy conversion      REÃACA
            AACN4cAAdAAIzVOAAQ lossy conversion      SãO PAULO
            AACN4cAAdAAIzYUAAT lossy conversion      SãO PAULOTOSÃ
            AACN4cAAdAAIzZKAAp lossy conversion      CASTILLA Y LEÃN
            AACN4cAAdAAIzZZAAh lossy conversion      NORD- TRÃNDELAG
            AACN4cAAdAAIzfmAAY lossy conversion      PARANÃ
            AACN4cAAdAAIzhdAAJ lossy conversion      VäRMLAND
            AACN4cAAdAAIzhyAAX lossy conversion      SÃO PAULO
            AACN4cAAdAAIziCAAB lossy conversion      SãO PAULO
            AACN4cAAdAAIzimAAk lossy conversion      SÃDERMANLAND
            AACN4cAAdAAIzjwAAl lossy conversion      CÃRDOBA
            AACN4cAAdAAIzkIAAZ lossy conversion      SÃO PAULO
            AACN4cAAdAAIzmyAAJ lossy conversion      SÃO PAULO
            AACN4cAAdAAIznsAAp lossy conversion      SÃO PAULO
            AACN4cAAdAAIzqqAAf lossy conversion      GRAUBüNDEN
            AACN4cAAdAAIzv2AAD lossy conversion      SWEDEN VäSTERBOTTEN
            AACN4cAAdAAIzw+AAw lossy conversion      REGIóN METROPOLITANA
            AACN4cAAdAAIzw4AAX lossy conversion     

            CÃDIZ

             

            Portion of cscscan.txt

             

            Application Data:

             

            USER.TABLE|COLUMN                                       Convertible       Truncation            Lossy

            -------------------------------------------------- ---------------- ---------------- ----------------

            AP.AP_INVOICE_DISTRIBUTIONS_ALL|DESCRIPTION                       0                0                2

            AP.AP_INVOICE_LINES_ALL|DESCRIPTION                               0                0                1

            AP.AP_INVOICE_LINES_ALL|ITEM_DESCRIPTION                          0                0                1

            AP.AP_NOTES|NOTES_DETAIL                                         24                0                0

            APPLSYS.BISM_OBJECTS|SYS_NC00023$                                 4                0                0

            APPLSYS.DR$FND_LOBS_CTX$I|TOKEN_TEXT                              0            1,698        9,144,011

            APPLSYS.FND_CONC_PROG_ANNOTATIONS|PROGRAM_ANNOTAT               277                0                0

            APPLSYS.FND_DOCUMENTS_LONG_TEXT|LONG_TEXT                         0                0              296

            APPLSYS.FND_DOCUMENTS_SHORT_TEXT|SHORT_TEXT                       0                2              817

            APPLSYS.FND_DOCUMENTS_TL|DESCRIPTION                              0                0               33

            APPLSYS.FND_DOCUMENTS_TL|TITLE                                    0                0               27

            APPLSYS.FND_FLEX_VALUES|FLEX_VALUE                                0                0                1

            APPLSYS.FND_FLEX_VALUES_TL|DESCRIPTION                            0                0                1

            APPLSYS.FND_FLEX_VALUES_TL|FLEX_VALUE_MEANING                     0                0                2

            APPLSYS.FND_FORM_FUNCTIONS|IREP_DESCRIPTION                   8,421                0                0

            APPLSYS.FND_IREP_CLASSES|DESCRIPTION                          2,857                0                0

            APPLSYS.FND_IREP_CLASSES|XML_DESCRIPTION                         41                0                0

            APPLSYS.FND_IREP_FUNCTION_FLAVORS|DESCRIPTION                 8,772                0                0

            APPLSYS.FND_LOG_MESSAGES|CALLSTACK                          159,756                0                0

            APPLSYS.FND_LOG_MESSAGES|ERRORSTACK                           2,304                0                0

            APPLSYS.FND_LOG_MESSAGES|MESSAGE_TEXT                             0                0                1

            APPLSYS.FND_OAM_CONTEXT_FILES|TEXT                                7                0                0

            APPLSYS.FND_OAM_DOC_LINK|DOC_LINK_INFO                            1                0                0

            APPLSYS.FND_OBJECTS|IREP_DESCRIPTION                            975                0                0

            APPLSYS.FND_OBJECTS|IREP_XML_DESCRIPTION                        399                0                0

            APPLSYS.FND_OBJECT_DEFINITIONS|SYS_NC00017$                       3                0                0

            APPLSYS.FND_OBJECT_DEFINITIONS|SYS_NC00019$                       3                0                0

            APPLSYS.WF_ITEM_ATTRIBUTE_VALUES|SYS_NC00012$                     0                0              572

            APPLSYS.WF_ITEM_ATTRIBUTE_VALUES|SYS_NC00015$            14,900,351                0                0

            APPLSYS.WF_ITEM_ATTRIBUTE_VALUES|TEXT_VALUE                       0                0              572

            APPLSYS.WF_LOCAL_ROLES|DESCRIPTION                                0                0            4,375

            APPLSYS.WF_LOCAL_ROLES|DISPLAY_NAME                               0                0            4,170

            APPLSYS.WF_LOCAL_ROLES|EMAIL_ADDRESS                              0                0               42

            APPS.PLAN_TABLE|OTHER_XML                                        74                0                0

             

            Regards,

            SreeGanesh

            • 3. Re: How to find the characterset of a Lossy data mentioned in csscan, to be specific
              Srini Chavali-Oracle

              The data that you have posted certainly is not US7ASCII - are you sure the database characterset is US7ASCII ? How has this data been inserted into the database ?

               

              Srini

              • 4. Re: How to find the characterset of a Lossy data mentioned in csscan, to be specific
                SreeGanesh8900

                Hi Srini,

                 

                Yes the database characterset is US7ASCII, these are the lossy data's from the CSSCAN report.

                 

                how to find the characterset of these lossy data's and what is your suggestion?

                 

                Regards,

                SreeGanesh

                • 5. Re: How to find the characterset of a Lossy data mentioned in csscan, to be specific
                  SreeGanesh8900

                  Sorry srini,

                   

                  This report is for to_char - AL32UTF8

                  • 6. Re: How to find the characterset of a Lossy data mentioned in csscan, to be specific
                    Srini Chavali-Oracle

                    How was this data inserted into a database with the US7ASCII characterset ?

                    • 7. Re: How to find the characterset of a Lossy data mentioned in csscan, to be specific
                      Sergiusz Wolicki-Oracle

                      The scan report shows something that looks like a mixture of WE8ISO8859P1/WE8MSWIN1252 and AL32UTF8 data. It will be difficult to clean up. As you have posted only a small portion of scan.err, there may be other character sets as well. One of the best methods to find out the character set is to analyze the source country of the data. Your fragment shows location names in Latin America and Western Europe. If you have other locations as well, e.g. from Central Europe, you may also have other character sets in the database, e.g. EE8MSWIN1250/EE8ISO8859P2.

                      Interestingly, your lossy data seems to be in eBS tables. Current internet architecture should not allow such data to be entered.

                       

                      Thanks

                      Sergiusz

                      • 8. Re: How to find the characterset of a Lossy data mentioned in csscan, to be specific
                        A.Ebenezer

                        Srini_Chavali wrote:

                         

                        How was this data inserted into a database with the US7ASCII characterset ?

                        Check this link

                        Invalid Data That Results from Setting the Client's NLS_LANG Parameter Incorrectly

                         

                        When the Client has nls parameter setting same as the  Database, Oracle assumes that there is no need for conversion, and this may lead to invalid data entered into the database.