1 Reply Latest reply: Jun 12, 2014 12:09 AM by Srinath Menon-Oracle RSS

    SES Crwaled with Zero error and Zero data

    1010126

      Hi,

      we are not getting any error while crawling UCM form SES but also we are not able to fetch any crwaled data.

       

      Following is log genrated

       

       

       

      18:10:11:457 INFOThread-2Waiting for items to be consumed
      18:10:11:457 INFOmainEQP-80325: Empty control queue. Nothing to process.
      18:10:11:457 INFOThread-2Thread-2: All items have been consumed
      18:10:11:458 INFOThread-2Unable to move the erroneous channel file idcplg to idcplg.prcsdErr
      18:10:11:459 INFOThread-2posting status feed to http://VDEVMSG:16200/cs/idcplg?IdcService=SES_CRAWLER_STATUS&IsJava=1&source=ITBASource&StatusFeed=
      18:10:11:459 INFOmainLoading document service pipeline : Default pipeline
      18:10:11:540 INFOThread-2HTTP status code: 200
      18:10:11:540 INFOThread-2idcplg.err uploaded successfully
      18:10:11:541 INFOThread-2Finished processing RSS channel
      18:10:11:795 INFOmainLoading document service manager "oracle.search.plugin.doc.extractor.DocumentSummarizerManager"...
      18:10:11:820 INFOmainStopword directory = /app_itba/SES/oracle/product/11.1.2.0.0/ses/seshome/search/lib/plugins/doc/extractor/phrasestopwords
      18:10:11:842 INFOmainMax number of terms = 20
      18:10:11:843 INFOmainMax number of phrases = 10
      18:10:11:843 INFOmainMax terms per phrase = 6
      18:10:11:843 INFOmainMin term frequency = 3
      18:10:11:843 INFOmainMin phrase frequency = 2
      18:10:11:843 INFOmainEnable sentence extraction = false
      18:10:11:843 INFOmainMax sentences = 3
      18:10:12:016 INFOmainInitializing language detection module...
      18:10:12:017 INFOmainLoading training data /app_itba/SES/oracle/product/11.1.2.0.0/ses/seshome/search/data/training//danish.dat for language da
      18:10:12:244 INFOmainLoading training data /app_itba/SES/oracle/product/11.1.2.0.0/ses/seshome/search/data/training//dutch.dat for language nl
      18:10:12:262 INFOmainLoading training data /app_itba/SES/oracle/product/11.1.2.0.0/ses/seshome/search/data/training//english.dat for language en
      18:10:12:272 INFOmainLoading training data /app_itba/SES/oracle/product/11.1.2.0.0/ses/seshome/search/data/training//french.dat for language fr
      18:10:12:289 INFOmainLoading training data /app_itba/SES/oracle/product/11.1.2.0.0/ses/seshome/search/data/training//german.dat for language de
      18:10:12:305 INFOmainLoading training data /app_itba/SES/oracle/product/11.1.2.0.0/ses/seshome/search/data/training//italian.dat for language it
      18:10:12:324 INFOmainLoading training data /app_itba/SES/oracle/product/11.1.2.0.0/ses/seshome/search/data/training//portugue.dat for language pt
      18:10:12:338 INFOmainLoading training data /app_itba/SES/oracle/product/11.1.2.0.0/ses/seshome/search/data/training//spanish.dat for language es
      18:10:12:353 INFOmainDone
      18:10:12:846 INFOfilter_1Initializing crawler plug-in "Oracle Content Server crawler plug-in"
      18:10:12:846 INFOcrawler_4Initializing crawler plug-in "Oracle Content Server crawler plug-in"
      18:10:12:846 INFOfilter_1Crawler plug-in "Oracle Content Server crawler plug-in" crawl starts
      18:10:12:846 INFOcrawler_4Crawler plug-in "Oracle Content Server crawler plug-in" crawl starts
      18:10:12:846 INFOfilter_1No more items to process
      18:10:12:846 INFOcrawler_2Initializing crawler plug-in "Oracle Content Server crawler plug-in"
      18:10:12:847 INFOfilter_1No more items. Crawler thread exiting.
      18:10:12:847 INFOcrawler_2Crawler plug-in "Oracle Content Server crawler plug-in" crawl starts
      18:10:12:847 INFOfilter_1Crawler plug-in "Oracle Content Server crawler plug-in" crawl finishes
      18:10:12:847 INFOcrawler_4No more items to process
      18:10:12:846 INFOcrawler_3Initializing crawler plug-in "Oracle Content Server crawler plug-in"
      18:10:12:847 INFOcrawler_2No more items to process
      18:10:12:847 INFOcrawler_3Crawler plug-in "Oracle Content Server crawler plug-in" crawl starts
      18:10:12:847 INFOcrawler_2No more items. Crawler thread exiting.
      18:10:12:848 INFOcrawler_3No more items to process
      18:10:12:848 INFOcrawler_2Crawler plug-in "Oracle Content Server crawler plug-in" crawl finishes
      18:10:12:848 INFOcrawler_3No more items. Crawler thread exiting.
      18:10:12:847 INFOcrawler_4No more items. Crawler thread exiting.
      18:10:12:848 INFOcrawler_3Crawler plug-in "Oracle Content Server crawler plug-in" crawl finishes
      18:10:12:848 INFOcrawler_4Crawler plug-in "Oracle Content Server crawler plug-in" crawl finishes
      18:10:12:850 INFOfilter_0Initializing crawler plug-in "Oracle Content Server crawler plug-in"
      18:10:12:851 INFOfilter_0Crawler plug-in "Oracle Content Server crawler plug-in" crawl starts
      18:10:12:851 INFOfilter_0No more items to process
      18:10:12:851 INFOfilter_0No more items. Crawler thread exiting.
      18:10:12:851 INFOfilter_0Crawler plug-in "Oracle Content Server crawler plug-in" crawl finishes
      18:10:12:851 INFOfilter_0Shut down crawler plug-in "Oracle Content Server crawler plug-in"
      18:10:12:852 INFOfilter_0Crawler thread stopping due to stop crawl command
      18:10:12:852 INFOfilter_0Shut down crawler plug-in "Oracle Content Server crawler plug-in"
      18:10:12:852 INFOfilter_0Crawler thread stopping due to stop crawl command
      18:10:12:852 INFOfilter_0Shut down crawler plug-in "Oracle Content Server crawler plug-in"
      18:10:12:852 INFOfilter_0Crawler thread stopping due to stop crawl command
      18:10:12:853 INFOfilter_0Shut down crawler plug-in "Oracle Content Server crawler plug-in"
      18:10:12:853 INFOfilter_0Crawler thread stopping due to stop crawl command
      18:10:12:853 INFOfilter_0Shut down crawler plug-in "Oracle Content Server crawler plug-in"
      18:10:12:853 INFOfilter_0Crawler thread stopping due to stop crawl command
      18:10:12:853 INFOfilter_0Shut down document service agent "Default pipeline"
      18:10:12:877 INFOcache_0Caching thread cache_0 returns without getting a file
      18:10:12:877 INFOcache_0Shutting down all caching threads...
      18:10:12:877 INFOcache_2Caching thread cache_2 returns without getting a file
      18:10:12:878 INFOcache_1Caching thread cache_1 returns without getting a file
      18:10:12:878 INFOcache_0Total number of documents cached = 0
      18:10:12:878 INFOcache_0Total data collected = 0 bytes
      18:10:12:879 INFOcache_0Indexing log file is "search_i1ds26.log" under oracle_home/ctx/log/
      18:10:12:901 INFOcache_0Indexing started at 6/11/14 6:10 PM
      18:10:12:901 INFOcache_0Task ID = 1091
      18:10:13:202 INFOmonitorRemote command "reportstatistics" received, argument = "null"
      18:10:13:202 INFOmonitorExecuting remote command "reportstatistics"
      18:10:13:204 INFOmonitorSend back remote command execution result
      18:10:13:978 INFOcache_0Indexing completed at 6/11/14 6:10 PM
      18:10:18:978 INFOcache_0Done
      18:10:18:978 INFOmainShutting down crawler...
      18:10:18:979 INFOmainShut down crawler plug-in "oracle.search.plugin.stellent.StellentCrawlerManager"
      18:10:19:138 INFOmonitorRemote command "reportstatistics" received, argument = "quit"
      18:10:19:138 INFOmonitorExecuting remote command "reportstatistics"
      18:10:19:139 INFOmonitorSend back remote command execution result
      18:10:19:236 INFOmainShutting down all crawling threads...
      18:10:19:244 INFOmainDone
      18:10:19:244 INFOmain
      18:10:19:244 INFOmain=================== Crawling results ===================
      18:10:19:245 INFOmainCrawling started at 6/11/14 6:10 PM
      18:10:19:246 INFOmainCrawling stopped at 6/11/14 6:10 PM
      18:10:19:246 INFOmainTotal crawling time = 0:0:11
      18:10:19:246 INFOmain
      18:10:19:247 INFOmainTotal number of documents fetched = 0
      18:10:19:247 INFOmainDocument fetch failures = 0
      18:10:19:247 INFOmainDocument conversion failures = 0
      18:10:19:248 INFOmainTotal number of unique documents indexed = 0
      18:10:19:248 INFOmainTotal data collected = 0 bytes
      18:10:19:248 INFOmainTotal number of non-indexable documents = 0
      18:10:19:248 INFOmain
      18:10:19:249 INFOmainNumber of times disk cache is full = 0

       

      thanks

       

      Arvind

        • 1. Re: SES Crwaled with Zero error and Zero data
          Srinath Menon-Oracle

          Hi Arvind ,

           

          I presume that you have created the snapshot from UCM first and then did the crawling from SES . In that case check how many items from ucm has been included in the snapshot:

           

          Navigate to UCM - Administration - System Audit Information - Tracing Sections - Active Section

           

          Remove the existing trace and add :

           

          requestaudit,sescrawler,system + Full verbose

           

          Update the changes and clear the server output .

           

          Run the snapshot from UCM

           

          Go to server output and check the logs to see how many items were processed .

           

          Thanks,

          Srinath