Uploaded image for project: 'OpenOLAT'
  1. OpenOLAT
  2. OO-1522

Limit the content size of indexed document

    XMLWordPrintable

    Details

      Description

      The content of a document to be indexed can grow infinitely. We need to set a limit. Large Excel can be as 150MB, this buffer will be copied and than indexed which is very memory intensive.

      • There is a maxFileSize parameter to limit the maximum size of files, use it as the max. value for the content.
      • The index writer is accessed from different threads, the main indexer thread and the different pooled folder indexer, fix this, it's illegal from Lucene point of view.
      • The folder index pool create zillions of threads and it's not really pooled, use a thread executor instead which is really pooled.

        Attachments

          Activity

            People

            • Assignee:
              srosse Stéphane Rossé
              Reporter:
              srosse Stéphane Rossé
              Tester:
              Florian Gnägi
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 0 minutes
                0m
                Remaining:
                Remaining Estimate - 0 minutes
                0m
                Logged:
                Time Spent - 1 day, 5 hours, 10 minutes
                1d 5h 10m