Uploaded image for project: 'OpenOLAT'
  1. OpenOLAT
  2. OO-1192

User import fails for large excel

    XMLWordPrintable

    Details

      Description

      How to reproduce

      • Import 2000 users
        => not all users imported
      • Reimport the 2000
        => some more, but still not all imported

      Many errors like this in logfile

      9:14:03,291  WARN DBImpl:193 - beginTransaction bulk-change, too many db access for one transaction, could be a performance problem (add closeSession/createSession in loop) logObject=entityManager ^%^ cause:n/a
      19:14:08,076  WARN DBImpl:193 - beginTransaction bulk-change, too many db access for one transaction, could be a performance problem (add closeSession/createSession in loop) logObject=entityManager ^%^ cause:n/a
      19:14:13,081  WARN DBImpl:193 - beginTransaction bulk-change, too many db access for one transaction, could be a performance problem (add closeSession/createSession in loop) logObject=entityManager ^%^ cause:n/a
      19:14:15,003  INFO ThreadInfosManager:175 - High usage on thread:ThreadInfo[id=86:name=http-bio-8080-exec-4:cpu=92%] because thread work at: unkown
      

      Reviewing the code in UserImportController shows that in the entire import no intermediary commit is made. The code should commit after every 20th user or so.

      • in update identity loop
      • in create identity loop

      Most likely this should also be done in BusinessGroupServiceImple methods to add/remove as owners, participant or waiting list.

        Attachments

          Activity

            People

            Assignee:
            srosse Stéphane Rossé
            Reporter:
            gnaegi Florian Gnägi
            Tester:
            Florian Gnägi
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0 minutes
                0m
                Logged:
                Time Spent - 2 hours, 30 minutes
                2h 30m