Uploaded image for project: 'eZ Publish / Platform'
  1. eZ Publish / Platform
  2. EZP-30296

Bulk content removing leads to serious Solr index inconsistencies

    Details

      Description

      Removing a huge amount of content objects in one go leads to serious Solr index inconsistencies. The plausible reason is the fact that eZ Platform sends separated document removal request for each content objects.

      Steps to reproduce

      1. Install clean eZ Platform,
      2. Configure Solr (ref: https://doc.ezplatform.com/en/2.4/guide/solr/)
      3. Set following values in solrconfig.xml to let Solr index immediately:

            <autoCommit>
              <maxTime>${solr.autoCommit.maxTime:1}</maxTime>
              <openSearcher>false</openSearcher>
            </autoCommit>
        

            <autoSoftCommit>
              <maxTime>${solr.autoSoftCommit.maxTime:1}</maxTime>
            </autoSoftCommit>
        

      4. Create a folder, for instance, Test under the project root folder,
      5. Create 3000 folder objects under the parent created in the previous step,
      6. Go to project root folder,
      7. Select Test folder from the sub-items list and click on remove,
      8. Confirm bulk removal,
      9. Go to Content structure -> Search, from filters list select Folder and perform search.
      10. On the result list you should see a lot of results (in my test case around 2k)
      11. Go to trash, click on Empty trash,
      12. Repeat step 9. You should still see lots of contents. If you try to go to the content preview, you should see 404 page.

      Current result:
      Not all of the content objects are removed from the search index.

      Expected result:
      All of the content objects should be removed from the search index.

        Activity

        There are no comments yet on this issue.

          People

          • Assignee:
            Unassigned
            Reporter:
            Kamil Madejski
          • Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated: