Uploaded image for project: 'eZ Publish / Platform'
  1. eZ Publish / Platform
  2. EZP-25325

Out-of-memory on Solr Search Engine Bundle solr_create_index

    XMLWordPrintable

    Details

      Description

      Steps to reproduce:

      1. Prepare a test eZ Publish 5.4 instalation, fully updated to 5.4.5;
      2. Install Solr Search Engine Bundle, as described here:

      https://doc.ez.no/display/EZP/Solr+Search+Engine+Bundle

      3. Following step 6 of the above documentation, run initial indexation. On websites with large databases, indexation will fail due to lack of memory:

      $ php ezpublish/console ezplatform:solr_create_index -vvv
      Indexing Content...
       17406/60392 [========>-------------------]  28% Elapsed: 15 minsPHP Fatal error:  Allowed memory size of 2147483648 bytes exhausted (tried to allocate 262209 bytes) in /home/noliveira/dev/backend/ezpublish/vendor/league/flysystem/src/Adapter/Local.php on line 302
      PHP Stack trace:
      PHP   1. {main}() /home/noliveira/dev/backend/ezpublish/ezpublish/console:0
      PHP   2. Symfony\Component\Console\Application->run() /home/noliveira/dev/backend/ezpublish/ezpublish/console:30
      PHP   3. eZ\Bundle\EzPublishCoreBundle\Console\Application->doRun() /home/noliveira/dev/backend/ezpublish/vendor/symfony/symfony/src/Symfony/Component/Console/Application.php:120
      PHP   4. Symfony\Bundle\FrameworkBundle\Console\Application->doRun() /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Bundle/EzPublishCoreBundle/Console/Application.php:41
      PHP   5. Symfony\Component\Console\Application->doRun() /home/noliveira/dev/backend/ezpublish/vendor/symfony/symfony/src/Symfony/Bundle/FrameworkBundle/Console/Application.php:96
      PHP   6. Symfony\Component\Console\Application->doRunCommand() /home/noliveira/dev/backend/ezpublish/vendor/symfony/symfony/src/Symfony/Component/Console/Application.php:189
      PHP   7. Symfony\Component\Console\Command\Command->run() /home/noliveira/dev/backend/ezpublish/vendor/symfony/symfony/src/Symfony/Component/Console/Application.php:846
      PHP   8. EzSystems\EzPlatformSolrSearchEngineBundle\Command\SolrCreateIndexCommand->execute() /home/noliveira/dev/backend/ezpublish/vendor/symfony/symfony/src/Symfony/Component/Console/Command/Command.php:256
      PHP   9. eZ\Publish\Core\Persistence\Cache\ContentHandler->load() /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezplatform-solr-search-engine/bundle/Command/SolrCreateIndexCommand.php:92
      PHP  10. eZPublishCorePersistenceLegacyContentHandler_00000000088f87b70000000073d480098f23d777407472c18f6db08da97f09ef->load() /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/Persistence/Cache/ContentHandler.php:71
      PHP  11. eZ\Publish\Core\Persistence\Legacy\Content\Handler->load() /home/noliveira/dev/backend/ezpublish/ezpublish/cache/noliveira/ezpublishnoliveiraDebugProjectContainer.php:49049
      PHP  12. eZ\Publish\Core\Persistence\Legacy\Content\Mapper->extractContentFromRows() /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/Persistence/Legacy/Content/Handler.php:322
      PHP  13. eZ\Publish\Core\Persistence\Legacy\Content\Mapper->extractFieldFromRow() /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/Persistence/Legacy/Content/Mapper.php:208
      PHP  14. eZ\Publish\Core\Persistence\Legacy\Content\Mapper->extractFieldValueFromRow() /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/Persistence/Legacy/Content/Mapper.php:379
      PHP  15. eZ\Publish\Core\Persistence\Legacy\Content\FieldValue\Converter\Image->toFieldValue() /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/Persistence/Legacy/Content/Mapper.php:416
      PHP  16. eZ\Publish\Core\Persistence\Legacy\Content\FieldValue\Converter\Image->parseLegacyXml() /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/Persistence/Legacy/Content/FieldValue/Converter/Image.php:168
      PHP  17. eZPublishCoreFieldTypeImageIOLegacy_00000000088f8b4e0000000073d480098f23d777407472c18f6db08da97f09ef->loadBinaryFileByUri() /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/Persistence/Legacy/Content/FieldValue/Converter/Image.php:199
      PHP  18. eZ\Publish\Core\FieldType\Image\IO\Legacy->loadBinaryFileByUri() /home/noliveira/dev/backend/ezpublish/ezpublish/cache/noliveira/ezpublishnoliveiraDebugProjectContainer.php:53269
      PHP  19. eZPublishCoreIOTolerantIOService_00000000088f95fb0000000073d480098f23d777407472c18f6db08da97f09ef->loadBinaryFileByUri() /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/FieldType/Image/IO/Legacy.php:148
      PHP  20. eZ\Publish\Core\IO\TolerantIOService->loadBinaryFileByUri() /home/noliveira/dev/backend/ezpublish/ezpublish/cache/noliveira/ezpublishnoliveiraDebugProjectContainer.php:53599
      PHP  21. eZ\Publish\Core\IO\TolerantIOService->loadBinaryFile() /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/IO/TolerantIOService.php:100
      PHP  22. eZ\Publish\Core\IO\IOService->buildDomainBinaryFileObject() /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/IO/TolerantIOService.php:93
      PHP  23. eZ\Publish\Core\IO\IOMetadataHandler\Flysystem->getMimeType() /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/IO/IOService.php:350
      PHP  24. League\Flysystem\Filesystem->getMimetype() /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/IO/IOMetadataHandler/Flysystem.php:70
      PHP  25. League\Flysystem\Adapter\Local->getMimetype() /home/noliveira/dev/backend/ezpublish/vendor/league/flysystem/src/Filesystem.php:559
      PHP  26. finfo->file() /home/noliveira/dev/backend/ezpublish/vendor/league/flysystem/src/Adapter/Local.php:302
      
      
      
        [Symfony\Component\Debug\Exception\OutOfMemoryException]
        Error: Allowed memory size of 2147483648 bytes exhausted (tried to allocate
         262209 bytes)
      
      
      
      Exception trace:
       () at /home/noliveira/dev/backend/ezpublish/vendor/league/flysystem/src/Adapter/Local.php:302
       finfo->file() at /home/noliveira/dev/backend/ezpublish/vendor/league/flysystem/src/Adapter/Local.php:302
       League\Flysystem\Adapter\Local->getMimetype() at /home/noliveira/dev/backend/ezpublish/vendor/league/flysystem/src/Filesystem.php:559
       League\Flysystem\Filesystem->getMimetype() at /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/IO/IOMetadataHandler/Flysystem.php:70
       eZ\Publish\Core\IO\IOMetadataHandler\Flysystem->getMimeType() at /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/IO/IOService.php:350
       eZ\Publish\Core\IO\IOService->buildDomainBinaryFileObject() at /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/IO/TolerantIOService.php:93
       eZ\Publish\Core\IO\TolerantIOService->loadBinaryFile() at /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/IO/TolerantIOService.php:100
       eZ\Publish\Core\IO\TolerantIOService->loadBinaryFileByUri() at /home/noliveira/dev/backend/ezpublish/ezpublish/cache/noliveira/ezpublishnoliveiraDebugProjectContainer.php:53599
       eZPublishCoreIOTolerantIOService_00000000088f95fb0000000073d480098f23d777407472c18f6db08da97f09ef->loadBinaryFileByUri() at /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/FieldType/Image/IO/Legacy.php:148
       eZ\Publish\Core\FieldType\Image\IO\Legacy->loadBinaryFileByUri() at /home/noliveira/dev/backend/ezpublish/ezpublish/cache/noliveira/ezpublishnoliveiraDebugProjectContainer.php:53269
       eZPublishCoreFieldTypeImageIOLegacy_00000000088f8b4e0000000073d480098f23d777407472c18f6db08da97f09ef->loadBinaryFileByUri() at /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/Persistence/Legacy/Content/FieldValue/Converter/Image.php:199
       eZ\Publish\Core\Persistence\Legacy\Content\FieldValue\Converter\Image->parseLegacyXml() at /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/Persistence/Legacy/Content/FieldValue/Converter/Image.php:168
       eZ\Publish\Core\Persistence\Legacy\Content\FieldValue\Converter\Image->toFieldValue() at /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/Persistence/Legacy/Content/Mapper.php:416
       eZ\Publish\Core\Persistence\Legacy\Content\Mapper->extractFieldValueFromRow() at /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/Persistence/Legacy/Content/Mapper.php:379
       eZ\Publish\Core\Persistence\Legacy\Content\Mapper->extractFieldFromRow() at /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/Persistence/Legacy/Content/Mapper.php:208
       eZ\Publish\Core\Persistence\Legacy\Content\Mapper->extractContentFromRows() at /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/Persistence/Legacy/Content/Handler.php:322
       eZ\Publish\Core\Persistence\Legacy\Content\Handler->load() at /home/noliveira/dev/backend/ezpublish/ezpublish/cache/noliveira/ezpublishnoliveiraDebugProjectContainer.php:49049
       eZPublishCorePersistenceLegacyContentHandler_00000000088f87b70000000073d480098f23d777407472c18f6db08da97f09ef->load() at /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Publish/Core/Persistence/Cache/ContentHandler.php:71
       eZ\Publish\Core\Persistence\Cache\ContentHandler->load() at /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezplatform-solr-search-engine/bundle/Command/SolrCreateIndexCommand.php:92
       EzSystems\EzPlatformSolrSearchEngineBundle\Command\SolrCreateIndexCommand->execute() at /home/noliveira/dev/backend/ezpublish/vendor/symfony/symfony/src/Symfony/Component/Console/Command/Command.php:256
       Symfony\Component\Console\Command\Command->run() at /home/noliveira/dev/backend/ezpublish/vendor/symfony/symfony/src/Symfony/Component/Console/Application.php:846
       Symfony\Component\Console\Application->doRunCommand() at /home/noliveira/dev/backend/ezpublish/vendor/symfony/symfony/src/Symfony/Component/Console/Application.php:189
       Symfony\Component\Console\Application->doRun() at /home/noliveira/dev/backend/ezpublish/vendor/symfony/symfony/src/Symfony/Bundle/FrameworkBundle/Console/Application.php:96
       Symfony\Bundle\FrameworkBundle\Console\Application->doRun() at /home/noliveira/dev/backend/ezpublish/vendor/ezsystems/ezpublish-kernel/eZ/Bundle/EzPublishCoreBundle/Console/Application.php:41
       eZ\Bundle\EzPublishCoreBundle\Console\Application->doRun() at /home/noliveira/dev/backend/ezpublish/vendor/symfony/symfony/src/Symfony/Component/Console/Application.php:120
       Symfony\Component\Console\Application->run() at /home/noliveira/dev/backend/ezpublish/ezpublish/console:30
       {main}() at /home/noliveira/dev/backend/ezpublish/ezpublish/console:0
      
      
      ezplatform:solr_create_index [<bulk_count>]
      

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              Unassigned
              Reporter:
              nuno.oliveira-obsolete@ez.no Nuno Oliveira (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: