Too long migration process

[binuabraham990]

Hi Guys,

I am now working with a shop where we have a large number of items (more than 260000). So when I am trying to migrate, the process gets too long (I am waiting for 2-3 days to finish the process, but it is still running). The reading step of migration shows more than 1.5 million plus items to handle (probably it is showing all the mappings). So now, I started to doubt myself. Am I doing something wrong? What can I do to make the process faster?

Also one other doubt, I tried to run the migration process in terminal, it was faster compared to browser process. But it stopped at some point (says some network issue in error). And then I am not able to continue the migration process in the terminal. But we can continue it on browser. So my doubt is, can I somehow continue the migration process on terminal? I couldn’t find any option on the help or in the code level.

Please share your ideas here.
Thank you.

[Krispin]

Hi,

all in all we always suggest
currently to start the migration in production mode over the cli and using the database connection to get the best performance.

Some explanation to this: In the test or DEV mode, the symfony logger is running in the background and slows the process down and can also cause memory exceptions. Using the CLI instead of the admin UI is preventing the http overhead and prevent timeouts. Also using the local database instead of using the API is preventing the http overhead and preventing also connection problems.

I hope this could help you.

Best regards

Krispin