Website crawl can be done by Screaming Frog crawler. Also collect URLs from Google webmaster tools, XML sitemaps, Google Analytics, the internal database of the e-commerce website and these URLs can be crawled in the crawler. Add these URLs to your main URLs and obtain a complete list of indexable URLs. But there are some URLs that are not actually indexable. So exclude them. You can avoid URLs like
Error 4XX and Error 5XX
Robots.txt and blocked URLs
CSS file, JavaScript files, SWF files
Images and redirecting URLs which have canonicalize to other URL
Crawling New Technologies
Crawling of large websites
Crawl only the indexable content. No need to crawl all URLs of the site
Divide the site into crawlable parts
If the site is too large you can crawl single directory at a time.
Machine Upgrade
To hold data during the crawl time you need more RAM. To install additional RAM on your computer for this. It will improve performance.
In WordPress-like sites, the URL structure may be like numbers. This is not good. So always add your keyword in the URL and it must be simple and meaningful. If the URLs contain numbers and are not meaningful one then redirect them to correct URLs.
To get more from the crawler screaming frog provides speed adjustments, query strings, search depth, etc. To avoid hanging and data loss leave some GB to the spider.
At the time of the content audit, there is a lot of bandwidth waste. This may be due to the crawling of the entire website and it may contain indexable URLs. There are some other tools too like Deep-crawl and Botify.
In the mobile setup, there are two codes one for mobile and the other for desktop. But for both these versions, only one URL is there. Depending on the type of device the URL may vary. By using JavaScript frames works affect the speed in the mobile version.