Memory Problem
Hi,
I'm running into some memory problem with this one scrape I'm having.
I have scrape this site 3 months ago and it worked fine.
Now I go to scrape it and it shoots up the memory really high after a couple of minutes.
My specs:
Win 7 ultimate x64
intel i5 760@260ghz
4gb ram
1024mb memory allocation in screen scraper settings
Things I've tried:
Strip the Write Details Script to log the sku only.
turn tidy off
limit size of details page to 1.5mb (it's around 2.5mb original) via scrapeableFile.setMaxResponse();
Tried to run it on a different computer, same thing.
Sometimes it even freezes screen scraper when I run the scrape, and then I have to end screen scraper through the windows task manager
Could I send it in and see if you can replicate the problem?
Test-Scraper, Sure. You can
Test-Scraper,
Sure. You can send it to scottw [@] screen-scraper. I'll let you know what I find.
-Scott
Email
Hi,
Not sure if you receive my email yet or not since you haven't replied. Let me know if you need me to send you the scrape again.