Issue with external_proxy_host
We have scrapped sites and saved it in fileSessionName.sss with some external proxy i.e
When we deploy this on production environment with some other external proxy, it does not override the
above mentioned external proxy with new one.
Hi, Are you setting your
Hi,
Are you setting your external proxy settings under the "Advanced" tab for your scraping session? If so, it should go with the scraping session. You might also be setting them under the "Settings" dialog box, which is a general setting and will not go with the scraping session when you export it.
Kind regards,
Todd
Hi
Hi Todd,
Thanks for the reply.
Actually we are scrapping and generating fileName.sss file on Windows environment and our production environment is GUI-less Solaris environment.
So we have specified our proxy ExternalProxyHost= in screen-scrapper.properties.
But the proxy mentioned in our fileName.sss (Windows) is not overriden by the ExternalProxyHost= property mentioned in Solaris environment.
Any Solutions or suggestions.
Kind Regards,
Yogesh
Yogesh, The settings you have
Yogesh,
The settings you have saved in your fileName.sss file are for that particular scraping session and will take precedence over any global setting in your properties file. If you want to affect a scraping session's proxy configuration via the screen-scraper.properties file then you should not have any settings under the advanced tab of your scraping session.
-Scott
Hi Scott, Thanks for your
Hi Scott,
Thanks for your reply.
I tried your suggestions, but they did not work for me.
What I did was I went to the advanced tab and removed everything i.e external proxy username and password.
As per your above reply, the setting in your properties file should have worked and by site should have been scraped.
But it did not work.
When I put the proxy settings again in advanced tab, everything started working fine again
Any Suggestions.
Regards,
Yogesh
correction & bug
Yogesh,
First, I need to restate how this works. The settings in either the general settings dialog or screen-scraper.properties file are inner-link. Making a change in one location will change them in the other. They are also the default settings that will be applied to any NEW scraping sessions. Adjusting these settings will not affect any existing scraping sessions unless from within the workbench you click the button, "Use these proxy settings for all current scraping sessions". This will apply the settings in the General Settings dialog to all of your scraping sessions.
Right now there is a bug in how this button is implemented. Until we have made a fix for the bug you will need to manually apply the settings to each of your scraping sessions under their respective Advanced tabs.
The rule still applies that any setting under the Advanced tab of a scraping session will override the settings in the properties file and General Settings dialog. This means that if you have settings in your screen-scraper.properties file and in the General Settings dialog but have NO settings for a particular scraping session, that scraping session will NOT use an external proxy.
Please let me know if you have any questions.
-Scott