Using proxy server: null:-1 An internal error occurred
This may be related to the other NULL pointer issue I logged earlier.
Running the proxy pool scripts. Cleared the proxy pool files with
echo > filename.txt
Did this for each of the files so I could verify they were getting populated with new values.
Ran the proxy session and got the "Using proxy server: null:-1 An internal error occurred" error right away:
Starting scraper.
Running scraping session: R
Processing scripts before scraping session begins.
Processing script: "reset_proxy_file"
2013-04-11_22:45:28 Setting the APPEND_TO_FILE session variable to false
Processing script: "Scrape_A_Search_results"
Scraping file: "Search results"
Search results: Processing scripts before a file is scraped.
Processing script: "Pause_Long_Random_09-14sec"
=> Waiting 11172 ms. <=
Processing script: "Pause_Log_Time"
>>----------- Script Time Mark -------------> 2013-04-11_22:45:39 <---------------------<<
Search results: Resolved URL: http://www.xroxy.com/proxylist.php?port=&type=&ssl=&country=&latency=&reliability=&sort=type&desc=&pnum=0#table
Using proxy server: null:-1
An internal error occurred, which has been logged in the error.log file. Please contact [email protected] for help.
Processing scripts after scraping session has ended.
Processing script: "TEST&WRITE_TO_"ANONYMOUS_GOOD_PROXIES_R""
This is the error in the error.log file that was reported:
Internal error: Host name may not be null
java.lang.IllegalArgumentException: Host name may not be null
at org.apache.http.HttpHost.
at org.apache.http.HttpHost.
at com.screenscraper.scraper.ScrapingSession.setProxySettingsOnHttpClient(ScrapingSession.java:5604)
at com.screenscraper.scraper.ScrapeableFile.scrapeData(ScrapeableFile.java:3375)
at com.screenscraper.scraper.ScrapeableFile.scrape(ScrapeableFile.java:2825)
at com.screenscraper.scraper.ScrapingSession.scrapeFile(ScrapingSession.java:3503)
at com.screenscraper.scraper.ScrapingSession.scrapeFile(ScrapingSession.java:3711)
at sun.reflect.GeneratedMethodAccessor82.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at bsh.Reflect.invokeMethod(Unknown Source)
at bsh.Reflect.invokeObjectMethod(Unknown Source)
at bsh.Name.invokeMethod(Unknown Source)
at bsh.BSHMethodInvocation.eval(Unknown Source)
at bsh.BSHPrimaryExpression.eval(Unknown Source)
at bsh.BSHBlock.eval(Unknown Source)
at bsh.BSHBlock.eval(Unknown Source)
at bsh.Interpreter.eval(Unknown Source)
at bsh.Interpreter.eval(Unknown Source)
at bsh.Interpreter.eval(Unknown Source)
at com.screenscraper.scraper.ScriptContext$ScriptRunner.run(ScriptContext.java:352)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:680)
That's just saying that one
That's just saying that one of the lines in your proxy file has a port but an empty or improper host address.