Home » Forums » screen-scraper » screen-scraper public support

An error occurred while preparing to issue the HTTP request: null

All,

I've got a scrapable file which is generating the following error:

: An error occurred while preparing to issue the HTTP request: null

Are there any logs for tracking down why I'm getting this error message?

Thanks,

James

‹ where to scrape ajax innerHTML? Working with Captcha from external programs ›
griffen on 06/14/2010 at 1:38 am

Reviewed the log file and it

Reviewed the log file and it looks a little light as I'm getting a lot more error messages.

I've looked through the tool and found logging on server settings and both are ticked. Further logging is set in the scraping session (logging level: Error). Is this correct or is there something else that I'm missing.

Interestingly enough the few lines I found contained an error message for the URL below. I've tried the URL in a browser and it works fine. Do you know why the URL below is failing?

IllegalArgumentException while preparing GET method: Invalid uri 'http://www.majestic.co.uk/find/category-is-Wine/Colour-is-Rosé+Wine/psi-is-0/pgs-is-50': escaped absolute path not valid
java.lang.IllegalArgumentException: Invalid uri 'http://www.majestic.co.uk/find/category-is-Wine/Colour-is-Rosé+Wine/psi-is-0/pgs-is-50': escaped absolute path not valid
at org.apache.commons.httpclient.HttpMethodBase.(HttpMethodBase.java:220)
at org.apache.commons.httpclient.methods.GetMethod.(GetMethod.java:88)
at com.screenscraper.scraper.ScrapeableFile.scrapeData(ScrapeableFile.java:2795)
at com.screenscraper.scraper.ScrapeableFile.scrape(ScrapeableFile.java:2442)
at com.screenscraper.scraper.ScrapingSession.scrapeFile(ScrapingSession.java:3057)
at com.screenscraper.scraper.ScrapingSession.scrapeFile(ScrapingSession.java:3104)
at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at bsh.Reflect.invokeMethod(Unknown Source)
at bsh.Reflect.invokeObjectMethod(Unknown Source)
at bsh.Name.invokeMethod(Unknown Source)
at bsh.BSHMethodInvocation.eval(Unknown Source)
at bsh.BSHPrimaryExpression.eval(Unknown Source)
at bsh.BSHBlock.eval(Unknown Source)
at bsh.BSHBlock.eval(Unknown Source)
at bsh.BSHWhileStatement.eval(Unknown Source)
at bsh.Interpreter.eval(Unknown Source)
at bsh.Interpreter.eval(Unknown Source)
at bsh.Interpreter.eval(Unknown Source)
at bsh.util.BeanShellBSFEngine.eval(Unknown Source)
at bsh.util.BeanShellBSFEngine.exec(Unknown Source)
at com.ibm.bsf.BSFManager.exec(BSFManager.java:479)
at com.screenscraper.scraper.ScriptContext$ScriptRunner.run(ScriptContext.java:308)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)

 griffen on 06/21/2010 at 4:14 pm

The problem is the "é" in the

The problem is the "é" in the URL. If you were to replace it with the HTML encoded value of "%C3" it will work.

We'll look into seeing if we can make screen-scraper handle these special characters more readily, but for now you may need to do a replaceAll on special characters like that.

 jason on 06/22/2010 at 9:35 am

I imagine that you're calling

I imagine that you're calling a scrapeable file with a variable instead of a URL in "URL" line, and if that is the case, your variable isn't set.

 jason on 06/14/2010 at 9:03 am

Is there a log file that

Is there a log file that details the variable name and scrapable file?

 griffen on 06/21/2010 at 11:36 am

Unless you've disabled

Unless you've disabled logging, there is a sub-directory in screen-scraper that should contain all the logs. In this case, the error.log won't be a lot of help.

If you're running the scrape in the workbench, the log only shows up there, otherwise a log named for the scrape should be in that same sub-directory.

 jason on 06/21/2010 at 11:45 am