screen-scraper public support

Hi

I start the screen scraper proxy to record. Then I want to login to flickr.

http://www.flickr.com/

I enter my credentials and hit submit. After loading I am redirected to the login page with credentials fields empty.

Is this, because the screen-scraper certificate is not valid and it works only with trusted clients?

I remember in the past that once i was able to login to flickr while proxying.

Can you login to flickr whith the proxy?

What can you do now?

Hope you can help me.

Ben

Hello-
Searched on Silverlight herein and didn't find any results. This makes me wonder if it's a done deal that scraping Silverlight content is impossible.
Any suggestions?
Thanks.

Hi I am trying to format my output file the file to meet my specs.

My first problem is some of my variables have a 40-80 character limit. How would I "trim" my variable to 40 characters?
For example: out.write( dataRecord.get( "TITLE" ) + "\t" );

"Title" often exceeds 40 characters. Is there anyway to cut it to less than 40 before it is written to my .txt file?

I've posted for help before with SSL logging in problems. I would think that Ebay would be a popular scrape though. Has anyone been successful logging in? When I run my proxy I get about 60-70 lines of requests. after importing all of them I'm still missing something. The end result is a cookie error from Ebay.

Please help I've hit a road block thats driving me crazy and I can not continue without this.

Is there a tutorial that goes a little deeper into SSL/cookies that I can review?

Thanks,
Ben

I think I figured it out. Thanks.

Is it possible to change the location of the screen scraper database from \resource\db to a network directory so two computers share the same DB?

I know it could cause problems if shared simultaneously, but we would be sure one was out before the other logged-in.

I am testing this url ( https://www.njportal.com/DOR/businessrecords/EntityDocs/BusinessCopies.aspx ),want to fetch all Business Name after click on radio button of Business Name and "testing" word in Business Name * .

1) home page(https://www.njportal.com/DOR/businessrecords/EntityDocs/BusinessCopies.aspx)

extract :
__EVENTVALIDATION
__VIEWSTATE

2)After clicking on radio button of Business Nameo

extracted new value of :
__EVENTVALIDATION ( |__EVENTVALIDATION|~@EVENTVALIDATION@~| )

<divclass="overvw-description">~@data_here@~</p>

I cant get the extractor pattern to work in the above example. I have tried to use the url get parameter but I think I need something more specific. Does anyone have any suggestions?

Hi,

I Screen-scraper's main focus is scraping the web, however does it work on local CSV files?

Hi,

I have a completely regular table to scrape, but sometimes the cells are empty, in which case that row is not scraped. Is there a way to scrape all the cells and return a value for the empty cell? Here's an example (pls ignore ~ symbol, I've put it to stop forum software from converting to html):

<~tr>
<~td>1<~/td>
<~td>Sweden<~/td>
<~td><~/td>
<~td>Peter Hanson<~/td>
<~td>66<~/td>
<~td>67<~/td>
<~td><~/td>
<~td><~/td>
<~td>266<~/td>
<~/tr>

cheers
Ian