screen-scraper public support
How can I Get one parameter in getCurrentPOSTData ?
Dear Friends !
How can I Get one parameter in getCurrentPOSTData ?
My session have a lot parameters but I can retrive only one parameters
Can I use getCurrentPOSTData("PARAMETER") ?
Thanks a Lot.
Need advise on how to create extractor pattern for data in html table format?
Hi,
I am new to this. But very excited to learn more. I have a simple question with regards of how to create extractor pattern when my source html stores data in html table format ? Example,
Leaving files open
We are calling screen scraper from within a web application running on Tomcat, so it is long running process. We are scraping
files from sites and downloading them using the session.downloadFile.
Some of the scraping sessions are scraping many documents and we are finding that after the files are downlaoded they are still open and we are getting "Too many files open" exception after. My question is why are the files being left in an open state after download? Is this a bug in the session.downloadfile?
Transfer Encoding: chunked - causing ERROR to be displayed
I'm downloading files using the session.downloadFile method and noticing an error being displayed during the scraping session. The Response Header has Transfer-Encoding: chuncked. The files appear to have downloaded properly and completely but the ERROR is disconcerting and may be causing asynchronous issues within the Java environment it is being called from. The Scraping Session is set up to use HttpClient. Any thoughts on why this would appear as an error
ERROR: Failed to save the file: C:\Temp\test.pdf. The error message was: chunked stream ended unexpectedly.
Problem Proceeding Through Site With AJAX
I am trying screen scraper out before I purchase a copy. I am trying to scrape a site that uses ajax. The site uses ajax to progress. I have run a scraping session that has worked when done in the browser but when I try to run this proxy session I get the error "JSMDIRECT Transaction did not complete" after the first page. There seems to be some transactions which are not showing up in the proxy session which are needed to progress in to the site. I notice that the is movement in the progress tab but these disappear. Is there anyway of getting these to put into the scraping session.
Direction on command line run error
I have run into one more snag in this first test. I am using the screen-scraper basic at the moment and understand from the documentation that I can invoke it from the command line. I am getting an error trying and hope somebody can point me in the right direction.
Problem with duplicate last line write
I'm new to screen-scraper and this forum, so apologies if I don't give enough info in this first post....
I took an example from the documentation and am trying to read in a .csv file of part numbers, scrape data on those parts, and write that back to a file.
I am getting everything to work except my output file has the last part number and associated info written twice. Any help would be much appreciated! I am posting the Initialization file. I am assuming the problem is here, but could obviously be wrong.
----------------------------------------------------
Scraping with varied POST data...
Hi all, Im relatively new to this scraping scene.
Basically I am scraping a store. Based on input (style number, length etc) I give a PHP program it checks for stock of the item.
The site returns multiple solutions on the page if they exist. I then use a script to determine the best one (price, location etc.).
This all works fine. The problem is that I want to be able to reserve the product if need be. The reserve page takes the post data from the previous solutions.
An input/output error occurred while connecting [SOLVED]
I have tried running the Hello World example (as well as my own) scraping session from a server running debian, but the sessions fail, with the message:
Forbidden Access to Shopping Site (Scraping Session) from Tutorial 2
403 Forbidden for access to Shopping Site (Scraping Session)
http://community.screen-scraper.com/files/Shopping%20Site%20(Scraping%20Session).sss
from Tutorial 2 - http://community.screen-scraper.com/Tutorial_2_Page_1