I may not be quite following, so hopefully you can clarify. First, you can use regular expressions in screen-scraper, so I'm not quite sure why you'd want to parse the text manually (I'd also be surprised if you got much of a performance gain). That said, you're certainly free to parse it yourself. You can always use an extractor pattern token that simply grabs a larger region of text, then output that.
I'm not sure if that helps. Could you clarify a bit more exactly what you'd like to do? You might even give the URL to the page you're extracting.
The tutorials were helpful. Because there are many fields (8 or so) that I want to capture in the datarecord and some require a regular expression to parse, I was thinking of simply outputing the entire datarecord capture (and no fields) and do the text parsing with another tool. I thought also there might be an improvement in performance.
So, I'm looking at outputting a region of text, etc.
Web Data Extraction
output the DATARECORD to a file
Hi,
I may not be quite following, so hopefully you can clarify. First, you can use regular expressions in screen-scraper, so I'm not quite sure why you'd want to parse the text manually (I'd also be surprised if you got much of a performance gain). That said, you're certainly free to parse it yourself. You can always use an extractor pattern token that simply grabs a larger region of text, then output that.
I'm not sure if that helps. Could you clarify a bit more exactly what you'd like to do? You might even give the URL to the page you're extracting.
Thanks,
Todd
output the DATARECORD to a file
Todd,
Thanks for the reply.
The tutorials were helpful. Because there are many fields (8 or so) that I want to capture in the datarecord and some require a regular expression to parse, I was thinking of simply outputing the entire datarecord capture (and no fields) and do the text parsing with another tool. I thought also there might be an improvement in performance.
So, I'm looking at outputting a region of text, etc.
BK
output the DATARECORD to a file
Hi,
We provide an example of this in our third tutorial: here. If you haven't done so already, I'd recommend going through the entire tutorial.
Kind regards,
Todd Wilson