Extraction Pattern Problem

Hi,

I am trying to make an extractor pattern that captures each doctor, the demographic info, and their specialty. I am trying to have the DATARECORD encompass all those components, and have the sub-extractor patterns match the individual fields, such as address or phone. I have been able to capture most of the pattern and individual components. However, when I try to make the DATARECORD field bigger than it currently is with different endings for the pattern, it times out and says that nothing meets the pattern described. I am attaching the a sample of the HTML that I am trying to capture, and the pattern I currently have. The lines I am trying to capture are the PCP and non-PCP specialties, For example:

<label>PCP Specialty:</label> No Specialties
 
<label>Non-PCP Specialty:</label> Neonatal-Perinatal Medicine

Thanks in advance.

Aviva

Attachment	Size
patterns.txt	10.18 KB

avivag on 04/27/2010 at 8:29 am

screen-scraper support for licensed users

Problem with ExtractData

I am running a script on a site that first displays a specialty and then lists providers that specialize in that specialty (not repeating the specialty name). I tried to set it up with the ExtractData function. However, I can't get the main token to include all the subsets of each specialty. I only get the first provider of each specialty to display, with one record processing per specialty, instead of more. I am including more info of the problem. Any help would be greatly appreciated.

Thanks.

Aviva

website: http://avmed.spectralogix.com/

Main extractor pattern:

<button class="ch1">~@SpecialtyDesc@~></button>
~@PROVIDERNAME@~Provider ID#&

ProviderName extractor pattern that is run manually from script:

~@ProviderName@~ 
~@Address1@~ 
~@City@~, ~@ST@~  ~@Zip@~ <a href="m.asp?f=slx&id=~@ProvID2@~&d=" target="_blank">map</a> 
~@Phone@~

Contents of web page:

HTTP/1.1 200 OK
Content-Type: text/html
Content-Length: 30478
X-Powered-By: ASP.NET
Server: Microsoft-IIS/6.0
Date: Thu, 29 Apr 2010 13:17:16 GMT
Cache-control: private

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta name="generator" content="HTML Tidy, see www.w3.org" />
<title>Online Directories - Powered by SpectraLogix</title>
<meta name="Generator" content="Visual" slickedit="slickedit" />
<meta name="Author" content="Larry" bailes="bailes" />
<meta name="Keywords" content="content" />
<meta name="Description" content="content" />
<link href="slx.css" type="text/css" rel="stylesheet" />
<style type="text/css">
br.page {page-break-after: always}
</style>
</head>
<body bgcolor="#FFFFFF">
<div style="text-align: center"> 
<table border="0" width="630" cellspacing="0" cellpadding="2">
<tr>
<td align="center" colspan="3"><input type="button" class="hide" value="Back" onclick="javascript:self.close();" />  <input type="button" class="hide" onclick="javascript:print();" value="Print" /></td>
</tr>

<tr>
<td colspan="2">Choice</td>
</tr>
</table>
</div>

<table>
<tr>
<td align="right"><img src="logo.gif" /></td>
</tr>

<tr>
<td></td>
</tr>

<tr>
<td colspan="3"></td>
</tr>

<tr valign="top">
<td width="210" style="font-family: arial; font-size: 80%"><button class="ch1">Ambulatory Surgery Center</button> 
Women & Teens Community Healthcare 
16876 NE 19th Ave 
Miami, FL  33162 <a href="m.asp?f=slx&id=76736&d=" target="_blank">map</a> 
(305) 895-1274 
Provider ID# 277243 
<button class="ch1">Ambulatory Surgery Center (Hospital Affiliated)</button> 
North Miami Beach Surgical Center 
120 NE 167th St 
Miami, FL  33162 <a href="m.asp?f=slx&id=7537&d=" target="_blank">map</a> 
(305) 940-5100 
Provider ID# 100845 
 
Venture Ambulatory Surgery C 
16853 NE 2nd Ave 
Ste 400 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=7512&d=" target="_blank">map</a> 
(305) 652-2999 
Provider ID# 100828 
<button class="ch1">Cardiovascular Disease</button> 
<img src="bc.jpg" /><a href="i.asp?id=237820π=choice&hs=S&nw=PR" class="d1">Reinfeld, Howard B MD</a> 
18260 NE 19th Ave 
Ste 201 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=53157&d=" target="_blank">map</a> 
(305) 956-9062 
Provider ID# 237820 
</td>
<td width="210" style="font-family: arial; font-size: 80%"><button class="ch1">Chiropractor</button> 
<img src="nbc.jpg" /><a href="i.asp?id=294593π=choice&hs=S&nw=PR" class="d1">Ceccarelli, Harrietta DC</a> 
18139 NE 19th Ave 
Ste B 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=96773&d=" target="_blank">map</a> 
(786) 487-0858 
Provider ID# 294593 
 
<img src="nbc.jpg" /><a href="i.asp?id=302784π=choice&hs=S&nw=PR" class="d1">Kogan, Natalia DC</a> 
909 N Miami Beach Blvd 
Ste 403 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=107988&d=" target="_blank">map</a> 
(305) 940-3506 
Provider ID# 302784 
<button class="ch1">Dermatology</button> 
<img src="bc.jpg" /><a href="i.asp?id=263944π=choice&hs=S&nw=PR" class="d1">Rockley, Paul F MD</a> 
17101 NE 19th Ave 
Ste 101 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=68494&d=" target="_blank">map</a> 
(305) 940-7766 
Provider ID# 263944 
 
<img src="bc.jpg" /><a href="i.asp?id=008189π=choice&hs=S&nw=PR" class="d1">Seber Jr, Joseph F MD</a> 
16870 NE 19th Ave 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=2375&d=" target="_blank">map</a> 
(305) 947-1466 
Provider ID# 008189 
 
<img src="bc.jpg" /><a href="i.asp?id=290363π=choice&hs=S&nw=PR" class="d1">Sullivan, Tory P MD</a> 
16100 NE 16th Ave 
Ste A 
Miami, FL  33162 <a href="m.asp?f=slx&id=91292&d=" target="_blank">map</a> 
(305) 933-1011 
Provider ID# 290363 
</td>
<td width="210" style="font-family: arial; font-size: 80%"><button class="ch1">Diagnostic Testing Facility</button> 
Fountain Imaging 
1 NE 167th St 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=124710&d=" target="_blank">map</a> 
(305) 770-4343 
Provider ID# 319618 
<button class="ch1">Durable Medical Equipment</button> 
Sng Labs/Prostetic Eye Institute 
1990 NE 163rd St 
Ste 208 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=45393&d=" target="_blank">map</a> 
(800) 972-1354 
Provider ID# 222558 
<button class="ch1">Family Practice</button> 
<img src="bc.jpg" /><a href="i.asp?id=310989π=choice&hs=P&nw=PR" class="d1">Bekic, Ronald M DO</a> 
1750 NE 167th St 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=117372&d=" target="_blank">map</a> 
(954) 262-4101 
Provider ID# 310989 
 
<img src="bc.jpg" /><a href="i.asp?id=294796π=choice&hs=P&nw=PR" class="d1">Breen, James Owen MD</a> 
1750 NE 167th St 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=97030&d=" target="_blank">map</a> 
(954) 262-4101 
Provider ID# 294796 
 
<img src="bc.jpg" /><a href="i.asp?id=260074π=choice&hs=P&nw=PR" class="d1">Calzada, Pablo J DO</a> 
1750 NE 167th St 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=67056&d=" target="_blank">map</a> 
(954) 262-4100 
Provider ID# 260074 
</td>
<td><img src="ih.gif" /></td>
</tr>

<tr>
<td></td>
</tr>

<tr>
<td colspan="3" valign="top"></td>
</tr>

<tr>
<td>This provider list is only current 
as of the date it was printed.</td>
<td align="center"><img src="bc.jpg" />Board Certified 
<img src="nbc.jpg" />Not Board Certified 
</td>
<td align="right">4/29/2010 8:17:16 AM 
page:1</td>
</tr>

<tr>
<td><img src="ih.gif" height="80" /></td>
</tr>

<tr>
<td align="center" colspan="3"><input type="button" class="hide" value="Back" onclick="javascript:self.close();" />  <input type="button" class="hide" onclick="javascript:print();" value="Print" /></td>
</tr>

<tr>
<td colspan="2">Choice</td>
<td align="right"><img src="logo.gif" /></td>
</tr>

<tr>
<td></td>
</tr>

<tr>
<td colspan="3"></td>
</tr>

<tr valign="top">
<td width="210"><button class="ch1">Family Practice (cont)</button> 
<img src="bc.jpg" /><a href="i.asp?id=280351π=choice&hs=P&nw=PR" class="d1">Cohen, Peter M DO</a> 
1750 NE 167th St 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=80638&d=" target="_blank">map</a> 
(305) 262-4100 
Provider ID# 280351 
 
<img src="nbc.jpg" /><a href="i.asp?id=267727π=choice&hs=P&nw=PR" class="d1">Dwyer, Grace MD</a> 
(No patients under 10) 
951 NE 167th St 
Ste 102 
Miami, FL  33162 <a href="m.asp?f=slx&id=69789&d=" target="_blank">map</a> 
(305) 944-1122 
Provider ID# 267727 
 
<img src="bc.jpg" /><a href="i.asp?id=221203π=choice&hs=P&nw=PR" class="d1">English, Scott R MD</a> 
16470 NE 10th Ave 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=44291&d=" target="_blank">map</a> 
(305) 651-9988 
Provider ID# 221203 
 
<img src="bc.jpg" /><a href="i.asp?id=276019π=choice&hs=P&nw=PR" class="d1">Failer, Raymond DO</a> 
1899 NE 164th St 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=74634&d=" target="_blank">map</a> 
(786) 274-1990 
Provider ID# 276019 
 
<img src="bc.jpg" /><a href="i.asp?id=101407π=choice&hs=P&nw=PR" class="d1">Jacobsen, Paul E DO</a> 
17101 NE 19th Ave 
Ste 204 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=8292&d=" target="_blank">map</a> 
(305) 945-5477 
Provider ID# 101407 
 
<img src="nbc.jpg" /><a href="i.asp?id=291220π=choice&hs=P&nw=PR" class="d1">Ledbetter, Susan L DO</a> 
1750 NE 167th St 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=92336&d=" target="_blank">map</a> 
(305) 949-6202 
Provider ID# 291220 
</td>
<td width="210" style="font-family: arial; font-size: 80%"><img src="nbc.jpg" /><a href="i.asp?id=312082π=choice&hs=P&nw=PR" class="d1">Lyn, Joan Y DO</a> 
16455 NE 6th Ave 
Miami, FL  33162 <a href="m.asp?f=slx&id=118816&d=" target="_blank">map</a> 
(954) 625-5061 
Provider ID# 312082 
 
<img src="bc.jpg" /><a href="i.asp?id=212353π=choice&hs=P&nw=PR" class="d1">McAdory, John T MD</a> 
16260 NE 13th Ave 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=38169&d=" target="_blank">map</a> 
(305) 944-1122 
Provider ID# 212353 
 
<img src="bc.jpg" /><a href="i.asp?id=294191π=choice&hs=P&nw=PR" class="d1">Momeni, Tony M DO</a> 
995 N Miami Beach Blvd 
Ste 100 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=96151&d=" target="_blank">map</a> 
(305) 957-0017 
Provider ID# 294191 
 
<img src="bc.jpg" /><a href="i.asp?id=312501π=choice&hs=P&nw=PR" class="d1">Munoz, Krishnamurti S DO</a> 
1750 NE 167th St 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=119275&d=" target="_blank">map</a> 
(954) 262-4101 
Provider ID# 312501 
 
<img src="bc.jpg" /><a href="i.asp?id=272583π=choice&hs=P&nw=PR" class="d1">Powell-Cole, Michelle C DO</a> 
17100 NE 19th Ave 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=72494&d=" target="_blank">map</a> 
(305) 948-4701 
Provider ID# 272583 
 
<img src="bc.jpg" /><a href="i.asp?id=281244π=choice&hs=P&nw=PR" class="d1">Schaffer, Judith P DO</a> 
1750 NE 167th St 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=81469&d=" target="_blank">map</a> 
(305) 949-6202 
Provider ID# 281244 
</td>
<td width="210" style="font-family: arial; font-size: 80%"><img src="bc.jpg" /><a href="i.asp?id=014359π=choice&hs=P&nw=PR" class="d1">Sztern, Luisa J MD</a> 
17200 NE 19th Ave 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=3316&d=" target="_blank">map</a> 
(305) 944-2233 
Provider ID# 014359 
<button class="ch1">Gastroenterology</button> 
<img src="bc.jpg" /><a href="i.asp?id=203994π=choice&hs=S&nw=PR" class="d1">Cohen, Jack R MD</a> 
909 N Miami Beach Blvd 
Ste 302 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=21529&d=" target="_blank">map</a> 
(305) 949-2491 
Provider ID# 203994 
 
<img src="bc.jpg" /><a href="i.asp?id=269005π=choice&hs=S&nw=PR" class="d1">Felder, Lewis R MD</a> 
16855 NE 2nd Ave 
Ste 202 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=70326&d=" target="_blank">map</a> 
(305) 770-0062 
Provider ID# 269005 
 
<img src="bc.jpg" /><a href="i.asp?id=293927π=choice&hs=S&nw=PR" class="d1">Lavergne, Jose A MD</a> 
16855 NE 2nd Ave 
Ste 202 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=95785&d=" target="_blank">map</a> 
(305) 770-0062 
Provider ID# 293927 
 
<img src="nbc.jpg" /><a href="i.asp?id=205490π=choice&hs=S&nw=PR" class="d1">Moskowitz, Jerome MD</a> 
909 N Miami Beach Blvd 
Ste 302 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=25127&d=" target="_blank">map</a> 
(305) 949-2491 
Provider ID# 205490 
</td>
<td><img src="ih.gif" /></td>
</tr>

<tr>
<td></td>
</tr>

<tr>
<td colspan="3" valign="top"></td>
</tr>

<tr>
<td>This provider list is only current 
as of the date it was printed.</td>
<td align="center"><img src="bc.jpg" />Board Certified 
<img src="nbc.jpg" />Not Board Certified 
</td>
<td align="right">4/29/2010 8:17:16 AM 
page:2</td>
</tr>

<tr>
<td><img src="ih.gif" height="80" /></td>
</tr>

<tr>
<td align="center" colspan="3"><input type="button" class="hide" value="Back" onclick="javascript:self.close();" />  <input type="button" class="hide" onclick="javascript:print();" value="Print" /></td>
</tr>

<tr>
<td colspan="2">Choice</td>
<td align="right"><img src="logo.gif" /></td>
</tr>

<tr>
<td></td>
</tr>

<tr>
<td colspan="3"></td>
</tr>

<tr valign="top">
<td width="210"><button class="ch1">Gastroenterology (cont)</button> 
<img src="bc.jpg" /><a href="i.asp?id=205738π=choice&hs=S&nw=PR" class="d1">Neustater, Brett R MD</a> 
16855 NE 2nd Ave 
Ste 202 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=25599&d=" target="_blank">map</a> 
(305) 770-0062 
Provider ID# 205738 
 
<img src="bc.jpg" /><a href="i.asp?id=008203π=choice&hs=S&nw=PR" class="d1">Roman, Ricardo J MD</a> 
16855 NE 2nd Ave 
Ste 202 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=2409&d=" target="_blank">map</a> 
(305) 770-0062 
Provider ID# 008203 
<button class="ch1">General Practice</button> 
<img src="nbc.jpg" /><a href="i.asp?id=204251π=choice&hs=P&nw=PR" class="d1">Benjamin, Yukhanan MD</a> 
(No patients under 7) 
909 N Miami Beach Blvd 
Ste 101 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=22238&d=" target="_blank">map</a> 
(305) 945-1288 
Provider ID# 204251 
 
<img src="nbc.jpg" /><a href="i.asp?id=015063π=choice&hs=P&nw=PR" class="d1">Gurarye, Roza B MD</a> 
2020 NE 163rd St 
Ste 105 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=3377&d=" target="_blank">map</a> 
(305) 948-3985 
Provider ID# 015063 
</td>
<td width="210" style="font-family: arial; font-size: 80%"><button class="ch1">Home Health Care</button> 
Compass Home Health Care 
18260 NE 19th Ave 
Ste 101 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=107532&d=" target="_blank">map</a> 
(305) 944-7777 
Provider ID# 302433 
<button class="ch1">Internal Medicine</button> 
<img src="bc.jpg" /><a href="i.asp?id=329376π=choice&hs=P&nw=PR" class="d1">Ghany, Reyan A MD</a> 
(Not accepting new members) 
1431 NE 162nd St 
Miami, FL  33162 <a href="m.asp?f=slx&id=132658&d=" target="_blank">map</a> 
(305) 949-0999 
Provider ID# 329376 
 
<img src="bc.jpg" /><a href="i.asp?id=283787π=choice&hs=P&nw=PR" class="d1">Hill, Gary R DO</a> 
1750 NE 167th St 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=83731&d=" target="_blank">map</a> 
(954) 262-4101 
Provider ID# 283787 
 
<img src="nbc.jpg" /><a href="i.asp?id=104177π=choice&hs=P&nw=PR" class="d1">Miranda, Francisco G MD</a> 
58 NE 167th St 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=15428&d=" target="_blank">map</a> 
(305) 956-7787 
Provider ID# 104177 
 
<img src="bc.jpg" /><a href="i.asp?id=329371π=choice&hs=P&nw=PR" class="d1">Molinares, Vanina MD</a> 
(Not accepting new members) 
1431 NE 162nd St 
Miami, FL  33162 <a href="m.asp?f=slx&id=132655&d=" target="_blank">map</a> 
(305) 949-0999 
Provider ID# 329371 
</td>
<td width="210" style="font-family: arial; font-size: 80%"><img src="bc.jpg" /><a href="i.asp?id=259904π=choice&hs=P&nw=PR" class="d1">Petteway, Anita MD</a> 
909 N Miami Beach Blvd 
Ste 503 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=66911&d=" target="_blank">map</a> 
(305) 944-8887 
Provider ID# 259904 
 
<img src="nbc.jpg" /><a href="i.asp?id=299588π=choice&hs=P&nw=PR" class="d1">Renelien, Jean L MD</a> 
(No patients under 2) 
152 NE 167th St 
Unit 102 
Miami, FL  33162 <a href="m.asp?f=slx&id=104111&d=" target="_blank">map</a> 
(305) 945-5437 
Provider ID# 299588 
 
<img src="nbc.jpg" /><a href="i.asp?id=262378π=choice&hs=P&nw=PR" class="d1">Tamayo, Victor I MD</a> 
301 NE 167th St 
Miami, FL  33162 <a href="m.asp?f=slx&id=67888&d=" target="_blank">map</a> 
(305) 940-0522 
Provider ID# 262378 
<button class="ch1">Kidney Dialysis</button> 
TRC Ckd At Venture 
16855 NE 2nd Ave 
Ste 205 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=6510&d=" target="_blank">map</a> 
(305) 654-7401 
Provider ID# 100173 
<button class="ch1">Nephrology</button> 
<img src="nbc.jpg" /><a href="i.asp?id=295926π=choice&hs=S&nw=PR" class="d1">Bleicher, Jeffrey M DO</a> 
(No patients under 18) 
1431 NE 162nd St 
Miami, FL  33162 <a href="m.asp?f=slx&id=98628&d=" target="_blank">map</a> 
(305) 949-0999 
Provider ID# 295926 
</td>
<td><img src="ih.gif" /></td>
</tr>

<tr>
<td></td>
</tr>

<tr>
<td colspan="3" valign="top"></td>
</tr>

<tr>
<td>This provider list is only current 
as of the date it was printed.</td>
<td align="center"><img src="bc.jpg" />Board Certified 
<img src="nbc.jpg" />Not Board Certified 
</td>
<td align="right">4/29/2010 8:17:16 AM 
page:3</td>
</tr>

<tr>
<td><img src="ih.gif" height="80" /></td>
</tr>

<tr>
<td align="center" colspan="3"><input type="button" class="hide" value="Back" onclick="javascript:self.close();" />  <input type="button" class="hide" onclick="javascript:print();" value="Print" /></td>
</tr>

<tr>
<td colspan="2">Choice</td>
<td align="right"><img src="logo.gif" /></td>
</tr>

<tr>
<td></td>
</tr>

<tr>
<td colspan="3"></td>
</tr>

<tr valign="top">
<td width="210" style="font-family: arial; font-size: 80%"><button class="ch1">Neurology</button> 
<img src="bc.jpg" /><a href="i.asp?id=231826π=choice&hs=S&nw=PR" class="d1">Blanco, Guillermo MD</a> 
(No patients under 18) 
2020 NE 163rd St 
Ste 203 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=51040&d=" target="_blank">map</a> 
(305) 948-3333 
Provider ID# 231826 
<button class="ch1">Obstetrics/Gynecology</button> 
<img src="bc.jpg" /><a href="i.asp?id=226449π=choice&hs=S&nw=PR" class="d1">Friefeld, Richard S MD</a> 
16601 NE 19th Ave 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=48771&d=" target="_blank">map</a> 
(305) 944-2902 
Provider ID# 226449 
 
<img src="bc.jpg" /><a href="i.asp?id=000207π=choice&hs=S&nw=PR" class="d1">Gross, Stuart I MD</a> 
16190 NE 11th Ct 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=1163&d=" target="_blank">map</a> 
(305) 944-3883 
Provider ID# 000207 
<button class="ch1">Ophthalmology</button> 
<img src="bc.jpg" /><a href="i.asp?id=242475π=choice&hs=S&nw=PR" class="d1">Gremillion, Charles M MD</a> 
1990 NE 163rd St 
Ste 208 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=56732&d=" target="_blank">map</a> 
(305) 947-0027 
Provider ID# 242475 
 
<img src="bc.jpg" /><a href="i.asp?id=240011π=choice&hs=S&nw=PR" class="d1">Hoffman, Joseph I MD</a> 
1990 NE 163rd St 
Ste 208 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=55092&d=" target="_blank">map</a> 
(305) 947-0027 
Provider ID# 240011 
</td>
<td width="210" style="font-family: arial; font-size: 80%"><img src="bc.jpg" /><a href="i.asp?id=287234π=choice&hs=S&nw=PR" class="d1">Taher, Rashid M MD</a> 
1990 NE 163rd St 
Ste 208 
Miami, FL  33162 <a href="m.asp?f=slx&id=87687&d=" target="_blank">map</a> 
(305) 947-0027 
Provider ID# 287234 
 
<img src="bc.jpg" /><a href="i.asp?id=100059π=choice&hs=S&nw=PR" class="d1">Tenzel, David P MD</a> 
1990 NE 163rd St 
Ste 208 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=6321&d=" target="_blank">map</a> 
(305) 947-0027 
Provider ID# 100059 
<button class="ch1">Optometrist</button> 
<a href="i.asp?id=243749π=choice&hs=S&nw=PR" class="d1">Edelman, Reed S OD</a> 
1950 NE 163rd St 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=58293&d=" target="_blank">map</a> 
(305) 940-0037 
Provider ID# 243749 
 
<a href="i.asp?id=277040π=choice&hs=S&nw=PR" class="d1">Kahn, William H OD</a> 
16853 NE 2nd Ave 
Ste 201 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=76168&d=" target="_blank">map</a> 
(305) 654-8810 
Provider ID# 277040 
 
<a href="i.asp?id=250265π=choice&hs=S&nw=PR" class="d1">Newman, Steven M OD</a> 
1825 NE 164th St 
Miami, FL  33162 <a href="m.asp?f=slx&id=62169&d=" target="_blank">map</a> 
(305) 945-7113 
Provider ID# 250265 
 
<a href="i.asp?id=293435π=choice&hs=S&nw=PR" class="d1">Phillips, Heather R OD</a> 
1372 NE 163rd St 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=95104&d=" target="_blank">map</a> 
(305) 945-3361 
Provider ID# 293435 
</td>
<td width="210" style="font-family: arial; font-size: 80%"><a href="i.asp?id=300218π=choice&hs=S&nw=PR" class="d1">Shechtman, Leon M OD</a> 
1950 NE 163rd St 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=104983&d=" target="_blank">map</a> 
(305) 940-0037 
Provider ID# 300218 
 
<a href="i.asp?id=277232π=choice&hs=S&nw=PR" class="d1">Silvetti, Thomas R OD</a> 
16853 NE 2nd Ave 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=76692&d=" target="_blank">map</a> 
(305) 654-8810 
Provider ID# 277232 
 
<a href="i.asp?id=277244π=choice&hs=S&nw=PR" class="d1">Stern, Jodi L OD</a> 
16853 NE 2nd Ave 
Ste 201 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=76824&d=" target="_blank">map</a> 
(305) 654-8810 
Provider ID# 277244 
 
<a href="i.asp?id=277247π=choice&hs=S&nw=PR" class="d1">Stern, Sidney J OD</a> 
16853 NE 2nd Ave 
Ste 201 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=76840&d=" target="_blank">map</a> 
(305) 654-8810 
Provider ID# 277247 
 
<a href="i.asp?id=209500π=choice&hs=S&nw=PR" class="d1">Tescher, Edward N OD</a> 
1825 NE 164th St 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=33283&d=" target="_blank">map</a> 
(305) 945-7113 
Provider ID# 209500 
 
<a href="i.asp?id=208870π=choice&hs=S&nw=PR" class="d1">Tescher, Marc B OD</a> 
1825 NE 164th St 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=31647&d=" target="_blank">map</a> 
(305) 945-7113 
Provider ID# 208870 
</td>
<td><img src="ih.gif" /></td>
</tr>

<tr>
<td></td>
</tr>

<tr>
<td colspan="3" valign="top"></td>
</tr>

<tr>
<td>This provider list is only current 
as of the date it was printed.</td>
<td align="center"><img src="bc.jpg" />Board Certified 
<img src="nbc.jpg" />Not Board Certified 
</td>
<td align="right">4/29/2010 8:17:16 AM 
page:4</td>
</tr>

<tr>
<td><img src="ih.gif" height="80" /></td>
</tr>

<tr>
<td align="center" colspan="3"><input type="button" class="hide" value="Back" onclick="javascript:self.close();" />  <input type="button" class="hide" onclick="javascript:print();" value="Print" /></td>
</tr>

<tr>
<td colspan="2">Choice</td>
<td align="right"><img src="logo.gif" /></td>
</tr>

<tr>
<td></td>
</tr>

<tr>
<td colspan="3"></td>
</tr>

<tr valign="top">
<td width="210"><button class="ch1">Optometrist (cont)</button> 
<a href="i.asp?id=277255π=choice&hs=S&nw=PR" class="d1">Trotman, Michelle A OD</a> 
16853 NE 2nd Ave 
Ste 201 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=76851&d=" target="_blank">map</a> 
(305) 654-8810 
Provider ID# 277255 
 
<a href="i.asp?id=270375π=choice&hs=S&nw=PR" class="d1">Williams, Lanelle S OD</a> 
1990 NE 163rd St 
Ste 208 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=71067&d=" target="_blank">map</a> 
(305) 947-0027 
Provider ID# 270375 
<button class="ch1">Pediatrics</button> 
<img src="bc.jpg" /><a href="i.asp?id=208586π=choice&hs=P&nw=PR" class="d1">Freimark, Michael J MD</a> 
(No patients over 17) 
17101 NE 19th Ave 
Ste 202 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=30791&d=" target="_blank">map</a> 
(305) 944-8638 
Provider ID# 208586 
 
<img src="bc.jpg" /><a href="i.asp?id=204064π=choice&hs=P&nw=PR" class="d1">Mahmood, Iftikher U MD</a> 
1990 NE 163rd St 
Ste 101 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=21755&d=" target="_blank">map</a> 
(305) 949-1275 
Provider ID# 204064 
 
<img src="bc.jpg" /><a href="i.asp?id=208666π=choice&hs=P&nw=PR" class="d1">Marcus, Donald C DO</a> 
(No patients over 17) 
17101 NE 19th Ave 
Ste 202 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=31007&d=" target="_blank">map</a> 
(305) 944-8638 
Provider ID# 208666 
</td>
<td width="210" style="font-family: arial; font-size: 80%"><img src="bc.jpg" /><a href="i.asp?id=286015π=choice&hs=P&nw=PR" class="d1">Olagbemi, Olakunle T MD</a> 
1990 NE 163rd St 
Ste 101 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=86354&d=" target="_blank">map</a> 
(305) 949-1275 
Provider ID# 286015 
<button class="ch1">Pharmacies</button> 
Pharmco 
901 N Miami Beach Blvd 
N Miami Beach, FL  33162 <a href="m.asp?f=slx&id=11864&d=" target="_blank">map</a> 
(305) 919-7399 
Provider ID# 1023580 
 
Prescription Drug Foundation Inc 
1777 NE 163rd St 
N Miami Beach, FL  33162 <a href="m.asp?f=slx&id=8844&d=" target="_blank">map</a> 
(305) 947-0433 
Provider ID# 1017498 
<button class="ch1">Physical/Occupational Treatment Center</button> 
Mercy Outpatient Rehabilitation Cln 
16459 NE 6th Ave 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=107968&d=" target="_blank">map</a> 
(305) 651-6340 
Provider ID# 302744 
<button class="ch1">Podiatry</button> 
<img src="nbc.jpg" /><a href="i.asp?id=272382π=choice&hs=S&nw=PR" class="d1">Clersaint, Lucita M DPM</a> 
(No patients under 12) 
58 NE 167th St 
Miami, FL  33162 <a href="m.asp?f=slx&id=72272&d=" target="_blank">map</a> 
(305) 944-1610 
Provider ID# 272382 
</td>
<td width="210" style="font-family: arial; font-size: 80%"><img src="bc.jpg" /><a href="i.asp?id=241199π=choice&hs=S&nw=PR" class="d1">Horn, Merrick L DPM</a> 
909 N Miami Beach Blvd 
Ste 401 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=55883&d=" target="_blank">map</a> 
(305) 949-4189 
Provider ID# 241199 
<button class="ch1">Pulmonary Disease</button> 
<img src="bc.jpg" /><a href="i.asp?id=203508π=choice&hs=S&nw=PR" class="d1">Corrales, Carlos F DO</a> 
16855 NE 2nd Ave 
Ste 302A 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=20225&d=" target="_blank">map</a> 
(305) 653-8566 
Provider ID# 203508 
<button class="ch1">Urgent Care Center</button> 
American Urgent Care LLC 
301 NE 167th St 
Ste 101 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=131899&d=" target="_blank">map</a> 
(877) 277-5772 
Provider ID# 328273 
 
Imed Urgent Care Center 
18100 NE 19th Ave 
North Miami Beach, FL  33162 <a href="m.asp?f=slx&id=110319&d=" target="_blank">map</a> 
(305) 949-7990 
Provider ID# 304492 
</td>
<td><img src="ih.gif" /></td>
</tr>

<tr>
<td></td>
</tr>

<tr>
<td colspan="3" valign="top"></td>
</tr>

<tr>
<td>This provider list is only current 
as of the date it was printed.</td>
<td align="center"><img src="bc.jpg" />Board Certified 
<img src="nbc.jpg" />Not Board Certified 
</td>
<td align="right">4/29/2010 8:17:16 AM 
page:5</td>
</tr>

<tr>
<td><img src="ih.gif" height="80" /></td>
</tr>
</table>

Your Search Selections Were: 
 
Search Type: Zip Code 
Search For:  
Search Area: 33162 
Records Matched: 76 
Pages: 6 
</body>
</html>

avivag on 04/29/2010 at 11:21 am

That is going to be difficult

That is going to be difficult because you establish a specialty, and it can span columns and/or pages. It looks reasonable to get each provider on there, and moderate to get the addresses, and near impossible to get the specialties off here.

It would take more HTTP requests, but be much easier, to click each doctor's name and get the information from that details page. Is there a reason you can't do it that way?

jason on 04/29/2010 at 2:34 pm

Problem with Extractor Pattern

The problems I had with using the link and getting the information off of there are:
a. Some of the locations (not doctors) do not have links.
b. The links seem to show many locations for each provider, more than the standard off the site.

I ended up resolving the specialty issue by running the search on one specialty at a time. This resolved most of my issues. However, I am still having difficulties with providers that have multiple addresses. An example would be http://avmed.spectralogix.com/, selecting the Choice network for 32003 for the pulmonary disease specialty. In records that display multiple addresses per provider, only the first is extracted. This is when using the extractor pattern:

~@ProviderName@~
~@Address1@~
~@City@~, ~@ST@~ ~@Zip@~ map
~@Phone@~

Despite extensive time I have spent trying to figure out the appropriate extractor pattern, I have not been able to properly isolate the pattern into a pattern and subpattern for the ExtractData method. I timeout with unsuccessful attempts at extractor patterns.

Any suggestions?

TIA,
Aviva

avivag on 05/11/2010 at 4:58 pm

Yeah, that is going to make

Yeah, that is going to make extracting like that nearly impossible. Could you get the provider ID from the link, and then scrape each address individually (including the provider ID) and then match the doctors to locations in post-processing?

jason on 05/21/2010 at 8:44 am

Thanks

Thanks Jason for your suggestion. I have been trying to implement it, although I am having problems getting good extraction patterns including the provider ID. I'll let you know how it goes.

avivag on 05/28/2010 at 8:05 am

Thanks for your suggestion,

Thanks for your suggestion, Jason. It is not applicable to this pattern. For this one, I am having a problem of finding the extractor pattern where there is one PCP specialty and one Non-PCP specialty per provider record, but I am having difficulty capturing it. However, your suggestion is relevant to a different script that I am currently working on that has a one-to-many relationship.

avivag on 04/29/2010 at 7:47 am

Addresses Extracto isr Pattern

I was able to get a pattern for Provider Name including the ProviderID that seems consistent. However, I don't seem to be able to get a pattern that contains the ProviderID that is consistent for the addresses. The pattern I have so far is:

~@oAddress1@~ ~@oCity@~, ~@oST@~ ~@oZip@~ map ~@oPhone@~ Provider ID# ~@oProviderID@~

A good area to test is Pulmonary Disease for 32003.

Any suggestions would be greatly appreciated.

Aviva

avivag on 05/28/2010 at 9:28 am

Each sub-extractor will match

Each sub-extractor will match only one time. In order to find multiple instances of a pattern in a block, you need: http://community.screen-scraper.com/API/extractData

jason on 04/27/2010 at 9:32 am

I just added this as I get

I just added this as I get this situation alot: http://community.screen-scraper.com/faq#79n1502

Let me know if it helps.

jason on 04/27/2010 at 9:54 am

Search

Community

screen-scraper

User login

Extraction Pattern Problem