Bookstore scrape

Hi Guys-

I recently started working on a new website that needs scraping. They are wanting to scrape each book based on the term, department, course, and section. I tried walking through the steps via the proxy, but can't figure out how the dropdowns are being populated. I figured I would scrape all that information them loop it back through to get the books for each department, course, and section. Any ideas on how to proceed?

Here is the website:

http://beloit.bncollege.com/webapp/wcs/stores/servlet/TBWizardView?catal...

Those are populated by AJAX.

Those are populated by AJAX. When you select an item from a pulldown, the proxy should capture an HTTP request that responds with the data for the next pulldown. It's a lot of requests, therefore a few extra scrapeable files, but this is getting more common.