HostingSquad
New Member
I am trying to get all of the products that drugstore.com offers through it's "http://www.drugstore.com/qxc88007_333181_sespider/api/api.htmThere is a total of 66,359 products, but I am not able to get a lot of them. When I try to get page 18 with 1000 products ( http://xml.drugstore.com/xml.asp?c=1&trx=xml&f=xml&pagesize=1000&page=18 ) the header returns with:
\[code\]Cache-Control
rivateContent-Length:156Content-Type:text/html; charset=utf-8Date:Wed, 06 Jun 2012 16:51:46 GMTExpires:Tue, 05 Jun 2012 16:51:29 GMTLocation:/500.asp?aspxerrorpath=/xml.aspP3P:CP=CAO DSP COR CUR ADM DEV TAI PSD IVD CONi OUR DEL OTRo INDServer:Microsoft-IIS/7.5Set-Cookie:STICKY=C0XML02P:CD0A011935314E35854273058C6507CA:bnmd1345cjrgdp55r34gkj55; domain=.drugstore.com; expires=Thu, 15-Jan-2037 08:00:00 GMT; path=/\[/code\]Then it redirects a few more times until it ends up at the drugstore.com homepage.I've tried different pages, pagesizes, and categories. There is always a couple of pages that don't work properly.Anyone else try this before?
Thanks!
\[code\]Cache-Control
rivateContent-Length:156Content-Type:text/html; charset=utf-8Date:Wed, 06 Jun 2012 16:51:46 GMTExpires:Tue, 05 Jun 2012 16:51:29 GMTLocation:/500.asp?aspxerrorpath=/xml.aspP3P:CP=CAO DSP COR CUR ADM DEV TAI PSD IVD CONi OUR DEL OTRo INDServer:Microsoft-IIS/7.5Set-Cookie:STICKY=C0XML02P:CD0A011935314E35854273058C6507CA:bnmd1345cjrgdp55r34gkj55; domain=.drugstore.com; expires=Thu, 15-Jan-2037 08:00:00 GMT; path=/\[/code\]Then it redirects a few more times until it ends up at the drugstore.com homepage.I've tried different pages, pagesizes, and categories. There is always a couple of pages that don't work properly.Anyone else try this before?Thanks!