<div style="margin: 12px 0px; font-family: arial; color: #333333; background: #ffffff; border: solid 4px #e5e5e5; width: 100%; clear: left;"><div class="CM_CTB_Content_Wrap" style="margin: 0px; padding: 0px;background-color: #ffffff;"><div style="border-bottom: solid 1px #dcdcdc; white-space: nowrap; margin-bottom: 8px; background-color: #eeeeee ;background-image: url(http://clipmarks.com/images/source-bg.gif); background-repeat: repeat-x; height: 24px; line-height: 24px; vertical-align: middle; padding-bottom: 4px; color: #666666; font-size: 10px;" ><a href="http://clipmarks.com/clip-to-blog/" title="see clips that are hot right now"><img src="http://content.clipmarks.com/blog_embed/92929199-65a6-497f-adbc-44d711696ab2/93F35958-14B6-460E-9969-9794C158FDBF/" alt="" width="19" height="19" border="0" style="vertical-align: middle; margin: 0px 4px; display: inline; border: none; float:none;" /></a>clipped from <a title="http://stackoverflow.com/questions/26947/how-to-implement-a-web-scraper-in-php" href="http://stackoverflow.com/questions/26947/how-to-implement-a-web-scraper-in-php" style="font-size: 11px;">stackoverflow.com</a></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/26947/how-to-implement-a-web-scraper-in-php"><H2><A href="http://stackoverflow.com/questions/26947/how-to-implement-a-web-scraper-in-php">How to implement a web scraper in PHP?</A></H2></blockquote><div style="border-bottom: solid 1px #dcdcdc; white-space: nowrap; margin-bottom: 8px; background-color: #eeeeee ;background-image: url(http://clipmarks.com/images/source-bg.gif); background-repeat: repeat-x; height: 24px; line-height: 24px; vertical-align: middle; padding-bottom: 4px; color: #666666; font-size: 10px;" ><a href="http://clipmarks.com/clip-to-blog/" title="see clips that are hot right now"><img src="http://content8.clipmarks.com/images/clip-icon.gif" alt="" width="19" height="19" border="0" style="vertical-align: middle; margin: 0px 4px; display: inline; border: none; float:none;" /></a>clipped from <a title="http://stackoverflow.com/questions/26947/how-to-implement-a-web-scraper-in-php#27109" href="http://stackoverflow.com/questions/26947/how-to-implement-a-web-scraper-in-php#27109" style="font-size: 11px;">stackoverflow.com</a></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/26947/how-to-implement-a-web-scraper-in-php#27109"><DIV class="post-text"><P>There is a <A rel="nofollow" href="http://www.amazon.com/Webbots-Spiders-Screen-Scrapers-Developing/dp/1593271204/ref=sr_1_1?ie=UTF8&s=books&qid=1219706338&sr=8-1">Book "Webbots, Spiders, and Screen Scrapers: A Guide to Developing Internet Agents with PHP/CURL"</A> on this topic - see a review <A rel="nofollow" href="http://www.phpclasses.org/reviews/id/1593271204.html">here</A> </p> <P>PHP-Architect covered it in a well written article in the <A rel="nofollow" href="http://phparch.com/c/magazine/issue/63">December 2007 Issue</A> by Matthew Turland</p> </DIV></blockquote><div style="border-bottom: solid 1px #dcdcdc; white-space: nowrap; margin-bottom: 8px; background-color: #eeeeee ;background-image: url(http://clipmarks.com/images/source-bg.gif); background-repeat: repeat-x; height: 24px; line-height: 24px; vertical-align: middle; padding-bottom: 4px; color: #666666; font-size: 10px;" ><a href="http://clipmarks.com/clip-to-blog/" title="see clips that are hot right now"><img src="http://content9.clipmarks.com/images/clip-icon.gif" alt="" width="19" height="19" border="0" style="vertical-align: middle; margin: 0px 4px; display: inline; border: none; float:none;" /></a>clipped from <a title="http://stackoverflow.com/questions/26947/how-to-implement-a-web-scraper-in-php#103554" href="http://stackoverflow.com/questions/26947/how-to-implement-a-web-scraper-in-php#103554" style="font-size: 11px;">stackoverflow.com</a></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/26947/how-to-implement-a-web-scraper-in-php#103554"><P>Scraping generally encompasses 3 steps: </P></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/26947/how-to-implement-a-web-scraper-in-php#103554"><li style="margin-left:16px;padding-left: 0px;">first you GET or POST your request to a specified URL </LI></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/26947/how-to-implement-a-web-scraper-in-php#103554"><li style="margin-left:16px;padding-left: 0px;">next you receive the html that is returned as the response</LI></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/26947/how-to-implement-a-web-scraper-in-php#103554"><li style="margin-left:16px;padding-left: 0px;">finally you parse out of that html the text you'd like to scrape.</LI></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/26947/how-to-implement-a-web-scraper-in-php#103554"><P>My Favorite program for working with RegExs is <A rel="nofollow" href="http://www.regexbuddy.com/">Regex Buddy</A>. I would advise you to try the demo of that product even if you have no intention of buying it. It is an invaluable tool and will even generate code for your regexs you make in your language of choice (including php).</P></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/26947/how-to-implement-a-web-scraper-in-php#103554"><P>Usage:</P></blockquote><div style="height: 2px; font-size: 2px; background: #dcdcdc; border-bottom: solid 1px #f5f5f5; margin: 2px 4px;"></div><blockquote style="text-align: left; padding: 0px 8px; margin: 4px 0px 8px 0px; background: transparent; border: none;" cite="http://stackoverflow.com/questions/26947/how-to-implement-a-web-scraper-in-php#103554">PHP Class: </blockquote></div><div style="margin: 0px 6px 6px 4px;"><table style="font-size: 11px;border-spacing: 0px;padding: 0px;" cellpadding="0" cellspacing="0" width="100%"><tr><td style="background:transparent;border-width:0px;padding:0px;">&nbsp;</td><td align="right" style="background:transparent;border-width:0px;padding:0px;width:107px" width="107"><a href="http://clipmarks.com/share/93F35958-14B6-460E-9969-9794C158FDBF/blog/" title="blog or email this clip"><img src="http://content6.clipmarks.com/images/c2b-foot.png" border="0" alt="blog it" width="107" height="17" style="border-width:0px;padding:0px;margin:0px;" /></a></td></tr></table></div></div>

New from the makers of Clipmarks:  Amplify.com - Don't just share the news...Amplify it!