Posted By

adamcoulombe on 10/30/09


Tagged

php parse html DOM php5 scrape XPath scraping


Versions (?)

Who likes this?

2 people have marked this snippet as a favorite

o0110o
Priestd09


Easy scraping and HTML parsing with PHP5 and XPath


 / Published in: PHP
 

This example uses filegetcontents to retrieve remote HTML. From there, we can parse through it using PHP5's DOMDocument and DOMXpath. XPath Queries are easy to create using the Firefox extension "XPather"

  1. <?php
  2. //a URL you want to retrieve
  3. $my_url = 'http://www.digg.com';
  4. $html = file_get_contents($my_url);
  5. $dom = new DOMDocument();
  6. $dom->loadHTML($html);
  7. $xpath = new DOMXPath($dom);
  8.  
  9. //Put your XPath Query here
  10. $my_xpath_query = "/html/body/div[@id='container']/div[@id='contents']/div[@class='list' and @id='wrapper']/div[@class='main' and position()=1]/div[contains(@class, 'news-summary')]/div[@class='news-body']/h3";
  11. $result_rows = $xpath->query($my_xpath_query);
  12.  
  13. //here we loop through our results (a DOMDocument Object)
  14. foreach ($result_rows as $result_object){
  15. echo $result_object->childNodes->item(0)->nodeValue;
  16. }
  17. ?>

Report this snippet  

Comments

RSS Icon Subscribe to comments
Posted By: webdatascraping on July 15, 2014

Hi,

This is great tutorial of Web Scraping in PHP, SimpleHTML DOM is really easy library to develop php based scraper that uses Xpath.

Check pdf scraping using php on my blog......http://www.webdata-scraping.com/blog

You need to login to post a comment.