Your Ad Here

advanced code snippet search

Posted By

Tamedo on 11/23/07


Tagged

curl scrape


Versions (?)

Who likes this?

2 people have marked this snippet as a favorite

vali29
wirenaught


Scrape with curl PT 2

 / Published in: PHP
 
Expand | Embed | Plain Text 
  1. <html>
  2. <?
  3. // Set up the CURL object
  4. $ch = curl_init( "http://www.metacritic.com/video/" );
  5.  
  6. // Fake out the User Agent
  7. curl_setopt( $ch, CURLOPT_USERAGENT, "Internet Explorer" );
  8.  
  9. // Start the output buffering
  10. ob_start();
  11.  
  12. // Get the HTML from MetaCritic
  13. curl_exec( $ch );
  14. curl_close( $ch );
  15.  
  16. // Get the contents of the output buffer
  17. $str = ob_get_contents();
  18. ob_end_clean();
  19.  
  20. // Get just the list sorted by name
  21. preg_match( "/\<DIV ID=\"sortbyname1\"\>(.*?)\<\/DIV\>/is",
  22. 		$str, $byname );
  23.  
  24. // Get each of the movie entries
  25. preg_match_all( "/\<SPAN.*?>(.*?)\<\/SPAN\>.*?\<A.*?\>(.*?)\<BR\>/is",
  26. 		$byname[0], $moviedata );
  27.  
  28. // Work through the raw movie data
  29. $movies = array();
  30. for( $i = 0; $i < count( $moviedata[1] ); $i++ )
  31. {
  32. 		// The score is ok already
  33. 		$score = $moviedata[1][$i];
  34.  
  35. 		// We need to remove tags from the title and decode
  36. 		// the HTML entities
  37. 		$title = $moviedata[2][$i];
  38. 		$title = preg_replace( "/<.*?>/", "", $title );
  39. 		$title = html_entity_decode( $title );
  40.  
  41. 		// Then add the movie to the array
  42. 		$movies []= array( $score, $title );
  43. }
  44. ?>
  45. <body>
  46. <table>
  47. <tr>
  48. <th>Name</th><th>Score</th>
  49. </tr>
  50. <? foreach( $movies as $movie ) { ?>
  51. <tr>
  52. <td><? echo( $movie[1] ) ?></td>
  53. <td><? echo( $movie[0] ) ?></td>
  54. </tr>
  55. <? } ?>
  56. </table>
  57. </body>
  58. </html>

Report this snippet  

You need to login to post a comment.