Advanced Search

Return to Snippet

Revision: 46114
at May 13, 2011 01:13 by level09
Initial Code 
$userAgent = 'Googlebot/2.1 (http://www.googlebot.com/bot.html)';
        $curl = curl_init($url);
        curl_setopt($curl, CURLOPT_USERAGENT, $userAgent);
        curl_setopt($curl, CURLOPT_AUTOREFERER, true);
        curl_setopt($curl, CURLOPT_FOLLOWLOCATION, true);
        curl_setopt($curl, CURLOPT_RETURNTRANSFER, 1 );
        curl_setopt($curl, CURLOPT_TIMEOUT, 2 );                
        $html = curl_exec( $curl );
	    curl_close( $curl);
Initial URL 

                                

                                                            

                                    

                                        

                                        Initial Description
                                        

                                    

                                    

                                

                                                            

                                    

                                        

                                        Initial Title
                                        

                                    

                                    
byPAss curl / file_get_contents blocking for scrapping

                                

                                                            

                                    

                                        

                                        Initial Tags
                                        

                                    

                                    
curl, php

                                

                                                            

                                    

                                        

                                        Initial Language
                                        

                                    

                                    
PHP