Simple crawling using cURL

example of simple crawling of web pages using client URL (cURL) $curl = curl_init(); curl_setopt($curl, CURLOPT_URL, "http://www.example-url.com"); curl_setopt($curl, CURLOPT_RETURNTRANSFER, 1); $content= curl_exec($curl); curl_close($curl);   var_dump($content);  //content being crawled

Shorten your URLs

public function tinyURL($url = null) { if ($url) { return file_get_contents("http://tinyurl.com/api-create.php?url=".$url); } else { return false; } }