counter
Currently browsing crawler


Articles on crawler

Sitemap Generator in PHP (also web crawler, and search engine data builder)

Tags: , , , , , — Hawk on September 29, 2007 at 11:31 am

Sitemap Generator

Php Sitemap Generator

version 1.0
by Hawk
Presented by http://www.hawkenterprises.org
Download at http://www.hawkenterprises.org/sitemap_generator.php (Requires Login)

(Remember we make revenue through ads on this site)

Ever wish you could just open up a program and have it generate an index of all links on your site? You need this php sitemap generator, you need the search engines to have this precious file called a sitemap.xml. It’s so important you have this file that all search engines check it when they crawl your site. This can easily be adapted to make a php xml sitemap generator. (more…)

Search Engine + DomCrawler = Search Site

Tags: , , , , — Hawk on September 22, 2007 at 5:21 pm

Fairly Simple folks. We have currently on our site everything you would need to create a google.com style site. So guess what we are going to do for you? We are going to combine these search engine and Crawler to create this. (more…)