Databases: Web Crawler using MySQL DB
vivek (contact me)
This class can be used to retrieve Web pages and store the URLs links in a MySQL database.
It retrieves a given Web page and parses its HTML content to extract the URLs of links and frames.
The URLs that are crawled are stored in a MySQL database table if the URL was not yet stored previously.
The class can also display in a Web page the list of URLs already stored from a given domain.
Click here for detailed information about this class on phpclasses.org