November 25, 2017, 06:02:59 AM

News:

Welcome to Xhanch Forum


How does the scrapper/crawler work?

Started by Xhanch Studio, March 07, 2011, 06:46:40 AM

previous topic - next topic
Go Down

Xhanch Studio

March 07, 2011, 06:46:40 AM Last Edit: September 22, 2011, 04:18:01 PM by Xhanch Studio
Scrapper/crawler helps you to automate your manga website as it will keep fetching mangas and chapters from source sites.

On the admin page, there will be a Scrapper Catalog menu. You will get a list of available mangas on a selected source site. After that, you just need to select which mangas you want to scrap or you may simply select all to scrap all those mangas. At this step, WP Manga will only get all manga information and store it to your database, no chapters yet so far. Finally, let the crawler(which will be a CRON job) do its task to retrieve all manga chapters and keep your website automatically updated when new chapters are available from the source.

You can determine whether you want to store scrapped mangas on your server or not. If not, the script will only stores image URLs so the manga reader will load the images directly from its source site.
Best Regards,
Susanto B.Sc
----------------------------------------------------------------------------
Web development services, WordPress plugin and theme development, PSD to XHTML conversion - http://xhanch.com
Read free manga online - http://authrone.com

Go Up