Abstract—With the advent of internet technology, data has
exploded to a considerable amount. Large volumes of data can
be explored easily through search engines, to extract valuable
information. Web crawlers are an indispensible part of search
engine, which are program (proceeds with the search term) that
can traverse through the hyperlinks, indexes them, parses the
files and adds new links in to its queue and the mentioned
process is done several times until search term vanishes from
those pages. The web crawler looks for updating the links which
has already been indexed. This paper briefly reviews the
concepts of web crawler, its architecture and its different types.
It lists the software used by various mobile systems and also
explores the ways of usage of web crawler in mobile systems and
reveals the possibility for further research.
Index Terms—Web crawlers, mobile systems, mobile web
crawler.
Pavalam is with the National University of Rwanda, Rwanda, India
(e-mail: spavalam@nur.ac.rw).
Kasmir Raja is with SRM University, Chennai, India. (e-mail:
svkr@srmuniv.ac.in ).
Jawahar M. and Felix Akorli are with ICT at National University of
Rwanda, Rwanda, India. (e-mail: mjawahar@nur.ac.rw;
fakorli@nur.ac.rw ).
Cite:Pavalam S. M., S. V. Kasmir Raja, Jawahar M., and Felix K. Akorli, "Web Crawler in Mobile Systems," International Journal of Machine Learning and Computing vol.2, no. 4, pp. 531-534, 2012.