Distributed crawler using python and Redis
School of Engineering & Technology Department of Computer Science and Engineering, G H Raisoni University, Saikheda, India.
Review
World Journal of Advanced Engineering Technology and Sciences, 2023, 08(02), 367–371.
Article DOI: 10.30574/wjaets.2023.8.2.0126
Publication history:
Received on 13 March 2023; revised on 22 April 2023; accepted on 25 April 2023
Abstract:
An online platform known as a price comparison website serves as an intermediary between consumers and sellers. It presents various lists of prices for products selected by the user, enabling them to make informed decisions and save money. Additionally, it fosters price awareness in consumers, making them less susceptible to deceitful retailer advertisements. In essence, the website also serves as a promotional tool for retailers, supermarkets, hypermarkets, and shops to reach out to customers. In today's economic environment, where living costs are high, and time is limited, a price comparison website can significantly assist consumers with their shopping and household needs.
Keywords:
Distributed-crawler; Scrapy; Python; Data Scraping; Generic Structure; Crawler; Web scraping
Full text article in PDF:
Copyright information:
Copyright © 2023 Author(s) retain the copyright of this article. This article is published under the terms of the Creative Commons Attribution Liscense 4.0