Category : scrapy

I am trying to scrape zomato.com . I have succeeded to extract the urls from ‘https://www.zomato.com/tr/istanbul’ but I am taking empty list response ‘https://www.zomato.com/tr/istanbul/taksim-restoranlar%C4%B1’. Thanks in advanced for your support. import scrapy class ZomatoSpider(scrapy.Spider): name = ‘zomato’ allowed_domains = ["zomato.com"] start_urls = [‘https://www.zomato.com/tr/istanbul/taksim-restoranlar%C4%B1’] def parse(self, response): all_href = response.css(‘.sc-klgLii’) all_urls = all_href.css(‘ a::attr(href)’).extract_first() print(all_urls) yield ..

Read more

Scrape data for all products from the men’s shoes section using Python from https://farfetch.com or https://matchesfashion.com (choose any one). The data we want you to collect should be for Germany (Deutschland). Make sure that you select the right country and the prices are in Euros (€). The output should be a .csv file with the ..

Read more

I’ve been trying to build an aggregator and I’ve kept on getting the error stated in the title: AttributeError: ‘str’ object has no attribute ‘text’ import requests from scrapy.linkextractors import LinkExtractor query = input() request = requests.get(‘https://google.com/search?’, params={‘q’:query}) getLink = LinkExtractor() for link in getLink.extract_links(request.text): print(link) Source: Python..

Read more