User-agent: Scrapy Allow: / user-agent: * allow: /