scrapy shell not opening long link
<p>I'm dealing with 
scrapy shell. URL that I'm trying to crawl is: <a href="http://allegro.pl/sportowe-uzywane-251188?a_enum[127779][15]=15&amp;a_text_i[1][0]=2004&amp;a_text_i[1][1]=2009&amp;a_text_i[5][0]=950&amp;id=251188&amp;offerTypeBuyNow=1&amp;order=p&amp;string=gsxr&amp;bmatch=base-relevance-aut-1-5-0913" rel="nofollow">http://allegro.pl/sportowe-uzywane-251188?a_enum[127779][15]=15&amp;a_text_i[1][0]=2004&amp;a_text_i[1][1]=2009&amp;a_text_i[5][0]=950&amp;id=251188&amp;offerTypeBuyNow=1&amp;order=p&amp;string=gsxr&amp;bmatch=base-relevance-aut-1-5-0913</a></p>

<p>But when I do "view(response)"  I'm getting blank page
Page looks not loaded </p>

<pre><code>&gt;&gt;&gt; response.css("title")
[]
</code></pre>

<p>Now fun part is sometimes it loads properly with same set of commands</p>

<p>It's working for me, I suggest you to start with very basic tutorial:</p>

<pre><code>import scrapy

class BlogSpider(scrapy.Spider):
    name = 'blogspider'
    start_urls = ['http://allegro.pl/sportowe-uzywane-251188?a_enum%5B127779%5D%5B15%5D=15&amp;a_text_i%5B1%5D%5B0%5D=2004&amp;a_text_i%5B1%5D%5B1%5D=2009&amp;a_text_i%5B5%5D%5B0%5D=950&amp;id=251188&amp;offerTypeBuyNow=1&amp;order=p&amp;string=gsxr&amp;bmatch=base-relevance-aut-1-1-0913']

    def parse(self, response):
        print "----------------------------------------------------------------"
        print response.body
        print "----------------------------------------------------------------"
</code></pre>

<p>I'm able to see the body of the page. <code>view(response)</code> is wrong, undefined function.</p>

<p>Save this code as <code>myspider.py</code> and run with <code>scrapy runspider myspider.py</code>. You will see a big string printing into your terminal, that is the body between <code>-------------</code>s.</p>

<p><strong>For Scrapy Shell:</strong></p>

<p>Start in shell mode: <code>scrapy shell</code></p>

<p>Just run:</p>

<pre><code>&gt;&gt;&gt; fetch("http://allegro.pl/sportowe-uzywane-251188?a_enum%5B127779%5D%5B15%5D=15&amp;a_text_i%5B1%5D%5B0%5D=2004&amp;a_text_i%5B1%5D%5B1%5D=2009&amp;a_text_i%5B5%5D%5B0%5D=950&amp;id=251188&amp;offerTypeBuyNow=1&amp;order=p&amp;string=gsxr&amp;bmatch=base-relevance-aut-1-1-0913")
&gt;&gt;&gt; view(response)
</code></pre>

<p>It will open scraped page in your default browser. You URL is working for me.</p>

<p>And for title tag it shows:</p>

<pre><code>&gt;&gt;&gt; response.css("title")
[&lt;Selector xpath=u'descendant-or-self::title' data=u'&lt;title&gt;Gsxr w Sportowe U\u017cywane - Motocyk'&gt;]
</code></pre>

<p>Crawled/scraped web page will be saved under <code>/tmp</code> directory like <code>/tmp/tmpn8wziQ.html</code></p>

python scrapy