Scraping cached pages
<p>I'm using <code>scrapy</code> in order to fetch some web content, in this fashion:</p>

<pre><code>class PitchforkTracks(scrapy.Spider):
    name = "pitchfork_tracks"
    allowed_domains = ["pitchfork.com"]
    start_urls = [
                    "http://pitchfork.com/reviews/best/tracks/?page=1",
                    "http://pitchfork.com/reviews/best/tracks/?page=2",
                    "http://pitchfork.com/reviews/best/tracks/?page=3",
     ]
</code></pre>

<p>everything is working fine.</p>

<p>now, instead of hitting the pages directely, I would like to scrape <code>google</code> <code>caches</code> of the same pages. </p>

<p>what is the proper <code>syntax</code>to achieve that?</p>

<p><strong>PS:</strong> I have tried <code>"cache:http://pitchfork.com/reviews/best/tracks/?page=1",</code>, to no avail.</p>

<p>you can use following Google URL for scraping cache page</p>

<p><a href="http://webcache.googleusercontent.com/search?q=cache:http://pitchfork.com/reviews/best/tracks/?page=1" rel="nofollow">http://webcache.googleusercontent.com/search?q=cache:http://pitchfork.com/reviews/best/tracks/?page=1</a></p>

python scrapy browser-cache