How to scrape value from page that loads dynamicaly?
<p>The homepage of the website I'm trying to scrape displays four tabs, one of which reads "[Number] Available Jobs". I'm interested in scraping the [Number] value. When I inspect the page in Chrome, I can see the value enclosed within a <code>&lt;span&gt;</code> tag.</p>

<p><a href="http://i.stack.imgur.com/xeirT.png" rel="nofollow"><img src="http://i.stack.imgur.com/xeirT.png" alt="enter image description here"></a></p>

<p>However, there is nothing enclosed in that <code>&lt;span&gt;</code> tag when I view the page source directly. I was planning on using the Python <code>requests</code> module to make an HTTP GET request and then use regex to capture the value from the returned content. This is obviously not possible if the content doesn't contain the number I need.</p>

<p>My questions are:</p>

<ol>
<li><p>What is happening here? How can a value be dynamically loaded into a
page, displayed, and then not appear within the HTML source?</p></li>
<li><p>If the value doesn't appear in the page source, what can I do to
reach it?</p></li>
</ol>

<ol>
<li>for data that load dynamically you should look for an xhr request in the networks and if you can make that data productive for you than voila!! </li>
<li>you can you phantom js, it's a headless browser and it captures the html of that page with the dynamically loaded content. </li>
</ol>

python html httprequest httpresponse