Getting data from a site, which cant be found in main HTML file in Python
<p>I'am using python and making a request:
<code>page = requests.get('http://www.finam.ru/profile/moex-akcii/aeroflot/news/?start-date=2016-01-01&amp;end-date=2016-12-31',auth=('user', 'pass'))</code></p>

<p>I expect, that i will be able to find everything, that i can see, when i view the website. But as i dont know it for certian and not familiar with libraries, i try to check it manually:</p>

<ol>
<li>I RightClick on the random part of the page and select "show the page code". And actually, i can not find needed info there!</li>
<li>I RightClick on the random part of the page and select "research this element", and i CAN find it there in a wierd "tree" structure :
<a href="http://i.stack.imgur.com/Bm0cK.png" rel="nofollow"><img src="http://i.stack.imgur.com/Bm0cK.png" alt="research this item"></a></li>
</ol>

<p>So the question is, which HTML file i recieve, when making request? and how to retrive  topic names from the "tree structure".
Total noob with HTML.</p>

<p>Besides the source html, there is a JavaScript code running on the web site, which manipulate and change the DOM (the tree structure that you describe). When you request it via Python, the JavaScript code does not run so you can see only the initial html code. Doing such stuff called scraping , you can do it with tools such as selenuim</p>

python html