How do I use a webscraper in python if I have a minimal OS?
<p>I am trying to make my raspberry pi interact with my wifi router using python. Since my router doesn't have an API, I need to use a webscraper or something similar in python to enter password, go to links, etc... I have tried using selenium and Beautifulsoup, but those both require web browsers that I cant get on raspbian minimal.</p>

<pre><code>from selenium import webdriver
driver = webdriver.Firefox
</code></pre>

<p>and the result...</p>

<pre><code>Traceback (most recent call last):
File "&lt;stdin&gt;", line 1, in &lt;module&gt;
AttributeError: 'module' object has no attribute 'firefox'
</code></pre>

<p>Most routers use basic authentication. You can supply the username and password in the request URL by the following scheme: <code>https://USERNAME:PASSWORD@webaddress.com</code></p>

<p>You don't need Selenium to make HTTP requests. Selenium is for browser automation. BeautifulSoup is for parsing HTML and has nothing to do with making HTTP requests.</p>

<p>You can use a library like <code>requests</code> to make HTTP requests without the need for any browser.</p>

python web-scraping raspberry-pi raspbian