Error getting data from website
On 7/12/19 1:51 PM, Chris Angelico wrote:
> On Sat, Dec 7, 2019 at 11:46 AM Michael Torrie <torriem at gmail.com> wrote:
>> On 12/6/19 5:31 PM, DL Neil via Python-list wrote:
>>> If you read the HTML data that the REPL has happily splattered all over
>>> your terminal's screen (scroll back) (NB "soup" is easier to read than
>>> is "content"!) you will observe that what you saw in your web-browser is
>>> not what Amazon served in response to the Python "requests.get()"!
>> So scraping static html is probably not going to get you where you want
>> to go. There are heavier tools, such as Selenium that uses a real
>> browser to grab a page, and the result of that you can parse and search
> Or look for an API instead.
However, Selenium is possibly less-manageable for a 'beginner'.
(NB my poorly-based assumption of OP)
Amazon's HTML-response actually says this/these, but I left it open as a
(learning) exercise for the OP. They likely prefer the API approach,
because it can be measured...