Added a scrapper for Yahoo Finance Data in the YahooFinanceProcessor class

[aymeric75]

Hello,

The YahooDownloader class is limited by the max number of request per hour (2000) which prevents one to use the current code since it's trying to retrieve data from '2010-01-01' to '2023-03-01' which is way more than 2k requests.

I built a function scrap_data in YahooFinanceProcessor class to retrieve the same data as the YahooDownloader but by scrapping the website with Selenium.

I tested the code and it's working as you can see on the screenshot below:

In addition, one should install Google Chrome using the following commands:

wget https://dl.google.com/linux/direct/google-chrome-stable_current_amd64.deb
sudo dpkg -i google-chrome-stable_current_amd64.deb 

the above command may produce errors related to missing deps so do:

sudo apt install -f 
google-chrome --version

[aymeric75]

Apparently my pull request got rejected because of Unsuccessful checks

I have hard time understand what this Reorder python import check is and what fails exactly, could you please give me an hint ?

Thanks!

[aymeric75]

ok

[aymeric75]

@BruceYanghy I opened an issue related to the pre-commit fails, indeed, fails appear even on a virgin installation of FinRL (without having modified the code at all), I think this is a big issue since no PR at all can pass the test

[zhumingpassional]

thanks .
does it work well now?

[aymeric75]

thanks . does it work well now?

The code works well yes, I only have an issue to commit it (because of pre-commit fails as you can notice), I tried to modify the code directly on github and created another PR but it fails the same...

I don't know what to do.

[zhumingpassional]

now that this code works well, I will merge it.
I do not quite understand you. why it fails?

[aymeric75]

now that this code works well, I will merge it. I do not quite understand you. why it fails?

I meant the pre-commits checks fail, but my code works perfectly, thanks for merging :))