Can someone help me on this Tennis website?
I have created a website that scrapes data from flashscore.com tennis website and directly hosts on our domain from github. I've used selenium for this..I am looking to automate the daily refresh so that it scrapes daily and refreshes our website..but right now it is taking 5 minutes to update single players data ( minimum 3 min to switch between tabs and fetc all data from flashscore)
We have around 450+ matches everyday...so you can imagine the time it would take to update if I have to go by current process...is there any way we can fasten this?
P.S. We are already using threading in the project!!