Firstly, a very happy new year to you all!
I had some free time recently, wherein I decided to build Harwest - A minimalistic tool to host all your submissions on GitHub. I had written a detailed post about it here: https://codeforces.com/blog/entry/85788
Please feel free to give it a try if you’d like!
Currently, Harwest supports Codeforces and AtCoder, and naturally, I’d like to extend the support to CodeChef too.
However, I know scraping data directly from the CodeChef web-pages is highly discouraged and that they throttle the requests for the same.
I did come across https://developers.codechef.com/ wherein they provide restricted access upon request but I wonder how well are these APIs maintained and if they are open to providing access for such projects. I couldn’t find much documentation around it as well and hence wonder if anyone of you has tried it before, and if so how well did it work out for them?
Also, has anyone tried scraping the solutions directly from the web-pages at a very low rate, say 1 page request per second? Is that still a feasible option with retries?
I know these are quite off-topic questions but would be glad to hear if anyone of you already have some idea about it. Thanks a ton!