Efficiently and reliably scrapes course information from National Cheng Kung University on a regular basis(if you choose to store data on onedrive). The collected data is organized into Excel files and can be automatically uploaded to OneDrive or saved locally (to your personal computer or github repo).
- Organized the course information of NCKU and then prepare an
excel
file. - Execute using multithreading.
- Solve the captcha with RCNN AI model to prevent block by the website server.
- Run at a specified time automatically with github action.
- Upload the result
excel
file to onedrive(you should set some info). - Save the result
excel
file just on the current repo(that need some setting, you can refer to this).
- Upload the result
excel
file to onedrive(you should set some info). - Save the result
excel
file just on that machine(by setting the argssave
withlocal
for functionrun
inmain.py
).
Download example_202409.xlsx
for example.
- Fork and set
github action secret
(if you need to store course data in onedrive).
or
- Download, setting the args
save
withlocal
for functionrun
inmain.py
, and enjoy it.
- python==3.8.10