Skip to content

Web scrape and analysis of Kenyan Contract Awards (Government)

Notifications You must be signed in to change notification settings

rush4ratio/contract_awards_ppoa

Repository files navigation

Contract awards as reported by Kenya's Public Procurement and Oversight Authority (PPOA)


The Public Procurement and Disposal Act established the PPOA. It dictates the rules of public tendering in Kenya and specifically for what it terms procuring entities; basically a public entity to which the Act applies.

Scraping with Python


This a Python 2-only repo. Use python contract_awards.py in the command line. Trivial to do if you have a Linux variant. Otherwise, if you are a Windows 10 user, don't despair, see Bash on Ubuntu on Windows

Python libraries needed to be installed via pip

  • Beautiful Soup

Scraping directly through the command line


After ensuring contract_awards_shell_script is executable by changing permissions e.g. chmod +x contract_awards_shell_script, run ./contract_awards_shell_script

Python libraries needed for the command line version

Please see Jeroen Janssen's Data Science at the Command Line. This repo specifically makes use of:

  • scrape
  • jq
  • xml2json
  • json2csv

Also, you may need to install ssed. On Ubuntu, sudo apt-get update and sudo apt-get install ssed will do the trick. I may have well as used sed, but ssed is preferable since I'm partial to PCRE regular expressions.

About

Web scrape and analysis of Kenyan Contract Awards (Government)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages