Skip to content

TJV Parser is a script that will scrape and parse public authorities file and post online in open format

Notifications You must be signed in to change notification settings

codeforcroatia/imamopravoznati-tjv

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

TJV register scraper

This is a scraper that runs on Morph. To get started see Morph.io the documentation. Scraper runs and data on Morph.io: https://morph.io/codeforcroatia/imamopravoznati-tjv.

Python 3.5 with Pandas.

How it works?

  1. Scraper will take data from official CSV register at https://tjv.pristupinfo.hr/ (TJV)
  2. Scraped TJV CSV data will be stored to allData table
  3. Then data will be processed and cleanup - it will compare existing data and allData and mark what was updated since last run.
  4. Clean data will be stored to data table

Work by SelectSoft

About

TJV Parser is a script that will scrape and parse public authorities file and post online in open format

Topics

Resources

Code of conduct

Security policy

Stars

Watchers

Forks

Packages

No packages published

Languages