petrbouchal / czgov-jobs-test

Scrapes www.mpo.cz

Internetové stránky Ministerstva průmyslu a obchodu poskytují svým návštěvníkům ucelenou informaci o práci úřadu, jehož resort obsahuje značnou šířku problematiky hospodářství České republiky.


Volná místa ve státní správě - SANDBOX FOR TESTING DB

Deployed version at https://github.com/petrbouchal/czgov-jobs/

Links

Contributors petrbouchal

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Starting scraper... http://www.mpo.cz/cz/ministr-a-ministerstvo/ministerstvo/#category315 Nalezeno 1 pozic na MPO Celkem nalezeno pozic: 1 [{'jobtitle': u'Nab\xeddka pracovn\xedch m\xedst', 'dept': 'MPO', 'joburl': u'http://www.mpo.cz/dokument61716.html', 'datetime': datetime.datetime(2015, 6, 26, 13, 0, 15, 161495)}] Traceback (most recent call last): File "scraper.py", line 48, in <module> db.insert('data', row) File "/app/litepiesql.py", line 76, in insert self.query("INSERT INTO " + tablename + " (" + tablelist + ") VALUES (" + valueholder + ");", valuelist) File "/app/litepiesql.py", line 101, in query tc.execute(query, tuple(escapeList)) sqlite3.OperationalError: table data has no column named datetime

Data

Downloaded 1 time by MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (166 KB) Use the API

rows 10 / 169

dept jobtitle joburl lastseen firstseen seenfor live latest
MZe
Odborný referent / referentka - analytik / analytička oddělení ekonomického řízení a controllingu
2014-11-10 16:38:22.718888
2014-11-07 00:35:05.610598
7.0
1
0
MZe
Odborný referent / referentka - metodik / metodička modulu FM
2014-11-10 16:38:22.718888
2014-11-07 00:35:05.610598
7.0
1
0
MZe
Odborný referent / referentka odddělení rozpočtu a financování
2014-11-10 16:38:22.718888
2014-11-07 00:35:05.610598
7.0
1
0
MZe
Odborný referent / referentka oddělení myslivosti
2014-11-10 16:38:22.718888
2014-11-08 18:46:56.064103
3.0
1
0
MZe
Odborný referent / referentka oddělení rybářství a včelařství
2014-11-10 16:38:22.718888
2014-11-08 18:46:56.064103
3.0
1
0
MZe
Odborný referent / referentka oddělení státní správy lesů, myslivosti a rybářství
2014-11-10 16:38:22.718888
2014-11-08 18:46:56.064103
3.0
1
0
MZe
Odborný referent / referentka oddělení ekonomických rozborů
2014-11-10 16:38:22.718888
2014-11-07 00:35:05.610598
7.0
1
0
MZe
Odborný referent / referentka oddělení ekonomických rozborů
2014-11-10 16:38:22.718888
2014-11-07 00:35:05.610598
7.0
1
0
MZe
Odborný referent / referentka oddělení administrace národních podpor (1)
2014-11-10 16:38:22.718888
2014-11-07 00:35:05.610598
7.0
1
0
MZe
Odborný referent / referentka oddělení administrace národních podpor (2)
2014-11-10 16:38:22.718888
2014-11-07 00:35:05.610598
7.0
1
0

Statistics

Average successful run time: less than a minute

Total run time: 30 minutes

Total cpu time used: less than 20 seconds

Total disk space used: 736 KB

History

  • Manually ran revision d8bc1813 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 2035c80e and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 937e864d and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision d87c8d2a and failed .
    nothing changed in the database
    6 pages scraped
  • Manually ran revision d87c8d2a and failed .
    nothing changed in the database
  • Manually ran revision c6668c5a and failed .
    nothing changed in the database
  • Manually ran revision ce24a81f and completed successfully .
    299 records removed, 169 records updated in the database
  • Auto ran revision b78ab8ea and completed successfully .
    154 records added in the database
  • Auto ran revision b78ab8ea and completed successfully .
    157 records added in the database
  • Manually ran revision ad4f8f3a and completed successfully .
    157 records added in the database
  • Manually ran revision 2483b106 and completed successfully .
    315 records removed, 156 records updated in the database
  • Manually ran revision e9d93fb7 and completed successfully .
    157 records added in the database
  • Manually ran revision e9d93fb7 and completed successfully .
    157 records added in the database
  • Manually ran revision e9d93fb7 and completed successfully .
    157 records added in the database
  • Manually ran revision 6aa68a58 and failed .
    nothing changed in the database
  • Manually ran revision 6aa68a58 and failed .
    nothing changed in the database
  • Manually ran revision a88808b7 and failed .
  • Manually ran revision e96b9029 and failed .
    nothing changed in the database
  • Manually ran revision e96b9029 and completed successfully .
    7 records removed, 124 records updated in the database
  • Manually ran revision 2857e39e and completed successfully .
    117 records added in the database
  • Manually ran revision e1a4a8bb and completed successfully .
    6 records added in the database
  • Manually ran revision 7f2fc93f and failed .
  • Manually ran revision 7f2fc93f and failed .
  • Manually ran revision f600da30 and completed successfully .
    8 records added in the database
  • Manually ran revision a1cfde3b and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

Python

czgov-jobs-test / scraper.py