New York City Housing Authority (NYCHA) Temperature Sensor Data Scraping

NYCHA regularly updates a web page that displays information about indoor temperature sensor data by each development.

Morph.io scraper

This web scraper runs daily and extracts the data from all of these tables and saves the results in a SQLite database. The scraper is hosted on morph.io.

See temp_scraper on morph.io.

Credit to @austensen for inspiring this scraper. Thank you @julia-guo @ryanywchen for contributing to this scraper

Contributors ybchen00 julia-guo

Last run failed with status code 999.

Console output of last run

Please install the Morph Github App on ybchen00 so that Morph can access this repository on GitHub. Please go to https://github.com/apps/morph-io/installations/new/permissions?repository_ids%5B%5D=259159195&repository_ids%5B%5D=252864957&repository_ids%5B%5D=259159779&suggested_target_id=55371562 Why? See https://morph.io/documentation/github_app

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3 KB) Use the API

rows 10 / 13

Online Sensors Nighttime Exceptions (10:00pm to 6:00am) Total Apartments Daytime Exceptions (6:00am to 10:00pm) Borough Development
0
0
217
0
Manhattan
344 EAST 28TH STREET
143
0
162
0
Brooklyn
CONEY ISLAND
354
0
1,944
0
Bronx
CASTLE HILL
0
0
237
0
Bronx
EAST 180TH STREET-MONTEREY AVENUE
0
0
103
0
Bronx
STEBBINS AVENUE-HEWITT PLACE
82
0
132
0
Brooklyn
CAREY GARDENS
52
0
99
0
Brooklyn
CONEY ISLAND I (SITE 1B)
0
0
96
0
Manhattan
131 SAINT NICHOLAS AVENUE
402
0
434
0
Manhattan
LEXINGTON
57
0
80
0
Manhattan
TWO BRIDGES URA (SITE 7)

Statistics

Average successful run time: 11 minutes

Total run time: 6 days

Total cpu time used: 22 minutes

Total disk space used: 52.2 KB

History

  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

temp_parser / scraper.py