getproperly / airbnb_data_collector

collect airbnb data

Scrapes m.airbnb.com

Search | Airbnb Mobile


This is a scraper that runs on Morph. To get started see the documentation

Contributors getproperly

Last run failed with status code 137.

Console output of last run

Injecting configuration and compiling... Injecting scraper code and running... https://m.airbnb.com/api/-/v1/listings/search?location=San-Francisco--CA--United-States&price_min=300&price_max=400&number_of_guests=1&offset=0&guests=1&items_per_page=20 new offset 20 https://m.airbnb.com/api/-/v1/listings/search?location=San-Francisco--CA--United-States&price_min=300&price_max=400&number_of_guests=1&offset=20&guests=1&items_per_page=20 new offset 40 https://m.airbnb.com/api/-/v1/listings/search?location=San-Francisco--CA--United-States&price_min=300&price_max=400&number_of_guests=1&offset=40&guests=1&items_per_page=20

Data

Downloaded 3 times by MikeRalphson EddieHomie

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (171 KB) Use the API

rows 10 / 323

price reviews_count lat room_type_category smart_location property_type date_added bedrooms price_native user_name picture_url url city id lng name user_id address
10
0
37.75570733559518
private_room
San Francisco, CA
Apartment
2015-05-06 13:25:50
1
10
Mark
San Francisco
6145184
-122.41824514928929
Test
31877112
Capp Street, San Francisco, CA 94110, United States
20
0
37.775362023178815
shared_room
San Francisco, CA
Apartment
2015-05-06 13:25:50
1
20
Adam
San Francisco
5906245
-122.39546814981246
2015 Golden Bowl Derby Crash Space
4380306
King Street, San Francisco, CA 94158, United States
10
0
37.776410055978864
entire_home
San Francisco, CA
Apartment
2015-05-06 13:25:50
1
10
George
San Francisco
2066449
-122.43126326479212
Spacious 1 BR in great neighborhood
4375203
Fell Street, San Francisco, CA 94117, United States
20
1
37.86862266830249
shared_room
Berkeley, CA
Apartment
2015-05-06 13:25:50
1
20
Sarah
Berkeley
6235055
-122.25759429935519
Close to campus sublet
32353570
Durant Avenue, Berkeley, CA 94704, United States
19
12
37.87381628131162
shared_room
Berkeley, CA
House
2015-05-06 13:25:50
1
19
David
Berkeley
4448896
-122.27232145328168
Tent in safe backyard
1169287
Martin Luther King Junior Way, Berkeley, CA 94704, United States
23
0
37.86675539775572
shared_room
Berkeley, CA
Apartment
2015-05-06 13:25:50
1
23
Natasha
Berkeley
6273122
-122.25966348122304
Best location! 1 block from UCB
32601887
Durant Ave, Berkeley, CA 94704, United States
22
0
37.66087008974916
private_room
Pacifica, CA
Apartment
2015-05-06 13:25:50
1
22
Cera
Pacifica
4244077
-122.47964984747918
One Room for Rent for 3 weeks
17791924
Gateway Drive, Pacifica, CA 94044, United States
49
6
37.77737502388324
shared_room
San Francisco, CA
Apartment
2015-05-06 13:26:24
1
49
StartupHaus
San Francisco
5670035
-122.40767404045548
(B5) Top Bunk in Startup House
5324881
Folsom Street, San Francisco, CA 94103, United States
42
2
37.77699124860962
shared_room
San Francisco, CA
Apartment
2015-05-06 13:26:24
1
42
Xiaojun
San Francisco
5862094
-122.39684852383961
Shared Room in Shared Condo!
12142963
Brannan Street, San Francisco, CA 94107, United States
33
2
37.734486326550424
private_room
San Francisco, CA
House
2015-05-06 13:26:24
1
33
Lulu
San Francisco
5650515
-122.46268635827865
STUDIO/NO WINDOW BEST PRICE!!!
5565510
San Jacinto Way, San Francisco, CA 94127, United States

Statistics

Total run time: 26 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 201 KB

History

  • Manually ran revision f0742aa0 and failed .
    40 records added in the database
    2 pages scraped
  • Manually ran revision 9acf352b and failed .
    283 records added in the database
    15 pages scraped
  • Manually ran revision d6c3e440 and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

Python

airbnb_data_collector / scraper.py