adrianshort / inlink-scraper

Scrapes planning applications data for BT InLink kiosks


BT InLink planning applications scraper

Scrapes planning applications data for BT InLink kiosks from UK council websites.

Contributors adrianshort

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.1 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.4). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby/  Fetching public_suffix 3.0.3  Using bundler 1.15.2  Fetching connection_pool 2.2.2  Fetching unf_ext 0.0.7.5  Installing connection_pool 2.2.2  Installing public_suffix 3.0.3  Fetching http-form_data 2.1.1  Installing unf_ext 0.0.7.5 with native extensions  Fetching http_parser.rb 0.6.0  Installing http_parser.rb 0.6.0 with native extensions  Installing http-form_data 2.1.1  Fetching httpclient 2.8.3  Installing httpclient 2.8.3  Fetching mime-types-data 3.2018.0812  Installing mime-types-data 3.2018.0812  Fetching net-http-digest_auth 1.4.1  Installing net-http-digest_auth 1.4.1  Fetching mini_portile2 2.4.0  Installing mini_portile2 2.4.0  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Fetching webrobots 0.1.2  Installing webrobots 0.1.2  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching net-http-persistent 3.0.0  Installing net-http-persistent 3.0.0  Fetching addressable 2.6.0  Installing addressable 2.6.0  Fetching mime-types 3.2.2  Installing mime-types 3.2.2  Fetching nokogiri 1.10.1  Installing nokogiri 1.10.1 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20180417  Installing domain_name 0.5.20180417  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching http 3.3.0  Installing http 3.3.0  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby/ (at morph_defaults@fc50176)  Fetching mechanize 2.7.6  Installing mechanize 2.7.6  Fetching uk_planning_scraper 0.4.3  Installing uk_planning_scraper 0.4.3  Bundle complete! 2 Gemfile dependencies, 25 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (28.71s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.4). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... 1 of 112: Aberdeen Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://publicaccess.aberdeencity.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.aberdeencity.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://publicaccess.aberdeencity.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.aberdeencity.gov.uk:443 2 of 112: Adur and Worthing Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planning.adur-worthing.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.adur-worthing.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planning.adur-worthing.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.adur-worthing.gov.uk:443 3 of 112: Allerdale Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Allerdale at URL: https://planning.allerdale.gov.uk/portal/servlets/ApplicationSearchServlet Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Allerdale at URL: https://planning.allerdale.gov.uk/portal/servlets/ApplicationSearchServlet 4 of 112: Amber Valley Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Amber Valley at URL: https://www.ambervalley.gov.uk/environment-and-planning/planning/development-management/planning-applications/view-a-planning-application.aspx Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Amber Valley at URL: https://www.ambervalley.gov.uk/environment-and-planning/planning/development-management/planning-applications/view-a-planning-application.aspx 5 of 112: Arun Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Arun at URL: https://www.arun.gov.uk/weekly-lists Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Arun at URL: https://www.arun.gov.uk/weekly-lists 6 of 112: Ashfield Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Ashfield at URL: https://www2.ashfield.gov.uk/cfusion/Planning/plan_findfile.cfm Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Ashfield at URL: https://www2.ashfield.gov.uk/cfusion/Planning/plan_findfile.cfm 7 of 112: Ashford Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Ashford at URL: http://planning.ashford.gov.uk/planning/Default.aspx?new=true Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Ashford at URL: http://planning.ashford.gov.uk/planning/Default.aspx?new=true 8 of 112: Aylesbury Vale Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://publicaccess.aylesburyvaledc.gov.uk/online-applications//search.do?action=advanced&searchType=Application Error: connection refused: publicaccess.aylesburyvaledc.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://publicaccess.aylesburyvaledc.gov.uk/online-applications//search.do?action=advanced&searchType=Application Error: connection refused: publicaccess.aylesburyvaledc.gov.uk:443 9 of 112: Babergh Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planning.baberghmidsuffolk.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.baberghmidsuffolk.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planning.baberghmidsuffolk.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.baberghmidsuffolk.gov.uk:443 10 of 112: Barking and Dagenham Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://paplan.lbbd.gov.uk/online-applications/search.do?action=advanced Error: connection refused: paplan.lbbd.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://paplan.lbbd.gov.uk/online-applications/search.do?action=advanced Error: connection refused: paplan.lbbd.gov.uk:80 11 of 112: Barnet Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://publicaccess.barnet.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.barnet.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://publicaccess.barnet.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.barnet.gov.uk:443 12 of 112: Bedford Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://www.publicaccess.bedford.gov.uk/online-applications/search.do?action=advanced Error: connection refused: www.publicaccess.bedford.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://www.publicaccess.bedford.gov.uk/online-applications/search.do?action=advanced Error: connection refused: www.publicaccess.bedford.gov.uk:80 13 of 112: Bexley Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://pa.bexley.gov.uk/online-applications/search.do?action=advanced Error: connection refused: pa.bexley.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://pa.bexley.gov.uk/online-applications/search.do?action=advanced Error: connection refused: pa.bexley.gov.uk:80 14 of 112: Birmingham Scrape 1 of 2: keywords: inlink Using Northgate scraper. I, [2019-02-04T17:09:21.187475 #20] INFO -- : Form variables: {"csbtnSearch"=>"Search", "txtProposal"=>"inlink", "cboSelectDateValue"=>"DATE_VALID", "rbGroup"=>"rbRange", "dateStart"=>"2017-06-15", "dateEnd"=>"2019-02-04"} D, [2019-02-04T17:09:21.187565 #20] DEBUG -- : HTTP request headers: D, [2019-02-04T17:09:21.187616 #20] DEBUG -- : {"Origin"=>"https://eplanning.birmingham.gov.uk", "Referer"=>"https://eplanning.birmingham.gov.uk/Northgate/PlanningExplorer/GeneralSearch.aspx"} D, [2019-02-04T17:09:21.187654 #20] DEBUG -- : GET: https://eplanning.birmingham.gov.uk/Northgate/PlanningExplorer/GeneralSearch.aspx Error: failed to connect: Connection refused - connect(2) for "eplanning.birmingham.gov.uk" port 443 Scrape 2 of 2: keywords: bt phone kiosk Using Northgate scraper. I, [2019-02-04T17:09:21.491283 #20] INFO -- : Form variables: {"csbtnSearch"=>"Search", "txtProposal"=>"bt phone kiosk", "cboSelectDateValue"=>"DATE_VALID", "rbGroup"=>"rbRange", "dateStart"=>"2017-06-15", "dateEnd"=>"2019-02-04"} D, [2019-02-04T17:09:21.491370 #20] DEBUG -- : HTTP request headers: D, [2019-02-04T17:09:21.491422 #20] DEBUG -- : {"Origin"=>"https://eplanning.birmingham.gov.uk", "Referer"=>"https://eplanning.birmingham.gov.uk/Northgate/PlanningExplorer/GeneralSearch.aspx"} D, [2019-02-04T17:09:21.491460 #20] DEBUG -- : GET: https://eplanning.birmingham.gov.uk/Northgate/PlanningExplorer/GeneralSearch.aspx Error: failed to connect: Connection refused - connect(2) for "eplanning.birmingham.gov.uk" port 443 15 of 112: Blackpool Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://idoxpa.blackpool.gov.uk/online-applications/search.do?action=advanced Error: connection refused: idoxpa.blackpool.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://idoxpa.blackpool.gov.uk/online-applications/search.do?action=advanced Error: connection refused: idoxpa.blackpool.gov.uk:443 16 of 112: Bolton Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://www.planningpa.bolton.gov.uk/online-applications-17/search.do?action=advanced Error: connection refused: www.planningpa.bolton.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://www.planningpa.bolton.gov.uk/online-applications-17/search.do?action=advanced Error: connection refused: www.planningpa.bolton.gov.uk:443 17 of 112: Bracknell Forest Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planapp.bracknell-forest.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planapp.bracknell-forest.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planapp.bracknell-forest.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planapp.bracknell-forest.gov.uk:443 18 of 112: Bradford Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planning.bradford.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.bradford.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planning.bradford.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.bradford.gov.uk:443 19 of 112: Brent Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://pa.brent.gov.uk/online-applications/search.do?action=advanced&searchType=Application Error: connection refused: pa.brent.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://pa.brent.gov.uk/online-applications/search.do?action=advanced&searchType=Application Error: connection refused: pa.brent.gov.uk:443 20 of 112: Brighton and Hove Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planningapps.brighton-hove.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningapps.brighton-hove.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planningapps.brighton-hove.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningapps.brighton-hove.gov.uk:443 21 of 112: Bristol Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planningonline.bristol.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningonline.bristol.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planningonline.bristol.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningonline.bristol.gov.uk:443 22 of 112: Bromley Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://searchapplications.bromley.gov.uk/online-applications/search.do?action=advanced Error: connection refused: searchapplications.bromley.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://searchapplications.bromley.gov.uk/online-applications/search.do?action=advanced Error: connection refused: searchapplications.bromley.gov.uk:443 23 of 112: Bury Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planning.bury.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.bury.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planning.bury.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.bury.gov.uk:443 24 of 112: Calderdale Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://portal.calderdale.gov.uk/online-applications/search.do?action=advanced Error: connection refused: portal.calderdale.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://portal.calderdale.gov.uk/online-applications/search.do?action=advanced Error: connection refused: portal.calderdale.gov.uk:443 25 of 112: Camden Scrape 1 of 2: keywords: inlink Using Northgate scraper. I, [2019-02-04T17:09:26.260555 #20] INFO -- : Form variables: {"csbtnSearch"=>"Search", "txtProposal"=>"inlink", "cboSelectDateValue"=>"DATE_VALID", "rbGroup"=>"rbRange", "dateStart"=>"2017-06-15", "dateEnd"=>"2019-02-04"} D, [2019-02-04T17:09:26.260631 #20] DEBUG -- : HTTP request headers: D, [2019-02-04T17:09:26.260674 #20] DEBUG -- : {"Origin"=>"http://planningrecords.camden.gov.uk", "Referer"=>"http://planningrecords.camden.gov.uk/Northgate/PlanningExplorer17/GeneralSearch.aspx"} D, [2019-02-04T17:09:26.260710 #20] DEBUG -- : GET: http://planningrecords.camden.gov.uk/Northgate/PlanningExplorer17/GeneralSearch.aspx Error: failed to connect: Connection refused - connect(2) for "planningrecords.camden.gov.uk" port 80 Scrape 2 of 2: keywords: bt phone kiosk Using Northgate scraper. I, [2019-02-04T17:09:26.833805 #20] INFO -- : Form variables: {"csbtnSearch"=>"Search", "txtProposal"=>"bt phone kiosk", "cboSelectDateValue"=>"DATE_VALID", "rbGroup"=>"rbRange", "dateStart"=>"2017-06-15", "dateEnd"=>"2019-02-04"} D, [2019-02-04T17:09:26.833878 #20] DEBUG -- : HTTP request headers: D, [2019-02-04T17:09:26.833906 #20] DEBUG -- : {"Origin"=>"http://planningrecords.camden.gov.uk", "Referer"=>"http://planningrecords.camden.gov.uk/Northgate/PlanningExplorer17/GeneralSearch.aspx"} D, [2019-02-04T17:09:26.833926 #20] DEBUG -- : GET: http://planningrecords.camden.gov.uk/Northgate/PlanningExplorer17/GeneralSearch.aspx Error: failed to connect: Connection refused - connect(2) for "planningrecords.camden.gov.uk" port 80 26 of 112: Cardiff Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planningonline.cardiff.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningonline.cardiff.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planningonline.cardiff.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningonline.cardiff.gov.uk:443 27 of 112: Cheshire West and Chester Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://pa.cheshirewestandchester.gov.uk/online-applications/search.do?action=advanced Error: connection refused: pa.cheshirewestandchester.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://pa.cheshirewestandchester.gov.uk/online-applications/search.do?action=advanced Error: connection refused: pa.cheshirewestandchester.gov.uk:443 28 of 112: City of London Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://www.planning2.cityoflondon.gov.uk/online-applications/search.do?action=advanced Error: connection refused: www.planning2.cityoflondon.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://www.planning2.cityoflondon.gov.uk/online-applications/search.do?action=advanced Error: connection refused: www.planning2.cityoflondon.gov.uk:80 29 of 112: Croydon Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://publicaccess2.croydon.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess2.croydon.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://publicaccess2.croydon.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess2.croydon.gov.uk:80 30 of 112: Cornwall Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://planning.cornwall.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.cornwall.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://planning.cornwall.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.cornwall.gov.uk:80 31 of 112: County Durham Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://publicaccess.durham.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.durham.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://publicaccess.durham.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.durham.gov.uk:443 32 of 112: Darlington Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://publicaccess.darlington.gov.uk/online-applications/search.do?action=advanced Error: Failed to open TCP connection to publicaccess.darlington.gov.uk:443 (Cannot assign requested address - connect(2) for "publicaccess.darlington.gov.uk" port 443) Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://publicaccess.darlington.gov.uk/online-applications/search.do?action=advanced Error: Failed to open TCP connection to publicaccess.darlington.gov.uk:443 (Cannot assign requested address - connect(2) for "publicaccess.darlington.gov.uk" port 443) 33 of 112: Doncaster Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planning.doncaster.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.doncaster.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planning.doncaster.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.doncaster.gov.uk:443 34 of 112: Ealing Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://pam.ealing.gov.uk/online-applications/search.do?action=advanced Error: connection refused: pam.ealing.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://pam.ealing.gov.uk/online-applications/search.do?action=advanced Error: connection refused: pam.ealing.gov.uk:443 35 of 112: East Riding of Yorkshire Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://newplanningaccess.eastriding.gov.uk/newplanningaccess/search.do?action=advanced Error: connection refused: newplanningaccess.eastriding.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://newplanningaccess.eastriding.gov.uk/newplanningaccess/search.do?action=advanced Error: connection refused: newplanningaccess.eastriding.gov.uk:443 36 of 112: Edinburgh Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://citydev-portal.edinburgh.gov.uk/idoxpa-web/search.do?action=advanced Error: connection refused: citydev-portal.edinburgh.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://citydev-portal.edinburgh.gov.uk/idoxpa-web/search.do?action=advanced Error: connection refused: citydev-portal.edinburgh.gov.uk:443 37 of 112: Enfield Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planningandbuildingcontrol.enfield.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningandbuildingcontrol.enfield.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planningandbuildingcontrol.enfield.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningandbuildingcontrol.enfield.gov.uk:443 38 of 112: Epsom and Ewell Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://eplanning.epsom-ewell.gov.uk/online-applications/search.do?action=advanced Error: connection refused: eplanning.epsom-ewell.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://eplanning.epsom-ewell.gov.uk/online-applications/search.do?action=advanced Error: connection refused: eplanning.epsom-ewell.gov.uk:80 39 of 112: Glasgow Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://publicaccess.glasgow.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.glasgow.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://publicaccess.glasgow.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.glasgow.gov.uk:443 40 of 112: Greenwich Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planning.royalgreenwich.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.royalgreenwich.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planning.royalgreenwich.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.royalgreenwich.gov.uk:443 41 of 112: Hackney Scrape 1 of 2: keywords: inlink Using Northgate scraper. I, [2019-02-04T17:09:33.640391 #20] INFO -- : Form variables: {"csbtnSearch"=>"Search", "txtProposal"=>"inlink", "cboSelectDateValue"=>"DATE_VALID", "rbGroup"=>"rbRange", "dateStart"=>"2017-06-15", "dateEnd"=>"2019-02-04"} D, [2019-02-04T17:09:33.640440 #20] DEBUG -- : HTTP request headers: D, [2019-02-04T17:09:33.640470 #20] DEBUG -- : {"Origin"=>"http://planning.hackney.gov.uk", "Referer"=>"http://planning.hackney.gov.uk/Northgate/PlanningExplorer/generalsearch.aspx"} D, [2019-02-04T17:09:33.640491 #20] DEBUG -- : GET: http://planning.hackney.gov.uk/Northgate/PlanningExplorer/generalsearch.aspx Error: failed to connect: Connection refused - connect(2) for "planning.hackney.gov.uk" port 80 Scrape 2 of 2: keywords: bt phone kiosk Using Northgate scraper. I, [2019-02-04T17:09:34.095246 #20] INFO -- : Form variables: {"csbtnSearch"=>"Search", "txtProposal"=>"bt phone kiosk", "cboSelectDateValue"=>"DATE_VALID", "rbGroup"=>"rbRange", "dateStart"=>"2017-06-15", "dateEnd"=>"2019-02-04"} D, [2019-02-04T17:09:34.095309 #20] DEBUG -- : HTTP request headers: D, [2019-02-04T17:09:34.095335 #20] DEBUG -- : {"Origin"=>"http://planning.hackney.gov.uk", "Referer"=>"http://planning.hackney.gov.uk/Northgate/PlanningExplorer/generalsearch.aspx"} D, [2019-02-04T17:09:34.095354 #20] DEBUG -- : GET: http://planning.hackney.gov.uk/Northgate/PlanningExplorer/generalsearch.aspx Error: failed to connect: Connection refused - connect(2) for "planning.hackney.gov.uk" port 80 42 of 112: Halton Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Halton at URL: https://webapp.halton.gov.uk/planningapps/ Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Halton at URL: https://webapp.halton.gov.uk/planningapps/ 43 of 112: Hammersmith and Fulham Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://public-access.lbhf.gov.uk/online-applications/search.do?action=advanced Error: connection refused: public-access.lbhf.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://public-access.lbhf.gov.uk/online-applications/search.do?action=advanced Error: connection refused: public-access.lbhf.gov.uk:80 44 of 112: Haringey Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Haringey at URL: http://www.planningservices.haringey.gov.uk/portal/servlets/ApplicationSearchServlet Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Haringey at URL: http://www.planningservices.haringey.gov.uk/portal/servlets/ApplicationSearchServlet 45 of 112: Harrow Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Harrow at URL: http://www.harrow.gov.uk/planningsearch/lg/plansearch.page?org.apache.shale.dialog.DIALOG_NAME=planningsearch&Param=lg.Planning&searchType=detailed Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Harrow at URL: http://www.harrow.gov.uk/planningsearch/lg/plansearch.page?org.apache.shale.dialog.DIALOG_NAME=planningsearch&Param=lg.Planning&searchType=detailed 46 of 112: Havering Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Havering at URL: http://development.havering.gov.uk/OcellaWeb/planningSearch Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Havering at URL: http://development.havering.gov.uk/OcellaWeb/planningSearch 47 of 112: Hillingdon Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Hillingdon at URL: http://planning.hillingdon.gov.uk/OcellaWeb/planningSearch Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Hillingdon at URL: http://planning.hillingdon.gov.uk/OcellaWeb/planningSearch 48 of 112: Hounslow Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Hounslow at URL: http://planning.hounslow.gov.uk/planning_search.aspx Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Hounslow at URL: http://planning.hounslow.gov.uk/planning_search.aspx 49 of 112: Hull Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://www.hullcc.gov.uk/padcbc/publicaccess-live/search.do?action=advanced Error: connection refused: www.hullcc.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://www.hullcc.gov.uk/padcbc/publicaccess-live/search.do?action=advanced Error: connection refused: www.hullcc.gov.uk:443 50 of 112: Islington Scrape 1 of 2: keywords: inlink Using Northgate scraper. I, [2019-02-04T17:09:34.925889 #20] INFO -- : Form variables: {"csbtnSearch"=>"Search", "txtProposal"=>"inlink", "cboSelectDateValue"=>"DATE_VALID", "rbGroup"=>"rbRange", "dateStart"=>"2017-06-15", "dateEnd"=>"2019-02-04"} D, [2019-02-04T17:09:34.925942 #20] DEBUG -- : HTTP request headers: D, [2019-02-04T17:09:34.925973 #20] DEBUG -- : {"Origin"=>"http://planning.islington.gov.uk", "Referer"=>"http://planning.islington.gov.uk/northgate/planningexplorer/generalsearch.aspx"} D, [2019-02-04T17:09:34.926178 #20] DEBUG -- : GET: http://planning.islington.gov.uk/northgate/planningexplorer/generalsearch.aspx Error: failed to connect: Connection refused - connect(2) for "planning.islington.gov.uk" port 80 Scrape 2 of 2: keywords: bt phone kiosk Using Northgate scraper. I, [2019-02-04T17:09:35.097810 #20] INFO -- : Form variables: {"csbtnSearch"=>"Search", "txtProposal"=>"bt phone kiosk", "cboSelectDateValue"=>"DATE_VALID", "rbGroup"=>"rbRange", "dateStart"=>"2017-06-15", "dateEnd"=>"2019-02-04"} D, [2019-02-04T17:09:35.097897 #20] DEBUG -- : HTTP request headers: D, [2019-02-04T17:09:35.097935 #20] DEBUG -- : {"Origin"=>"http://planning.islington.gov.uk", "Referer"=>"http://planning.islington.gov.uk/northgate/planningexplorer/generalsearch.aspx"} D, [2019-02-04T17:09:35.097957 #20] DEBUG -- : GET: http://planning.islington.gov.uk/northgate/planningexplorer/generalsearch.aspx Error: failed to connect: Connection refused - connect(2) for "planning.islington.gov.uk" port 80 51 of 112: Kensington and Chelsea Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Kensington and Chelsea at URL: https://www.rbkc.gov.uk/planning/searches/default.aspx?adv=1#advancedSearch Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Kensington and Chelsea at URL: https://www.rbkc.gov.uk/planning/searches/default.aspx?adv=1#advancedSearch 52 of 112: Kingston upon Thames Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://publicaccess.kingston.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.kingston.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://publicaccess.kingston.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.kingston.gov.uk:443 53 of 112: Knowsley Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planapp.knowsley.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planapp.knowsley.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planapp.knowsley.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planapp.knowsley.gov.uk:443 54 of 112: Lambeth Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planning.lambeth.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.lambeth.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planning.lambeth.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.lambeth.gov.uk:443 55 of 112: Leeds Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://publicaccess.leeds.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.leeds.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://publicaccess.leeds.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.leeds.gov.uk:443 56 of 112: Lewisham Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://planning.lewisham.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.lewisham.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://planning.lewisham.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.lewisham.gov.uk:80 57 of 112: Liverpool Scrape 1 of 2: keywords: inlink Using Northgate scraper. I, [2019-02-04T17:09:41.912430 #20] INFO -- : Form variables: {"csbtnSearch"=>"Search", "txtProposal"=>"inlink", "cboSelectDateValue"=>"DATE_VALID", "rbGroup"=>"rbRange", "dateStart"=>"2017-06-15", "dateEnd"=>"2019-02-04"} D, [2019-02-04T17:09:41.912483 #20] DEBUG -- : HTTP request headers: D, [2019-02-04T17:09:41.912508 #20] DEBUG -- : {"Origin"=>"http://northgate.liverpool.gov.uk", "Referer"=>"http://northgate.liverpool.gov.uk/PlanningExplorer17/GeneralSearch.aspx"} D, [2019-02-04T17:09:41.912528 #20] DEBUG -- : GET: http://northgate.liverpool.gov.uk/PlanningExplorer17/GeneralSearch.aspx Error: failed to connect: Connection refused - connect(2) for "northgate.liverpool.gov.uk" port 80 Scrape 2 of 2: keywords: bt phone kiosk Using Northgate scraper. I, [2019-02-04T17:09:42.378710 #20] INFO -- : Form variables: {"csbtnSearch"=>"Search", "txtProposal"=>"bt phone kiosk", "cboSelectDateValue"=>"DATE_VALID", "rbGroup"=>"rbRange", "dateStart"=>"2017-06-15", "dateEnd"=>"2019-02-04"} D, [2019-02-04T17:09:42.378772 #20] DEBUG -- : HTTP request headers: D, [2019-02-04T17:09:42.378798 #20] DEBUG -- : {"Origin"=>"http://northgate.liverpool.gov.uk", "Referer"=>"http://northgate.liverpool.gov.uk/PlanningExplorer17/GeneralSearch.aspx"} D, [2019-02-04T17:09:42.378818 #20] DEBUG -- : GET: http://northgate.liverpool.gov.uk/PlanningExplorer17/GeneralSearch.aspx Error: failed to connect: Connection refused - connect(2) for "northgate.liverpool.gov.uk" port 80 58 of 112: London Legacy Development Corporation Scrape 1 of 2: keywords: inlink Error: Planning system not supported for London Legacy Development Corporation at URL: http://planningregister.londonlegacy.co.uk/swift/apas/run/wphappcriteria.display Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for London Legacy Development Corporation at URL: http://planningregister.londonlegacy.co.uk/swift/apas/run/wphappcriteria.display 59 of 112: Manchester Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://pa.manchester.gov.uk/online-applications/search.do?action=advanced Error: connection refused: pa.manchester.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://pa.manchester.gov.uk/online-applications/search.do?action=advanced Error: connection refused: pa.manchester.gov.uk:443 60 of 112: Merton Scrape 1 of 2: keywords: inlink Using Northgate scraper. I, [2019-02-04T17:09:42.818518 #20] INFO -- : Form variables: {"csbtnSearch"=>"Search", "txtProposal"=>"inlink", "cboSelectDateValue"=>"DATE_VALID", "rbGroup"=>"rbRange", "dateStart"=>"2017-06-15", "dateEnd"=>"2019-02-04"} D, [2019-02-04T17:09:42.818575 #20] DEBUG -- : HTTP request headers: D, [2019-02-04T17:09:42.818601 #20] DEBUG -- : {"Origin"=>"http://planning.merton.gov.uk", "Referer"=>"http://planning.merton.gov.uk/Northgate/PlanningExplorerAA/GeneralSearch.aspx"} D, [2019-02-04T17:09:42.818620 #20] DEBUG -- : GET: http://planning.merton.gov.uk/Northgate/PlanningExplorerAA/GeneralSearch.aspx Error: failed to connect: Connection refused - connect(2) for "planning.merton.gov.uk" port 80 Scrape 2 of 2: keywords: bt phone kiosk Using Northgate scraper. I, [2019-02-04T17:09:43.260563 #20] INFO -- : Form variables: {"csbtnSearch"=>"Search", "txtProposal"=>"bt phone kiosk", "cboSelectDateValue"=>"DATE_VALID", "rbGroup"=>"rbRange", "dateStart"=>"2017-06-15", "dateEnd"=>"2019-02-04"} D, [2019-02-04T17:09:43.260625 #20] DEBUG -- : HTTP request headers: D, [2019-02-04T17:09:43.260658 #20] DEBUG -- : {"Origin"=>"http://planning.merton.gov.uk", "Referer"=>"http://planning.merton.gov.uk/Northgate/PlanningExplorerAA/GeneralSearch.aspx"} D, [2019-02-04T17:09:43.260678 #20] DEBUG -- : GET: http://planning.merton.gov.uk/Northgate/PlanningExplorerAA/GeneralSearch.aspx Error: failed to connect: Connection refused - connect(2) for "planning.merton.gov.uk" port 80 61 of 112: Milton Keynes Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://publicaccess2.milton-keynes.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess2.milton-keynes.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://publicaccess2.milton-keynes.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess2.milton-keynes.gov.uk:443 62 of 112: Newcastle upon Tyne Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://publicaccessapplications.newcastle.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccessapplications.newcastle.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://publicaccessapplications.newcastle.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccessapplications.newcastle.gov.uk:443 63 of 112: Newham Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://pa.newham.gov.uk/online-applications/search.do?action=advanced Error: connection refused: pa.newham.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://pa.newham.gov.uk/online-applications/search.do?action=advanced Error: connection refused: pa.newham.gov.uk:443 64 of 112: North East Lincolnshire Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://planninganddevelopment.nelincs.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planninganddevelopment.nelincs.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://planninganddevelopment.nelincs.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planninganddevelopment.nelincs.gov.uk:80 65 of 112: North Lincolnshire Scrape 1 of 2: keywords: inlink Error: Planning system not supported for North Lincolnshire at URL: http://www.planning.northlincs.gov.uk/plan/search/ Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for North Lincolnshire at URL: http://www.planning.northlincs.gov.uk/plan/search/ 66 of 112: North Somerset Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planning.n-somerset.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.n-somerset.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planning.n-somerset.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.n-somerset.gov.uk:443 67 of 112: Northern Ireland Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://epicpublic.planningni.gov.uk/publicaccess/search.do?action=advanced&searchType=Application Error: connection refused: epicpublic.planningni.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://epicpublic.planningni.gov.uk/publicaccess/search.do?action=advanced&searchType=Application Error: connection refused: epicpublic.planningni.gov.uk:80 68 of 112: North Tyneside Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://idoxpublicaccess.northtyneside.gov.uk/online-applications/search.do?action=advanced Error: connection refused: idoxpublicaccess.northtyneside.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://idoxpublicaccess.northtyneside.gov.uk/online-applications/search.do?action=advanced Error: connection refused: idoxpublicaccess.northtyneside.gov.uk:443 69 of 112: Northumberland Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://publicaccess.northumberland.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.northumberland.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://publicaccess.northumberland.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.northumberland.gov.uk:443 70 of 112: Nottingham Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://publicaccess.nottinghamcity.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.nottinghamcity.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://publicaccess.nottinghamcity.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.nottinghamcity.gov.uk:80 71 of 112: Old Oak and Park Royal Development Corporation Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Old Oak and Park Royal Development Corporation at URL: http://planningregister.opdc.london.gov.uk/swift/apas/run/wphappcriteria.display Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Old Oak and Park Royal Development Corporation at URL: http://planningregister.opdc.london.gov.uk/swift/apas/run/wphappcriteria.display 72 of 112: Oldham Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://planningpa.oldham.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningpa.oldham.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://planningpa.oldham.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningpa.oldham.gov.uk:80 73 of 112: Peterborough Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planpa.peterborough.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planpa.peterborough.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planpa.peterborough.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planpa.peterborough.gov.uk:443 74 of 112: Plymouth Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planning.plymouth.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.plymouth.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planning.plymouth.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.plymouth.gov.uk:443 75 of 112: Poole Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://boppa.poole.gov.uk/online-applications/search.do?action=advanced Error: connection refused: boppa.poole.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://boppa.poole.gov.uk/online-applications/search.do?action=advanced Error: connection refused: boppa.poole.gov.uk:443 76 of 112: Portsmouth Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://publicaccess.portsmouth.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.portsmouth.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://publicaccess.portsmouth.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.portsmouth.gov.uk:80 77 of 112: Redbridge Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Redbridge at URL: http://planning.redbridge.gov.uk/swiftlg/apas/run/wphappcriteria.display Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Redbridge at URL: http://planning.redbridge.gov.uk/swiftlg/apas/run/wphappcriteria.display 78 of 112: Richmond Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Richmond at URL: http://www2.richmond.gov.uk/PlanData2/Planning_Report.aspx Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Richmond at URL: http://www2.richmond.gov.uk/PlanData2/Planning_Report.aspx 79 of 112: Rochdale Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://publicaccess.rochdale.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.rochdale.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://publicaccess.rochdale.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.rochdale.gov.uk:80 80 of 112: Rutland Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://publicaccess.rutland.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.rutland.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://publicaccess.rutland.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.rutland.gov.uk:443 81 of 112: Salford Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://publicaccess.salford.gov.uk/publicaccess/search.do?action=advanced Error: connection refused: publicaccess.salford.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://publicaccess.salford.gov.uk/publicaccess/search.do?action=advanced Error: connection refused: publicaccess.salford.gov.uk:80 82 of 112: Sefton Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://pa.sefton.gov.uk/online-applications/search.do?action=advanced Error: connection refused: pa.sefton.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://pa.sefton.gov.uk/online-applications/search.do?action=advanced Error: connection refused: pa.sefton.gov.uk:443 83 of 112: Sheffield Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planningapps.sheffield.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningapps.sheffield.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planningapps.sheffield.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningapps.sheffield.gov.uk:443 84 of 112: Solihull Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://publicaccess.solihull.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.solihull.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://publicaccess.solihull.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.solihull.gov.uk:443 85 of 112: Southend-on-Sea Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://publicaccess.southend.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.southend.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://publicaccess.southend.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.southend.gov.uk:443 86 of 112: South Downs Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planningpublicaccess.southdowns.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningpublicaccess.southdowns.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planningpublicaccess.southdowns.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningpublicaccess.southdowns.gov.uk:443 87 of 112: Southampton Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planningpublicaccess.southampton.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningpublicaccess.southampton.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planningpublicaccess.southampton.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningpublicaccess.southampton.gov.uk:443 88 of 112: South Gloucestershire Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://developments.southglos.gov.uk/online-applications/search.do?action=advanced Error: connection refused: developments.southglos.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://developments.southglos.gov.uk/online-applications/search.do?action=advanced Error: connection refused: developments.southglos.gov.uk:443 89 of 112: South Tyneside Scrape 1 of 2: keywords: inlink Using Northgate scraper. I, [2019-02-04T17:09:53.553554 #20] INFO -- : Form variables: {"csbtnSearch"=>"Search", "txtProposal"=>"inlink", "cboSelectDateValue"=>"DATE_VALID", "rbGroup"=>"rbRange", "dateStart"=>"2017-06-15", "dateEnd"=>"2019-02-04"} D, [2019-02-04T17:09:53.553609 #20] DEBUG -- : HTTP request headers: D, [2019-02-04T17:09:53.553634 #20] DEBUG -- : {"Origin"=>"http://planning.southtyneside.info", "Referer"=>"http://planning.southtyneside.info/Northgate/PlanningExplorer/GeneralSearch.aspx"} D, [2019-02-04T17:09:53.553653 #20] DEBUG -- : GET: http://planning.southtyneside.info/Northgate/PlanningExplorer/GeneralSearch.aspx Error: failed to connect: Connection refused - connect(2) for "planning.southtyneside.info" port 80 Scrape 2 of 2: keywords: bt phone kiosk Using Northgate scraper. I, [2019-02-04T17:09:54.206130 #20] INFO -- : Form variables: {"csbtnSearch"=>"Search", "txtProposal"=>"bt phone kiosk", "cboSelectDateValue"=>"DATE_VALID", "rbGroup"=>"rbRange", "dateStart"=>"2017-06-15", "dateEnd"=>"2019-02-04"} D, [2019-02-04T17:09:54.206194 #20] DEBUG -- : HTTP request headers: D, [2019-02-04T17:09:54.206221 #20] DEBUG -- : {"Origin"=>"http://planning.southtyneside.info", "Referer"=>"http://planning.southtyneside.info/Northgate/PlanningExplorer/GeneralSearch.aspx"} D, [2019-02-04T17:09:54.206242 #20] DEBUG -- : GET: http://planning.southtyneside.info/Northgate/PlanningExplorer/GeneralSearch.aspx Error: failed to connect: Connection refused - connect(2) for "planning.southtyneside.info" port 80 90 of 112: Southwark Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planning.southwark.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.southwark.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planning.southwark.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.southwark.gov.uk:443 91 of 112: St. Helens Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://publicaccess.sthelens.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.sthelens.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://publicaccess.sthelens.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.sthelens.gov.uk:443 92 of 112: Stockport Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://planning.stockport.gov.uk/PlanningData-live/search.do?action=advanced Error: connection refused: planning.stockport.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://planning.stockport.gov.uk/PlanningData-live/search.do?action=advanced Error: connection refused: planning.stockport.gov.uk:80 93 of 112: Stockton-on-Tees Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://www.developmentmanagement.stockton.gov.uk/online-applications/search.do?action=advanced Error: Failed to open TCP connection to www.developmentmanagement.stockton.gov.uk:443 (Cannot assign requested address - connect(2) for "www.developmentmanagement.stockton.gov.uk" port 443) Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://www.developmentmanagement.stockton.gov.uk/online-applications/search.do?action=advanced Error: Failed to open TCP connection to www.developmentmanagement.stockton.gov.uk:443 (Cannot assign requested address - connect(2) for "www.developmentmanagement.stockton.gov.uk" port 443) 94 of 112: Stoke-on-Trent Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planning.stoke.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.stoke.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planning.stoke.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.stoke.gov.uk:443 95 of 112: Sunderland Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://www.sunderland.gov.uk/online-applications/search.do?action=advanced Error: connection refused: www.sunderland.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://www.sunderland.gov.uk/online-applications/search.do?action=advanced Error: connection refused: www.sunderland.gov.uk:443 96 of 112: Sutton Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planningregister.sutton.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningregister.sutton.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planningregister.sutton.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningregister.sutton.gov.uk:443 97 of 112: Swindon Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://pa1.swindon.gov.uk/publicaccess/search.do?action=advanced Error: connection refused: pa1.swindon.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://pa1.swindon.gov.uk/publicaccess/search.do?action=advanced Error: connection refused: pa1.swindon.gov.uk:443 98 of 112: Tameside Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Tameside at URL: https://public.tameside.gov.uk/plan/f422planapp.asp Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Tameside at URL: https://public.tameside.gov.uk/plan/f422planapp.asp 99 of 112: Thurrock Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://regs.thurrock.gov.uk/online-applications/search.do?action=advanced Error: connection refused: regs.thurrock.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://regs.thurrock.gov.uk/online-applications/search.do?action=advanced Error: connection refused: regs.thurrock.gov.uk:443 100 of 112: Torbay Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://www.torbay.gov.uk/newpublicaccess/search.do?action=advanced Error: connection refused: www.torbay.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://www.torbay.gov.uk/newpublicaccess/search.do?action=advanced Error: connection refused: www.torbay.gov.uk:443 101 of 112: Tower Hamlets Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://development.towerhamlets.gov.uk/online-applications/search.do?action=advanced Error: connection refused: development.towerhamlets.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://development.towerhamlets.gov.uk/online-applications/search.do?action=advanced Error: connection refused: development.towerhamlets.gov.uk:443 102 of 112: Trafford Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://publicaccess.trafford.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.trafford.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://publicaccess.trafford.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.trafford.gov.uk:443 103 of 112: Wakefield Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planning.wakefield.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.wakefield.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planning.wakefield.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.wakefield.gov.uk:443 104 of 112: Waltham Forest Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Waltham Forest at URL: http://planning.walthamforest.gov.uk/application-search?civica.query.ReceivedDateFrom=20%2F05%2F2018&civica.query.ReceivedDateTo=26%2F05%2F2018 Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Waltham Forest at URL: http://planning.walthamforest.gov.uk/application-search?civica.query.ReceivedDateFrom=20%2F05%2F2018&civica.query.ReceivedDateTo=26%2F05%2F2018 105 of 112: Wandsworth Scrape 1 of 2: keywords: inlink Using Northgate scraper. I, [2019-02-04T17:10:01.621000 #20] INFO -- : Form variables: {"csbtnSearch"=>"Search", "txtProposal"=>"inlink", "cboSelectDateValue"=>"DATE_VALID", "rbGroup"=>"rbRange", "dateStart"=>"2017-06-15", "dateEnd"=>"2019-02-04"} D, [2019-02-04T17:10:01.621096 #20] DEBUG -- : HTTP request headers: D, [2019-02-04T17:10:01.621124 #20] DEBUG -- : {"Origin"=>"https://planning1.wandsworth.gov.uk", "Referer"=>"https://planning1.wandsworth.gov.uk/Northgate/PlanningExplorer/GeneralSearch.aspx"} D, [2019-02-04T17:10:01.621143 #20] DEBUG -- : GET: https://planning1.wandsworth.gov.uk/Northgate/PlanningExplorer/GeneralSearch.aspx Error: failed to connect: Connection refused - connect(2) for "planning1.wandsworth.gov.uk" port 443 Scrape 2 of 2: keywords: bt phone kiosk Using Northgate scraper. I, [2019-02-04T17:10:01.936435 #20] INFO -- : Form variables: {"csbtnSearch"=>"Search", "txtProposal"=>"bt phone kiosk", "cboSelectDateValue"=>"DATE_VALID", "rbGroup"=>"rbRange", "dateStart"=>"2017-06-15", "dateEnd"=>"2019-02-04"} D, [2019-02-04T17:10:01.936500 #20] DEBUG -- : HTTP request headers: D, [2019-02-04T17:10:01.936527 #20] DEBUG -- : {"Origin"=>"https://planning1.wandsworth.gov.uk", "Referer"=>"https://planning1.wandsworth.gov.uk/Northgate/PlanningExplorer/GeneralSearch.aspx"} D, [2019-02-04T17:10:01.936547 #20] DEBUG -- : GET: https://planning1.wandsworth.gov.uk/Northgate/PlanningExplorer/GeneralSearch.aspx Error: failed to connect: Connection refused - connect(2) for "planning1.wandsworth.gov.uk" port 443 106 of 112: West Berkshire Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://publicaccess.westberks.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.westberks.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://publicaccess.westberks.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.westberks.gov.uk:443 107 of 112: Westminster Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://idoxpa.westminster.gov.uk/online-applications/search.do?action=advanced Error: connection refused: idoxpa.westminster.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://idoxpa.westminster.gov.uk/online-applications/search.do?action=advanced Error: connection refused: idoxpa.westminster.gov.uk:80 108 of 112: Wigan Scrape 1 of 2: keywords: inlink Error: Planning system not supported for Wigan at URL: https://apps.wigan.gov.uk/planapps/PlanAppsAppSearch.asp Scrape 2 of 2: keywords: bt phone kiosk Error: Planning system not supported for Wigan at URL: https://apps.wigan.gov.uk/planapps/PlanAppsAppSearch.asp 109 of 112: Windsor and Maidenhead Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://publicaccess.rbwm.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.rbwm.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://publicaccess.rbwm.gov.uk/online-applications/search.do?action=advanced Error: connection refused: publicaccess.rbwm.gov.uk:80 110 of 112: Wirral Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planning.wirral.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.wirral.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planning.wirral.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planning.wirral.gov.uk:443 111 of 112: Wolverhampton Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: http://planningonline.wolverhampton.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningonline.wolverhampton.gov.uk:80 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: http://planningonline.wolverhampton.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningonline.wolverhampton.gov.uk:80 112 of 112: York Scrape 1 of 2: keywords: inlink Using Idox scraper. Getting: https://planningaccess.york.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningaccess.york.gov.uk:443 Scrape 2 of 2: keywords: bt phone kiosk Using Idox scraper. Getting: https://planningaccess.york.gov.uk/online-applications/search.do?action=advanced Error: connection refused: planningaccess.york.gov.uk:443

Data

Downloaded 129 times by adrianshort

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.44 MB) Use the API

rows 10 / 1508

scraped_at authority_name council_reference date_received date_validated status decision date_decision info_url address description documents_count documents_url alternative_reference appeal_status appeal_decision
2018-10-10T15:36:59
Enfield
18/03819/ADV
2018-10-04
2018-10-04
Application in Progress
Site:- Public Footpath Opposite Telephone Exchange High Street EN3 4EW
Installation of an internally illuminated digital LED display screen to both sides of the proposed free standing InLink.
7
PP-07311230
Unknown
Not Available
2018-10-10T16:17:56
Lewisham
DC/18/108640
2018-08-21
2018-08-21
Registered
PAVEMENT OUTSIDE, 238-242 LEWISHAM HIGH STREET, LONDON, SE13
Prior approval for the installation of a free-standing InLink digital touchscreen unit outside 238-242 Lewisham High Street SE13, pursuant to Schedule 2, Part 16 of the Town and Country Planning (General Permitted Development) Order 2015.
5
LE/INLINK/TP
Not Available
2018-10-10T16:18:43
Lewisham
DC/18/108631
2018-08-21
2018-08-21
Registered
PAVEMENT OUTSIDE, 2 DEPTFORD HIGH STREET, LONDON, SE8
Prior approval for the installation of a free-standing InLink digital touchscreen unit outside 2 Deptford High Street SE8, pursuant to Schedule 2, Part 16 of the Town and Country Planning (General Permitted Development) Order 2015.
5
DE/INLINK/TP
Not Available
2018-10-10T16:21:00
Lewisham
DC/18/108613
2018-08-21
2018-08-21
Registered
GIFFIN SQUARE, DEPTFORD HIGH STREET, LONDON, SE8 4RQ
Prior approval for the installation of a free-standing InLink digital touchscreen unit at Griffin Square Deptford High Street SE8, pursuant to Schedule 2, Part 16 of the Town and Country Planning (General Permitted Development) Order 2015.
5
DE/INLINK/TP
Not Available
2018-10-10T18:24:42
Salford
18/72106/TEL56
2018-07-07
2018-08-07
Decided
Outside Monarch Solicitors City Point 156 Chapel Street Salford M3 6BF
Prior notification of proposed ground based apparatus comprising of an InLink unit
0
PP-06986806
Unknown
Not Available
2018-10-12T10:08:46
Lewisham
DC/18/108652
2018-08-21
2018-08-21
Registered
DEPTFORD RAILWAY STATION, DEPTFORD HIGH STREET, LONDON, SE8 3NU
Prior approval for the installation of a free-standing InLink digital touchscreen unit outside Deptford Railway Station, Deptford High Street SE8, pursuant to Schedule 2, Part 16 of the Town and Country Planning (General Permitted Development) Order 2015.
5
DE/INLINK/TP
Not Available
2018-10-12T10:09:01
Lewisham
DC/18/108650
2018-08-21
2018-08-21
Registered
PAVEMENT OUTSIDE, 177-179 DEPTFORD HIGH STREET, LONDON, SE8
Prior approval for the installation of a free-standing InLink digital touchscreen unit outside 177-179 Deptford High Street SE8, pursuant to Schedule 2, Part 16 of the Town and Country Planning (General Permitted Development) Order 2015.
5
DE/INLINK/TP
Not Available
2018-10-12T10:09:16
Lewisham
DC/18/108648
2018-08-21
2018-08-21
Registered
PAVEMENT OUTSIDE, 221-225 DEPTFORD HIGH STREET, LONDON, SE8
Prior approval for the installation of a free-standing InLink digital touchscreen unit outside 221-225 Deptford High Street SE8, pursuant to Schedule 2, Part 16 of the Town and Country Planning (General Permitted Development) Order 2015.
5
DE/INLINK/TP
Not Available
2018-10-12T10:10:02
Lewisham
DC/18/108641
2018-08-21
2018-08-21
Registered
PAVEMENT OUTSIDE, 197 LEWISHAM HIGH STREET, LONDON, SE13
Prior approval for the installation of a free-standing InLink digital touchscreen unit outside 197 Lewisham High Street SE13, pursuant to Schedule 2, Part 16 of the Town and Country Planning (General Permitted Development) Order 2015.
5
LE/INLINK/TP
Not Available
2018-10-12T10:10:18
Lewisham
DC/18/108637
2018-08-21
2018-08-21
Registered
PAVEMENT OPPOSITE, 262 LEWISHAM HIGH STREET, LONDON, SE13
Prior approval for the installation of a free-standing InLink digital touchscreen unit outside 233-241 Lewisham High Street SE13, pursuant to Schedule 2, Part 16 of the Town and Country Planning (General Permitted Development) Order 2015.
5
LE/INLINK/TP
Not Available

Statistics

Average successful run time: about 9 hours

Total run time: 3 months

Total cpu time used: about 4 hours

Total disk space used: 1.52 MB

History

  • Auto ran revision 21862a4c and completed successfully .
    nothing changed in the database
  • Auto ran revision e3bd2840 and failed .
    79 records added, 79 records removed in the database
    119 pages scraped
  • Auto ran revision e3bd2840 and completed successfully .
    1406 records added, 1406 records removed in the database
    2144 pages scraped
  • Auto ran revision e3bd2840 and completed successfully .
    1410 records added, 1410 records removed in the database
    2142 pages scraped
  • Auto ran revision e3bd2840 and completed successfully .
    1119 records added, 1119 records removed in the database
    1760 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

inlink-scraper / scraper.rb