paulbradshaw / starting_to_code

nothing yet

Scrapes foo.com and www.foo.com

Foo.com


Contributors paulbradshaw

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... hello <!DOCTYPE html> <html data-adblockkey='MFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAL/3/SrV7P8AsTHMFSpPmYbyv2PkACHwmG9Z+1IFZq3vA54IN7pQcGnhgNo+8SN9r/KtUWCb9OPqTfWM1N4w/EUCAwEAAQ==_SWSZ/a887qeNgDyR88V/HpagDd3mJsrqq9QAOtr60lLTbm6U8aRlziJpuHLWpAnAP7Knt5Cp4voX6zE0ZRJ4kw=='> <head> <meta charset='UTF-8'> <title>Foo.com</title> <link href='data:image/png;base64,iVBORw0KGgo=' rel='icon' type='image/png'> <link href="/assets/style-85cdb3be1709c9028b204b38f8ccb358.css" media="none" onload="if(media!==&#x27;all&#x27;)media=&#x27;all&#x27;" rel="stylesheet" type="text/css" /> <link href="/assets/belt_layout_caf-4a3dea87ed4a809b49d0640b48d26654.css" media="none" onload="if(media!==&#x27;all&#x27;)media=&#x27;all&#x27;" rel="stylesheet" type="text/css" /> <!-- = stylesheet_link_tag "/load_style", :media => "all" --> <meta content="authenticity_token" name="csrf-param" /> <meta content="yLRKAs12R9rP5EyWu33caMgLcYSNJKzqHLD66AKVB+g=" name="csrf-token" /> <style> a, .ourterm a{ color: #00c; } .background1{ background-color: #ccc; } .background2{ background-color: #aaa; } .divider_background{ background-color: #aaa; } </style> </head> <body> <script async="async" src="/assets/application-ed93414a748943685ca41c9e0c475bc5.js" type="text/javascript"></script> <center> <div id='outer_container'> <div id='outer_container2'> <div id='container'> <div id='header'> <div class='logo'> <a href="/">Foo.com</a> </div> <div class='googleframe' id='header_image'></div> </div> <div id='main'> <div class='image'> <img alt="Cordovabeach" border="0" src="/media/W1siZiIsIjIwMTIvMDQvMjYvMjAvMTEvNDkvNDI2L2NvcmRvdmFiZWFjaC5qcGciXSxbInAiLCJ0aHVtYiIsIjc1MHgyMDAjIl1d/cordovabeach.jpg" /></div> <div class='search'> <div class='catch_phrase'> <div id='wysiwyg_id_322' class='mercury-region' data-type='editable'>Search FOO.com </div> </div> <div class='googleframe' id='search'></div> </div> </div> <script> var searchblock1 = { 'type' : 'searchbox', 'container' : 'search', 'widthSearchButton' : 100, 'searchBoxMethod' : 'get' }; </script> <div id='footer'> <a href='/digimedia_privacy_policy.html' target='_blank'>Privacy Policy</a> - Copyright &copy; 2018 Digimedia.com, L.P. </div> </div> </div> </div> </center> <script src="/assets/abp2-4831d5b24977f8140fd9aa25543527f2.js" type="text/javascript"></script> <script src="/assets/ads-832e97bfd2d3e735f6dc8a30dd7190bc.js" type="text/javascript"></script> <!-- %script{:type=>"text/javascript", :language=>"JavaScript", :src=>"/abp.js"} --> <script language='JavaScript' src='http://www.google.com/adsense/domains/caf.js' type='text/javascript'></script> <script> function jscript_log(name, severity, message, page){ $.ajax({ type: "POST", url: "/log_error", data: { name: name, severity: severity, domain: window.location.hostname, message: message, tag: 'dp-digimedia_js', page: page }, context: document.body }) } </script> <script> function google_index_loaded(requestAccepted, status) { if(!requestAccepted){ console.log('failed: ' + requestAccepted); jscript_log('faillisted', 10, JSON.stringify(status), "/") } console.log('status: '); console.log(status); } var pageOptions = { 'pubId' : 'dp-digimedia_js', 'kw': 'foo', 'domainRegistrant': 'as-drid-oo-1626960400946279', 'resultsPageBaseUrl': 'http://www.foo.com/results?', 'channel': 'digi-caf_pef,digimedia-template-09', 'adtest' : false, 'optimizeTerms': true, 'terms': '', 'colorAttribution' : 'black', 'fontFamilyAttribution' : 'arial', 'fontSizeAttribution' : 12, 'attributionBold' : false, 'fontSizeTitle' : 16, 'fontSizeDescription' : 12, 'lineHeightTitle' : 22, 'attributionBold' : false, 'numRepeated' : 3, 'pageLoadedCallback' : google_index_loaded, 'colorTitleLink' : '#00c', 'colorDomainLink' : 'green', 'noTitleUnderline' : false } </script> <script>new google.ads.domains.Caf(pageOptions, searchblock1);AdblockPlus.detect('/px.gif', function(usesABP){console.log('usesABP:' + usesABP);if(usesABP){blocked_ads_logger('whitelisted');}else{if(adsblocked()){blocked_ads_logger('blocked');}else{blocked_ads_logger('not_blocked');}}});</script> <!-- Global site tag (gtag.js) - Google Analytics --> <script async src='https://www.googletagmanager.com/gtag/js?id=UA-1726084-83'></script> <script> window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'UA-1726084-83', { 'page_title': 'foo.com', 'page_location': 'http://www.foo.com/', 'page_path': '/' }); gtag('event', 'index', {'event_category': 'domain_name', 'event_label': 'foo.com'}); </script> </body> </html> <Element html at 0x7f704a634470> Foo.com Privacy Policy

Statistics

Average successful run time: half a minute

Total run time: 2 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 32.3 KB

History

  • Manually ran revision 33183400 and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 3fcce3e0 and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Manually ran revision 9bd96ce7 and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 602dd11e and completed successfully .
    nothing changed in the database
  • Manually ran revision 88bf6f97 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

starting_to_code