ManuelBCU / Myfirstscraper

Scrapes foo.com, www.foo.com, query.wikidata.org, and 3 other domains

Foo.com


Contributors ManuelBCU

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Hello <!DOCTYPE html> <html data-adblockkey='MFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAL/3/SrV7P8AsTHMFSpPmYbyv2PkACHwmG9Z+1IFZq3vA54IN7pQcGnhgNo+8SN9r/KtUWCb9OPqTfWM1N4w/EUCAwEAAQ==_SWSZ/a887qeNgDyR88V/HpagDd3mJsrqq9QAOtr60lLTbm6U8aRlziJpuHLWpAnAP7Knt5Cp4voX6zE0ZRJ4kw=='> <head> <meta charset='UTF-8'> <title>Foo.com</title> <link href='data:image/png;base64,iVBORw0KGgo=' rel='icon' type='image/png'> <link href="/assets/style-85cdb3be1709c9028b204b38f8ccb358.css" media="none" onload="if(media!==&#x27;all&#x27;)media=&#x27;all&#x27;" rel="stylesheet" type="text/css" /> <link href="/assets/belt_layout_caf-4a3dea87ed4a809b49d0640b48d26654.css" media="none" onload="if(media!==&#x27;all&#x27;)media=&#x27;all&#x27;" rel="stylesheet" type="text/css" /> <script src="///code.jquery.com/jquery-3.3.1.min.js" type="text/javascript"></script> <!-- = stylesheet_link_tag "/load_style", :media => "all" --> <meta content="authenticity_token" name="csrf-param" /> <meta content="xwwx3Az7eNBsKLH/ILLcx4/+QPvTmr8yNwAKR6yghso=" name="csrf-token" /> <style> a, .ourterm a{ color: #00c; } .background1{ background-color: #ccc; } .background2{ background-color: #aaa; } .divider_background{ background-color: #aaa; } </style> </head> <body> <script async="async" src="/assets/application-ea87d7f1cf81efea754ac69b6a6922a8.js" type="text/javascript"></script> <center> <div id='outer_container'> <div id='outer_container2'> <div id='container'> <div id='header'> <div class='logo'> <a href="/">Foo.com</a> </div> <div class='googleframe' id='header_image'></div> </div> <div id='main'> <div class='image'> <img alt="Cordovabeach" border="0" src="/media/W1siZiIsIjIwMTIvMDQvMjYvMjAvMTEvNDkvNDI2L2NvcmRvdmFiZWFjaC5qcGciXSxbInAiLCJ0aHVtYiIsIjc1MHgyMDAjIl1d/cordovabeach.jpg" /></div> <div class='search'> <div class='catch_phrase'> <div id='wysiwyg_id_322' class='mercury-region' data-type='editable'>Search FOO.com </div> </div> <div class='googleframe' id='search'></div> </div> </div> <script> var searchblock1 = { 'type' : 'searchbox', 'container' : 'search', 'widthSearchButton' : 100, 'searchBoxMethod' : 'get' }; </script> <div id='footer'> <a href='/digimedia_privacy_policy.html' target='_blank'>Privacy Policy</a> - Copyright &copy; 2019 Digimedia.com, L.P. </div> </div> </div> </div> </center> <script src="/assets/abp2-4831d5b24977f8140fd9aa25543527f2.js" type="text/javascript"></script> <script src="/assets/ads-832e97bfd2d3e735f6dc8a30dd7190bc.js" type="text/javascript"></script> <!-- %script{:type=>"text/javascript", :language=>"JavaScript", :src=>"/abp.js"} --> <script language='JavaScript' src='///www.google.com/adsense/domains/caf.js' type='text/javascript'></script> <script> function jscript_log(name, severity, message, page){ $.ajax({ type: "POST", url: "/log_error", data: { name: name, severity: severity, domain: window.location.hostname, message: message, tag: 'dp-digimedia_js', page: page }, context: document.body }) } </script> <script> function google_index_loaded(requestAccepted, status) { if(!requestAccepted){ console.log('failed: ' + requestAccepted); jscript_log('faillisted', 10, JSON.stringify(status), "/") } console.log('status: '); console.log(status); } var pageOptions = { 'pubId' : 'dp-digimedia_js', 'kw': 'foo', 'domainRegistrant': 'as-drid-oo-1626960400946279', 'resultsPageBaseUrl': '///www.foo.com/results?', 'channel': 'digi-caf_pef,digimedia-template-09', 'adtest' : false, 'optimizeTerms': true, 'terms': '', 'colorAttribution' : 'black', 'fontFamilyAttribution' : 'arial', 'fontSizeAttribution' : 12, 'attributionBold' : false, 'fontSizeTitle' : 16, 'fontSizeDescription' : 12, 'lineHeightTitle' : 22, 'attributionBold' : false, 'numRepeated' : 3, 'pageLoadedCallback' : google_index_loaded, 'colorTitleLink' : '#00c', 'colorDomainLink' : 'green', 'noTitleUnderline' : false } </script> <script>new google.ads.domains.Caf(pageOptions, searchblock1);AdblockPlus.detect('/px.gif', function(usesABP){console.log('usesABP:' + usesABP);if(usesABP){blocked_ads_logger('whitelisted');}else{if(adsblocked()){blocked_ads_logger('blocked');}else{blocked_ads_logger('not_blocked');}}});</script> <!-- Global site tag (gtag.js) - Google Analytics --> <script async src='https://www.googletagmanager.com/gtag/js?id=UA-1726084-83'></script> <script> window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'UA-1726084-83', { 'page_title': 'foo.com', 'page_location': 'http://www.foo.com/', 'page_path': '/' }); gtag('event', 'index', {'event_category': 'domain_name', 'event_label': 'foo.com'}); </script> <script> var privacy_policy='/digimedia_privacy_policy.html'; var domain_name='foo.com' </script> <script src="///privacy.digimedia.com/check_cookie_country_code.js" type="text/javascript"></script> <style> .privacy_consent{ background:rgb(0,0,0,0.5); } .privacy_consent a{ color:black; } .privacy_consent_box{ text-shadow:none; padding:0px 20px; font-size:1.4em; } .privacy_consent_box h2{ display:none; margin:0px; padding:15px 0px 5px 0px; border-bottom: 1px solid #eee; } .privacy_consent_button{ padding:10px 20px; background:green; color:white; } .privacy_consent_more_button{ margin-right:15px; padding:10px 20px; background:black; color:white; } .privacy_consent_footer{ position:relative; clear:both; } .privacy_consent_footer_p{ font-size:0.6em; margin:0px; margin-top:15px; } </style> <script> $(document).ready(function(){ pc_options = { privacy_domain: "privacy.digimedia.com", ssl: false, title: null, question: "This website uses cookies to improve user experience. By using our website you consent to our <a href='"+privacy_policy+"' target='_blank'>privacy policy</a>.", links_left: [], agree_text: "YES, I ACCEPT", more_info_text: "MORE INFO", more_info_link: privacy_policy, text_color: 'black', link_color: 'black', width: '320px', height: '150px' } privacy_consent(pc_options); }); </script> </body> </html> [<Element div at 0x7f6c662722b8>] <Element html at 0x7f6c668f1f18> <Element a at 0x7f6c662722b8> <a href="/">Foo.com</a> {'link': '<a href="/">Foo.com</a>\n'} <Element a at 0x7f6c66272310> <a href="/digimedia_privacy_policy.html" target="_blank">Privacy Policy</a> - Copyright &#169; 2019 Digimedia.com, L.P. {'link': '<a href="/digimedia_privacy_policy.html" target="_blank">Privacy Policy</a>\n - \nCopyright &#169; 2019 Digimedia.com, L.P.\n'}

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3 KB) Use the API

rows 2 / 2

link
<a href="/">Foo.com</a>
<a href="/digimedia_privacy_policy.html" target="_blank">Privacy Policy</a> - Copyright © 2019 Digimedia.com, L.P.

Statistics

Average successful run time: half a minute

Total run time: 5 minutes

Total cpu time used: less than 10 seconds

Total disk space used: 57.1 KB

History

  • Manually ran revision 5848b5c9 and completed successfully .
    2 records added, 2 records removed in the database
    41 pages scraped
  • Manually ran revision 42c10615 and failed .
    2 records added in the database
    134 pages scraped
  • Manually ran revision 0c7903bf and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 5ae17923 and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision ab7e1eaf and failed .
    nothing changed in the database
    2 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Myfirstscraper