bluexm / hkjobadsDS

job ads


Introduction

This scraper for Morph.io is scraping job ads related to Data science in Hongkong. The initial objective is to observe the state and evolution of the discipline in Hong-Kong, through a dashboard or analytical related work.

The scraper currently scrapes search results obtained from indeed.hk.

Analytics

Analytics could bring up: - a view on companies: - state of companies: view on the technology stack used

  • needs in needs of HK companies
  • evolution of each company: hiring turnover, past skills recruited,
  • level of sophistication of the company (are requirements over-asking, are they a christmas list ?)
    • an agregated view:
  • usual stacks

    • length of time for an ad to stay

Initial questions

  • How many ads ? By time ? By company ? How do ads evolve ?
  • what are really the jobs asked for ?
  • Data analyst or data scientists ?
  • Mistakes and misunderstandings in the ads ?
  • General understanding (e.g. asking for "R/Python" is poor)
  • Are ads only copies of each other ?
  • What system is used in each company ?

Extensions

  • extend to other job boards (glassdoor, ...)
  • Extend beyond DS
  • Extend to ads in Chinese (different search)

Contributors bluexm cecilialee

Last run failed with status code 255.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-3.6.2  ! Requested runtime (python-3.6.2) is not available for this stack (cedar-14).  ! Aborting. More info: https://devcenter.heroku.com/articles/python-support

Data

Downloaded 60 times by bluexm cecilialee ebyron15 1976umar

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (8.75 MB) Use the API

rows 10 / 2589

timestamp scrping_dt ad_cie_indeed ad_jobtitle_indeed search_ad_url ad_url ad_jobdate ad_jobtitle ad_jobcie ad_jobdes ad_email
1588765828.7584
2020-05-06 11:50:28
Keyteo
Data Scientist - Hong Kong - (M/F)
- Just posted
Data Scientist - Hong Kong - (M/F)
Keyteo
Context of the jobKEYTEO Hong Kong is hiring a new permanent Consultant to work as Data Scientist for a project at one of our clients in the financial industry.The Consultant will work full time onsite at the client.ActivitiesThe Data Scientist will work with the client's team, his/her responsibilities include:Leverage data and machine learning technologies to transform data and text into actionable insightsBecome an integral part of the product growth team while working closely with data and marketingOptimize joint development efforts through appropriate database use and project designCommunicate results and ideas to key decision makersKeep up-to-date with latest technology trendsSharing of software best-practices with colleagues and mentoring of junior membersRequired profileA love for data and a strong sense of ownership5+ years of hands-on experience with developing statistical learning models for data analysisAdvanced NLP knowledge, especially for non-English Asian languagesExperience with big data tools: Hadoop, Spark, Kafka, etc.PhD or Master's degree in Mathematics, Statistics, Computer Science or a related technical fieldSalarySalary can be discussed upon profile.
noreply@indeed.com
1588765828.7584
2020-05-06 11:50:28
Société Générale
INTERN: Data Scientist
- 30+ days ago
INTERN: Data Scientist
Société Générale
ResponsibilitiesMain Responsibilities:Assist in Projects in Data science, including machine learning, big data, robotic process automation, data visualization and natural language processingOrganize knowledge sharing presentation and demonstration to the teamPropose innovative technical solutions and implement them using the latest technologiesImprove the existing systems by using the latest technologyProfile RequiredYour Profile:Currently studying towards a Bachelors or Masters degree in Mathematics, Computer science or similarKnowledge in python, node.js and web application developmentDemonstrate the capacity to work in a team environment, on collective successDisplay responsibility and act ethicallyDisplay commitment, demonstrating consideration for othersGood communication and organizational skillsPro-active, swift, analytical, rigorous, able to multi task and work under pressureFluent English is mandatoryPlease specify your availabilities for the internship on your resume.This is a 2-3 month internship with Societe Generale in Hong Kong whereby you will work within one business line / support function for the period. In order to apply for an internship opportunity with us please ensure you are currently studying towards a Bachelors or Masters degree and are available for the 2-3 month period.Business InsightSociete Generale is one of the leading financial services groups in Europe. Based on a universal banking model, the Group combines financial strength with a strategy of sustainable growth, putting its resources to work to finance the economy and its clients’ projects.With our regional headquarters in Hong Kong – a core hub of the worldwide Societe Generale Group – we employ over 9,000 employees in the region. Our expertise here ranges from corporate and investment banking to asset management, securities services, global transaction banking and specialised financial services.Within the Market Risk department in Asia, the major missions of the Metrics Monitoring Group are to independently monitor the capital markets activities, to support the development of the business and to meet the regulatory challenges of tomorrow.We are anequal opportunities employerand we are proud to make diversity a strength for our company. Societe Generale is committed to recognizing andpromoting all talents, regardless of their beliefs, age, disability, parental status, ethnic origin, nationality, sexual or gender identity, sexual orientation, membership of a political, religious, trade union or minority organisation, or any other characteristic that could be subject to discrimination.Job code:200002E3Business unit:Societe Generale Hong Kong BranchStarting date:01/06/2020Date of publication:24/01/2020
noreply@indeed.com
1588765828.7584
2020-05-06 11:50:28
CargoSmart (Hong Kong) Limited
Data Scientist / Associate Data Scientist / Trainee
- 2 days ago
Data Scientist / Associate Data Scientist / Trainee
CargoSmart (Hong Kong) Limited
We are a leading international container transport and logistics service provider, operating from more than 360 offices in 70 countries around the world. Our modern and ever-expanding fleet, in addition to our extensive international facilities, links Asia, Europe, North America and Mediterranean, the Indian sub-continent, the Middle East and Australia/New Zealand. As a customer-focused organization we embrace quality standards, utilizing the most advanced information technology and e-Commerce platforms in the industry.OOCL has long been recognized as the industry leader in developing and providing IT solutions for both container transportation customers and logistics customers. In addition, we are also the pioneer in the provision of IT solutions for other industry players through our advanced systems and portals. One such system is CargoSmart, one of the most advanced online application and integration service in the ocean container transportation industry, which has received 5 awards for its innovative use of leading technology.At OOCL we recognize that people are our most important asset and would like to invite high-caliber candidates to join our global team.Accelerate your careerExperience a taste of advanced technologies and working modulesEquip yourself with global exposure and a wide range of innovative projectsWork with a highly skilled team made up of talented individuals with amazing backgroundsYour roleBe curious and passionate in developing or enhancing machine learning and artificial intelligence algorithmsBring up your insights to dedicated projects with strong analytical and logical thinkingTransform your knowledge and ideas into enterprise solutionsEnjoy team collaboration and an open organizationWho we are looking forBachelors degree or above in Data Science, Statistics, Operations Research, Computer Science or related disciplinesSolid experience in artificial intelligence, Machine Learning, Data Science projectsKeen to learn high programing languages:Python, R, R/shiny, Spark on Big Data Cloud based technologies, SQL, and JavaLess experience will be considered as Associate Data ScientistFresh graduates are welcome to join Data Science Trainee ProgramInterested parties, please submit your application letter together with detailed resume and copies of your latest transcript by clicking Apply Now.(Data collected will be used for recruitment purpose only.)Full-time
noreply@indeed.com
1588765828.7584
2020-05-06 11:50:28
Gogovan
Data Scientist/Analyst
- 12 days ago
Data Scientist/Analyst
Gogovan
Mid LevelHong KongData Scientist/AnalystAbout UsOver the years, GOGOVAN has expanded its business from Hong Kong to Singapore, South Korea, Mainland China, India, and Taipei City and will continue to expand globally. In August 2017, GOGOVAN merged with 58 Suyun, the leader in Mainland China’s intra-city logistics market, and increased GOGOVAN’s presence to over 300 cities, with more than 8 million registered drivers under its network.Who we're looking forWe are looking for a tech-and-business savvy Data Analyst to join our data team.‍What you will be doing in this role:Understand and clarify stakeholder requirements and objectively interpret analysis results to make data-informed decisionsPerform quantitative analysis using Python (or R / Matlab) to uncover actionable insights and recommend feasible solution for our operation, product, marketing and other business unitsWrite SQL to process data in Postgres/MySQL databases and AWS AthenaBuild dashboards with Apache Superset to visualize data and monitor KPIEvaluate impact of business solutions/decisions and implement experiments related to incentive schemes, product feature change, marketing campaignsBuild models and algorithms to optimize solutions for marketplace efficiency and user retention and to estimate possible impact of our business actionsPerform statistical analysis to test significance of results due to business decisions and external factorsCreate and maintain ETL jobs to pre-process data from various sources for analytics purposeProcess data with Spark or Java/ScalaScrap data from web sources and APIAnalyse user behaviour with Mixpanel and AppsflyerConduct experiments with Braze messaging system to engage and retain usersWrite Javascript to develop web-based data exploration tools; knowing Node.js, React JS and Kepler.gl is a plusAbout you:excited by the workwilling to learn parts of the list above that you are less familiar withan analytical and curious personan excellent team playera pragmatic & results-driven personable to partner with cross functional teammates and innovatelove making suggestions to improve our work and cultureWhat we offer:birthday Leavemedical and dental Insurancefree GOGOVAN ridescompetitive salaryclear career progression path
noreply@indeed.com
1588765828.7584
2020-05-06 11:50:28
Asian Aim Service Ltd
Associate Data Scientist (Listed Group) (5 days work, No Sat...
- 6 days ago
Associate Data Scientist (Listed Group) (5 days work, No Sat) (28K-30K)
Asian Aim Service Ltd
Please call Ms. Lam at 2869-8638 or email:[email redacted, apply via company website] to obtain an application formDegree in Data Science, Computer Science, Mathematics, Statistics or relevant discipline 3-6 years experience in Data Science with Python and Machine Learning, Hadoop/Spark/TensorFlow exp. MUST Hands-on experience in machine learning and deep learning algorithms Good benefits and prospects Please call Ms. Lam at 2869-8638 / email: asianaim-biznetvigator. com to obtain an application form.All applications applied through our system will be delivered directly to the advertiser and privacy of personal data of the applicant will be ensured with security.Full-time,Permanent
noreply@indeed.com
1588765828.7584
2020-05-06 11:50:28
Krunch
Junior Data Scientist
- 30+ days ago
Junior Data Scientist
Krunch
Job Highlights:1~2 years of relevant work experience (fresh graduate are welcomed)Dynamic Tech Startup Environment working closely with US Silicon Valley tech firmsPython and SQL is a mustJob Responsibilities:Analyze and process complex data sets using advanced querying, visualization and analytics toolsWork on Data Cleansing and Normalizing, Data Management and Data Processing techniques like extracting, concatenating, modeling, sub-setting and duplicate recordsDevelop algorithms based on deep-dive statistical analysis and predictive data modelingCollecting data, text standardization and performing text mining using different python libraries to create clusters and classify to compare the lab resultsRequirement(Must):Hong Kong based University graduate in Computer Science, Quantitative Analysis, Statistics or related disciplinesStrong knowledge and experience with Python/R and SQLKnowledge of a variety of machine learning techniques (clustering, decision tree learning, artificial neural networks, etc.)Communication skills including written and spoken English (must) and ChineseFresh graduates are welcomedRequirement(Preferred):Experience with distributed data/computing tools: Hadoop or Apache SparkExperience visualizing/presenting data for stakeholders using: ggplot, d3.js , Matplottlib, or TableauFamiliar with different database structures like Array, Trees is a plusExperience with Unstructured data set would be an advantageGood interpersonal skills to deliver high quality of work and meet tight deadlinesBenefits:Attractive salary packageFlexible working hoursCan work remotely as long as deliverables are met on timely mannerOpportunity to travel and connect with tech firms in Silicon ValleyWork with experienced data scientistIf you are interested in this opportunity, please contact Jordan Chung viainfo@krunchdata.io
noreply@indeed.com
1588765828.7584
2020-05-06 11:50:28
Prime Insight
Junior Data Scientist
- 12 days ago
Junior Data Scientist
Prime Insight
Prime Insight specialises in recruitment spanning Data Analytics, Market Research, Technology and Digital. Established in 2008, we have built strong relationships with clients across industries, helping them with talent identification and acquisition across these hard-to-find rapidly developing skillsets.We want to be the best at what we do, connecting the best candidates with the best jobs, while changing the experience for everyone involved, starting with our candidates. We work through a quality-driven candidate-first approach, delivered by our highly experienced consultants in London, Dubai, Singapore and Hong Kong.At Prime Insight, we are Passionate, Bold and Genuine. So, be connected and let us change the experience.Prime Insight is a subsidiary of the London Stock Exchange quoted Prime People Plc.Website:www.primeinsight.comAs part of an established data science team, you willwork closely with Senior Data Scientists in an innovative and dynamic environment to drive growth by using big data technologies. You will learn to leverage data, both currently available big data and various external data sources, to develop a deep, while actionable, understanding of how customer data can be used to support the existing and new Lines of Business.ResponsibilitiesWork with complex and large data setsApply advanced analytical methods to solve difficult and non-routine business problemsAssist Data Scientists in building machine learning modelsGather data from multiple sources and extract business insightsWork closely with cross-function teams to achieve end-to-end data driven solutionsData visualization using different reporting software, such as Tableau and QlikRequirementsBachelor or Master degree in a quantitative discipline (e.g., statistics, operations research, bioinformatics, economics, computational biology, computer science, mathematics, physics, electrical engineering, and industrial engineering)1-3 years of experience in working with Big Data and deriving analytical findings and insights for a variety of audiences is an advantageMinimum 1 year using Python.A fast learner to learn new technology from research papersExperience in working with Big Data technologies (such as Hadoop and Spark) is a big plusEffective communication skill to understand business challenges and requirements while clearly elaborate the data analysis and mining tactic to help the businessAbility to use common sense to think independently and think out of the box, strong problem solving and analytical capabilities combined with critical thinking and research capabilityAbility to work in a time critical environment and to meet deadlinesInterested parties please click Apply Now to apply job.All applications applied through our system will be delivered directly to the advertiser and privacy of personal data of the applicant will be ensured with security.Full-time,Permanent
noreply@indeed.com
1588765828.7584
2020-05-06 11:50:28
Wheelock and Company Limited
Data Scientist
- 30+ days ago
Data Scientist
Wheelock and Company Limited
RESPONSIBILITIESResponsible for the analytics pipeline from data extraction, blending, cleansing and processing to model creation and result visualizationGather, analyze data and build statistical models to conduct data analysis and create algorithms to predict probabilitiesDevelop predictive and prescriptive models through programming in R or Python.Communicate quantitative insights into recommendations and present final results.Lead researches in the application of AI for stakeholdersIdentify and explore relevant data sources from internal and external sources, covering structured and unstructured dataDesign data collection, integration and retention requirements and frameworkWork with the IT system team to design and implement data-driven systems; and refine data collection processREQUIREMENTSDegree holder in related disciplinesStrong data project management, business process analysis and numerical skillsMinimum of 3 years in managerial role of data science, analytics or data managementMinimum of 6 years in data science, modeling and some scriptingHands on experience with machine learning models using Python or RGood command in using data management tools, data systems or related softwareData visualization skills, preferred experience in Power BI, Quik or TableauFluency in English and Chinese are requiredDesire to work across various projects and enjoy strategically advising clients on emerging data techniques and initiatives.
noreply@indeed.com
1588765828.7584
2020-05-06 11:50:28
Krunch
Data Scientist
- 23 days ago
Data Scientist
Krunch
Job Highlights:2~4 years of relevant work experienceDynamic Tech Startup Environment working closely with US Silicon Valley tech firmsPython and SQL is a mustJob Responsibilities:Research and Analyze complex data sets using advanced querying, visualization and analytics toolsWork on Data Cleansing and Normalizing, Data Management and Data Processing techniques like extracting, concatenating, modeling, sub-setting and duplicate recordsResearch and develop algorithms based on deep-dive statistical analysis and predictive data modelingCollecting data, text standardization and performing text mining using different python libraries to create clusters and classify to compare the lab resultsRequirement:Doctoral degree in Computer Science, Quantitative Analysis, Statistics or related disciplinesStrong knowledge and experience with Python/R and SQLKnowledge of a variety of machine learning techniques (clustering, decision tree learning, artificial neural networks, etc.)Communication skills including written and spoken English (must) and ChineseExperience with distributed data/computing tools: Hadoop or Apache SparkExperience visualizing/presenting data for stakeholders using: ggplot, d3.js , Matplottlib, or TableauFamiliar with different database structures like Array, Trees is a plusExperience with Unstructured data set would be an advantageGood interpersonal skills to deliver high quality of work and meet tight deadlinesBenefits:Attractive salary packageFlexible working hoursCan work remotely as long as deliverables are met on timely mannerOpportunity to travel and connect with tech firms in Silicon ValleyIf you are interested in this opportunity, please contact Jordan Chung viainfo@krunchdata.io
noreply@indeed.com
1588765828.7584
2020-05-06 11:50:28
Libbler
Data Scientist
- 30+ days ago
Data Scientist
Libbler
FintechTechnologyHong KongFull timeAboutData Scientist for one of Hong Kong’s fastest-growing FinTech companies innovating in personal finance solutions. Successful candidate will work with their high potential team focusing on deep technology problems leveraging big scale personal finance data.RequirementsStrong math and quantitative analysis background: cleansing, modeling and analysis1+ year relevant experience in Data science. Data Engineering and ETL/ pipeline workflows a plusPython and cloud technology experienceMinimum experience:1 yearLanguage(s):KEY EXPERTISEData cleansingMachine learningFintechData miningCloud computingPythonJOB REF IDVHwjRQy
noreply@indeed.com

Statistics

Average successful run time: 2 minutes

Total run time: 3 days

Total cpu time used: about 8 hours

Total disk space used: 9.11 MB

History

  • Auto ran revision 0c09af56 and failed .
    nothing changed in the database
  • Auto ran revision 0c09af56 and failed .
    nothing changed in the database
  • Auto ran revision 0c09af56 and failed .
    nothing changed in the database
  • Auto ran revision 0c09af56 and failed .
    nothing changed in the database
  • Auto ran revision 0c09af56 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

hkjobadsDS / scraper.py