Specialist Data Engineer – MECoE

You already applied for this job.





Work type

Full Time

Job category

Engineering, Technology/IT

Date published

20 November 2019

Date closing

10 December 2019 at 00:00 GMT

About BHP

At BHP we support our people to grow, learn, develop their skills and reach their potential.

With a global portfolio of operations, we offer a diverse and inclusive environment with extraordinary career opportunities. Our strategy is to focus on creating a safe work environment where our employees feel strongly connected to our values and objectives, and where the capability of our people is key to our success.

Come and be a part of this success.

About the role

BHP’s Maintenance and Engineering and Engineering Centre of Excellence (MECoE) is the coming together of a dedicated, innovative team focused on identifying, achieving and maintaining the highest standards in maintenance for BHP globally.

The role will be performed from our Centre of Excellence hub based in our Brisbane office, supported by the latest technology to engage with our sites around the Australia and the globe.

Reporting to the Manager Data Analysis and Analytics, you will be responsible for overall architecture and development of our data lake, data pipelines and deployment of dashboards and algorithms developed by our data visualisation specialists and data scientists using DataOps principles.

Your key responsibilities in this role would be to:
  • Work closely with the BHP technology team to build the infrastructure required for optimal extraction, transformation, processing and modelling data using big data technologies;
  • Identify, design and implement improvements to optimise internal processes, data lake infrastructure, data pipelines and documentation;
  • Ensure security and quality of the entire data pipeline;
  • Automate manual processes including quality control, testing and deployment;
  • Create and maintain data pipelines to power our machine learning tools, models and dashboards;
  • Monitor the deployed tools and dashboards ensuring its proper upkeep and maintenance;
  • Collaborate with data scientists, data visualisation specialists, systems dynamics specialists, data analysts and business stakeholders to deliver data solutions to maximise the business value;
  • Create frameworks, guidelines, standards, procedures and documentation for testing, ongoing support and maintenance.

About You

The successful candidate will be able to work within a team environment to bring in best practices from DevOps, software engineering/development in our analytics processes and pipelines.

The following outlines key skills and experience to succeed in this role:
  • Strong track record of manipulating, processing, and extracting data from large databases;
  • Strong Cloudera, Hue, Impala skills;
  • Hands on experience in modelling and managing databases: relational SQL and NoSQL
  • Expertise in ETL tools;
  • DataOps: Eliminate the barriers between Data (Data) and operations (Ops);
  • Experience with data pipeline and workflow management tools;
  • Experience with unit testing, test driven development (TDD), behavior driven development (BDD), and code versioning systems (e.g. Bitbucket);
  • Experience in configuring and executing automated tests in a continuous integration development environment through Continuous Integration and Continuous delivery (CI/CD) tools;
  • Proficient in general propose programming languages (R and Python);
  • Experience in structured problem solving approaches to generate business value through analytics;
  • Experienced within a project management framework and mindset.
  • Experience in working with variety of stakeholders and people with different areas of expertise in an agile environment; and
  • A relevant tertiary qualification (Master’s degree in Information Technology, Computer Science, software Engineering or related discipline) is advantageous.

Supporting a diverse workforce

At BHP, we recognise that we are strengthened by diversity. We are committed to providing a work environment in which everyone is included, treated fairly and with respect. We are an Equal Opportunity employer and we encourage applications from women and Indigenous people.

We know there are many aspects of our employees’ lives that are important, and work is only one of these, so we offer benefits to enable your work to fit with your life. These benefits include flexible working options, a generous paid parental leave policy, other extended leave entitlements and parent rooms.  
Loading the player...