Connecting...

Senior Data Engineer

Location Melbourne, Victoria
Job Type Contract
Reference JO-2010-101589_1602745240
Posted 4 days ago

Role : Sr Data Engineer

Contract - 6 months with extensions

Location - Melbourne (WFH to start with)

As the Senior Data Engineer you will have the following experience:

You will be available for an immediate start / 1 week notice

    • Experience of building data and analytics platforms with structured and un-structured data sources
    • Design, construct, install, test and maintain data pipelines across various layers in the data lake and presentation layer
    • Build high-performance algorithms, and prototypes around ETL data movement and ML models
    • Strong hands- on experience in Python and Pyspark
    • Hands-on experience with unit testing automation, regression testing suite and automated test data generation
    • Employ pyspark, sql in notebooks. Experience with a data processing engine like Databricks or EMR or equivalent
    • Collaborate with members of team (eg, data architects, the IT team, data scientists) on the project's goals
    • Recommend different ways to constantly improve data reliability and quality
    • Azure Cloud

Other skill :

    • Data modelling experience - Kimball, Inmon, vault models
    • Devops, git integration, automation of ci/cd pipelines
    • Agile processes
    • Implementation of Streaming analytics solutions
    • IoT, Event based triggers(Pub-Sub) systems




To apply, click the link and upload your current resume in Microsoft Word format only (.doc or .docx). Want to know more about Davidson? Visit us at www.davidsonwp.com