Connecting...

Data Warehouse DevOps Specialist

Job Title: Data Warehouse DevOps Specialist
Contract Type: Permanent
Location: Brisbane
Industry:
Salary: $100000 - $120000 per annum, Benefits: Build your own career path!
Start Date: 2019-06-10
Reference: JO-1904-94625-3
Contact Name: Soraya Hosseini
Contact Email: soraya.hosseini@davidsonwp.com
Job Published: June 11, 2019 11:33

Job Description


My client is looking for a talented professional who has the skills and passion to work in a cross functional team. In this role your main responsibility is to develop and maintain CICD DevOps pipeline with the goal to deploy multiple times in a day into Azure production environment.
 

Roles and Responsibilities:

  • Join an agile team and get involves in sprint planning and cycles
  • Manage develop and maintain code within Azure DevOps
  • Develop and execute test plans including data design and data extract / transform
  • Develop data pipelines and re-usable notebooks use of Data factory and Data bricks
  • Code in SQL/Python, leveraging the Spark processing engine
  • Ensure design and structure of the data lake as per policy
  • Develop and maintain data integration solutions to load and transform data
  • Ensure standards to create reusable frameworks for data load and error handling is used
  • Extract data from various sources (API, SFTP, Azure BLOB, S3 bucket)
  • Review work product of others for compliance with development standards
  • Assist in standard/governance and writing of technical documentation
  • Partner with key internal and external stakeholders to scope upcoming projects and deliver on key projects
  • Create technical scoping document on data sourcing, data structure and data model (conceptual, logical, and physical)
  • Ensuring Data Catalog is updated
  • Assisting with security, data protection
  • Design, document, and implement SSAS cubes (tabular) from dimensional models
  • Implementation of data governance through the use of SSAS meta-data layers

Required Experience:

  • Experience in incremental data loading patterns
  • Have expertise in implementing and maintaining data warehouse (Kimball) model and data marts
  • Demonstrate good knowledge on performance tuning on the data warehouse
  • Knowledge of Development Life Cycles
  • Strong experience in SQL, Databases and data modelling (Kimball)
  • Knowledge in Powershell, Azure Powershell, Python and .Net
  • Backup, automation, Azure Key Vaults, Azure Storage accounts, Disks, blob, Data lake
  • Experience with producing design specifications and creating technical documentation
  • Ability to work with large amounts of data
  • Experience with developing & supporting Relational Database (T-SQL)
  • ETL and design using SSIS
  • Experience in Azure Data Factory and Data Bricks
  • Experience Data Warehouse Development
  • Experience using Jira and Confluence
  • High level of flexibility with the ability to deal with high pressure environments, change and deadlines
  • Ability to work in team as well as contributing autonomously
 
Please submit your application in Word format. No visa sponsorship provided.




To apply, click the link and upload your current resume in Microsoft Word format only (.doc or .docx). If you would like to have a confidential discussion, please contact Soraya Hosseini on 07 3023 1005, quoting ref no. JO-1904-94625. Want to know more about Davidson? Visit us at www.davidsonwp.com