Azure Senior Data Engineer

We’re looking for a Senior Data Engineer with just the right amount of quirk, craft, and computational wizardry to help us take things up a notch (or twelve).

You will work within a team solving complex problems to deliver real business value across a wide range of industries such as mining, telco’s, retail and financial services. You will help develop best practices and drive improvements in data engineering across the business.


Requirements:

• Graduate or Postgraduate degree in Computer Science, Information Technology,
• Statistics, Engineering or related technical field
• 8+ years of relational SQL database
• Solid understanding of Apache Spark as a distributed data processing framework
• Experience in designing, implementing and performance tuning solutions in Apache Spark
• Experience in complex data warehouse and data lake design
• Experience in building, optimising and manging data pipelines for large and complex datasets
• Experience using Azure cloud data platform technologies:
• Azure Storage / Data Lake
• Azure SQL Database
• Azure Data Factory
• Azure Databricks
• Azure Synapse Analytics to implement data pipelines and analytical solutions
• Experience in Python would be beneficial
• Experience with streaming technologies such as Spark streaming or Kafka would be beneficial
• A relevant data engineering certification would be beneficial

Reference number for this position is GZ60673 which is a permanent REMOTE position offering a cost to company salary of R1.1m per annum negotiable on experience and ability. Contact Garth on az.oc.egrem-e@zhtrag or call him on 011 463 3633 to discuss this and other opportunities.

Are you ready for a change of scenery? The E-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the E-Merge website www.e-merge.co.za for more great positions.

Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!

Posted on 12 Aug 09:51, Closing date 11 Oct