AWS Data Eng (JHB contract)

A client in Gauteng is seeking a Senior Data Engineer with AWS as follows

• To design and build data pipelines in AWS for BI visualization to end users
• Design pipelines using Data Modelling schemes, for storing Big Data and complex relational data
• Verify and scrub / clean source data using Data Quality tools and methods
• Extract from sources like Oracle / SQL / Dynamo DB’s, Big Data, and Boto S3 etc. using ETL / ELT tools
• Build data pipelines using Terraform, Python, Py Spark, Glue, Kinesis, Kafka, CloudFormation etc.
• In-depth knowledge of data formats, incl. XML, CSV, JSON / AVRO, RESTful API’s, Apache Parquet etc.
• Automate Linux / Unix servers with Bash / Shell scripts and code containerization using Docker
• BI dev exp. is useful, as you’ll work with Analysts / Devs who will be building BI reports (not required)
• Basic Networking exp. with troubleshooting issues will be useful (not required)
• At least 6+ yrs exp. in Data Engineering or similar Back-End Dev exp. is required
• Solid Agile / DevOps methodology exp. is required
• Relevant AWS and Data Eng. certs as well as an IT / Eng. degree are a big benefit

This is a hybrid work contract with a few days / week at their offices in Gauteng

If you’d like to apply, pls complete the application form below and upload your latest CV