Advertise your job vacancies
Subscribe to email job alerts
Recruitment news
LAC deems subjective assessments 'unfair' in retrenchment process
Chloë Loubser, Mbali Mnyandu, and Josua Loots
AWS Data Engineer
Location: | Johannesburg |
Type: | Contract |
Reference: | #NG59270 |
Company: | E-Merge IT Recruitment |
Pioneers in harnessing the power of artificial intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision is to provide next-generation actionable insights to every company, globally, by harnessing the value of data using high-performance, interoperable and simplified solutions are currently looking for an AWS data engineer to join their fast-paced and dynamic team!
Responsibilities
- Design, build and operationalise large scale enterprise data solutions and applications
- Analyse, re-architect and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services and Kafka CC.
- Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, PySpark, Scala, Kafka CC.
- Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
- Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud.
- Design, implement and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.
- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL, AWS big data technologies and Kafka CC.
- Create and support real-time data pipelines built on AWS technologies including Glue, Lambda, Step Functions, PySpark, Athena and Kafka CC.
- Continual research of the latest big data and visualisation technologies to provide new capabilities and increase efficiency.
- Bachelor's degree in computer science, information technology, or other relevant fields
- 5 – 8 years’ experience
- Has experience in any of the following AWS Athena and Glue Pyspark, DynamoDB, Redshift, Lambda, Step Functions and Kafka CC
- Proficient in AWS Redshift, S3, Glue, Athena, PySpark, Step Functions, Glue Workflows, Kafka CC, Delta.io
- Knowledge of software engineering best practices across the development lifecycle
- Experience with big data tools is a must: Delta.io, PySpark, Kafka, etc.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
Are you ready for a change of scenery? E-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the E-Merge website www.e-merge.co.za for more great positions.
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals.
Posted on 01 Aug 13:45, Closing date 30 Sep