AWS Data Engineer
Location: | Johannesburg |
Remote work: | Some remote work allowed |
Type: | Contract |
Reference: | #NG59270 |
Company: | E-Merge IT Recruitment |
Pioneers in harnessing the power of artificial intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision is to provide next generation actionable insights to every company, globally, by harnessing the value of data using high performance, interoperable and simplified solutions are currently looking for an AWS data engineer to join their fast-paced and dynamic team!
Responsibilities
- Design, build and operationalise large scale enterprise data solutions and applications
- Analyse, re-architect and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services and Kafka CC.
- Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, PySpark, Scala, Kafka CC.
- Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
- Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud.
- Design, implement and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.
- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL, AWS big data technologies and Kafka CC.
- Create and support real-time data pipelines built on AWS technologies including Glue, Lambda, Step Functions, PySpark, Athena and Kafka CC.
- Continual research of the latest big data and visualization technologies to provide new capabilities and increase efficiency.
- Bachelor's degree in computer science, information technology, or other relevant fields
- Has experience in any of the following AWS Athena and Glue Pyspark, DynamoDB, Redshift, Lambda, Step Functions and Kafka CC
- Proficient in AWS Redshift, S3, Glue, Athena, PySpark, Step Functions, Glue Workflows, Kafka CC, Delta.io
- Knowledge of software engineering best practices across the development lifecycle
- Experience with big data tools is a must: Delta.io, PySpark, Kafka, etc.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
Are you ready for a change of scenery? E-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the E-Merge website www.e-merge.co.za for more great positions.
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!
Posted on 21 Jun 14:26, Closing date 20 Aug
Data Engineer
An esteemed and forward-thinking bank in South Africa is seeking a highly experienced data engineer to join their innovative team.
Qualified Aviation Engineer
Our client in Gauteng is looking to employ a qualified aviation engineer, licensed in the avionics, electrical and instrument sector. Requirements: Qualified...
Cloud Engineer
A dynamic and innovative company in Johannesburg is seeking a skilled and experienced Cloud engineer with a strong background in AWS and Docker to join their team.
DevOps Engineer
A leading technology company is seeking a skilled and motivated DevOps engineer to join their dynamic team in Johannesburg.
Azure Data Engineer
A long serving bank known as Africa's biggest lender of assets and financial services group committed to providing banking insurance and asset management services have...
AWS Data Engineer
An AWS Advanced partner that augments and accelerates organisational capabilities with agile, modern, data-driven solutions and services built according to well...
Senior Data Engineer - AWS
A leading African Corporate Investment Bank and part of one of the largest financial services groups that are passionate Solutionists who offer clients innovative...
Python AWS Software Engineer
Are you looking for a new opportunity with a leading manufacturing business working with cutting-edge technologies? Then this is a great opportunity we are...
Data Engineer
Attention: Please note that the hiring team responsible for this position will be using the PikUniq platform for candidate screening and conducting one-way interviews.
Electric Engineer
My client, a consulting engineering firm in Pretoria is seeking a professional electrical engineer to join their team.
Intermediate Data Solutions Engineer
Join a data driven team as an intermediate data solutions engineer, where your thorough understanding of best practice business intelligence implementations will be...
Senior Data Solutions Engineer
Join a data driven team as a senior data solutions engineer, where your thorough understanding of best practice business intelligence implementations will be crucial in...
Intermediate C# Full Stack Software Engineer - Angular 10+
New work in at an award-winning tech house and fintech, with a core focus in Biometrics and identity verification systems.
AWS Data Engineer
Our valued client, a leader in African capital markets and a powerhouse in the automotive industry, is renowned for its diverse product offerings and global reach.
Software Engineer
Join a cutting-edge online background screening platform dedicated to revolutionising the trust economy.
Azure Data Engineer
A leading telecommunications company, with innovative solutions from designing, building, deploying, and managing high performance computing infrastructure and an...
AWS Data Engineer
Pioneers in harnessing the power of artificial intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision...
AWS Cloud Engineer
Our client are a dynamic, full-service retail and brand execution company dedicated to delivering maximum in-store impact for their clients at the shelf.
Software Engineer
Join a cutting-edge online background screening platform dedicated to revolutionizing the trust economy.
Data Engineer
A Software company with premier custom software and product development, delivering custom-made solutions for large enterprises as well as dynamic start-ups is looking...
Software Quality Engineer
Take the leap into a fulfilling career with a highly esteemed banking institution actively seeking a permanent software quality engineer who possesses exceptional...
Quality Engineer Selenium Lead
A fantastic opportunity for a QA Lead to Lead the Test Implementation in accordance with the agreed Quality Assurance principles and standards in order to manage the...
Junior Data Engineer
An upbeat company that helps clients understand the rich data collected from the traditional retail market in South Africa and Africa broadly are in the market for a...
AWS Data Engineer
A leader in African capital markets with a comprehensive suite of products, a vast global reach while and an acute positioning as a local bank with the expertise ability...
Senior Cloud Engineer /Developer - C#/Azure
New work in at an African digital tech hub with a core focus in User experience design, web and mobile tech as well as Machie learning.
Software Engineer
Join a cutting-edge online background screening platform dedicated to revolutionizing the trust economy.
Data Engineer
Who are we: An international group of companies within the hospitality industry Who are we looking for: A data Engineer with a high degree of proficiency in...
Senior Dev-Ops Engineer
Are you an experienced DevOps Engineer with a passion for finance and cutting-edge technologies? Do you excel at designing and implementing robust infrastructure...
Hardware/Software Engineer
Our valued client, who in the market, has seamless integration capabilities with a diverse range of products and financial/payment systems are looking for a skilled and...
Qualified Aviation Engineer
Our client in Gauteng is looking to employ a qualified aviation engineer, licensed in the avionics, electrical and instrument sector. Requirements: Qualified...