AWS Data Engineer
Location: | Johannesburg |
Type: | Permanent |
Reference: | #NG58761 |
Company: | E-Merge IT Recruitment |
An information technology and business consulting company that provides highly specialised solutions to large and small enterprises in both the private and public sectors seeks a highly motivated and experienced AWS data engineer to join their Global Markets division. In this role, you will work closely with our traders, quantitative analysts, and data scientists to design, develop, and maintain data infrastructure and pipelines for our global markets business. The ideal candidate should have a strong background in C# or Python programming and building data pipelines on AWS, especially with AWS Glue Jobs using PySpark or AWS Glue Spark.
Responsibilities:
- Creating data models that can be used to extract information from various sources
- Lead the design, implementation, and successful delivery of large-scale, critical, or difficult data solutions involving a significant amount of data
- Utilise expertise in SQL and have a strong understanding of ETL and data modelling
- Ability to ingest data into AWS S3, perform ETL into RDS or Redshift
- Use AWS Lambda (C# or Python) for event-driven data transformations
- Designing and implementing security measures to protect data from unauthorised access or misuse
- Maintaining the integrity of data by designing backup and recovery procedures
- Work on automating the migration process in AWS from development to production
- Bachelor's degree in computer science, information systems, or related field.
- AWS Certified Machine Learning – Specialty Certificate
- Must have experience with AWS Glue Jobs using PySpark or AWS Glue Spark
- 5 Years Python/C# Development
- 3 Years AWS Data Engineering
- Strong SQL and C# or Python programming knowledge
- Objective oriented principles in C# or Python
- AWS technical certifications (Developer Associate or Solutions Architect)
- services (S3, RDS, Aurora, DynamoDB, Lambda, SNS, SQS, Kinesis, IAM)
- Experience working with RDBMS databases, such as Postgres, SQL Server
Are you ready for a change of scenery? E-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the E-Merge website www.e-merge.co.za for more great positions.
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals.
Posted on 28 Feb 10:14, Closing date 28 Apr
BI Engineer Analyst
A bank with a dominant market position in finance and is ideally positioned to offer bespoke funding solutions to set the business up for success is searching for a BI...
Azure Data Engineer
Join a long serving bank and financial services group, committed to providing banking, insurance and asset management services.
Intermediate C# Full Stack Software Engineer - Angular 10+
New work in at an award-winning tech house and fintech, with a core focus in Biometrics and identity verification systems.
Engineering Manager - C#/.Net
If you’re ready to take your career to the next level in a management position, and you have a passion for fintech, then this opportunity could just be for you.
Senior C# Full Stack Software Engineer
New work in at an award-winning tech house and fintech, with a core focus in biometrics and identity verification systems.
Senior C# Software Engineer
Are you ready to dive into the world of cutting-edge identity verification software? This top-notch company based in the heart of Johannesburg is on the lookout for a...
Junior Mechanical Engineer
Attention: Please note that the hiring team responsible for this position will be using the PikUniq platform for candidate screening and conducting one-way...
AWS Data Engineer
A fantastic opportunity for an AWS Data Engineer to join a team of specialists developing the next generation of software systems.
Ansible Linux Operations Engineer
One on the leading manufacturing businesses are looking for a Ansible Operations Engineer to join their team of IT innovators.
Full Stack Java Software Engineer
One of an international recognised company that is a leading-edge innovator of intelligence solutions that makes amounts of communication data flow, is currently in...
Azure Data Engineer
Join a long serving bank and financial services group, committed to providing banking, insurance and asset management services.
Expediting Administrator - Engineering Sector
Expediting administrator required for engineering/manufacturing company in the Vaal area. Successsful candidate will be responsible for: expediting and order...
Software Engineering Tech Lead
Responsibilities: Collaborate with various stakeholders to determine software requirements.Provide architectural blueprints to the development team.Guide and assist the...
Platform Engineer/Cloud Engineer
Our client is looking for a platform/Cloud engineer with solid experience working with Kubernetes and containerised workloads, CI/CD tools and in building and supporting...
AWS Data Engineer
Looking for an opportunity with one of the leading companies in the manufacturing industry in search for an AWS data engineer that plays a crucial role in building and...
Senior C# Full Stack Software Engineer
New work in at an award-winning tech house and fintech, with a core focus in biometrics and identity verification systems.
System Integration Engineer
Become a member of a team enthusiastic about the challenges posed by integrating complex systems comprising diverse components and subsystems currently in search for...
Senior C# Software Engineer
This leading identity verification software solutions company in Johannesburg, is seeking a Senior C# Software Engineer to join its team.
Java Developer/ DevOps Engineer
The business is renowned as a worldclass manufacturing environment who have been in existence for over a 100 years.
AWS Redshift Data Engineer
E-commerce environment for fast growing FCMG group which is a differentiated and diversified retailer of Furniture, Household appliances, Consumer electronic and...
AWS Data Engineer
Our valued client, a prominent player in African capital markets and a major presence in the automotive industry, is recognised for its diverse product offerings and...
Hardware/Software Engineer
Our valued client, who in the market, has seamless integration capabilities with a diverse range of products and financial/payment systems are looking for a skilled and...
Data Engineer
A data consulting company, who specialises in business intelligence, machine learning and DataOps, is in search of a data engineer who will take on the responsibility of...
Senior C# Software Engineer
This leading identity verification software solutions company in Johannesburg, is seeking a senior C# software engineer to join its team.
Senior Full Stack C# Engineer
Are you ready to join the software revolution? My client’s premier custom software and product development IT company is seeking a talented individual to join...
Data Engineer
A cyber risk startup on a mission to make SaaS security compliance smart, effortless, and simple by creating an automated end-to-end solution for startups and tech...
Azure Cloud Engineer
A long-serving bank and financial services group known as Africa's biggest lender by assets requires the services of an Azure Cloud engineer, your role will be to...
AWS Data Engineer
An information technology and business consulting company that provides highly specialised solutions to large and small enterprises in both the private and public...
Data Engineer
Join a long serving bank and financial services group, committed to providing banking, insurance and asset management services.