Data Engineer

Remuneration:	R50000 - R66000 per month cost-to-company
Location:	Johannesburg
Job level:	Mid/Senior
Type:	Permanent
Company:	Ad Talent Africa

Who are we: An international group of companies within the hospitality industry

Who are we looking for:  A data Engineer with a high degree of proficiency in SSIS, SQL, SSAS Cubes, DAX, MDX and building stored procedures

What will you do:

The data engineer will be responsible for designing data models, maintaining, and optimizing data infrastructure for data collection, management, transformation, and access. They will be responsible for building and maintaining data pipelines from source systems to the data warehouse and data lake. They will work closely with the data scientist to build machine learning and analytics infrastructure.

• Collaborate with data scientists to prepare data sets for analytical modelling
• Contribute to and ensure solutions align to the design and direction of the company technology evolution
• Ensure adherence to data standards, principles, preferences and practices. Short term deployment must align to strategic long-term delivery.
• Assess external data management opportunities and threats and develop security, back-up, and recovery specifications.
• Project manage and document installations and actions taken around the development and amendment to databases and dashboards
• Define requirements for the Datawarehouse scaling to optimise performance and cost management.
• Maintains database performance by identifying and resolving production and application development problems
• Check the conformance of the delivered data warehouse to standards and architectural decisions and resolve design and architectural conflicts by explaining and justifying design and architectural decisions
• Conduct investigations and analyses into potential technology innovations, and deliver a data architecture to support the future business growth and streamline processes
• Collaborate with business process owners and management to determine database structural requirements by analysing client operations, applications, and programming; reviewing objectives with clients; evaluating current systems
• Design solutions and update the data warehouse infrastructure to manage data requirements in the organisation, including the daily monitoring and management of the functionality and optimal performance of various databases
• Develop algorithms and manage data warehouse processes, visualisation and reporting using application lifecycle management (ALM) tools to ensure predictability and reliability
• Develop data management reports for various business stakeholders in order for them to complete required analyses and make business decisions
• Develop standards and processes for database management aligned to legislation, gaming regulation requirements and security protocols – ensuring they are updated and communicated
• Implement sufficient control measures (including systems and processes) and checks to mitigate any risk to the business
• Ensure own competence to meet changing technology and database architecture requirements remains relevant, and receive necessary training and updates
• Conduct testing and audit compliance of new or enhanced products to ensure requirements of key stakeholders (customers, staff and gambling boards) are met.
• Ensure a complete understanding of information flow and system architecture and how it relates to underlying data structures
• Review the interfaces tracking dashboards and reports in order to resolve any data issues timeously
• Liaise with compliance function to discover data regulatory requirements for inclusion when integrating key data policies and standards
• Establish appropriate levels of coordination, communication and liaison with internal stakeholders to ensure database changes and functionalities in the warehouse remain up to date and relevant

What do you need:

• BSc Degree (in Computer Science, Engineering, Mathematics, Statistics, Information Systems or other technical/quantitative discipline).
• Post graduate degree is an advantage
• Microsoft certified: Azure Data Engineer/Azure Solutions Architect Associate or any equivalent cloud certifications
• Any certification in data modelling, data warehousing, project management will be advantageous.
• Minimum five years of building data pipelines including at least 3 years of experience developing both multidimensional and tabular models with large and complex datasets
• Experience with data migration and integration
• Experience building data dictionaries, dimensional data models, architecture diagrams, meta data repositories, data integration processes, ETL processes and data quality
• Experience with developing enterprise data warehouse solutions, data modelling and development
• Must be passionate about data and analytics
• High degree of proficiency in SSIS, SQL, SSAS Cubes, DAX, MDX and building stored procedures
• Power BI
• Advanced knowledge and skills in Oracle databases
• Project management
• Verbal and written communication skills
• Knowledge of Agile SDLC methodology
• Azure Synapse SQL
• Experience in DevOps an advantage
• Ability to learn new applications and technologies quickly

Skills:

• Analytics
• Data
• Project management

 

Posted on 07 Jun 14:28, Closing date 7 Jul