Data Engineer
| Remuneration: | R500000 - R800000 per year |
| Location: | Johannesburg |
| Job level: | Mid |
| Type: | Permanent |
| Company: | PikUniq |
Attention: Please note that the hiring team responsible for this position will be using the PikUniq platform for candidate screening and conducting one-way interviews. Each application received will be carefully evaluated and screened. Further information on how to get started will be provided.We are looking forward to receiving your application.Position: Data engineer
Location: Johannesburg
About the role: Seeking a passionate and experienced data engineer for an opportunity based in Johannesburg
. As a data engineer, you'll play a pivotal role in driving data-driven decision-making and innovation within the organization. Your expertise in building robust data pipelines, modelling complex datasets, and developing enterprise data warehouse solutions will empower the teams to unlock valuable insights and make informed choices. You’ll collaborate closely with data scientists, business stakeholders, and cross-functional teams, ensuring the data infrastructure aligns with the strategic vision and supports future growth. Your contributions will directly impact the ability to streamline processes, optimize performance, and deliver exceptional products and services to the customers.
Responsibilities:- Data wrangling: Collaborate with data scientists to prepare and transform data sets for analytical modelling. Strategic Alignment: Contribute to and ensure solutions align with the company's technology evolution roadmap.
- Data governance: Ensure adherence to data standards, principles, and best practices, while aligning short-term deployments with long term strategic delivery.
- Risk assessment: Assess external data management opportunities and threats, developing security, backup, and recovery specifications.
- Project management: Manage and document installations, database developments, and dashboard amendments.
- Performance optimisation: Define requirements for data warehouse scaling to optimise performance and cost management.
- Database maintenance: Maintain database performance by identifying and resolving production and application development issues.
- Architectural compliance: Ensure the delivered data warehouse conforms to standards and architectural decisions, resolving design conflicts.
- Technology innovation: Conduct investigations and analyses into potential technology innovations, delivering data architectures to support future business growth and process streamlining.
- Requirements gathering: Collaborate with business process owners and management to determine database structural requirements.
- Data warehouse development: Design solutions and update the data warehouse infrastructure to manage organisational data requirements, including daily monitoring and management of database functionality and performance.
- Algorithm development: Develop algorithms and manage data warehouse processes, visualisation, and reporting using ALM tools. Reporting: Develop data management reports business stakeholders to support analyses and decision-making.
- Standards and compliance: Develop and communicate standards and processes for database management aligned with legislation, gaming regulation requirements, and security protocols.
- Risk mitigation: Implement control measures and checks to mitigate business risks.
- Continuous learning: Ensure competence in changing technology and database architecture requirements through training and updates.
- Testing and auditing: Conduct testing and audit compliance of new or enhanced products to meet stakeholder requirements.
- System architecture: Ensure a complete understanding of information flow and system architecture in relation to underlying data structures.
- Data issue resolution: Review interface tracking dashboards and reports to resolve data issues promptly.
- Regulatory compliance: Liaise with the Compliance function to discover data regulatory requirements for inclusion in key data policies and standards.
- Stakeholder coordination: Establish appropriate levels of coordination, communication, and liaison with internal stakeholders to ensure database changes and functionalities remain up-to-date and relevant.
Minimum requirements:- BSc degree in computer science, engineering, mathematics, statistics, information systems, or other technical/ quantitative discipline
- Microsoft certified: Azure Data Engineer/ Azure Solutions Architect Associate or equivalent cloud certifications in data modeling, data warehousing, project management
- Minimum five years of experience building data pipelines, including at least three years developing multidimensional and tabular models with large and complex datasets
- High degree of proficiency in SSIS, SQL, SSAS Cubes, DAX, MDX, and building stored procedures
- Advanced knowledge and skills in Oracle databases
- Power Bl experience
- Experience with data migration and integration
- Experience building data dictionaries, dimensional data models, architecture diagrams, metadata repositories, data integration processes, ETL processes, and data quality
- Experience with developing enterprise data warehouse solutions, data modelling, and development
- Passion for data and analytics
- Project management skills
- Verbal and written communication skills Knowledge of Agile SDLC methodology
- Azure Synapse SQL experience
- Experience in DevOps Ability to learn new applications and technologies quickly
- Analysing, creating, and improving skills
- Sourcing information skills
- Applying expertise and technology skills
- Managing relationships skills
- Taking ownership skills Responding with urgency skills
- Collaborating skills
- High adaptability
- Business acumen
Skills:- SSIS, SQL, SSAS Cubes, DAX, MDX, and building stored procedures.
- Oracle Databases, Power BI, data migration and integration, developing multidimensional and tabular models with large and complex datasets
Company Description
At PikUniq, we're revolutionising the way talent meets opportunity. With our cutting-edge HRTech platform, we blend traditional recruitment methodologies with innovative technology, and our solutions streamline and optimise the hiring process.
Our mission is simple: to connect employers with unique talent. Whether you're a forward-thinking company seeking the perfect fit or a talented individual ready to embark on your next career journey, PikUniq is here to make it happen. Join us in shaping the future of recruitment and unlock boundless possibilities with PikUniq.
Posted on 02 Jul 11:13, Closing date 31 Aug
