Data Engineer
HYQOO
Job Description What you’ll do You will be a founding data engineer responsible for finding the best cloud solution to solve data storage, processing, and orchestration while keeping the cost in check. You will design, build, and deploy batch and real-time data pipelines, storage, and model schemas. This will involve leveraging performance tuning techniques, conceptual schemas, and modern technology. You will assist the team in selecting a tool to manage automated workflows and a tool to manage the data itself. You will be responsible for identifying, defining, protecting, and managing data from its raw form to its consumption. You will collaborate with product teams, data analysts, data scientists, and technology teams. Responsibility Design, develop, and maintain critical data infrastructure, datasets, and pipelines. Ensure data is stored safely and securely, adhering to frequently changing regulations (e.g. GDPR) and best practices for user data storage and security. Take ownership of critical data pipelines, manage their SLAs, and constantly improve pipeline efficiency and data quality. Facilitate data integration and transformation requirements for moving data between applications, ensuring interoperability with database, data warehouse, and data mart environments. Assist in designing and...
Tanzania : International
2024-01-21
Contact our recruitment agency in Tanzania