Responsibilities

• Develop, test, and maintain processes to integrate and manage data from various sources.
• Work closely with data scientists, analysts, and other stakeholders to understand data requirements and ensure data quality and integrity.
• Implement data governance best practices, including data lineage, metadata management, and versioning.
• Design, implement, and maintain scalable and reliable data platforms and systems.
• Collaborate with the development team to build and deploy new features, ensuring they meet performance and reliability standards.
• Monitor and optimize the performance, security, and availability of data platforms, addressing issues proactively.
• Create and maintain automation scripts and tools to streamline data processing and platform management tasks.
• Implement continuous integration and continuous delivery (CI/CD) pipelines to ensure smooth and efficient deployments.
• Contribute to the development of internal tools and frameworks that enhance productivity and standardize operations.
• Stay current with industry trends, emerging technologies, and best practices in data engineering and platform management.
• Identify opportunities to improve existing systems, processes, and tools, driving continuous improvement initiatives.
• Contribute to the documentation of systems, processes, and best practices to ensure knowledge sharing across the team.