We are looking for a highly experienced and skilled Data Architect to join our team. The ideal candidate will have 12-15 years of experience in architecting solutions of data engineering, focusing on ELT and PySpark / Hadoop workloads. In addition to strong solution and delivery skills, the ideal candidate will also have a view on business growth and managing stakeholders.
Responsibilities :
- Design and implement high-performance, scalable, and secure data architectures.
- Work with business stakeholders to understand their data needs and translate them into technical requirements.
- Design and develop data pipelines and workflows using ELT principles and PySpark / Hadoop
- Optimize data pipelines and workflows for performance and efficiency
- Work with data scientists and engineers to ensure that data is accessible and usable for analytics and machine learning
- Implement data governance and security best practices
- Manage and mentor data engineers
- Contribute to the overall data engineering strategy and roadmap
Requirements
Qualifications :
12-15 years of experience in data engineering, with a focus on ELT and PySpark / Hadoop workloadsStrong experience in designing and implementing high-performance, scalable, and secure data architectures.Experience with data governance and security best practicesExperience in managing and mentoring data engineersExcellent communication and interpersonal skillsAbility to work independently and as part of a teamStrong problem-solving and analytical skillsDesired Skills :
Experience with cloud computing platforms such as AWS, Azure, or GCPExperience with big data technologies such as Spark, Hadoop, Hive, and KafkaExperience with data warehousing and data lakesExperience with DevOps and MLOps practicesExperience with data science and machine learning, streaming data processingExperience with real-time analytics, data visualization and reporting tools