Data Engineer

• Job Title: Data Engineer
• Location: Hyderabad
• Job: Permanent

Position Overview:

• This position will report to the Senior Data Architect within the Consumer Healthcare business unit (Opella) at Sanofi. The Data Engineer will collaborate across multiple business functions and work closely with data scientists, data architects, and data governance teams to implement scalable data pipelines and platforms that support various business needs.
• S/he should have strong expertise in Snowflake, Python, AWS, dbt, and Git to join our data engineering team.
• The successful candidate will be responsible for designing, building, and optimizing data pipelines to support advanced analytics and business intelligence initiatives. You will work with cutting-edge cloud technologies to ensure data is accessible, clean, and optimized for use by various teams across the organization.
• This role requires someone who can collaborate effectively with data architects, analysts and business stakeholders to deliver scalable and high-performance data solutions

Key Responsibilities:
The Data Engineer will be responsible for:

• Design, develop, and maintain data pipelines using Python and dbt to ingest, transform, and store data in Snowflake.
• Build and manage Snowflake data warehouses and data marts, ensuring efficient and scalable data architectures.
• Leverage AWS services (e.g., S3, Lambda, Glue, EC2) to develop cloud-based data pipelines and automate data workflows.
• Develop ETL/ELT pipelines to load data into Snowflake, ensuring performance, scalability, and reliability.
• Optimize data queries and performance within Snowflake, ensuring efficient use of resources and minimizing query costs.
• Use dbt for transforming and modeling data in Snowflake, implementing robust testing, documentation, and version control processes.
• Implement and manage CI/CD pipelines for data engineering projects using Git to ensure smooth development, testing, and deployment processes.
• Ensure data quality, integrity, and consistency through best practices in data governance, documentation, and monitoring.
• Troubleshoot and optimize existing data workflows, resolving any issues with data ingestion, processing, or query performance.

Qualification

• 7+ years of experience in Data Engineering, with a strong focus on database development, ETL/ELT processes, and cloud platforms.
• Strong experience with Snowflake as a data warehouse platform, including data modeling, performance tuning, and optimization.
• Proficiency in Python for building data pipelines, automation, and data transformations.
• Hands-on experience with AWS cloud services, particularly S3, Lambda, Glue and EC2.
  Expertise in dbt for managing and transforming data within Snowflake.
• Experience with SQL for complex data queries, transformations, and performance optimization.
• Familiarity with Git for version control, branching, and collaborating on data engineering projects.
• Experience building and maintaining ETL/ELT pipelines in cloud environments.
  Excellent troubleshooting skills with the ability to optimize and improve existing data processes.
• Ability to work independently and in collaboration with cross-functional teams.
  Strong communication skills to effectively interact with technical and non-technical stakeholders.

Education:

• Bachelor’s degree in computer science, Information Technology, Data Engineering, or a related field.