Data Engineer

We are seeking a detail-oriented and highly skilled Data Engineer. In this role, you will be responsible for designing and executing reliable, scalable data migration solutions across systems and databases. You’ll work closely with Project delivery, Business Owners, Infrastructure, and System vendor teams to ensure successful ETL processes and data integrity during large-scale migration for scientific applications used by a Life Sciences client.

Job Responsibilities

·Curate and analyze existing scientific data sets to be migrated.

·Collaborate with key stakeholders to develop and document a standard data migration approach/ plan.

·Coordinate and perform all data migration activities and tasks.

• Perform complex data mapping, data cleaning, transformation, and validation tasks with precision and ensuring Data integrity.
• Ensure data quality, consistency, and compliance throughout the migration lifecycle.
• Monitor and troubleshoot migration processes, optimizing for performance and reliability.
• Maintain data documentation, including data definitions, processes, and technical specifications, for future reference.

·Monitor and report progress of the data migration plan at project level.

• Work with a fast-paced agile team.
• Assist validation team to identify testing scenarios and testing strategies to validate the data migration in a controlled environment.
• Provide support for ad-hoc analysis and reporting as required by leadership and key stakeholders.
• Recommend and support deploying data migration ETL tools that would be a good fit for the purpose of the initiative.

• 5+ years of professional experience in data migration, ETL engineering, or related data-focused roles.
• Previous experience with migrating and integrating large complex data sets with Pharmaceutical Applications like LIMS and SDMS is preferred.
• Proven experience as a Data Analyst with strong analytical and problem-solving skills.
• Familiarity with GXP compliance and Validation process utilized in Life Sciences industry.
• Strong expertise with relational databases, with hands-on experience in MySQL and PostgreSQL.
• Deep understanding of ETL processes, data modeling, and mapping best practices.
• Proven ability to work with AWS and Azure cloud infrastructure, including but not limited to S3, RDS, ECS, and Lambda.
• Excellent problem-solving, communication, and documentation skills.
• Ability to work independently and collaboratively in a fast-paced Agile environment
• Strong communication and interpersonal skills, with the ability to effectively interact with team members at all levels.
• Background in handling sensitive data with attention to privacy and compliance standards
• Familiarity with database migration tools or platforms (e.g., Flyway, Liquibase, AWS DMS).

Originally posted on Himalayas