Assignment description:

We are looking for a Data Engineer in India for our client in the Pharmaceutical Industry

Responsibilities:

The candidate will leverage Data Mesh and Medallion architecture principles within Azure Databricks and manage CI/CD processes in Azure DevOps to support data-driven decision-making in drug development and clinical trials.

Key Responsibilities:

Data Pipeline Design and Development:

• Design, construct, install, test, and maintain highly scalable data management systems using Azure Databricks following Data Mesh and Medallion architecture principles
• Ensure architectures support the needs of scientific and compliance-focused stakeholders.
• Integrate new data management technologies and software engineering tools into existing structures.

GxP Compliance:

• Implement and maintain data solutions and documentation in compliance with GxP guidelines critical for pharmaceutical applications.
• Collaborate with quality assurance teams to ensure data integrity and reliability for regulatory submissions.

CI/CD Pipeline Management:

• Develop and maintain scalable and efficient CI/CD pipelines in Azure DevOps to automate testing and deployment of data pipelines.
• Ensure continuous monitoring, testing, and performance tuning of all data management and processing systems.

Data Product Development:

• Build data products and services to support varied requirements from cross-functional teams including R&D, clinical operations, and regulatory affairs.
• Assist in translating data into usable insights and predictions to support strategic decisions.

Collaboration and Communication:

• Work closely with data scientists, business stakeholders, and IT teams to ensure solutions are robust, scalable, and aligned with business requirements.
• Document and communicate data architecture and engineering solutions clearly to both technical and non-technical stakeholders.

Qualifications:

Education & Certification:

• Bachelor’s or master's degree in computer science, Data Science, Bioinformatics, or a related field.
• Certification in Azure Databricks and/or Azure DevOps is highly advantageous.

Experience:

• Proven experience as a Data Engineer, preferably in the pharmaceuticals industry, with an understanding of GxP compliance requirements.
• Experience in building and optimizing ‘big data’ data pipelines, architectures, and data sets.
• Experience in Azure Databricks and Azure DevOps, with a deep understanding of Datamesh and Medallion architecture principles.

Skills:

• Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.

• Adept at queries, report writing, and presenting findings.

• Excellent interpersonal and communication skills, capable of working in a cross-functional environment.