Job Description

About The Role - Lead Data Engineer Mandatory skills - 8yrs Plus Lead Role Cloud - Azure Python /Pyspark Azure ADF Databricks Azure Data Engineer This role contributes to the construction of the development data fabric and data strategy. This role will interact with architects, engineers, data modelers, product owners as well as other team members in Clinical Solutions and R&D. This role will actively participate in creating technical solutions, designs, implementations & participate in the relentless improvement of R&D Tech systems in alignment with agile and DevOps principles. The Data Engineer demonstrates both depth and breadth across key data engineering competencies e.g. Software Development, Testing, DevOps, Data Science/Analytics, and cloud . Can collaborate with experts from other subject domains. Primary responsibilities include using Azure cloud services and Client data platform tools to ingest, egress, and transform data from multiple sources. In addition, the role will demonstrate core engineering knowledge/experience of industry technologies, practices, and frameworks such as data fabric and scaling data platforms, containerization, cloud-based platforms, data analytics, machine learning, and data streaming. Examples Of Technologies Include Java/C#/Python, Denodo, Snowflake, GIT, Azure DevOps, Data Bricks, Presto, Spark, Azure Data Factory, ADLS V2, Kafka, Selenium, JUnit/N Unit, Safe, Kanban, Docker, AI/ML, Azure/GCP Cloud Architecture including networking principles and scaling applications. The Data Engineer, Clinical Solutions role is a senior technical role and will provide you the opportunity to lead key activities to progress your career. These Responsibilities Include The Following Working with other teams that are defining DevOps and data platform practices to meet the requirements of clinical solutions. Supporting engineering teams in the adoption and creation of data fabric best practices. Conducting POCs of new technologies and helping to embed them in product teams Being part of a cutting-edge team creating the Development Data Fabric Ensures that technical delivery is fully compliant with Client Security, Quality and Regulatory standards. Ensures use of relevant R&D Tech / central services and collaborating with service partners in identification and delivery of service improvements Maintains best practices for engineering and architecture on our Confluence site. This requires hands on experience with cutting edge technology. Pro-actively engages in experimentation and innovation to drive relentless improvement. Provides leadership, technical direction and client expertise to architecture and engineering teams composed of client FTEs, strategic partners and software vendors. We are looking for professionals with these required skills to achieve our goals: Total 11+ years of experience and proficient with at least 3 **of the below skills and can demonstrate knowledge and value with relevant experience in all the following competencies: Must have experience in Spark, Python and Databricks Software development, architecture design & technology platforms/frameworks Data Platforms and Domain-driven design Agile, DevOps & Automation [of testing, build, deployment, CI/CD, etc.] Data science (e.g. AI/ML), data analytics & data quality/integrity Testing strategies & frameworks ** Role Requires Demonstrated skill in delivering high-quality engineered data products Knowledge of industry standards and technology platforms aligned to Client and R&D roadmaps Excellent communication, negotiation, influencing and stakeholder management skills Customer focus and excellent problem-solving skills Computer Science or related bachelor\'s degree - MS in Computer Science is preferred Familiarity and use of various open-source ecosystems including JavaScript, Bigdata, java, python etc. Good understanding of various software paradigms: domain-driven, procedural, data-driven, object-oriented, functional Familiar with .NET Core (C#), Java, Python Demonstrable knowledge depth in more than one area of software engineering and technology Preferred Qualifications If you have the following characteristics, it would be a plus : Experience in agile software development and DevOps, relevant technology platforms [e.g., Kubernetes] and frameworks [e.g. Docker] including cloud technologies & data structures (i.e. information management), data models or relational database design Subject matter expertise in clinical development R&D Tech requires Engineers with understanding of the relevant technical and scientific domains. Able to deliver continuous change to meet rapidly evolving R&D strategy and ambition. Experience with agile development methods, with security strategies and best practices, data integration mechanisms, architectural design tools, delivering and integrating COTS applications, areas of Service Oriented Architecture (SOA), Application Integration, Business Process Management and Data Quality. Experience in applying AI/ML, data curation, virtualization, predictive modelling, workflow, and advanced visualization techniques to enable decision support across multiple products and assets to drive results across R&D business operations.

foundit