approach, that converges our product capabilities and opening new possibilities using machine learning and artificial intelligence. This approach encompasses a multitude of vendors (Microsoft, AWS, ESRI, Snowflake, IBM and Apache Software Foundation) and services (Azure, Microsoft Fabric, ApacheAirflow, dbt Cloud, watsonx, Kafka, Kubernetes (EKS and AKS), Red Hat Open Shift, plus others.) thus ensuring we can … core object-oriented concepts with good knowledge of Java, Web services, JavaScript, Json, XML, JDBC, and other related technologies. Experience in data and orchestration tools including some of dbt, ApacheAirflow, Azure Data Factory. Experience with unit testing in a variety of languages and tools. Perhaps experience of Junit, NUnit, XUnit and Jest, along with experience of associated More ❯
processes, including prompt logic, model usage, and data governance considerations, promoting transparency and responsible AI use. 7. Automate ETL pipeline orchestration and data processing workflows: Leverage orchestration tools like ApacheAirflow, Perfect to schedule, automate, and manage ETL jobs, reducing manual intervention and improving operational reliability. 8. Implement monitoring, alerting, and troubleshooting for data workflows: Set up real … Bash. Knowledge of Linux-based operating systems. Experience with Amazon Web Services cloud platform or another cloud platform. Proven work experience with containerization and orchestration tools such as Docker, Airflow, Prefect and Kubernetes. Knowledge of cybersecurity best practices. Excellent communication and collaboration skills. Ability to work effectively in a fast-paced and dynamic environment. Self-discipline and delivery focused. More ❯
platform, ensuring scalability, reliability, and security. Drive modernisation by transitioning from legacy systems to a lean, scalable platform. Act as a lead expert for technologies such as AWS, DBT, Airflow, and Databricks. Establish best practices for data modelling, ingestion, storage, streaming, and APIs. Governance & Standards Ensure all technical decisions are well-justified, documented, and aligned with business needs. Lead … in data engineering and cloud engineering, including data ingestion, transformation, and storage. Significant hands-on experience with AWS and its data services. Expert-level skills in SQL, Python, DBT, Airflow and Redshift. Confidence in coding, scripting, configuring, versioning, debugging, testing, and deploying. Ability to guide and mentor others in technical best practices. A product mindset, focusing on user needs More ❯
common life sciences data acquisition software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., ApacheAirflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and container orchestration tools (e.g., Docker, Kubernetes). ZONTAL is an More ❯
common life sciences data acquisition software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., ApacheAirflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and container orchestration tools (e.g., Docker, Kubernetes). ZONTAL is an More ❯
