37 Apache Airflow Jobs in the UK excluding London

within the EU Fusion programme and connections to international HPC communities, showcasing contributions made to the field. - Experience in workflow management systems such as Apache Airflow. - Familiarity with Research Data Management methodologies, modern database technologies including SQL, NoSQL and Graph Databases, and parallel file access technologies such as MPI more »

engineers to assist with technical work in agreed territories Key skills/knowledge: Expertise in GCP Experience in Python , SQL Knowledge and expertise in Airflow , Dataform, Git Previous experience working in a team in one of the following functions: data analytics, software or application development, database development Previous experience more »

Design, build, and maintain scalable data architectures, including pipelines andcloud-based data warehouses.Tech: Python (NumPy, Pandas), SQL, ETL, Cloud (AWS, Azure or GCP), Snowflake, Airflow, BigQuery, PowerBI/TableauIndustry: Fintech, Maritime tradingImmersum are supporting the growth of a specialist consultancy who solely specialise in the Maritime trading industry. You … expertise in developing and optimising ETL pipelines.Version Control: Experience with Git for code collaboration and change tracking.Data Pipeline Tools: Proficiency with tools such as Apache Airflow.Cloud Platforms: Familiarity with AWS, Azure, Snowflake, and GCP.Visualisation: Tableau or PowerBIDelivery Tools: Familiarity with agile backlogs, code repositories, automated builds, testing, and releases. more »

as Hadoop and Spark. Experience with data warehousing technologies such as Redshift, Snowflake, or BigQuery. Experience with data pipeline and ETL tools such as Apache NiFi, Airflow, or Glue. Knowledge of data governance and security best practices. Strong problem-solving and analytical skills. Ability to work well in more »

cloud-hosted data platform that would be used by the entire firm.Tech Stack: Python/Java, Dremio, Snowflake, Iceberg, PySpark, Glue, EMR, dbt and Airflow/Dagster.Cloud: AWS, Lambdas, ECS servicesThis role would focus on various areas of Data Engineering including:End to End ETL pipeline development and deployment … processes and toolsImplementing Data Curation, metadata management and data quality tooling.Requirements:Strong Python/Java Software Engineering skillsExcellent AWS knowledge, ideally with exposure to Airflow, Glue, Iceberg and SnowflakePrevious experience with Dremio, dbt, EMR or DagsterGood Computer Science fundamentals knowledge with strong knowledge of software and data architecture.If you more »

the above project of redesigning the Creditsafe platform into the cloud space. You will be expected to work with technologies such as Python, Linux, Airflow, AWS DynamoDB, S3, Glue, Athena, Redshift, lambda, API Gateway, Terraform, CI/CD. KEY DUTIES AND RESPONSIBILITIES You will actively contribute to the codebase … and participate in peer reviews. Design and build metadata driven, event based distributed data processing platform using technologies such as Python, Airflow, Redshift, DynamoDB, AWS Glue, S3. As an experienced Engineer, you will play a critical role in the design, development, and deployment of our business-critical system. You more »

and you’ll build the solution. They work in a mix of SQL, Python programming but also operate with modern tech such as Snowflake, Airflow, DBT, Kubernetes/Docker and cubeJS whilst also using Tableau CRM and Jupyter notebooks for gaining data insights. If you think there’s a … to be a SQL Server expert with strong architecture skills and also strong skills with Python, and DBT. The more experience with things like Airflow, cubeJS and Snowflake, plus other data viz tools would be a huge plus.Total compensation for this role is up to £250,000, split between more »

Job DescriptionJob Title: Data EngineerJob Type: Full Time, PermanentWorking location: London, HybridRole Purpose At Travelex we are developing modern data services, which will be at the heart of our relationship with our customers. Our data architecture is becoming more service more »

data practices Possess strong knowledge of data tools, data management tools, and various data and information technologies. E.g. DAMA DMBOK, Microsoft SQL Server, Couchbase, Apache Druid, Spark, Kafka, Airflow, etc In-depth understanding of modern data principles, methodologies, and tools Excellent communication and collaboration skills, with the ability … native computing concepts and experience working with hybrid or private cloud platforms is a plus. Demonstrable technical experience working with a Microsoft, Redhat, and Apache data and software engineering environment. A team-oriented individual with a passion for engineered excellence and the ability to lead and motivate a team more »

using Docker, Kubernetes and Cloud services. Experience with Azure stack will be an asset. Experience designing and implementing event-driven/microservices applications using Apache Kafka, Flink, etc. Exposure to model deployment and serving tools like Seldon Core, KServe, etc. Experience with drift detection and adaptation techniques as well … and familiarity with tools to manage infrastructure as code, like Terraform and package managers like Helm Charts. Proficiency with pipeline orchestration tools, such as Airflow, Kubeflow, and Argo Workflows. Outstanding communication skills, ability to convey complex technical concepts to non-technical stakeholders and collaborate with cross-functional teams. A more »

Job DescriptionSENIOR DATA ENGINEER LONDON/HYBRID£65,000-75,000 PER ANNUMThis fast-growing E-commerce company are searching for a new Senior Data Engineer. You will be responsible for building out and maintaining the company's Azure platform. more »

Job DescriptionJoin a leader in generative AI technologies, who have recently secured Series A funding to advance our work in digital avatars and human clones. Role: MLOps EngineerLocation: LondonSalary: Up to £100,000Responsibilities:Develop ML Pipelines: Build and maintain scalable more »