76 to 100 of 195 Apache Airflow Jobs in England

platform as the business continues to invest Tech Environment: Azure Python SQL Server Azure Data Services Data Warehousing Data Engineering & ETL Workflow orchestration (Airflow, Luigi or similar) You'll probably be someone who: Has experience leading or mentoring Data Engineers Still enjoys writing code and solving engineering problems ...

modern cloud based data platforms. Solid understanding of data modelling and data transformation principles. Ability to work effectively within collaborative engineering teams. Desirable Experience: Airflow Databricks Experience supporting AI or machine learning initiatives. Semantic layer experience. Exposure to Azure and multi cloud environments. Understanding of Inmon 3NF data modelling ...

with Snowflake. Knowledge of MongoDB or other NoSQL databases. Experience working within AWS or other cloud environments. Familiarity with workflow orchestration tools such as Airflow, Prefect or Dagster. Experience with market data providers such as Bloomberg, Refinitiv or ICE. Exposure to enterprise data management platforms. Knowledge of Kafka ...

implementing batch and stream data processing systems. Experience with Datadog, SQL, Terraform, Docker, AWS (ECS, Kinesis, SQS, CloudWatch), GCP (BigQuery). Knowledge of Airflow, Kafka, Flink, dbt, Kubernetes is highly beneficial. Good understanding of AI platforms, experience building infrastructure for LLM orchestration (e.g., vector databases, RAG pipelines, GPU scaling ...

with Snowflake. Knowledge of MongoDB or other NoSQL databases. Experience working within AWS or other cloud environments. Familiarity with workflow orchestration tools such as Airflow, Prefect or Dagster. Experience with market data providers such as Bloomberg, Refinitiv or ICE. Exposure to enterprise data management platforms. Knowledge of Kafka ...

necessary infrastructure, resources, and interfaces to enable data loading and LLM workflows. Use Python/Java and large-scale data workflow orchestration platforms e.g. Airflow to construct software artifacts for ETL, interfacing with diverse data formats and storage technologies, and incorporate them into robust data workflows and dynamic systems ...

necessary infrastructure, resources, and interfaces to enable data loading and LLM workflows. Use Python/Java and large-scale data workflow orchestration platforms e.g. Airflow to construct software artifacts for ETL, interfacing with diverse data formats and storage technologies, and incorporate them into robust data workflows and dynamic systems ...

organisation* Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI* Expertise in Streaming Data, Event Driven Design, Data Governance ...

organisation Deep understanding & hands‐on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design, Data Governance ...

organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design, Data Governance ...

organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design, Data Governance ...

across the data engineering domain. Engage with data engineering technical detail when needed, understanding the data platform landscape including data ingestion, transformation (DBT), orchestration (Airflow), streaming (Kafka), and data warehousing (Snowflake), and able to articulate technical choices and trade-offs to different stakeholders. Work at both conceptual and detailed … despite complexity in data requirements and priorities. What I need to know: Strong understanding of data engineering technologies including data ingestion, transformation (DBT), orchestration (Airflow/Astronomer). Experience with cloud data platforms (AWS data services, Azure data services) including cost management and optimization Knowledge of data quality frameworks ...

Strong hands‐on background with modern cloud data platforms (AWS/GCP/Azure) Expertise across Python, SQL and data orchestration tools such as Airflow Experience building scalable data pipelines and data platforms in a fast‐paced fintech or technology environment A collaborative leadership style with the ability ...

Strong hands-on background with modern cloud data platforms (AWS/GCP/Azure) Expertise across Python, SQL and data orchestration tools such as Airflow Experience building scalable data pipelines and data platforms in a fast-paced fintech or technology environment A collaborative leadership style with the ability ...

Experience Data Modeling Data Integration & Ingestion Data Manipulation and Processing GitHub, GitHub Actions, Azure DevOps Data Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest AI based Code developed and AI-built automated data pieplines Key Characteristics Technology expert who constantly pursues knowledge enhancement ...

Python Experience with AWS and modern data technologies Familiarity with version control systems such as Git Experience with orchestration tools such as Airflow Ability to troubleshoot and improve data platform performance Strong attention to detail and focus on data quality Excellent communication and collaboration skills Willingness to learn ...

will take ownership of the data platform, optimising it for scalability to ensure successful client onboarding. You'll use modern tools (such as Airflow, Prefect, Dagster or AWS Step Functions) for ETL design and orchestration, work on transformation logic to clean, validate and enrich data (including handling missing values ...

working as a Data Engineer Strong understanding of data engineering principles, ETL processes and data warehousing concepts Experience using workflow orchestration tools such as Airflow to schedule, monitor and manage data pipelines Experience working with at least one major cloud data platform, preferably Azure Strong data modelling skills, including ...

improvements What will set you apart Hands-on experience with the modern data stack, for example Iceberg or Delta, Snowflake or Databricks, dbt or Airflow Experience with a data migration or re-platforming project, on either the product or the engineering side Experience in financial services or another regulated ...

management. Data Center Optimization Collaborate with facilities and operations teams to optimize infrastructure deployments based on available rack space, power draw, thermal dynamics, and airflow efficiency. Contribute to the planning and provisioning of data center resources, ensuring support for both traditional workloads and AI‐intensive environments. Evaluate emerging technologies ...

visualisation languages and libraries (SQL, python, matplotlib, etc.) as well as some of the supporting tools and platforms (e.g. git, MLFlow, Kubernetes, Kubeflow, Trino, AirFlow). A strong understanding of statistical concepts (hypothesis testing, sampling, probability distributions). Excellent communication and collaboration skills to effectively bridge the gap between ...

Cloud Run), AWS (Bedrock, SageMaker) Experience building and automating AI/ML pipelines using tools such as MLflow, Kubeflow, Azure ML, Vertex Pipelines, Airflow or Google ADK Hands-on experience with Generative and Agentic AI frameworks such as LangChain, LlamaIndex, CrewAI, Autogen, Google ADK, or similar. Ability to design ...

talks, or threads about building with AI. MLOps and model serving experience (BentoML, MLflow, Vertex AI, SageMaker). Streaming and batch ingestion pipelines (Spark, Airflow, Beam, Glue). Healthcare or life sciences domain exposure. AWS Professional certification or other relevant industry certifications. What We Offer At Newpage ...

native solutions that support analytics, automation, and digital transformation. Data Engineering, Full Stack & Platform Development Design and implement scalable data pipelines using tools like Apache Spark, Airflow, or dbt.Build and maintain data lakes, warehouses, and real-time streaming solutions. Develop APIs and microservices to expose data securely ...

bring mission‐critical software, analytics, and AI to life and is the company behind Astro, the industry‐leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data‐driven applications. Trusted by more than … building and scaling AE and Sales Engineering functions in a high‐growth environment. Preferred Qualifications Experience selling into the modern data stack ecosystem (Airflow, dbt, Snowflake, Databricks, Kafka, or similar). Familiarity with open‐source‐led or product‐led growth (PLG) sales motions — understanding how to convert community users ...