76 to 100 of 141 Apache Airflow Jobs in England

Python and SQL, familiarity with Scala or R advantageous Experience with data orchestration and workflow management tooling such as Azure Data Factory or Airflow Please see full job description attached. What you can expect from us We believe doing your best work starts with feeling supported both professionally ...

unstructured data sources including Cassandra HBase Kafka and Spark* Strong ETL and data pipeline experience particularly with modern big data toolsets such as Airflow and Nifi or equivalent* Strong programming background in either Java Python or Scala* Experience in modern engineering practices and technologies* Good working knowledge of data ...

organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design, Data Governance ...

bring mission‐critical software, analytics, and AI to life and is the company behind Astro, the industry‐leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data‐driven applications. Trusted by more than … building and scaling AE and Sales Engineering functions in a high‐growth environment. Preferred Qualifications Experience selling into the modern data stack ecosystem (Airflow, dbt, Snowflake, Databricks, Kafka, or similar). Familiarity with open‐source‐led or product‐led growth (PLG) sales motions — understanding how to convert community users ...

pipelines Developing solutions using Python and SQL Working with cloud platforms including AWS, Azure, or GCP Using technologies such as Spark, Databricks, and Airflow Improving data quality, reliability, and performance Applying modern engineering practices including automation, testing, and CI/CD What theyre looking for: Strong programming skills ...

Python Experience with AWS and modern data technologies Familiarity with version control systems such as Git Experience with orchestration tools such as Airflow Ability to troubleshoot and improve data platform performance Strong attention to detail and focus on data quality Excellent communication and collaboration skills Willingness to learn ...

cloud‐native architectures, with experience shaping technical direction across teams and stakeholders Solid expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg or similar table formats ...

abstraction layers Model the cost, feasibility and risk of different LLMs and implementation approaches THE STACK AWS, Bedrock, LangGraph, LangChain, Python, FastAPI, PostgreSQL, Snowflake, Airflow, React, Next.js, Kubernetes. YOUR EXPERIENCE 15+ years in enterprise software engineering with a background in product engineering organisations or technology companies Deeply technical: recent ...

notebooks for analysis dbt and Databricks data platform with Delta Lake Lightdash as our BI tool and semantic layer Streamlit for interactive data applications Airflow for orchestration Kubernetes for application deployment CI/CD with GitHub and CircleCI Infrastructure on AWS, deployed with Terraform/Spacelift ...

cloud-native architectures, with experience shaping technical direction across teams and stakeholders Solid expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg or similar table formats ...

similar databases. Experience designing data models, schemas and transformation layers for complex datasets. Experience with directed acyclic graph-based orchestration tools such as Airflow, Dagster, Prefect or similar systems. Familiarity with data warehouses, object storage, queues, APIs and cloud infrastructure. Experience with data quality testing, lineage, observability, versioning ...

platforms and pipelines (batch and real-time ingestion). Hands-on familiarity with: Snowflake (or equivalent cloud data warehouse), Looker (or other BI tools), Airflow, Pub/Sub, or similar orchestration and ingestion frameworks. Experience with data infrastructure monitoring and optimization. Strong communication skills. Ability to translate business goals ...

management. Data Center Optimization Collaborate with facilities and operations teams to optimize infrastructure deployments based on available rack space, power draw, thermal dynamics, and airflow efficiency. Contribute to the planning and provisioning of data center resources, ensuring support for both traditional workloads and AI‐intensive environments. Evaluate emerging technologies ...

visualisation languages and libraries (SQL, python, matplotlib, etc.) as well as some of the supporting tools and platforms (e.g. git, MLFlow, Kubernetes, Kubeflow, Trino, AirFlow). A strong understanding of statistical concepts (hypothesis testing, sampling, probability distributions). Excellent communication and collaboration skills to effectively bridge the gap between ...

specialist consultancy renowned for delivering mission-critical solutions, working with modern technologies in a secure, cutting-edge environment Key Skills required: - PyTorch - TensorFlow - SciKit - Airflow or Prefect - ML flow (really nice to have) - Python - SQL - Data Modelling This role will require an active SC Clearance and British Citizenship ...

Python, Bash, Ansible, Puppet) Familiarity with containerisation (Docker, Kubernetes) Nice to have: Experience with CI/CD pipelines (GitLab, Jenkins) Exposure to data tooling (Airflow, NiFi, Elasticsearch) Experience with Cloudera/Hadoop ecosystems (Spark, Hive, HDFS) Why join? Work on modern data platforms at scale Collaborate with data scientists ...

Experience Data Modeling Data Integration & Ingestion Data Manipulation and Processing GitHub, GitHub Actions, Azure DevOps Data Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest Key Characteristics Technology expert who constantly pursues knowledge enhancement and has an inherent curiosity to understand work from multiple dimensions. ...

Looking For Strong experience designing and building scalable data pipelines Proficiency in SQL, Python, Databricks or Azure Experience with tools such as Git and Airflow Proven ability to test, troubleshoot and improve data platforms Experience delivering high-quality, reliable data solutions Strong communication skills and ability to work ...

production Solid software engineering skills (Python, APIs, systems) Good understanding of MLOps stack (CI/CD, monitoring, pipelines) Familiarity with tools like MLflow, Airflow, Evidently, DVC, Docker, Kubernetes. Cloud experience (AWS/GCP/Azure) Some mentoring/leadership experience + desire to grow into management Nice to have ...

building data pipelines Proficient in SQL, Python, AWS and other data management technologies Familiarity with version control systems like Git and orchestration tools like Airflow Ability to test and troubleshoot data platforms reliably. A track record of improving data reliability and quality Excellent communication skills and the ability ...

forecasting, and statistical modeling in a product environment. Expertise in Python or R, fluency in SQL, and experience with large‐scale data tech (Databricks, Airflow, dBT a plus). Experience with FinTech, payments, crypto, or blockchain data is a strong plus. Advanced degree (MS, PhD) in a quantitative field ...

treasury or liquidity management domains. You are proficient with SQL and know your way around data pipeline management tools such as Snowflake, dbt, Git, Airflow, Python, and Lightdash. You're comfortable owning analytics from data transformation through to delivering actionable insights. You are commercially minded. Able to translate your ...

alongside a clear sense of when simpler rules-based approaches are the better choice Experience with cloud data tooling such as BigQuery, Spark, dbt, Airflow or similar Experience building tooling for operational or investigative teams, and partnering closely with the people who use it Interest in AI safety ...

PostgreSQL (or similar relational databases) and NoSQL databases. Experience with vector databases such as Qdrant, Milvus or pgvector . Familiarity with technologies such as Apache Spark, Airflow, Kafka, Elasticsearch/OpenSearch, Pandas and Polars . Strong understanding of data modelling, storage architecture and performance optimisation. Desirable Experience working ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...