26 to 50 of 121 Apache Airflow Jobs in England

Optimise Python performance through effective use of loops , vectorization , threading , and understanding of the Global Interpreter Lock (GIL) . Desirable Experience Experience with Kubeflow , Airflow , or dbt . Hands-on experience with Google Cloud Platform (GCP) . Knowledge of containerisation (Docker, Kubernetes) and CI/CD practices. Familiarity with ...

marketing teams to align data solutions with business needs Requirements Strong SQL skills and experience with ETL/ELT and pipeline orchestration tools (e.g., Airflow, dbt, Data Factory) Experience with cloud data platforms (e.g., Azure, AWS, or GCP) Proficiency in data modelling (dimensional, entity-relationship, event-driven) Understanding ...

identify anomalies and ensure data integrity for use by commercial trading and analytics teams. Automate data workflows using Python, SQL, and orchestration tools (e.g., Airflow or similar). Assist in transitioning legacy datasets and codebases into scalable, cloud-native workflows aligned with our modern data architecture. Document data sources ...

MarTech, and marketing teams to align data solutions with business needsRequirementsStrong SQL skills and experience with ETL/ELT and pipeline orchestration tools (e.g., Airflow, dbt, Data Factory)Experience with cloud data platforms (e.g., Azure, AWS, or GCP)Proficiency in data modelling (dimensional, entity-relationship, event-driven)Understanding ...

within multi-disciplinary teams, delivering modern data platforms into large organisations. Previous practical experience of using both SQL and task orchestration software (eg. dbt, Airflow/Prefect/Dagster or equivalent) to develop production-grade pipelines that bring data to life Strong Snowflake experience is preferred, and Databricks experience ...

efficiency.Help shape the technical roadmap for data engineering across Elliptic.Leverage and deploy AI and agentic systems to operate more effectively.Tech environmentScala | Spark | Databricks | AWS | Airflow | Kubernetes | Terraform | Functional ProgrammingYou will thrive here if youEnjoy end-to-end ownership, from writing the code to architecture design to coaching others through ...

preparation specifically geared toward AI model integration Technical Fluency: A strong conceptual understanding of modern data ecosystems, data warehousing, pipeline orchestration tools (e.g., dbt, Airflow), and data governance standards Cross-Functional Communication: Outstanding stakeholder management skills, with a demonstrated ability to foster collaboration between technical developers and non-technical ...

Azure, Databricks, Snowflake, and cloud-native data platforms.Experience working with Kafka, Solace, RMDS/TREP, and real-time messaging technologies.Experience with automation platforms including Airflow, Azure Data Factory, Ansible, Power Automate, or similar tooling.Strong understanding of market data licensing, entitlement management, and redistribution controls.Excellent stakeholder management, communication, and influencing ...

Python skills * Hands-on experience designing and developing ETL pipelines and data workflows * Experience designing and maintaining data pipelines using technologies such as Apache Airflow or Spark * Experience working with cloud platforms including AWS, Azure or GCP * Strong understanding of data modelling, integration and governance principles * Experience working ...

databases like Snowflake/Redshift/BigQueryExperience with Python/PySparkExperience with implementing Rest APIs.Business Intelligence (BI) knowledge/experienceKnowledge on tools like Terraform, Airflow, DBT and HarnessModern data engineering practisesThe environment is that of Facebook or Google, relaxed open with time to think and make the right decisions. ...

databases like Snowflake/Redshift/BigQueryExperience with Python/PySparkExperience with implementing Rest APIs.Business Intelligence (BI) knowledge/experienceKnowledge on tools like Terraform, Airflow, DBT and HarnessModern data engineering practicesThe environment is that of Facebook or Google, relaxed open with time to think and make the right decisions. ...

initial 6-month contract. Core Technical Requirements Strong experience with Snowflake for data warehousing, including writing efficient SQL and managing schemas. Proficiency in Airflow for orchestration and workflow management. Hands-on experience with AWS services , particularly S3 for storage and Lambda for serverless processing. Familiarity with Kafka concepts (producers ...

communication skills. Highly Desirable: Experience with Spark/PySpark. Familiarity with Azure Data Lake, Snowflake, or similar platforms. Knowledge of orchestration tools like Airflow or Azure Data Factory. Exposure to financial services environments. Experience supporting large-scale data transformation or migration programmes. What We're Looking For: A senior ...

scripting language — Python is required.Proficiency in at least one object-oriented language.Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto.Experience with AWS, GCP, or Looker (advantageous but not essential).Solid background in data modelling, including the design, implementation and optimisation of conceptual ...

scripting language — Python is required.Proficiency in at least one object-oriented language.Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto.Experience with AWS, GCP, or Looker (advantageous but not essential).Solid background in data modelling, including the design, implementation and optimisation of conceptual ...

Comfortable building from scratch in a fast-moving, product-led environment Experience with vector databases and vector search in modern AI systems Desirable: Spark, Airflow, Kafka, Elasticsearch/OpenSearch, event-driven architectures Cloud experience (AWS, GCP or Azure), GCP is a plus Why join High impact and ownership ...

Comfortable building from scratch in a fast-moving, product-led environment Experience with vector databases and vector search in modern AI systems Desirable: Spark, Airflow, Kafka, Elasticsearch/OpenSearch, event-driven architectures Cloud experience (AWS, GCP or Azure), GCP is a plus Why join High impact and ownership ...

building and maintaining modular, scalable data models that follow best practicesStrong understanding of dimensional modellingFamiliarity with AWS data services ( S3, Athena, Glue )Experience with Airflow for scheduling and orchestrating workflowsExperience working with data lakes or modern data warehouses (Snowflake, Redshift, BigQuery)A pragmatic problem solver who can balance technical ...

analytics or data platforms, or significantly evolving existing ones.Experience with data quality and observability, using dbt or complementary tooling.Familiarity with orchestration tools such as Airflow, Dagster, or Prefect.Experience with semantic layers, metrics frameworks, or analytics consumption patterns.Exposure to data governance, access control, or analytics enablement at scale.Experience mentoring ...

preferred) or similar platforms: Snowflake, BigQuery, Redshift, Synapse, or equivalent Strong proficiency with: SQL (advanced level) Spark/PySpark Data pipeline orchestration tools (e.g., Airflow, ADF, etc.) Data Modelling Extensive experience designing: Fact and dimension tables Star and snowflake schemas Aggregation layers and semantic models Data Migration & Mapping Demonstrated ...

tools. Experience building and optimising scalable data pipelines and data warehouses. Knowledge of AWS technologies such as Redshift, S3 and Athena. Experience with Airflow, Fivetran or similar orchestration and integration tools. Strong Linux/Unix and Bash scripting skills. A solid understanding of data quality, governance, lineage and monitoring. ...

modern cloud based data platforms. Solid understanding of data modelling and data transformation principles. Ability to work effectively within collaborative engineering teams. Desirable Experience: Airflow Databricks Experience supporting AI or machine learning initiatives. Semantic layer experience. Exposure to Azure and multi cloud environments. Understanding of Inmon 3NF data modelling ...

Experience Data Modeling Data Integration & Ingestion Data Manipulation and Processing GitHub, GitHub Actions, Azure DevOps Data Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest AI based Code developed and AI-built automated data pieplinesKey CharacteristicsTechnology expert who constantly pursues knowledge enhancement ...

GenAI (Agent Core, Copilot Studio, Amazon Bedrock), and Graph Databases (Neo4j). Cloud & Tools: Strong command of AWS (Lambda, Glue, EMR, MWAA, S3), Azure, Airflow, Terraform, Docker, Kubernetes, and Jenkins. Programming: Advanced skills in Python, SQL, Scala, Java, and Shell Scripting. Leadership Competencies Strategic Advisory: Proven ability to lead ...

auction systemsExcellent communication skills, able to explain complex technical systems to commercial, operations and senior leadership teams.Experience with Google Cloud, Docker, Kafka, Spark, Airflow, ElasticSearch, ClickHouse or similar production infrastructureExperience owning product roadmaps, release governance or cross-functional delivery across distributed teams and time zones.What we can offerBonusHybrid working ...