176 to 200 of 225 Apache Airflow Jobs in London

experience. Experience building self-serve ML platforms or tools for non-expert users. Experience with lakeFS , DVC , MLflow , Weights & Biases , Kubernetes, Kubeflow, Flyte, Dagster, Airflow, or Argo. LLM application, context engineering, structured output, or LLM evaluation experience. Exposure to radar, AIS, EO/IR fusion, tracking, sensor fusion, robotics ...

planning or optimisation. Familiarity with digital advertising measurement challenges such as attribution bias, selection effects, incrementality gaps, and platform limitations. Experience with BigQuery, Looker, Airflow, or similar data ecosystems. Passion for gaming and a track record of using data to improve commercial decision‐making. About King With a mission ...

Learning, or AI workloads. Experience with MLOps tooling such as MLflow, Kubeflow, Vertex AI, or similar technologies. Knowledge of workflow orchestration platforms such as Apache Airflow. Experience with data processing technologies such as Pandas, Apache Beam, Spark, or similar frameworks. Strong SQL skills and experience with analytical databases ...

/CD experience. Highly Desirable Familiarity with OneTick, PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar. Order book reconstruction Tick-to-bar aggregation Airflow, Dagster, Prefect or MLflow Experience supporting quantitative research or trading systems Multi-asset market data (Equities, Futures, FX, Options, ETFs, CFDs) What We're Looking … market data engineering with proven experience building reliable, scalable data platforms. Our non-negotiable requirements are: Expert Python Strong SQL Scalable data pipeline development Apache Parquet Market data normalisation Automated data quality controls Deep tick and market data expertise Experience in MLOps is advantageous but not essential. We welcome ...

/CD experience. Highly Desirable Familiarity with OneTick, PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar. Order book reconstruction Tick-to-bar aggregation Airflow, Dagster, Prefect or MLflow Experience supporting quantitative research or trading systems Multi-asset market data (Equities, Futures, FX, Options, ETFs, CFDs) What We're Looking … market data engineering with proven experience building reliable, scalable data platforms. Our non-negotiable requirements are: Expert Python Strong SQL Scalable data pipeline development Apache Parquet Market data normalisation Automated data quality controls Deep tick and market data expertise Experience in MLOps is advantageous but not essential. We welcome ...

cost efficiency, scalability, and reliabilityContribute to the target architecture and long-term platform directionData Engineering & DeliveryDesign and build robust, scalable data pipelines (Snowflake, dbt, Airflow, ADF, Python)Apply strong practices in test-driven development, monitoring, logging, and observabilityOwn more complex technical solutions and problem-solvingSupport production issues and drive … Python, with hands-on experience building data pipelines and transformations at scaleHands-on experience with a modern cloud data stack, including Snowflake, dbt, Airflow, and Databricks, on a cloud platform (Azure preferred)Demonstrated experience delivering data lineage and traceability within a regulated environment (e.g. SOX, financial services, healthcare ...

including model deployment, monitoring, evaluation, and lifecycle management Strong hands‐on understanding of modern data and AI tooling, ideally including SQL, Python, Snowflake, dbt, Airflow, Metabase, Tableau, and AWS‐based data services Experience with data ingestion, streaming, and change data capture tooling, such as Fivetran, Estuary, or similar platforms … standards, and enablement for analytics engineers Ability to oversee API‐based and batch data extraction processes, particularly those built in Python and orchestrated using Airflow Understanding of machine learning tooling and lifecycle management, ideally including DVC, MLflow, Evidently AI, or equivalent platforms for experiment tracking, versioning, monitoring, and evaluation ...

CDO. What you’ll need for this role Hands-on experience designing and operating large-scale data pipelines on GCP (BigQuery, Cloud Composer/Airflow, GCS), with proven knowledge of Apache Kafka and real-time streaming architectures Demonstrated experience leading or technically mentoring a team of data engineers ...

intent signals. You will sit in the Data group and partner with GTM Systems, RevOps and frontline teams, building pipelines with dbt, Snowflake and Airflow, and extending enrichment with LLMs across multiple #J-18808-Ljbffr ...

multiple teams. In this contract role, expect to define standards, build reusable data movement frameworks and drive best practices with AWS Glue, Spark and Airflow in a regulated environment. London-based with on-site presence three days a week. #J-18808-Ljbffr ...

architectural tradeoffs Hands-on experience designing tokenisation schemes for heterogeneous feature types such as numerical, categorical, and temporal Proficiency in Python, PyTorch, SageMaker, and Airflow Experience owning the full model lifecycle, from training through to serving in production Comfortable working in a small, high ownership team on open ended ...

data analysis packages such as Numpy, Pandas, etc. • Experience with SQL and/or other database technologies • Knowledge of modern technologies such as AWS, Airflow, Docker, GitLab and Redis • Ideally working with data visualization technologies such as Dash, Plotly, You will be joining a progressive and exciting company committed ...

clear, performant, and reliable queries to transform large complex datasets) You have experience building and owning automated data pipelines with tools like DBT/Airflow Experimentation & Statistics: Experience running A/B tests and analysing the results to drive product decisions Ownership: You enjoy working independently in a fast ...

harnessing, mounting and internal assembly, defining the interface requirements and constraints that keep electrical and mechanical designs coherent. Validate mechanical designs for electrical fit, airflow, thermal performance, manufacturability and secure‐by‐design alignment, and represent electrical, integration and security requirements in mechanical design reviews. Lead EMC design, EMC testing ...

into solutions.Key responsibilities:Building and maintaining data pipelines and services under the guidance of senior engineers.Working with technologies such as Python, SQL, Spark, and Airflow to process large-scale data.Using AI-assisted development tools such as Claude Code, Copilot, or Codex as part of your workflow.Contributing … Spark.Basic understanding of data engineering concepts including batch processing and relational databases.Some hands-on experience with data pipeline tools; exposure to Spark or Airflow is a plus.Familiarity with cloud platforms (preferably AWS); production experience is not required.A collaborative mindset and willingness to learn and communicate openly within the team.Nice ...

Azure , with GCP particularly desirable Knowledge of technologies such as BigQuery, Snowflake, Redshift, Synapse, Databricks or equivalent Experience with modern tooling such as dbt, Airflow and Terraform , or comparable technologies Strong knowledge of ETL/ELT and data integration patterns Understanding of CI/CD, automated testing and DataOps ...

contracts, staking, or other on-chain systems- Full-stack development with Python (FastAPI)- Strong relational data modeling fundamentals- GitOps and Kubernetes- Job orchestration systems (Airflow, Prefect, etc.)For more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice at . ...

level English (written and spoken).Desirable:Experience in a platform engineering or inner-source context; GraphQL federation.Geospatial experience (Mapbox, PostGIS) or exposure to Kafka, Airflow, GeoServer.We are a dynamic company dedicated to nurturing connections and innovating solutions to tackle market challenges head-on. If you thrive on customer satisfaction ...

simulation platformEffectively integrate machine-learned graphics subsystems into the simulation platformImplement production quality software in PythonAbout youEssential Experience with workflow orchestration systems (e.g. Airflow, Dagster, Flyte, etc.) and/or developing data intensive applicationsExcellent development skills in PythonDeep knowledge of Kubernetes at the user levelGood sense of systems ...

Spark for building and optimizing large-scale data pipelines, with a strong grasp of data structuring for performance and efficiencyHands-on experience with Airflow for orchestrating complex data workflows, and Apache Iceberg for table format management at scaleExtensive AWS experience including EKS, Docker, and Kubernetes; comfortable owning infrastructure ...

technical design reviews.Must Haves (Hard Skills)Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake.Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi-structured financial data logs (JSON/Avro).Robust …/ELT Orchestration: Expert proficiency in data transformation engines (such as dbt) and scheduling tools (such as Airflow).Stream/Message Queues: Solid understanding of event-driven architectures and streaming processing via Apache Kafka.Strong Programming Foundations: Proficiency in Python, SQL, or an Object-Oriented language (Java/Scala ...

technical design reviews. Must Haves (Hard Skills) Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake. Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi‐structured financial data logs (JSON/… Avro). Robust ETL/ELT Orchestration: Expert proficiency in data transformation engines (such as dbt) and scheduling tools (such as Airflow). Stream/Message Queues: Solid understanding of event‐driven architectures and streaming processing via Apache Kafka. Strong Programming Foundations: Proficiency in Python ...

building internal developer tools, DSLs, or compilers, multi-language proficiency such as Go, C, or Rust, cybersecurity, workflow orchestration with Prefect or Airflow, high-growth SaaS Условия: Competitive salary Meaningful equity One of the first engineering hires Direct access to the founders Huge ownership from day one Build products ...

elevate our current data pipelines and streaming architectures. Establish best practices for monitoring, reliability, and scale across our data ecosystem (using Python, dbt, Airflow, Kafka, and Trino/Iceberg).Build the Unified Customer View: Productionize PoCs into scalable Airflow/dbt data workflows to lay the groundwork … Python and proven experience architecting, deploying, and maintaining Big Data and streaming/batch pipelines (e.g., Kafka Streams, Event Streaming, Trino, Iceberg).dbt & Airflow Proficiency: Hands-on experience using dbt for scalable data transformations and Airflow for workflow orchestration.Data Architecture Mastery: A strong background in designing scalable, fault ...

/Java and/or Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code” tools … partners across the organization via Technical Design Documents. This is a great opportunity to further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform & Google Cloud Platform. Benefits Hybrid working Long contract Award winning work environment ...