101 to 125 of 224 Apache Airflow Jobs in London

languages and database querying languagesExperience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal)Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, code review, test ...

Experience mentoring or supporting the development of junior team members Experience within Digital Media, Revenue Management, Gaming, Gambling or Consumer Competitions Experience with dbt, Airflow, Git or similar tools Exposure to personalisation, recommendation engines or marketing technology platforms Familiarity with tools such as Tableau, Braze, Adswizz, Rudderstack or Covatic ...

necessary infrastructure, resources, and interfaces to enable data loading and LLM workflows.Use Python/Java and large-scale data workflow orchestration platforms e.g. Airflow to construct software artifacts for ETL, interfacing with diverse data formats and storage technologies, and incorporate them into robust data workflows and dynamic systemsWhat ...

architectures, or agentic systems. Experience designing external‐facing APIs, including versioning, backwards compatibility, and OpenAPI/REST standards. Familiarity with data infrastructure such as Airflow, Spark, Iceberg, or Kafka. Experience with energy markets. Modo Energy is an equal opportunity employer. Employment decisions are made on the basis of qualifications ...

systems (CMS), subscription platforms, ad tech, and social media. Proven ability to automate and optimise data workflows, using modern ETL/ELT tools (e.g., Airflow, dbt, Apache Spark) to ensure timely and reliable delivery of data. Experience building robust data models and reporting layers to support performance dashboards … experience in a data engineering role. Tools & Technologies: Databases: Proficient in relational SQL databases. Workflow Management Tools: Experience with orchestration platforms such as Apache Airflow. Programming Languages: Skilled in one or more of the following languages, i.e.: Python, Java, Scala. Cloud Infrastructure: Strong understanding of cloud infrastructure such ...

Familiarity with PostgreSQL and Snowflake Preferred: Familiarity with Web Frameworks such as Django, Flask or FastAPI Preferred: Familiarity with event streaming platforms such as Apache Kafka Preferred: Familiarity with data pipeline platforms such as Apache Airflow Preferred: Familiarity with Java Preferred: Experience in one or more relevant ...

Familiarity with PostgreSQL and Snowflake Preferred: Familiarity with Web Frameworks such as Django, Flask or FastAPI Preferred: Familiarity with event streaming platforms such as Apache Kafka Preferred: Familiarity with data pipeline platforms such as Apache Airflow Preferred: Familiarity with Java Benefits and Perks We value the total ...

join them 5+ years’ experience in Data Engineering Experience designing scalable data pipelines for machine learning workloads Experience implementing orchestration tools such as Apache Airflow or equivalent. Knowledge of data modelling, dimensional modelling and data warehousing principles. Whether you’re developing new products, building scalable platforms or unlocking ...

well as present complex findings clearly to both technical and non-technical audiencesProficient in using Tech Stack such as Amazon S3, Lambda function, Kafka, Apache Airflow or Bloomberg Teck Stack in production environmentExceptional problem-solving skills, numerical proficiency and high attention to detailAbility to work independently as well ...

preferred knowledge of AI infrastructure. Proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Proven experience ...

knowledge of AI infrastructure. Good proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Significant experience ...

native architecturesPractical experience with Azure (Azure OpenAI, Azure AI Foundry, AI Search) and familiarity with AWS or GCPProficiency with containerized deployment, MLOps tooling (MLFlow, Airflow), and infrastructure-as-code practicesBachelor’s or Master’s degree in Computer Science, Data Science, or related fieldExperience with Azure AI Agent Service ...

Master• Data Integration & Ingestion – Skill• Data Manipulation and Processing – Skill• GITHUB, Action, Azure DevOps – Skill• Data factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest – SkillOptional skills:• Experience in project management, running a scrum team.• Experience working with BPC, Planning.• Exposure to working with external ...

Redshift/S3 and SQL Server.You have several years of strong experience with ETL/ELT processes and APIs with tools such as dbt, Airflow, and Talend.You are proficient in using BI visualisation tools, in particular Power BI, Tableau & Metabase.You have good knowledge of data modelling & transformation techniques within ...

development.Excellent SQL skills and fluency in Python or R, with experience applying analytical and statistical methods to business problems.Experience with orchestration tools (e.g., DBT, Airflow) for deploying reliable data workflows.Strong communication and empathy - ability to translate complex data concepts for non-technical stakeholders.Collaborativeproduct mindset- comfort working closely with Sales ...

solutions engineering, customer success, and field teams.Bias for action, strong ownership, and comfort operating in ambiguous, fast-moving environments.Nice to HaveExperience with Snowflake, dbt, Airflow, BI platforms, semantic layers, or adjacent cloud data platform ecosystems.Experience creating technical enablement for SQL developers, analytics engineers, or modern data teams.Familiarity with open ...

/DS libraries (scikit-learn, NumPy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.)PySparkAWS cloud infrastructure: EMR, ECS, Athena, etcMLOps/DevOps: Terraform, Docker, Airflow, MLFlowMonitoring and evaluation platforms including New Relic and BraintrustMore information:Enjoy fantastic perks like private healthcare & dental insurance, a generous work from abroad policy ...

organisation* Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI* Expertise in Streaming Data, Event Driven Design, Data Governance ...

/CD, testing frameworks, type-hinting, code reviews); and can build scalable, maintainable solutions Nice-to-have skills: Experience with DevOps tools (Airflow, Kubernetes, Terraform, GCP), data integration/ETL and pipeline optimization, or reinforcement learning algorithms Customer collaborator: Comfortable working directly with clients and cross-functional teams, aligning ...

organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design, Data Governance ...

secureCost-conscious: optimised warehouse spend, storage strategies, or job efficiency, and treat compute as a resource to manage, not ignorePlatform fluency: worked across orchestration (Airflow, Dagster), warehouses (Snowflake, BigQuery, Databricks), ingestion (Fivetran, Airbyte, custom), and transformation (dbt, Spark)AI Native: experienced in agentic coding workflows (context, harness, loop ...

practices (Git, CI/CD, testing frameworks, type-hinting, code reviews); and can build scalable, maintainable solutionsNice-to-have skills: Experience with DevOps tools (Airflow, Kubernetes, Terraform, GCP), data integration/ETL and pipeline optimization, or reinforcement learning algorithmsCustomer collaborator: Comfortable working directly with clients and cross-functional teams ...

models, schemas to support business requirementsDevelop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc.Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based.Working collaboratively with the client and cross …/Azure SQL, PostgreSQL)You have framework experience within either Flask, Tornado or Django, DockerExperience working with ETL pipelines is desirable e.g. Luigi, Airflow or ArgoExperience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc.Data acquisition and development of data sets and improving data qualityPreparing data ...

schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the client …/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving ...

platformsAdvanced Python and SQL skills, with experience in modern engineering practices such as CI/CD and TDDExperience with big data frameworks such as Apache Spark or similar technologiesSolid understanding of data modelling, data warehousing, OLTP and data lake architecturesExperience working with cloud ecosystems such as AWS, Azure … GCPFamiliarity with tools such as Kafka, Airflow, Hive, Delta, or similar technologiesStrong understanding of software engineering principles and production supportExperience with Linux, containerisation and enterprise scheduling toolsKnowledge of data governance, security and data privacy principles including GDPRConfident communicator, able to present complex technical concepts to varied audiencesA proactive, self ...