101 to 125 of 192 Apache Airflow Jobs in England

Familiarity with PostgreSQL and Snowflake Preferred: Familiarity with Web Frameworks such as Django, Flask or FastAPI Preferred: Familiarity with event streaming platforms such as Apache Kafka Preferred: Familiarity with data pipeline platforms such as Apache Airflow Preferred: Familiarity with Java Benefits and Perks We value the total ...

well as present complex findings clearly to both technical and non-technical audiencesProficient in using Tech Stack such as Amazon S3, Lambda function, Kafka, Apache Airflow or Bloomberg Teck Stack in production environmentExceptional problem-solving skills, numerical proficiency and high attention to detailAbility to work independently as well ...

preferred knowledge of AI infrastructure. Proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Proven experience ...

knowledge of AI infrastructure. Good proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Significant experience ...

Python Experience with AWS and modern data technologies Familiarity with version control systems such as Git Experience with orchestration tools such as Airflow Ability to troubleshoot and improve data platform performance Strong attention to detail and focus on data quality Excellent communication and collaboration skills Willingness to learn ...

learning services. Experience with machine learning frameworks such as TensorFlow, PyTorch, or scikit-learn. Knowledge of pipeline orchestration and data workflow tools such as Airflow, Dataform, or dbt. Experience delivering advanced measurement and modelling solutions, including marketing mix modelling, incrementality testing, causal impact analysis, attribution modelling, propensity modelling, churn ...

operating large-scale data transfer pipelines at multi-TB or PB scaleExperience orchestrating parallelised transfer jobs: Flyte preferred; other workflow orchestration tools (e.g. Airflow, Prefect) will be consideredExperience building reliable, observable data systems, including retry strategies, backfills, data integrity checks, lifecycle/state tracking and operational alerting.Strong cloud platform ...

solutions engineering, customer success, and field teams.Bias for action, strong ownership, and comfort operating in ambiguous, fast-moving environments.Nice to HaveExperience with Snowflake, dbt, Airflow, BI platforms, semantic layers, or adjacent cloud data platform ecosystems.Experience creating technical enablement for SQL developers, analytics engineers, or modern data teams.Familiarity with open ...

/DS libraries (scikit-learn, NumPy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.)PySparkAWS cloud infrastructure: EMR, ECS, Athena, etcMLOps/DevOps: Terraform, Docker, Airflow, MLFlowMonitoring and evaluation platforms including New Relic and BraintrustMore information:Enjoy fantastic perks like private healthcare & dental insurance, a generous work from abroad policy ...

organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design, Data Governance ...

secureCost-conscious: optimised warehouse spend, storage strategies, or job efficiency, and treat compute as a resource to manage, not ignorePlatform fluency: worked across orchestration (Airflow, Dagster), warehouses (Snowflake, BigQuery, Databricks), ingestion (Fivetran, Airbyte, custom), and transformation (dbt, Spark)AI Native: experienced in agentic coding workflows (context, harness, loop ...

practices (Git, CI/CD, testing frameworks, type-hinting, code reviews); and can build scalable, maintainable solutionsNice-to-have skills: Experience with DevOps tools (Airflow, Kubernetes, Terraform, GCP), data integration/ETL and pipeline optimization, or reinforcement learning algorithmsCustomer collaborator: Comfortable working directly with clients and cross-functional teams ...

platformsAdvanced Python and SQL skills, with experience in modern engineering practices such as CI/CD and TDDExperience with big data frameworks such as Apache Spark or similar technologiesSolid understanding of data modelling, data warehousing, OLTP and data lake architecturesExperience working with cloud ecosystems such as AWS, Azure … GCPFamiliarity with tools such as Kafka, Airflow, Hive, Delta, or similar technologiesStrong understanding of software engineering principles and production supportExperience with Linux, containerisation and enterprise scheduling toolsKnowledge of data governance, security and data privacy principles including GDPRConfident communicator, able to present complex technical concepts to varied audiencesA proactive, self ...

Complex modelling and performance-aware DML and DDL across Snowflake/Clickhouse• Kubernetes and Docker• Kafka• Strong understanding of Git, code review, CI, TDD• Apache Airflow - desirable, but not essentialResponsibilities• Design, build and own bespoke low latency pipelines for our most demanding data sources.• On-call rota, owning ...

demonstrable experience designing, deploying, and operating big data platforms at scale. You will have hands-on experience with OSS data ecosystems (e.g., Spark, Trino, Airflow, Apache Superset, and similar technologies). You will have knowledge of cloud platforms and traditional on-premise hosting; hands-on experience with Azure ...

building data pipelines Proficient in SQL, Python, AWS and other data management technologies Familiarity with version control systems like Git and orchestration tools like Airflow Ability to test and troubleshoot data platforms reliably. A track record of improving data reliability and quality Excellent communication skills and the ability ...

Platform services and infrastructure. Platform Guidance: Educate developers and researchers about the platform technology landscape, training on and facilitating the use of AWS, Airflow, Coder, Jenkins, Kubernetes, Terraform, and more to build, test, deploy, run, and observe. Workflow Automation & Best Practices:Collaborate with analytics and engineering teams to automate ...

Backend Engineering background Experience building APIs and system integrations Experience working within complex, data-intensive environments Strong understanding of software engineering best practices Desirable Airflow Snowflake AWS Exposure to data warehousing and modern analytics platforms Experience supporting reporting, commercial analytics, or performance data solutions IDEAL BACKGROUND We're especially ...

development.Excellent SQL skills and fluency in Python or R, with experience applying analytical and statistical methods to business problems.Experience with orchestration tools (e.g., DBT, Airflow) for deploying reliable data workflows.Strong communication and empathy - ability to translate complex data concepts for non-technical stakeholders.Collaborativeproduct mindset- comfort working closely with Sales ...

cloud-native data architecture (AWS/GCP/Snowflake).Architect and implement scalable ingestion and transformation pipelines using Fivetran, Databricks, and Airflow/DBT.Design and code modular data services and APIs that unify campaign, conversion, and audience datasets across 20+ marketing platforms.Build and optimize schemas, transformations, and ETL logic … pipelines.QualificationsHands-on experience as a Data Engineer or Data Platform Developer, including direct contributions to production codebases.Expert-level proficiency in Python, SQL, and Apache Spark for data pipeline development.Proven experience building ELT workflows using Fivetran, Airflow, DBT, or Databricks.Solid understanding of data modeling, dimensional design, and schema normalization ...

We are recruiting for an Analytical Engineer on behalf of one of the UK's most recognised and celebrated personal lines insurers. The successful candidate will be working alongside a talented team of Data & AI ...

infrastructure. Well versed and proven experience in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Longstanding experience ...

background as a Machine Learning Engineer. Technical Skills: Strong in SQL and Python (Pandas, Scikit-learn, Jupyter, Matplotlib). Data transformation & manipulation : experience with Airflow, DBT and Kubeflow Cloud: Experience with GCP and Vertex AI (developing ML services). Expertise: Solid understanding of computer science fundamentals and time-series ...

join our dynamic, expanding team. Over the last few years we’ve built a solid data foundation using best in class technologies (dbt, BigQuery, Airflow) and are just at the start of our journey to leverage this data in a more sophisticated way.About Zapp:Zapp is London’s leading ...

this role.Key Skills:Azure StackELT ExperienceData ModelingData Integration & IngestionData Manipulation and ProcessingGitHub, GitHub Actions, Azure DevOpsData Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTestKey CharacteristicsTechnology expert who constantly pursues knowledge enhancement and has an inherent curiosity to understand work from multiple dimensions.Deep data focus ...