24 of 24 Apache Airflow Jobs in the South East

/GCP beneficial) Strong data modelling knowledge Understanding of data governance and security best practices Ability to translate business needs into scalable solutions Desirable Airflow, dbt, Kafka, CI/CD, BI tools, governance platforms, financial services experience. Interested in building modern, enterprise-scale data platforms in a highly regulated ...

environment Proven experience delivering at least one production-grade data platform Strong hands-on capability with modern data engineering tools such as Python, SQL, Airflow, Spark, Kafka, dbt, Snowflake (Essential) Experience with backend technologies (e.g. Java/Spring Boot) Experiencewith cloud platforms (AWS, Azure, or GCP) and cloud-native ...

Cassandra) Expertise in building and maintaining ETL pipelines and data workflows Familiarity with cloud data platforms (AWS, Azure, GCP) and data pipeline orchestration tools (Airflow, Prefect, etc.) Understanding of data modelling, schema design, and performance optimisation Experience with agile development methodologies, including Scrum and Kanban Familiarity with version control ...

Data Engineer: Passion for building scalable, resilient cloud data platforms Strong experience with Databricks or Snowflake on AWS Proven Python skills, including Spark and Airflow expertise Advanced SQL skills and end-to-end data modelling experience Experience building batch and real-time data integrations Hands-on CICD skills with ...

Skills and Experience * Strong commercial experience working with AWS in production environments. * Proficiency in Python and SQL for data processing and orchestration. * Experience with Airflow for workflow management. * Knowledge of cloud data warehousing, ideally Redshift. * Experience with infrastructure as code and CI/CD tooling such as Terraform ...

databricks Proficiency in programming languages such as Python, Spark, SQL. Strong experience with SQL databases. Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF). Experience with cloud platforms (Azure preferred) and related data services. Knowledge of big data technologies (e.g., Hadoop, Spark, Kafka). ...

experience. Hands-on experience with Hadoop - configuring multi-node Hadoop clusters, including resource management, security, and performance tuning. Strong Big Data engineering background using Apache Airflow, Spark, dbt, Kafka, and Hadoop ecosystem tools. Knowledge of RDBMS systems (PostgreSQL, SQL Server) and familiarity with NoSQL/distributed databases such ...

understanding ML pipelines and models in a production setting. Direct experience with Google Cloud Platform, BigQuery, and associated tooling. Experience with workflow tools like Airflow or Kubeflow. Familiarity with dbt (Data Build Tool). Please send your CV for more information on these roles. Reasonable Adjustments: Respect and equality ...

tools including Intelligent Document Processing and LLMs. Required: Strong programming skills i.e Python. Experience working with any front end languages ideally React. Experience with Airflow, Kubernetes, Docker, SQL/NoSQL databases. Must have strong financial serivces background/open to fintech startup firms. Cloud and CI/CD knowledge. ...

technologies including the Python scientific stack (NumPy, Pandas, SciPy, etc.), frameworks such as OpenCV, PyTorch, TensorFlow and JAX, data pipeline tools such as Airflow or Prefect and data processing tools such as Spark or Databricks. The Company The Python Developer will be joining a company whose platform has been ...

needs to be an IBM Certified TM1 developer as well as have a formal SQL qualification. Intermediate knowledge of Python & Django Intermediate Knowledge of Airflow and its application Awareness of cloud technologies and their application Administrator of Planning Analytics (TM1) and Oracle (systems admin) Experience of coaching & mentoring ...

essential) Experience with Lightdash or Looker (or similar BI tools) Solid analytical mindset with attention to detail Desirable: Experience with Python and/or Airflow Familiarity with data modelling and pipeline orchestration The client is looking to move quickly for this. If you are interested in going forward, please ...

Python, and Ansible Familiarity with containers (Docker, Kubernetes, LXC) Experience with monitoring tools and SQL databases Exposure to big data systems (e.g., Spark, HDFS, Airflow) Summary A great opportunity for someone who enjoys solving complex infrastructure challenges, automating systems, and working closely with engineering teams. Spectrum IT Recruitment (South ...

ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing for data workflows Orchestrate pipelines using Airflow, Prefect, or Dagster Improve observability, monitoring, and lineage across data systems Mentor junior engineers and elevate engineering standards Key Skills and Experience Management … Data Engineering experience Expert-level SQL and advanced data modelling Strong Python Experience with Snowflake and Databricks Cloud experience Experience with orchestration tools (Airflow, Prefect) CI/CD and DataOps experience for data platforms This role will suit someone who is looking to remain hands on , whilst leading ...

including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage technologies ...

including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage technologies ...

GDPR) isn't a \"nice to have\"it's the whole game. You need to be decisive. You need to know the modern stack (Airflow, Fivetran, Python) well enough to know when someone is pulling the wool over your eyes, but you need to be senior enough to step ...

GDPR) isn't a \"nice to have\"it's the whole game. You need to be decisive. You need to know the modern stack (Airflow, Fivetran, Python) well enough to know when someone is pulling the wool over your eyes, but you need to be senior enough to step ...

GDPR) isn't a \"nice to have\"it's the whole game. You need to be decisive. You need to know the modern stack (Airflow, Fivetran, Python) well enough to know when someone is pulling the wool over your eyes, but you need to be senior enough to step ...

GDPR) isn't a \"nice to have\"it's the whole game. You need to be decisive. You need to know the modern stack (Airflow, Fivetran, Python) well enough to know when someone is pulling the wool over your eyes, but you need to be senior enough to step ...

Engineer (Mid Level) £45,000–£55,000 Remote (1-2 days per month London, Leeds or Preston) Tech Stack: GCP (BigQuery, Dataflow), DBT, Terraform, Airflow (Composer), Python, SQL VIQU are working with a growing, data-driven organisation they are building out a modern Data Platform following a successful migration … pipelines Strong SQL and Python skills, with hands-on experience building data pipelines Experience with DBT, Terraform, and version control (Git) Exposure to Airflow (or similar orchestration tools), Docker, and CI/CD practices Cloud experience in GCP (BigQuery preferred) or Azure/AWS environments Understanding of modern data ...

developing and growing sales of a range of high-quality testing and measurement instruments , used by engineers to assess building performance, air quality, airflow, temperature, pressure and environmental conditions. This role will be primarily office-based , focusing on developing client relationships, managing incoming enquiries and proactively identifying sales opportunities ...

financial services organisation Your new role We are seeking a Data Engineer to support the replacement of a legacy ETL tool with a modern Apache Spark based data platform. This is a hands-on engineering role focused on building and supporting Spark jobs, with an emphasis on performance, reliability … scalability.The role is focused on building nonperformance Apache Spark jobs, with a strong emphasis on performance optimisation. It is primarily Java-based, with Python strongly encouraged; experience across Java, Python, and Scala is ideal, with Java and Python being the preferred combination.The role sits within a small Agile delivery ...

quality solutions. Responsibilities: Build and optimise Azure data pipelines Maintain Databricks data platforms for analytics and reporting Implement transformations using dbt Orchestrate workflows with Airflow Support platform migrations and modernisation Apply engineering best practices, version control, and CI/CD Document solutions and contribute to technical discussions Collaborate with … client teams on scalable solutions Essential Experience: Hands-on Azure data platform experience Proficiency in Databricks DBT experience in enterprise environments Airflow workflow orchestration Exposure to a mix of industry backgrounds Desirable Experience: Consultancy or multi-client delivery experience Input into platform design and architecture Experience in regulated ...