76 to 100 of 117 Apache Airflow Jobs in England

build of cloud data warehouses - Snowflake experience is desirable, though Redshift or Synapse are also suitable - Experience with data orchestration tools such as Airflow or Prefect - Strong coding ability in Python, Java, or Scala - Experience building data infrastructure from scratch - Comfortable working with both batch and streaming data - Experience ...

outcomes Experience in startups, scale-ups, or consultancies is helpful — but not required. Nice to Have (Not Required) Experience with tools like Databricks, dbt, Airflow , or similar platforms Some exposure to API development or backend systems Experience integrating enterprise systems (ERP, CRM, operational platforms) Familiarity with dashboards or data ...

engineering and product teams to support evolving data requirements Requirements: SQL Server T-SQL DBA Skills Power BI ETL (SSIS or other, such as Airflow) MySQL would be useful but certainly not essential. Apply Now! If you have a range of experience in Data Engineering and you are looking ...

Tech Lead Manager in a data, platform or backend environment A background in data or backend engineering, such as AWS, Python or Scala, Spark, Airflow or similar Experience owning or supporting analytics, data or reporting products Strong people leadership skills including hiring, coaching and performance management A track record ...

Tech Lead Manager in a data, platform or backend environment A background in data or backend engineering, such as AWS, Python or Scala, Spark, Airflow or similar Experience owning or supporting analytics, data or reporting products Strong people leadership skills including hiring, coaching and performance management A track record ...

Tech Lead Manager in a data, platform or backend environment A background in data or backend engineering, such as AWS, Python or Scala, Spark, Airflow or similar Experience owning or supporting analytics, data or reporting products Strong people leadership skills including hiring, coaching and performance management A track record ...

Scala experience Experience delivering and maintaining distributed data processing systems using Big Data tools, lakehouse platforms, and workflow orchestration (experience with Spark, Databricks, or Airflow is a plus) Experience building with cloud platforms such as AWS, Azure, or GCP Experience working with AI tools or platforms (LLMs, predictive models ...

serving, scaling and monitoring workflows (e.g., BentoML, MLflow, Vertex AI, AWS Sagemaker) Experience building streaming + batch data ingestion and transformation pipelines (Spark/Airflow/Beam) Mobile and front-end web application development experience What We Offer At Newpage, we’re building a company that works smart ...

keys, sort keys , and workload management. Implement Redshift Spectrum to query data in S3 using external tables. 3. Data Lake & Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue, EMR, or Spark. Ensure high … monitoring. Required Skills 8 10 years ' experience in data engineering. Strong hands-on experience with: AWS S3, Athena, Glue, Redshift, EMR/Spark Apache Iceberg Python/SQL Experience in telecom data pipelines and handling large-scale structured/semi-structured data. Strong problem-solving, optimization, and debugging skills. ...

Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data availability. Develop ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

engineering and product teams to support evolving data requirements Requirements: SQL Server T-SQL DBA Skills Power BI ETL (SSIS or other, such as Airflow) MySQL would be useful but certainly not essential. Apply Now! If you have a range of experience in Data Engineering and you are looking ...

/Gas), who is technically well versed in systematic trading development, and analysis data-sets (time series, market-data). Stack: Python, AWS, ETL, Airflow The team has a flat structure, where developers are interfaced with PMs and traders, to ensure the software systems created are bespoke. ...

Senior Data Engineer (AWS, Airflow, Python) Based at client locations, working remotely, or based in our Godalming or Milton Keynes offices. Salary up to £65k plus company benefits. About Us Triad Group Plc is an award-winning digital, data, and solutions consultancy with over 35 years' experience primarily serving … maintain cloud data solutions. Maintain modular Terraform based IaC for reliable provisioning of AWS infrastructure. Develop, optimise and maintain robust data pipelines using Apache Airflow. Implement data transformation processes using Python to clean, preprocess, and enrich data for analytical use. Collaborate with data analysts, data scientists, developers, and other ...

Senior Data Engineer (AWS, Airflow, Python) Based at client locations, working remotely, or based in our Godalming or Milton Keynes offices. Salary up to £65k plus company benefits. About Us Triad Group Plc is an award-winning digital, data, and solutions consultancy with over 35 years' experience primarily serving … maintain cloud data solutions. Maintain modular Terraform based IaC for reliable provisioning of AWS infrastructure. Develop, optimise and maintain robust data pipelines using Apache Airflow. Implement data transformation processes using Python to clean, preprocess, and enrich data for analytical use. Collaborate with data analysts, data scientists, developers, and other ...

including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage technologies ...

Linux environment. - Experience in building automation tools and managing system configurations. - Knowledge of C++, KDB/q, and experience with technologies like Slurm, Airflow, Kafka, or AMPS. - Background in enhancing system stability, scalability, and performance while conducting root cause analyses to resolve incidents efficiently. - Observability skillset, monitoring and analysis ...

AI. Comfortable working in a fast-paced, agile environment. Excellent communication and collaboration skills. Nice to Have Experience with workflow orchestration tools (e.g., Temporal, Airflow). Familiarity with vector databases or semantic search tools. Experience building internal tooling or developer productivity enhancements using AI. Exposure to customer support ...

deliver reliable, high-performance data solutions using Databricks and modern cloud technologies. Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, and Delta Lake Build and optimize ETL/ELT workflows for batch and streaming data Develop data models to support analytics, reporting, and machine … data pipelines, architectures, and best practices Required Qualifications 3+ years of experience in data engineering or a similar role Strong experience with Databricks and Apache Spark Proficiency in Python and SQL Experience with Delta Lake, data modeling, and performance tuning Hands-on experience with cloud platforms (AWS, Azure ...

looking for Extensive experience in data engineering, including time in a lead role Strong Python and SQL skills Experience with orchestration tools (Airflow, Dagster, Prefect) Hands-on dbt , AWS, and modern data warehouses Strong data modelling and architectural capability Background scaling data platforms in high-growth environments Nice … have Snowflake or Apache Iceberg Infrastructure-as-Code (Terraform) Observability-driven data systems Package & Benefits Salary up to £120,000 Fully remote working Home-office setup Private healthcare and income protection 25 days holiday + enhanced parental leave Strong learning and development budget ...