Apache Airflow Jobs

1 to 25 of 104 Apache Airflow Jobs

Senior Data Scientist - Hybrid/Bristol - Up to £90k

Bristol, United Kingdom
Hybrid / WFH Options
Adecco
we will be happy to support you. KEYWORDS: Python/Google Cloud Platform/GCP/SQL/PostgreSQL/Pandas/SQLAlchemy/Apache Airflow/DataBricks/Data Bricks/Snowflake/Luigi/BigTable/Redis/CouchDB/RethinkDB/Elasticsearch/Insurance/… Asset Management/Reinsurance/Big Data/Python/Google Cloud Platform/GCP/SQL/PostgreSQL/Pandas/SQLAlchemy/Apache Airflow/DataBricks/Data Bricks/Snowflake/Luigi/BigTable/Redis/CouchDB/RethinkDB/Elasticsearch/Insurance/… Asset Management/Reinsurance/Big Data/Python/Google Cloud Platform/GCP/SQL/PostgreSQL/Pandas/SQLAlchemy/Apache Airflow/DataBricks/Data Bricks/Snowflake/Luigi/BigTable/Redis/CouchDB/RethinkDB/Elasticsearch/Insurance/ more »
Employment Type: Permanent
Salary: £70000 - £90000/annum Competitive package
Posted:

Data Scientist/Engineer - Hybrid/Bristol - Up to £60k

Bristol, United Kingdom
Hybrid / WFH Options
Adecco
support you. KEYWORDS: Python/Databricks/Data bricks/Google Cloud Platform/GCP/SQL/PostgreSQL/Pandas/SQLAlchemy/Apache Airflow/DataBricks/Data Bricks/Snowflake/Luigi/BigTable/Redis/CouchDB/RethinkDB/Elasticsearch/Postgres/… Big Data/Python/Databricks/Data bricks/Google Cloud Platform/GCP/SQL/PostgreSQL/Pandas/SQLAlchemy/Apache Airflow/DataBricks/Data Bricks/Snowflake/Luigi/BigTable/Redis/CouchDB/RethinkDB/Elasticsearch/Postgres/… Big Data/Python/Databricks/Data bricks/Google Cloud Platform/GCP/SQL/PostgreSQL/Pandas/SQLAlchemy/Apache Airflow/DataBricks/Data Bricks/Snowflake/Luigi/BigTable/Redis/CouchDB/RethinkDB/Elasticsearch/Postgres/ more »
Employment Type: Permanent
Salary: £50000 - £60000/annum Competitive package
Posted:

Data Engineer

London, England, United Kingdom
Hybrid / WFH Options
Aventum Group
Profisee), Snowflake Data Integration, Azure Service Bus, Deltalake, BigQuery, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App Service, Apache Airflow, Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, Azure ML is a plus Experience with more »
Posted:

Python Developer Software Engineer AWS Finance Trading London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
or Angular good but not necessary) Agile The following is DESIRABLE, not essential: AWS or GCP Buy-side Data tools such as Glue, Athena, Airflow, Ignite, DBT, Arrow, Iceberg, Dremio Fixed Income performance, risk or attribution TypeScript and Node Role: Python Developer (Software Engineer Programmer Developer Python Fixed Income … work is largely down to you. It can be entirely Back End. Otherwise, the stack includes Redux Saga, Ag-Grid, Node, TypeScript, gRPC, protobuf, Apache Ignite, Apache Airflow and AWS. As the application suite grows and advances in complexity, there is a decent amount of interaction with … the office 1-2 times a week. The tech environment is very new and will soon likely include exposure to the following: Glue, Athena, Airflow, Ignite, DBT, Arrow, Iceberg, Dremio This is an environment that has been described as the only corporate environment with a start-up/fintech more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Python Software Engineer AWS Iceberg Data Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … following: Advanced ability as a Senior Python Software Engineer/Technical Lead/Solutions Architect/Principal Engineer Good design and architecture ability Java Apache Iceberg Agile The following is DESIRABLE, not essential: Trading, Front Office finance AWS Glue Dremio Snowflake Spark, Airflow, Apache Iceberg, Arrow, DBT … manager, investment management) Role: Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Python Team Lead Software Engineer Developer Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Python Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager … experience: you must have led small teams on the delivery of projects AWS Glue Dremio Agile The following is DESIRABLE, not essential: Snowflake Spark, Airflow, Apache Iceberg, Arrow, DBT Trading, Front Office finance Some appreciation of asset classes such as Fixed Income, equities, FX or commodities Role: Python … Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC protobuf TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Java Software Engineer AWS Iceberg Data Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Senior Java Software Engineer (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial … following: Advanced ability as a Senior Java Software Engineer/Technical Lead/Solutions Architect/Principal Engineer Good design and architecture ability Python Apache Iceberg Agile The following is DESIRABLE, not essential: Trading, Front Office finance AWS Glue Dremio Snowflake Spark, Airflow, Apache Iceberg, Arrow, DBT … investment management) Role: Senior Java Software Engineer (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Python Technical Lead AWS Iceberg Data Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Python Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … You MUST have the following: Advanced ability as a Python Technical Lead/Solutions Architect/Principal Engineer Good design and architecture ability Java Apache Iceberg Agile The following is DESIRABLE, not essential: Trading, Front Office finance AWS Glue Dremio Snowflake Spark, Airflow, Apache Iceberg, Arrow, DBT … manager, investment management) Role: Python Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Java Technical Lead AWS Iceberg Data Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Java Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … You MUST have the following: Advanced ability as a Java Technical Lead/Solutions Architect/Principal Engineer Good design and architecture ability Python Apache Iceberg Agile The following is DESIRABLE, not essential: Trading, Front Office finance AWS Glue Dremio Snowflake Spark, Airflow, Apache Iceberg, Arrow, DBT … manager, investment management) Role: Java Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

React Developer Software Engineer Front End UI Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
there is little work to do here. Experience is data-intensive applications is desirable here. Other technology in the stack includes Node, gRPC, protobuf, Apache Ignite, Apache Airflow and AWS. They have a hybrid-working set up that requires the team to be in the office more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Python Solutions Architect Engineering Trading Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services … experience: you must have led small teams on the delivery of projects AWS Glue Dremio Agile The following is DESIRABLE, not essential: Snowflake Spark, Airflow, Apache Iceberg, Arrow, DBT Trading, Front Office finance Some appreciation of asset classes such as Fixed Income, equities, FX or commodities Role: Python … Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC protobuf TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services FX more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Lead Data Engineer (Java/ Python/ AWS/ Glue/ Dremio). Investment Management. £160,000 - £170,000 + 25% Bonus Target and Benefits. Hybrid 2 Days a week in St Pauls Office.

United Kingdom
Hybrid / WFH Options
CommuniTech Recruitment Group
AWS ecosystems like Lambdas, step functions and ECS services. Experience of Dremio is a nice to have Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake more »
Posted:

Staff Data Engineer - Global Data Platform (Enablement) team

United Kingdom
Bazaarvoice
designing and building robust, scalable, distributed data systems and pipelines, using open source and public cloud technologies. Strong experience with data orchestration tools: e.g. Apache Airflow, Dagster. Experience with big data storage and processing technologies: e.g. DBT, Spark, SQL, Athena/Trino, Redshift, Snowflake, RDBMSs (PostgreSQL/MySQL … . Knowledge of event-driven architectures and streaming technologies: e.g. Apache Kafka, Kafka Streams, Apache Flink. Experience with public cloud environments: e.g. AWS, GCP, Azure, Terraform. Strong knowledge of software engineering practices: e.g. testing, CI/CD (Jenkins, Github Actions), agile development, git/version control, containers etc. more »
Posted:

Senior Data Engineer. Java/ Python/ AWS. Investment Management. £135,000 - £145,000 + Discretionary Bonus and Benefits.

United Kingdom
CommuniTech Recruitment Group
step functions and ECS services. Strong understanding of AWS ecosystems like Lambdas, step functions and ECS services. Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake more »
Posted:

Senior Data Engineer. Java or Python and AWS. Investment Management. 12 month rolling Fixed Term Contract. £135,000 - £145,000 + 15% Guaranteed Bonus paid monthly + Benefits

United Kingdom
CommuniTech Recruitment Group
step functions and ECS services. Strong understanding of AWS ecosystems like Lambdas, step functions and ECS services. Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake more »
Posted:

React Developer Software Engineer Python Finance London

London, United Kingdom
Joseph Harry Ltd
Engineer Programmer Full Stack Python React ReactJS Fixed Income Front Office Brokerage Trading Banking Buy Side Buy-Side AWS GCP React TypeScript Finance PostgreSQL Apache Ignite MaterialUI Ag-Grid Redux Saga Cypress Node gRPC Front Office Trading Investment Management Asset Manager) required by our asset management client in London. … Engineer Programmer Full Stack Python React ReactJS Fixed Income Front Office Brokerage Trading Banking Buy Side Buy-Side AWS GCP React TypeScript Finance PostgreSQL Apache Ignite MaterialUI Ag-Grid Redux Saga Cypress Node gRPC Front Office Trading Investment Management Asset Manager) required by our asset management client in London. … expanded to cover elements of risk and provide further analysis. The product is built in React, TypeScript, Redux, Redux Saga, Ag-Grid, Node, Python, Airflow, Ignite, gRPC, PostgreSQL, protobuf and AWS. This is a full stack role with an emphasis on the Front End. Candidates also need some exposure more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Full Stack Developer Software Engineer React Python London

London, United Kingdom
Joseph Harry Ltd
Engineer Programmer Full Stack Python React ReactJS Fixed Income Front Office Brokerage Trading Banking Buy Side Buy-Side AWS GCP React TypeScript Finance PostgreSQL Apache Ignite MaterialUI Ag-Grid Redux Saga Cypress Node gRPC Front Office Trading Investment Management Asset Manager) required by our asset management client in London. … Engineer Programmer Full Stack Python React ReactJS Fixed Income Front Office Brokerage Trading Banking Buy Side Buy-Side AWS GCP React TypeScript Finance PostgreSQL Apache Ignite MaterialUI Ag-Grid Redux Saga Cypress Node gRPC Front Office Trading Investment Management Asset Manager) required by our asset management client in London. … expanded to cover elements of risk and provide further analysis. The product is built in React, TypeScript, Redux, Redux Saga, Ag-Grid, Node, Python, Airflow, Ignite, gRPC, PostgreSQL, protobuf and AWS. This is a full stack role with an emphasis on the Front End. Candidates also need some exposure more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer

Birmingham, England, United Kingdom
Hybrid / WFH Options
Lorien
in SQL, NoSQL, Blob,Delta Lake, and other enterprise scale data stores. Data Orchestration - Enterprise scale usage of technology such as Azure Data Factory, Apache Airflow, Logic Apps, DBT, SnapLogic, Spark or similar tools. Software Tooling - GIT/GitHub, CI/CD, deployment tools like Octopus, Terraform infrastructure more »
Posted:

Data Engineer

London Area, United Kingdom
Harrington Starr
AWS preferred) Solid understanding of libraries like Pandas and NumPy Experience in data warehousing tools like Snowflake, Databricks, BigQuery Familiar with AWS Step Functions, Airflow, Dagster, or other workflow orchestration tools Commercial experience with performant database programming in SQL Capability to solve complex technical issues, comprehending risks prior to more »
Posted:

AWS Data Engineer

United Kingdom
Hybrid / WFH Options
Maclean Moore Ltd
to develop unit test cases. Help in backlog grooming. Key skills: Extensive experience in developing Bigdata pipelines in cloud using Bigdata technologies such as Apache Spark Expertise in performing complex data transformation using Spark SQL queries Experience in orchestrating data pipelines using Apache Airflow Proficiency in Git more »
Employment Type: Contract
Rate: Up to £425 per day
Posted:

Staff Software Engineer (Insights)

United Kingdom
Bazaarvoice
Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL and data modeling Experience with building large-scale systems with extensive knowledge in data warehousing solutions. Developing prototypes and more »
Posted:

Staff Software Engineer (Insights)

London, England, United Kingdom
Bazaarvoice
Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL and data modeling Experience with building large-scale systems with extensive knowledge in data warehousing solutions. Developing prototypes and more »
Posted:

Software Developer

London Area, United Kingdom
Hybrid / WFH Options
Janus Henderson Investors
pandas, numpy, pyspark Good understanding of OOP, software design patterns, and SOLID principles Good experience in Docker Good experience in Linux Good experience in Airflow Good knowledge of cloud architecture Good experience in Terraform Expert experience with database systems (snowflake, sql, postgres etc.) Experience of micro-service development and more »
Posted:

Engineering Delivery Lead (AWS/Snowflake/Python/Scala) - UK based - 6 Month contract + extensions - £450-550/day + negotiable

England, United Kingdom
Orbis Group
Tech: - AWS (S3, Glue, EMR, Athena, Lambda) - Snowflake, Redshift - DBT (Data Build Tool) - Programming: Python, Scala, Spark, PySpark or Ab Initio - Data pipeline orchestration (Apache Airflow) - Knowledge of SQL This is a 6 month initial contract with a trusted client of ours. CVs are being presented on Friday more »
Posted:
Apache Airflow
10th Percentile
£67,050
25th Percentile
£85,000
Median
£112,500
75th Percentile
£142,500
90th Percentile
£165,000