Apache Airflow Jobs

1 to 25 of 109 Apache Airflow Jobs

Senior Data Scientist - Hybrid/Bristol - Up to £90k

Bristol, United Kingdom
Hybrid / WFH Options
Adecco
we will be happy to support you. KEYWORDS: Python/Google Cloud Platform/GCP/SQL/PostgreSQL/Pandas/SQLAlchemy/Apache Airflow/DataBricks/Data Bricks/Snowflake/Luigi/BigTable/Redis/CouchDB/RethinkDB/Elasticsearch/Insurance/… Asset Management/Reinsurance/Big Data/Python/Google Cloud Platform/GCP/SQL/PostgreSQL/Pandas/SQLAlchemy/Apache Airflow/DataBricks/Data Bricks/Snowflake/Luigi/BigTable/Redis/CouchDB/RethinkDB/Elasticsearch/Insurance/… Asset Management/Reinsurance/Big Data/Python/Google Cloud Platform/GCP/SQL/PostgreSQL/Pandas/SQLAlchemy/Apache Airflow/DataBricks/Data Bricks/Snowflake/Luigi/BigTable/Redis/CouchDB/RethinkDB/Elasticsearch/Insurance/ more »
Employment Type: Permanent
Salary: £70000 - £90000/annum Competitive package
Posted:

Data Scientist/Engineer - Hybrid/Bristol - Up to £60k

Bristol, United Kingdom
Hybrid / WFH Options
Adecco
support you. KEYWORDS: Python/Databricks/Data bricks/Google Cloud Platform/GCP/SQL/PostgreSQL/Pandas/SQLAlchemy/Apache Airflow/DataBricks/Data Bricks/Snowflake/Luigi/BigTable/Redis/CouchDB/RethinkDB/Elasticsearch/Postgres/… Big Data/Python/Databricks/Data bricks/Google Cloud Platform/GCP/SQL/PostgreSQL/Pandas/SQLAlchemy/Apache Airflow/DataBricks/Data Bricks/Snowflake/Luigi/BigTable/Redis/CouchDB/RethinkDB/Elasticsearch/Postgres/… Big Data/Python/Databricks/Data bricks/Google Cloud Platform/GCP/SQL/PostgreSQL/Pandas/SQLAlchemy/Apache Airflow/DataBricks/Data Bricks/Snowflake/Luigi/BigTable/Redis/CouchDB/RethinkDB/Elasticsearch/Postgres/ more »
Employment Type: Permanent
Salary: £50000 - £60000/annum Competitive package
Posted:

Data Engineer

London, England, United Kingdom
Hybrid / WFH Options
Aventum Group
Profisee), Snowflake Data Integration, Azure Service Bus, Deltalake, BigQuery, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App Service, Apache Airflow, Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, Azure ML is a plus Experience with more »
Posted:

Global IT Data Engineer Senior Specialist

Boston, Massachusetts, United States
Boston Consulting Group
WHAT YOU'LL DO Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow . Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards. Actively monitor and triage technical challenges in critical … Extremely talented in applying SCD, CDC and DQ/DV framework. Familiar with JIRA & Confluence . Must have exposure to technologies such as dbt, Apache airflow, and Snowflake . Desire to continually keep up with advancements in data engineering practices. Knowledge of AWS cloud, and Python is a … Requirements 5+ years of IT experience with major focus on data warehouse/database related projects Must have exposure to technologies such as dbt, Apache Airflow, Snowflake. Experience in data platforms: Snowflake, Oracle, SQL Server, MDM etc Expertise in writing SQL and database objects - Stored procedures, functions, and more »
Employment Type: Permanent
Salary: USD Annual
Posted:

Python Developer Software Engineer AWS Finance Trading London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
or Angular good but not necessary) Agile The following is DESIRABLE, not essential: AWS or GCP Buy-side Data tools such as Glue, Athena, Airflow, Ignite, DBT, Arrow, Iceberg, Dremio Fixed Income performance, risk or attribution TypeScript and Node Role: Python Developer (Software Engineer Programmer Developer Python Fixed Income … work is largely down to you. It can be entirely Back End. Otherwise, the stack includes Redux Saga, Ag-Grid, Node, TypeScript, gRPC, protobuf, Apache Ignite, Apache Airflow and AWS. As the application suite grows and advances in complexity, there is a decent amount of interaction with … the office 1-2 times a week. The tech environment is very new and will soon likely include exposure to the following: Glue, Athena, Airflow, Ignite, DBT, Arrow, Iceberg, Dremio This is an environment that has been described as the only corporate environment with a start-up/fintech more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Python Software Engineer AWS Iceberg Data Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … following: Advanced ability as a Senior Python Software Engineer/Technical Lead/Solutions Architect/Principal Engineer Good design and architecture ability Java Apache Iceberg Agile The following is DESIRABLE, not essential: Trading, Front Office finance AWS Glue Dremio Snowflake Spark, Airflow, Apache Iceberg, Arrow, DBT … manager, investment management) Role: Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Python Team Lead Software Engineer Developer Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Python Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager … experience: you must have led small teams on the delivery of projects AWS Glue Dremio Agile The following is DESIRABLE, not essential: Snowflake Spark, Airflow, Apache Iceberg, Arrow, DBT Trading, Front Office finance Some appreciation of asset classes such as Fixed Income, equities, FX or commodities Role: Python … Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC protobuf TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Python Technical Lead AWS Iceberg Data Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Python Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … You MUST have the following: Advanced ability as a Python Technical Lead/Solutions Architect/Principal Engineer Good design and architecture ability Java Apache Iceberg Agile The following is DESIRABLE, not essential: Trading, Front Office finance AWS Glue Dremio Snowflake Spark, Airflow, Apache Iceberg, Arrow, DBT … manager, investment management) Role: Python Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Java Technical Lead AWS Iceberg Data Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Java Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … You MUST have the following: Advanced ability as a Java Technical Lead/Solutions Architect/Principal Engineer Good design and architecture ability Python Apache Iceberg Agile The following is DESIRABLE, not essential: Trading, Front Office finance AWS Glue Dremio Snowflake Spark, Airflow, Apache Iceberg, Arrow, DBT … manager, investment management) Role: Java Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

React Developer Software Engineer Front End UI Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
there is little work to do here. Experience is data-intensive applications is desirable here. Other technology in the stack includes Node, gRPC, protobuf, Apache Ignite, Apache Airflow and AWS. They have a hybrid-working set up that requires the team to be in the office more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Python Solutions Architect Engineering Trading Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services … experience: you must have led small teams on the delivery of projects AWS Glue Dremio Agile The following is DESIRABLE, not essential: Snowflake Spark, Airflow, Apache Iceberg, Arrow, DBT Trading, Front Office finance Some appreciation of asset classes such as Fixed Income, equities, FX or commodities Role: Python … Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC protobuf TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services FX more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Lead Data Engineer (Java/ Python/ AWS/ Glue/ Dremio). Investment Management. £160,000 - £170,000 + 25% Bonus Target and Benefits. Hybrid 2 Days a week in St Pauls Office.

United Kingdom
Hybrid / WFH Options
CommuniTech Recruitment Group
AWS ecosystems like Lambdas, step functions and ECS services. Experience of Dremio is a nice to have Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake more »
Posted:

Staff Data Engineer - Global Data Platform (Enablement) team

United Kingdom
Bazaarvoice
designing and building robust, scalable, distributed data systems and pipelines, using open source and public cloud technologies. Strong experience with data orchestration tools: e.g. Apache Airflow, Dagster. Experience with big data storage and processing technologies: e.g. DBT, Spark, SQL, Athena/Trino, Redshift, Snowflake, RDBMSs (PostgreSQL/MySQL … . Knowledge of event-driven architectures and streaming technologies: e.g. Apache Kafka, Kafka Streams, Apache Flink. Experience with public cloud environments: e.g. AWS, GCP, Azure, Terraform. Strong knowledge of software engineering practices: e.g. testing, CI/CD (Jenkins, Github Actions), agile development, git/version control, containers etc. more »
Posted:

Senior Data Engineer. Java/ Python/ AWS. Investment Management. £135,000 - £145,000 + Discretionary Bonus and Benefits.

United Kingdom
CommuniTech Recruitment Group
step functions and ECS services. Strong understanding of AWS ecosystems like Lambdas, step functions and ECS services. Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake more »
Posted:

Senior Data Engineer. Java or Python and AWS. Investment Management. 12 month rolling Fixed Term Contract. £135,000 - £145,000 + 15% Guaranteed Bonus paid monthly + Benefits

United Kingdom
CommuniTech Recruitment Group
step functions and ECS services. Strong understanding of AWS ecosystems like Lambdas, step functions and ECS services. Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake more »
Posted:

Senior Data Engineer (Java/Python) - CDO

London (city), London, England
T Rowe Price
step functions and ECS services. Strong understanding of AWS ecosystems like Lambdas, step functions and ECS services. Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake more »
Employment Type: Permanent
Salary: Competitive
Posted:

Sr. Staff DevOps Engineer

Westminster, Colorado, United States
Hybrid / WFH Options
Maxar Technologies
Prior experience with CI/CD technologies such as Jenkins Prior experience with any of the following: Trino/Starburst, dbt (core or cloud), Apache Superset, OpenMetadata, Apache Airflow, Tableau. Prior experience with RDS databases, or Postgres. Agile software development lifecycle experience These skills would be amazing more »
Employment Type: Permanent
Salary: USD Annual
Posted:

Java Software Engineer Developer Finance Remote Ireland

Dublin, Ireland
Hybrid / WFH Options
Joseph Harry Ltd
Java or Kotlin, Kafka or equivalent and AWS or GCP. Experience in data engineering tooling would be advantageous, but is not essential - for example Airflow, DBT, Dremio, Iceberg, Dagster etc. This is an excellent opportunity to enter into finance without any prior experience and work on a long-term more »
Employment Type: Contract
Rate: EUR 525 Daily
Posted:

Senior Software/Data Engineer ( fixed term for 12 months)

London (city), London, England
Hybrid / WFH Options
T Rowe Price
experience. A good understanding of modern lakehouse architectures and corresponding technologies, such as Dremio, Snowflake, Iceberg, (Py)Spark/Glue/EMR, dbt and Airflow/Dagster. Experience with Cloud providers. Familiarity with AWS S3, ECS and EC2/Fargate would be considered particularly beneficial. Extensive experience with database more »
Employment Type: Contract
Rate: Competitive
Posted:

React Developer Software Engineer Python Finance London

London, United Kingdom
Joseph Harry Ltd
Engineer Programmer Full Stack Python React ReactJS Fixed Income Front Office Brokerage Trading Banking Buy Side Buy-Side AWS GCP React TypeScript Finance PostgreSQL Apache Ignite MaterialUI Ag-Grid Redux Saga Cypress Node gRPC Front Office Trading Investment Management Asset Manager) required by our asset management client in London. … Engineer Programmer Full Stack Python React ReactJS Fixed Income Front Office Brokerage Trading Banking Buy Side Buy-Side AWS GCP React TypeScript Finance PostgreSQL Apache Ignite MaterialUI Ag-Grid Redux Saga Cypress Node gRPC Front Office Trading Investment Management Asset Manager) required by our asset management client in London. … expanded to cover elements of risk and provide further analysis. The product is built in React, TypeScript, Redux, Redux Saga, Ag-Grid, Node, Python, Airflow, Ignite, gRPC, PostgreSQL, protobuf and AWS. This is a full stack role with an emphasis on the Front End. Candidates also need some exposure more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Full Stack Developer Software Engineer React Python London

London, United Kingdom
Joseph Harry Ltd
Engineer Programmer Full Stack Python React ReactJS Fixed Income Front Office Brokerage Trading Banking Buy Side Buy-Side AWS GCP React TypeScript Finance PostgreSQL Apache Ignite MaterialUI Ag-Grid Redux Saga Cypress Node gRPC Front Office Trading Investment Management Asset Manager) required by our asset management client in London. … Engineer Programmer Full Stack Python React ReactJS Fixed Income Front Office Brokerage Trading Banking Buy Side Buy-Side AWS GCP React TypeScript Finance PostgreSQL Apache Ignite MaterialUI Ag-Grid Redux Saga Cypress Node gRPC Front Office Trading Investment Management Asset Manager) required by our asset management client in London. … expanded to cover elements of risk and provide further analysis. The product is built in React, TypeScript, Redux, Redux Saga, Ag-Grid, Node, Python, Airflow, Ignite, gRPC, PostgreSQL, protobuf and AWS. This is a full stack role with an emphasis on the Front End. Candidates also need some exposure more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer

Birmingham, England, United Kingdom
Hybrid / WFH Options
Lorien
in SQL, NoSQL, Blob,Delta Lake, and other enterprise scale data stores. Data Orchestration - Enterprise scale usage of technology such as Azure Data Factory, Apache Airflow, Logic Apps, DBT, SnapLogic, Spark or similar tools. Software Tooling - GIT/GitHub, CI/CD, deployment tools like Octopus, Terraform infrastructure more »
Posted:

Data Engineer

London Area, United Kingdom
Harrington Starr
AWS preferred) Solid understanding of libraries like Pandas and NumPy Experience in data warehousing tools like Snowflake, Databricks, BigQuery Familiar with AWS Step Functions, Airflow, Dagster, or other workflow orchestration tools Commercial experience with performant database programming in SQL Capability to solve complex technical issues, comprehending risks prior to more »
Posted:

AWS Data Engineer

United Kingdom
Hybrid / WFH Options
Maclean Moore Ltd
to develop unit test cases. Help in backlog grooming. Key skills: Extensive experience in developing Bigdata pipelines in cloud using Bigdata technologies such as Apache Spark Expertise in performing complex data transformation using Spark SQL queries Experience in orchestrating data pipelines using Apache Airflow Proficiency in Git more »
Employment Type: Contract
Rate: Up to £425 per day
Posted:

Staff Software Engineer (Insights)

United Kingdom
Bazaarvoice
Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL and data modeling Experience with building large-scale systems with extensive knowledge in data warehousing solutions. Developing prototypes and more »
Posted:
Apache Airflow
10th Percentile
£67,050
25th Percentile
£85,000
Median
£112,500
75th Percentile
£142,500
90th Percentile
£165,000