46 to 70 of 83 Apache Airflow Jobs in England

data governance within the team and resolving escalated technical queries within a team. Extensive experience with Snowflake is essential and working knowledge of dbt, Airflow and AWS is highly desirable. Extensive stakeholders' management experience ideally in area of responsibility, with IT and architects and with external suppliers. more »

role in shaping the technological landscape of our projects. Key Responsibilities: Architect end-to-end solutions, leveraging your expertise in Python, Java, Spark, Trino, Airflow, and Hadoop. Maintain a hands-on approach, ensuring that your architectural vision translates seamlessly into implementation. Collaborate with cross-functional teams to design and more »

data manipulation and analysis Experience with Kubernetes and Docker for scalable infrastructure deployment Hands on experience with CI/CD and Orchestration tools eg. Airflow, Jenkins, Bamboo, etc. Experience with MongoDB is highly beneficial Knowledge of data pipeline development and optimization Familiarity with data science principles and workflows is more »

years of relevant work experience in Python, preferably also Typescript Experience using Spark and other data processing frameworks and data warehouses such as BigQuery, Airflow, Databricks, Hadoop, Kafka, Redshift, Redis or/and Hive more »

requirements and achieving impactful outcomes. A detail-oriented mindset and a reputation for maintaining high standards in your work. Tech Stack : dbt, SQL, Snowflake, Airflow, AWS, Tableau. DE&I is also at the heart of the business and they strongly believe that ensuring diversity of background and experience will more »

range of databases. Snowflake is widely used, as are Docker and Kubernetes for containerisation. ETL and ELT tech are also used every day, primarily Airflow, Spark, Hive and a lot more. You’ll need to come from a strong academic background with some commercial experience in a data heavy more »

TMS (Tealium IQ, GTM and Adobe Dynamic Tag Manager) changes. Integrate data sources via web and REST APIs. Data pippingand modelling using SQL, DBT, Airflow, ETL, Data Warehousing, Redshift and Python. Transfer knowledge of the business processes and requirements to the development teams. Collaborate with Product, Marketing and Development more »

our customers. Skills and experience we’re looking for: Experience of creating advanced visualisations in Tableau. Experience in SQL and Python. Experience of AWS, Airflow, S3 and working with Snowflake in a large complex organisation is advantageous. Experience of establishing processes to identify and managing issues, in data or more »

data quality checks and monitoring processes. KEY SKILLS Proficiency in SQL and data querying validation and testing purposes. Hands on experience with Snowflake or Airflow or DBT. Familiarity with data integration, ETL processes, and data governance frameworks. Solid understanding of data structures, relational databases and data modelling concepts. Experience more »

will have the following skills and experience Full Proficiency in GCP, Python, CI/CD. Docker and Kubernetes would be desirable as well as Airflow, and Terraform HOW TO APPLY: Please register your interest by submitting your CV to Callum Aris via the apply link on this page. more »

tooling: containers (e.g., Docker) container orchestration (Kubernetes/K8s) CI/CD experience Version control (Git, Github, Gitlab) Orchestration/DAGs tools (e.g., Argo, Airflow, Kubeflow) Infrastructure as Code (Terraform, etc.) HOW TO APPLY Please register your interest by sending your CV to niall.wharton@@xcede.com or click the Apply more »

Langchain, Semantic Kernel, and tools like MS tooling, Co-Pilot Studio, ML Studio, Prompt flow, Kedro, etc. Proficiency in pipeline orchestration with tools like Airflow, Kubeflow, and Argo . Exceptional communication skills, with the ability to articulate complex statistical concepts clearly. Personal Competencies: A results-oriented professional with a more »

4.Monitoring and Logging: Implement and maintain monitoring, logging, and alerting solutions. Key technologies: AWS, VPN, VPC Peering, EC2, S3, Lambda, Aurora, Docker/Kubernetes. Apache Airflow, AWS networking concepts such as VPN, VPC peering, subnets, security groups, NAT gateways.AWS CloudWatch or equivalent. Kafka or similar data streaming components. more »

on with projects but no requirements, previous experience in this is essential SKILLS AND EXPERIENCE NEEDED: Experience in Redshift database (AWS) Experience with DBT, Airflow and Fivetran Working collaboratively with multiple teams across the business Management/mentoring experience of a team INTERVIEW PROCESS: 1st Stage- Initial Chat 2nd more »

Infrastructure AWS Python Java Go JavaScript Big Data Lake Data Mesh Kubernetes Terraform Finance Trading Glue Athena Dremio Iceberg Snowflake DBT Arrow gRPC protobuf Airflow Ignite Asset Manager Investment Management Financial Services Hedge Fund) required by our asset management client in London. You MUST have the following: Strong experience … in an enterprise scale environment The following is DESIRABLE, not essential: SRE for big data Glue, Athena, Dremio, Iceberg, Snowflake, DBT, Arrow, gRPC, protobuf, Airflow, Ignite Graffana, Prometheus Role: Site Reliability Engineer (SRE DevOps Infrastructure AWS Python Java Go JavaScript Big Data Lake Data Mesh Kubernetes Terraform Finance Trading … Glue Athena Dremio Iceberg Snowflake DBT Arrow gRPC protobuf Airflow Ignite Asset Manager Investment Management Financial Services Hedge Fund) required by our asset management client in London. You will join a team 6 data engineers who are responsible for core engineering of a big data environment on AWS. You more »

Infrastructure AWS Python Java Go JavaScript Big Data Lake Data Mesh Kubernetes Terraform Finance Trading Glue Athena Dremio Iceberg Snowflake DBT Arrow gRPC protobuf Airflow Ignite Asset Manager Investment Management Financial Services Hedge Fund DevOps) required by our asset management client in London. You MUST have the following: Strong … in an enterprise scale environment The following is DESIRABLE, not essential: SRE for big data Glue, Athena, Dremio, Iceberg, Snowflake, DBT, Arrow, gRPC, protobuf, Airflow, Ignite Graffana, Prometheus Role: REMOTE Site Reliability Engineer (SRE DevOps Infrastructure AWS Python Java Go JavaScript Big Data Lake Data Mesh Kubernetes Terraform Finance … Trading Glue Athena Dremio Iceberg Snowflake DBT Arrow gRPC protobuf Airflow Ignite Asset Manager Investment Management Financial Services Hedge Fund DevOps) required by our asset management client in London. You will join a team 6 data engineers who are responsible for core engineering of a big data environment on more »

CD, and model monitoring. Proficiency in Python and relevant data manipulation and analysis libraries (eg, pandas, NumPy). Experience with distributed computing frameworks like Apache Spark is a plus. Apache Spark and Airflow would be a bonus. Role overview: If you're looking to work with a more »

is data analysis, building enterprise data platform within asset management or Financial Services is required Expert level Java/Python Development skills AWS expert - Apache Iceberg/Spark and Airflow Please apply for immediate consideration more »

and practices and tools like Jira and Confluence. What technical skills you will have Experience with general Cloud products (Cloyd SQL, BigQuery, RedShift, Snowflake, Apache Beam, Spark) or similar products. Experience with open-source data-stack tools such as Airflow, Airbyte, DBT, Kafka etc. Awareness of data visualisation more »

includes: building greenfield market data processing systems that will handle very large amounts of market/exchange data, data lake development using AWS Glue, Apache Kafka/Airflow and dbt, and more traditional end-to-end Data Pipeline development. Lastly, part of this role would look at the … Java or Python skills - ability to write production ready code Experience deploying code to AWS utilising relevant tools. Previous experience with AWS Glue, dbt, Airflow and Dagster Good communication skills, and ability to work both independently and collaboratively with a team. Excellent SQL skills For more information, please apply more »

projects and new innovations to support company growth and profitability. Our Tech Stack Python Scala Kotlin Spark Google PubSub Elasticsearch, Bigquery, PostgresQL Kubernetes, Docker, Airflow Key Responsibilities Designing and implementing scalable data pipelines using tools such as Apache Spark, Google PubSub etc. Optimising data storage and retrieval systems … Data Infrastructure projects, as well as designing and building data intensive applications and services. Experience with data processing and distributed computing frameworks such as Apache Spark Expert knowledge in one or more of the following languages - Python, Scala, Java, Kotlin Deep knowledge of data modelling, data access, and data more »

the following, it's a plus: Cutting-Edge Tech: Experience with containerisation, Kubernetes, and observability platforms. Workflow Wizardry: Familiarity with data orchestration tools like Airflow and ETL with Apache Beam. Data Visionary: Knowledge of DataVault (DV2) and data management concepts. Location: Our opportunities are available in London Victoria more »

and you’ll build the solution. They work in a mix of SQL, Python programming but also operate with modern tech such as Snowflake, Airflow, DBT, Kubernetes/Docker and cubeJS whilst also using Tableau CRM and Jupyter notebooks for gaining data insights. If you think there’s a … to be a SQL Server expert with strong architecture skills and also strong skills with Python, and DBT. The more experience with things like Airflow, cubeJS and Snowflake, plus other data viz tools would be a huge plus. Total compensation for this role is up to £250,000, split more »

enhance their systems. You will be involved with project migration and business-critical upgrades. You must have experience with Azure Data Factory – Google Cloud – Airflow, along with SQL and ETL experience. This could be a great career move with personal development plans to grow your career. You will require … a blend of the following: - Strong SQL Query experience Knowledge of Azure Data Factory is desirable Python Development knowledge Knowledge of Apache Airflow. Experience with enterprise DBMS and, ideally, Google BigQuery. Experience in Google Cloud Platform services. Any knowledge of Power BI and Tableau is useful. In return, our more »

analysis solutions. You will collaborate closely with cross-functional teams to design, implement, and optimize Python-based applications, with a particular emphasis on utilizing Airflow and also pandas for efficient data manipulation and analytics. This role offers an exciting opportunity to contribute to the transformation of their business through … reviews, identify areas for improvement, and implement best practices to ensure code quality and maintainability. Stay updated on emerging trends and technologies in Python, Airflow, pandas, and data engineering, and incorporate them into our development practices. Qualifications Proven experience as a Python Developer, with a strong focus on data … analytics. Solid understanding of pandas for data manipulation and analysis in big data environments. Proficiency in SQL for querying and manipulating relational databases. Strong Airflow experience Strong problem-solving skills and the ability to work effectively in a collaborative team environment. Excellent communication skills with the ability to convey more »