93 Apache Airflow Jobs in the UK

analysis solutions. You will collaborate closely with cross-functional teams to design, implement, and optimize Python-based applications, with a particular emphasis on utilizing Airflow and also pandas for efficient data manipulation and analytics. This role offers an exciting opportunity to contribute to the transformation of their business through … reviews, identify areas for improvement, and implement best practices to ensure code quality and maintainability. Stay updated on emerging trends and technologies in Python, Airflow, pandas, and data engineering, and incorporate them into our development practices. Qualifications Proven experience as a Python Developer, with a strong focus on data … analytics. Solid understanding of pandas for data manipulation and analysis in big data environments. Proficiency in SQL for querying and manipulating relational databases. Strong Airflow experience Strong problem-solving skills and the ability to work effectively in a collaborative team environment. Excellent communication skills with the ability to convey more »

Role: Senior Data Engineer 💾 Stack: Snowflake, AWS, Airflow, DBT and Tableau Excited to combat climate change and make a real impact? 🌍 We've teamed up with a startup dedicated to creating a net-zero product! 🚀 Over the past three years, they've built an outstanding in-house engineering team … Process: Two stages 💸 Salary: Base salary can go to £85k (bonus + up to 22% pension) 📊Key Skills Required: Experience in Snowflake (essential), AWS, Airflow, DBT and Tableau Experience in Agile environment Experience in start-up or scale-up environment No recent CV handy? No sweat! Just shoot me more »

the above project of redesigning the Creditsafe platform into the cloud space. You will be expected to work with technologies such as Python, Linux, Airflow, AWS DynamoDB, S3, Glue, Athena, Redshift, lambda, API Gateway, Terraform, CI/CD. KEY DUTIES AND RESPONSIBILITIES You will actively contribute to the codebase … and participate in peer reviews. Design and build metadata driven, event based distributed data processing platform using technologies such as Python, Airflow, Redshift, DynamoDB, AWS Glue, S3. As an experienced Engineer, you will play a critical role in the design, development, and deployment of our business-critical system. You more »

In this role you will be working within a new, greenfield division of the business, using a brand-new technology stack including Snowflake, dbt, Airflow and AWS. This function provide data for Machine Learning and Artificial Intelligence capabilities, helping them to provide the best possible service offering to their … Experience collaborating with Architects to design and lead the implementation of new data solutions Extensive experience with Snowflake Experience or working knowledge of dbt, Airflow and AWS is highly desirable Experience leading and managing a high-performing technical team Very strong stakeholder management experience, ideally including external suppliers You more »

In this role you will be working within a new, greenfield division of the business, using a brand-new technology stack including Snowflake, dbt, Airflow and AWS. This function provide data for Machine Learning and Artificial Intelligence capabilities, helping them to provide the best possible service offering to their … Experience collaborating with Architects to design and lead the implementation of new data solutions Extensive experience with Snowflake Experience or working knowledge of dbt, Airflow and AWS is highly desirable Experience leading and managing a high-performing technical team Very strong stakeholder management experience, ideally including external suppliers You more »

In this role you will be working within a new, greenfield division of the business, using a brand-new technology stack including Snowflake, dbt, Airflow and AWS. This function provide data for Machine Learning and Artificial Intelligence capabilities, helping them to provide the best possible service offering to their … looking for the following experience: Experience liaising with data consumers to understand their requirements Extensive experience with Snowflake Experience or working knowledge of dbt, Airflow and AWS is highly desirable Experience developing, testing and maintaining practical data architectures Experience resolving complex issues and identifying improvements in the testing and more »

In this role you will be working within a new, greenfield division of the business, using a brand-new technology stack including Snowflake, dbt, Airflow and AWS. This function provide data for Machine Learning and Artificial Intelligence capabilities, helping them to provide the best possible service offering to their … looking for the following experience: Experience liaising with data consumers to understand their requirements Extensive experience with Snowflake Experience or working knowledge of dbt, Airflow and AWS is highly desirable Experience developing, testing and maintaining practical data architectures Experience resolving complex issues and identifying improvements in the testing and more »

Role: Graduate Data Engineer Type: 12 months fixed-term Location: Peterborough Ready to utilise your skills to process and extract value from large datasets? Are you passionate about performing root cause analysis on various data? We have an exciting role more »

enhance their systems. You will be involved with project migration and business-critical upgrades. You must have experience with Azure Data Factory – Google Cloud – Airflow, along with SQL and ETL experience. This could be a great career move with personal development plans to grow your career. You will require … a blend of the following: - Strong SQL Query experience Knowledge of Azure Data Factory is desirable Python Development knowledge Knowledge of Apache Airflow. Experience with enterprise DBMS and, ideally, Google BigQuery. Experience in Google Cloud Platform services. Any knowledge of Power BI and Tableau is useful. In return, our more »

North America. - Build trusted client relationships. - Solve problems creatively and scope projects effectively. - Expertise in Google Cloud and modern data stack technologies (Fivetran, DBT, Airflow, BigQuery, etc). - Lead and sometimes work within project teams. - Manage multiple concurrent projects and meet client deadlines. What you need: - Have hands-on … experience with Google Cloud. - Have experience working with a mixture of Fivetran, BT, Airflow, Cube, Rudderstack, Snowflake, and Looker. - Possess outstanding analytical and problem-solving skills. - Demonstrate proficiency in SQL/Python. - Excel in consulting roles with the ability to manage multiple engagements – client-facing experience is a must more »

a MedTech company with a growing reputation in their field. The Data Architect will use their skills and experience of technologies including Kubernetes, Kafka, Airflow, Linux, AWS and Python to spearhead the evolution and enhancement of their existing data infrastructure, as they scale up the adoption of their software … the Software as a Medical Device industry Experience of designing and implementing scalable and secure data infrastructure Hands-on experience with the Kubernetes, Kafka, Airflow, Python, Ubuntu Linux, AWS (or similar cloud platforms) Strong database skills using SQL - Any experience with PostgreSQL or MongoDB would be advantageous An understanding more »

a MedTech company with a growing reputation in their field. The Data Architect will use their skills and experience of technologies including Kubernetes, Kafka, Airflow, Linux, AWS and Python to spearhead the evolution and enhancement of their existing data infrastructure, as they scale up the adoption of their software … the Software as a Medical Device industry Experience of designing and implementing scalable and secure data infrastructure Hands-on experience with the Kubernetes, Kafka, Airflow, Python, Ubuntu Linux, AWS (or similar cloud platforms) Strong database skills using SQL - Any experience with PostgreSQL or MongoDB would be advantageous An understanding more »

Are you ready to be a game-changer in the world of sports data? Do you want to be part of a team that's rewriting the playbook on sports analytics? This company is on a mission to revolutionise the more »

data practices Possess strong knowledge of data tools, data management tools, and various data and information technologies. E.g. DAMA DMBOK, Microsoft SQL Server, Couchbase, Apache Druid, Spark, Kafka, Airflow, etc In-depth understanding of modern data principles, methodologies, and tools Excellent communication and collaboration skills, with the ability … native computing concepts and experience working with hybrid or private cloud platforms is a plus. Demonstrable technical experience working with a Microsoft, Redhat, and Apache data and software engineering environment. A team-oriented individual with a passion for engineered excellence and the ability to lead and motivate a team more »

using Docker, Kubernetes and Cloud services. Experience with Azure stack will be an asset. Experience designing and implementing event-driven/microservices applications using Apache Kafka, Flink, etc. Exposure to model deployment and serving tools like Seldon Core, KServe, etc. Experience with drift detection and adaptation techniques as well … and familiarity with tools to manage infrastructure as code, like Terraform and package managers like Helm Charts. Proficiency with pipeline orchestration tools, such as Airflow, Kubeflow, and Argo Workflows. Outstanding communication skills, ability to convey complex technical concepts to non-technical stakeholders and collaborate with cross-functional teams. A more »

Data Engineer Azure/Snowflake/Power Bi/Airflow London (Contract) Role: Our client is looking to expand their data engineering team and add in the utilisation of Snowflake which is currently being used by a select few members of the team, and upskilling taking place alongside. They … has multiple years of experience using Snowflake as a data tool and can hit the ground running Experience Snowflake Financial services Cloud (Ideally azure) Airflow would be an advantage more »

Wave is currently representing a leading global embedded business finance provider, as we seek a Senior Machine Learning Engineer to join their team on a permanent basis! 📍Location: West London 💰Salary: Up to £100,000 + 15% Bonus Our client more »

Role: Azure Platform Architect Job Type: Permanent Location: London, UK Are you a Azure Platform Architect with a passion for architecting data solution in cloud ? We would love to hear from you! Careers at TCS: It means more TCS is more »