51 to 75 of 115 Apache Airflow Jobs in the UK

Studio, Visual Analytics, Visual Investigator, VDMML, Intelligent Decisioning, Environment Manager Solid understanding of data modelling and ETL Experience with batch scheduling and job orchestration (Airflow and/or native SAS schedulers) Knowledge of SAS performance optimisation, including database connectivity Experience collaborating with Architects to design robust, scalable solutions Ability ...

Studio, Visual Analytics, Visual Investigator, VDMML, Intelligent Decisioning, Environment Manager Solid understanding of data modelling and ETL Experience with batch scheduling and job orchestration (Airflow and/or native SAS schedulers) Knowledge of SAS performance optimisation, including database connectivity Experience collaborating with Architects to design robust, scalable solutions Ability ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...

peer to peer feedback and evolving healthy, curious and humble teams. Tech Stack: Python, Javascript/Typescript, React/React Native, AWS, GraphQL, Snowflake, Airflow, DDD. This is an incredible opportunity for a Senior Software Engineer to join a unique company as they embark on a period of significant ...

cloud data platforms (AWS, Azure or GCP) Exposure to big data technologies (Hadoop, Spark, Kafka) Familiarity with ETL/orchestration tools (e.g. Informatica, Talend, Airflow) Experience with API integration and microservices data flows Familiarity with AI/ML data pipelines or analytics platforms Experience using UML/SysML Security ...

Testing). Familiarity with C++ or Go is a significant plus. Tooling & Orchestration: Deep experience with containerization (Docker, Kubernetes) and orchestration tools like Kubeflow, Airflow, or Metaflow. Cloud Architecture: Expertise in deploying ML workloads on AWS, GCP, or Azure, utilizing managed services like SageMaker or Vertex AI. Data Foundations ...

behavioural data (web, apps, ads, etc.) Awareness of privacy and governance considerations Familiarity with AWS-based data stacks (S3, Spark/EMR, Athena, Airflow, notebooks) How you'll work Hybrid role, Manchester-based 2 days per week in the office, the rest flexible Flexible start and finish times Full ...

analytics, ads, etc) · Awareness of privacy and governance considerations around behavioural data · Familiarity with AWS based data stacks (e.g. S3, EMR/Spark, Athena, Airflow/Azkaban, notebooks). Why Join RealityMine? At RealityMine, we believe our people are at the heart of everything we do. That ...

analytics, ads, etc) · Awareness of privacy and governance considerations around behavioural data · Familiarity with AWS based data stacks (e.g. S3, EMR/Spark, Athena, Airflow/Azkaban, notebooks). Why Join RealityMine? At RealityMine, we believe our people are at the heart of everything we do. That ...

serving, scaling and monitoring workflows (e.g., BentoML, MLflow, Vertex AI, AWS Sagemaker) Experience building streaming + batch data ingestion and transformation pipelines (Spark/Airflow/Beam) Mobile and front-end web application development experience What We Offer At Newpage, we’re building a company that works smart ...

Oracle, SQL Server, PostgreSQL, MySQL). Knowledge of data warehouse and lakehouse architectures Familiarity with ETL/ELT and orchestration tools (e.g., Informatica, Talend, Apache Airflow). Experience in establishing and maintaining data governance frameworks Experience complying with data security requirements. Experience designing data models. Excellent problem-solving ...

environment * Good problem-solving skills and attention to detail * Excellent communication skills to work effectively with senior engineers and stakeholders Desirable Skills: * Experience with Apache Airflow for workflow orchestration * Familiarity with Alteryx for data preparation * Knowledge of REST APIs and integration patterns * Awareness of Agile methodologies Qualifications: * Bachelor ...

environment Good problem-solving skills and attention to detail Excellent communication skills to work effectively with senior engineers and stakeholders Desirable Skills: Experience with Apache Airflow for workflow orchestration Familiarity with Alteryx for data preparation Knowledge of REST APIs and integration patterns Awareness of Agile methodologies Qualifications: Bachelor ...

Experience with Agentic AI, LLMs, or autonomous agents Solid understanding of MLOps & CI/CD Experience with cloud platforms, Azure Familiarity with Spark, Kafka, Airflow, Docker, and Kubernetes Nice to Have Experience with vector databases (Pinecone, FAISS, Weaviate) ML platforms like MLflow, Kubeflow, SageMaker RAG, embeddings, or knowledge graphs ...

development experience. Experience building lakehouse architectures using Delta Lake. Strong cloud experience in Azure (preferred), AWS, or GCP. Experience with orchestration tools (ADF, Airflow, dbt, or similar). Certifications – Databricks Certified Data Engineer/Azure Data Engineer What’s in it for you: Fully remote role with flexible working ...

improving data literacy across the business Acting as an SQL subject matter expert (Postgres, Cloud SQL, BigQuery, Redshift) Using orchestration tools such as Airflow to deliver reliable, automated pipelines Contributing to IaC and CI/CD pipelines via GitHub Collaborating across engineering, analytics, data science, and product teams Experience ...

designing and owning data and analytics platforms in cloud environments. Dealing with huge volumes of data in a modern stacks (e.g. Snowflake, dbt, Airflow) and CI/CD practices. Whilst having microservices experience within a cloud environment, ideally AWS. If you have domain experience, great ...

Lead Data Engineer: Experience line managing teams of data professionals. Prior experience designing data platform(s) within GCP, working hands on with; Airflow, Big Query, Data Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Hands on skills ...

build of cloud data warehouses - Snowflake experience is desirable, though Redshift or Synapse are also suitable - Experience with data orchestration tools such as Airflow or Prefect - Strong coding ability in Python, Java, or Scala - Experience building data infrastructure from scratch - Comfortable working with both batch and streaming data - Experience ...

technologies including the Python scientific stack (NumPy, Pandas, SciPy, etc.), frameworks such as OpenCV, PyTorch, TensorFlow and JAX, data pipeline tools such as Airflow or Prefect and data processing tools such as Spark or Databricks. The Company The Python Developer will be joining a company whose platform has been ...

expectations of non-technical stakeholders. Good to Have (As Applicable) Familiar with AWS via hands on experience or certification Familiarity with orchestration tools like Airflow Familiarity with BASEL regulatory reporting framework Familiarity with engineering in a regulatory controlled environmen ...

Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data availability. Develop ...

needs into technical requirements. Possess outstanding communication and interpersonal skills, facilitating clear and effective collaboration within and outside the team. Desirables: Familiarity with the Apache Airflow platform. Basic knowledge of BI tools such as Power BI to support data visualization and insights. Experience with version control using ...

experience with Google Cloud Platform (GCP), ideally BigQuery. Proficiency in SQL for data transformation and optimisation. Experience with automation tools such as Python, Airflow, dbt, Power Automate, or similar. Understanding of data security, permissions, and governance best practices. Soft Skills: Excellent communication and ability to translate complex data concepts ...

programming skills in Python; experience with ML libraries such as Snowpark, PySpark, or PyTorch Experience with containerization tools like Docker and orchestration tools like Airflow or Astronomer Familiarity with cloud platforms (AWS, Azure) and ML services (e.g., SageMaker, Vertex AI) Experience with CI/CD pipelines and automation tools ...