1 to 25 of 29 Contract Apache Jobs in the UK excluding London

Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands ...

production pipelines Strong SQL and Python, plus hands-on Git Production experience with at least one of Databricks, Snowflake, Azure Data Factory, AWS Glue, Apache Airflow or PySpark Cloud-native orchestration and distributed data processing Infrastructure as code (e.g. Terraform) CI/CD and DevOps or DevSecOps practice ...

inputs/outputs, and adherence to resiliency and security expectations Preferred qualifications, capabilities, and skills Experience with data lakehouse architectures using Delta Lake, Apache Spark, or similar open-source frameworks Familiarity with AWS-native data services such as Glue, Lake Formation, Redshift, or Athena Exposure to data governance practices ...

with monitoring/logging tools (ELK stack, Prometheus, Splunk) Familiarity with service mesh and modern networking (Istio, Envoy) Exposure to data engineering and integration (Apache ecosystem, SQL, Python) Recognised technical certifications (AWS/Azure Architect, Kubernetes CKA/CKAD, Terraform) Experience in influencing technical standards, best practices, or contributing ...

Azure Cosmos DB, including SQL API and Mongo API. Excellent knowledge of Cosmos DB Change Data Feed (CDF) and Spark integration. Strong PySpark and Apache Spark distributed computing experience. Experience with Cosmos DB SDKs, including .NET, Java, Python or Node.js. Expertise in NoSQL data modelling, partitioning, indexing and query ...

Experience with non-relational database technologies (for example, MongoDB) and associated query patterns Familiarity with large-scale data processing and analytics platforms (for example, Apache Spark or Hadoop) Experience implementing, or partnering closely on, data quality, metadata, and governance controls to improve reliability and auditability Understanding of modern distributed ...

experience with BigQuery . Experience building and supporting production data pipelines. Experience developing transformation layers using dbt . Experience with orchestration tools such as Apache Airflow or Cloud Composer . Strong SQL and Python development skills. Experience designing scalable data models and data warehouse solutions. Strong stakeholder engagement ...

colleagues Must-have skills: RabbitMQ Java and microservices MongoDB and MySQL Kubernetes Grafana and Prometheus GitLab Job scheduling tooling (eg JS7 Job Scheduler, TWS, Apache Airflow) Reporting and visualisation tooling (from Pentaho BA, Power BI, SAP Business Objects) Nice to have: Databases and data platforms, ideally Oracle or Cloudera ...

configuration management and an interest in migrating to Ansible and cloud-native tooling. Experience managing Kubernetes platforms and deploying containerised applications. Knowledge of GitLab, Apache NiFi, HashiCorp Vault, Trend Micro Deep Security Manager, Ivanti device control, and Ansible Tower/AWX. Windows Infrastructure Experience with Windows Server administration, deployment ...

effectively with stakeholders and champion better ways of working. Nice to Have Experience with Docker, Java/Scala, Kafka, Pulsar, Azure Event Hub, Collibra, Apache Iceberg, Apache Arrow, PySpark or AI engineering technologies such as Snowflake AI, LangChain, LlamaIndex or Pinecone would be advantageous. This is a great ...

effectively with stakeholders and champion better ways of working. Nice to Have Experience with Docker, Java/Scala, Kafka, Pulsar, Azure Event Hub, Collibra, Apache Iceberg, Apache Arrow, PySpark or AI engineering technologies such as Snowflake AI, LangChain, LlamaIndex or Pinecone would be advantageous. This is a great ...

TOAD. AWS Data Stack: Strong working knowledge of the AWS cloud data ecosystem, specifically requiring experience with S3, AWS Glue, PySpark, EMR, and Apache Iceberg. Architecture & Design : Ability to translate complex business requirements into high-level and low-level technical designs (HLD/LLD), ensuring data quality and governance. ...

including supporting automated deployments, infrastructure management, monitoring, and scaling Coaching and mentoring junior engineers and promoting engineering best practices Understanding of data processing using Apache Spark and Apache Airflow for task orchestration Use of Python, SQL, and familiarity with PySpark Understanding of EMR and reviewing output logs ...

automated deployments, infrastructure management, monitoring, and scaling Coaching and mentoring junior engineers and promoting engineering best practices Skills & Experience: Understanding of data processing using Apache Spark and Apache Airflow for task orchestration Use of Python, SQL, and familiarity with PySpark Understanding of EMR and reviewing output logs ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full time on site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either ...

Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool, Leeds ...

Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool, Leeds ...

Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool, Leeds ...

Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool, Leeds ...

requirements and maintaining operational capability. This opportunity will involve working with MOD stakeholders, engineering teams and industry partners across platforms including Merlin, Wildcat, Chinook, Apache and Poseidon. Key Responsibilities Create, manage and maintain GOLDesp reference data across military aircraft platforms. Ensure data accuracy, integrity and compliance with airworthiness requirements. ...

hybrid work from home policy. Qualifications Commercial experience with web client or server-side development Proficiency with Golang, TypeScript, React, SQL, Kafka or Apache Flink Background delivering software in continuous change environments Familiarity with AI tools to enhance developer productivity Clear technical communication with cross-functional stakeholders Proven grasp ...

Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver, gold) Terraform, CI/CD and pipeline orchestration A track record of setting … pairing and design sessions Confidence communicating with technical and non-technical stakeholders, and challenging constructively Desirable: SQL Server or on-prem to cloud migration, Apache Flink, regulated industry experience If you'd rather shape a platform than inherit a finished one, and want a seat at the table while ...

software development team Hands-on experience designing and developing data integration/ETL pipelines from diverse data sources and formats Hands-on experience with Apache Airflow, dbt, and Python Strong database skills with Postgres SQL, DynamoDB, Snowflake, and Databricks Experience collaborating with Agile teams, product owners, and cross-functional … highly scalable data engineering solutions that power our client next-generation digital content platform. Design, develop, and maintain scalable data pipelines using DataBricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS Support platform optimization, infrastructure improvements, process control enhancements, and system upgrades Collaborate with our client technical teams ...

British nationals only; dual citizenship is not permitted The opportunity We're urgently looking for an experienced Data Engineer with strong AWS, Python and Apache Airflow skills to join a programme on an initial six-month contract. You'll help build and maintain reliable data pipelines, develop cloud-based … essential. What you'll be doing Developing and maintaining data pipelines using Python and AWS services. Building, scheduling and monitoring data workflows with Apache Airflow. Integrating data from multiple sources and preparing it for downstream use. Improving pipeline reliability, performance and data quality. Investigating data processing issues and implementing ...

Preferred Experience PostgreSQL and/or Snowflake. Modern Python web frameworks including Django, Flask or FastAPI. Event-driven architectures and streaming technologies such as Apache Kafka. Data orchestration and pipeline platforms such as Apache Airflow. Java development experience. Financial technology experience, including market data, order management, algorithmic trading ...