51 to 75 of 133 Apache Jobs in the UK excluding London

including target modelling, cutover approach, reconciliation strategy and technical risk management. Design and build the real‐time data architecture using Amazon MSK/Apache Kafka and PySpark Structured Streaming (evaluating Apache Flink where it is the better fit), including event schema governance, exactly‐once semantics and stream … large‐scale batch and streaming processing, and strong command of data modelling and data warehousing concepts. Production experience designing and operating streaming architectures with Apache Kafka or Amazon MSK, including stream processing with Spark Structured Streaming. Hands‐on experience with open table formats, such as Apache Iceberg ...

C#, .NET, Python, etc.) found in software development. Knowledge in Operating Systems (Linux, MS Windows) Databases (MS SQL, MySQL, Postgres), Application/Web Servers (Apache, IIS, Wildfly) Knowledge/experience in Networking, including switching, routing, firewalls and vulnerabilities Knowledgable about AI (artificial intelligence) Security Testing Tools such ...

hybrid) across large structured or semi-structured datasets. Hands-on experience with data lake, warehouse or lakehouse architectures at scale: Delta Lake or Apache Iceberg, schema evolution patterns, partition pruning, and the trade-offs between query performance and storage cost. Infrastructure fluency on AWS with Kubernetes or ECS. ...

processes. Technical Skills Programming: Proficiency in Python, Java, Scala, or similar languages. Big Data Technologies: Hands-on experience with big data tools e.g. (Databricks, Apache Spark, Hadoop). Cloud Platforms: Familiarity with AWS, Azure, GCP, or other cloud ecosystems for data engineering tasks. Expertise in relational databases (e.g. postgres … server) Data Integration Tools: Knowledge of platforms like Airflow, Apache NiFi, or Talend. Data Storage and Modelling: Experience with data warehousing tools (e.g. Snowflake, Redshift, BigQuery) and schema design. Version Control and CI/CD: Familiarity with Git, Docker, and CI/CD pipelines for deployment. Experience 2+ years ...

TOAD. AWS Data Stack: Strong working knowledge of the AWS cloud data ecosystem, specifically requiring experience with S3, AWS Glue, PySpark, EMR, and Apache Iceberg. Architecture & Design : Ability to translate complex business requirements into high-level and low-level technical designs (HLD/LLD), ensuring data quality and governance. ...

TOAD. AWS Data Stack: Strong working knowledge of the AWS cloud data ecosystem, specifically requiring experience with S3, AWS Glue, PySpark, EMR, and Apache Iceberg. Architecture & Design : Ability to translate complex business requirements into high-level and low-level technical designs (HLD/LLD), ensuring data quality and governance. ...

proactive mindset and passion for improving reliability, resilience and operational efficiency Experience with Java and Spring Boot or .NET application support. Knowledge of Apache Artemis, Red Hat AMQ, IBM MQ or similar messaging technologies. Experience with Ansible, StackStorm or other configuration and workflow automation tools. Experience with infrastructure ...

booking and life cycle processes Knowledge/experience of FIX in equity order management or request for quote flows. Additional technology experience: React JS, Apache NiFi, MongoDB, Solace or similar messaging middleware Education: Bachelor’s degree or equivalent experience required Master’s degree preferred This job description provides ...

etc.) Exposure to Angular, AlpineJS, Bootstrap Database tools: Toad, DBeaver, SQL Developer IDEs: VS Code, Eclipse, etc. Typescript TLS, PKI - certs etc. Keyfactor, Sectigo. Apache config Containers (Docker, Podman, etc) Testing tools: Selenium, JUnit Data formats: XML, JSON, YAML AWS, Azure, Cloud etc. Login Authentication (SSO, MFA) CI/ ...

including supporting automated deployments, infrastructure management, monitoring, and scaling Coaching and mentoring junior engineers and promoting engineering best practices Understanding of data processing using Apache Spark and Apache Airflow for task orchestration Use of Python, SQL, and familiarity with PySpark Understanding of EMR and reviewing output logs ...

automated deployments, infrastructure management, monitoring, and scaling Coaching and mentoring junior engineers and promoting engineering best practices Skills & Experience: Understanding of data processing using Apache Spark and Apache Airflow for task orchestration Use of Python, SQL, and familiarity with PySpark Understanding of EMR and reviewing output logs ...

seeking a Technical Delivery Lead to drive the engineering and technical strategy for a scalable, multi-tenant data integration platform built on Apache Airflow and Google Cloud. In this role, you will lead the delivery of production-grade data pipelines and cloud solutions, working closely with cross-functional teams … guiding teams in a collaborative environment. Roles and Responsibilities Lead the engineering and technical strategy for a scalable multi‐tenant data integration platform leveraging Apache Airflow and GCP technologies. Build and maintain production‐grade ETL/ELT pipelines orchestrated with Apache Airflow. Utilize container platforms such ...

have Programming: Proficiency in Python, Java, Scala, or similar languages for data processing. Big Data Technologies: Hands-on experience with tools such as Databricks, Apache Spark, and Hadoop. Cloud Platforms: Familiarity with AWS, Azure, GCP, or other cloud ecosystems for data engineering tasks. Database Management: Expertise in relational databases … e.g. Postgres, SQL Server). Data Integration Tools: Knowledge of platforms like Airflow, Apache NiFi, or Talend. Data Storage and Modelling: Experience with data warehousing tools (e.g. Snowflake, Redshift, BigQuery) and schema design. Version Control and CI/CD: Familiarity with Git, Docker, and CI/CD pipelines ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full time on site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either ...

experience, conversion, and operational efficiency.### What we are looking for### Essential:· Demonstrable experience as a Full-Stack PHP Developer, with strong expertise across PHP, Apache/Ngnix, SQL, and Linux environments.· Proven experience developing and integrating RESTful APIs and third-party services, alongside deploying and managing applications within Cloud ...

Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool, Leeds ...

Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool, Leeds ...

Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool, Leeds ...

Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool, Leeds ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that ...

role in shaping their in-house Architect to deliver the best possible solutions. You will have demonstrable experience in: The LAMP stack (Linux, Apache, MySQL, PHP) Proficiency with Node.js and related Javascript/Typescript ecosystems. · Supporting or developing large, highly transactional, web-based platforms for both ...

transfer, database, API/web service and SAP interfaces, including JMS, JDBC, SFTP, SOAP/REST, JSON, BAPI and IDoc. Also experience working with Apache, Tomcat and IIS is useful. Location & Security Requirements Candidates must be eligible to obtain SC Clearance. Candidates with current or previous SC Clearance ...

scalable systems together. Key Experience Experience working with real-time streaming applications using Kafka Streams, including KStream and KTable concepts. Experience working with Apache Flink solutions, including stateful processing, checkpointing, and fault-tolerant approaches. Experience working with high-throughput, low-latency data pipelines that process and transform large volumes ...

deliver secure, reliable, and scalable services that support critical public sector operations. Key Responsibilities Design, develop, and maintain data pipelines and processing workflows using Apache Spark and Python Build, schedule, and monitor workflow orchestration using Apache Airflow Develop and maintain infrastructure-as-code using Terraform across AWS environments … sprint planning, refinement, and other agile ceremonies Required Skills & Qualifications Experience with AWS services Experience with Terraform for infrastructure as code Experience with Apache Spark for data processing Experience with Apache Airflow for workflow orchestration Experience with Docker and containerisation Experience building and maintaining CI/CD pipelines ...

review and release processes Experience developing software for local government or the public sector Windows Server and IIS Python 3.11 or later Linux (Ubuntu), Apache and NGINX Microsoft Azure and Amazon Web Services (AWS) Building accessible web interfaces to WCAG 2.2 AA Degree in computing or a related subject ...