51 to 75 of 78 Apache Jobs in the UK excluding London

partnership with Inspire People, is hiring a Lead Data Engineer with strong SQL and Python expertise, experience across modern cloud data platforms including Databricks, Apache Spark and lakehouse architectures, and a proven abi... WKCL1_UKTJ ...

partnership with Inspire People, is hiring a Lead Data Engineer with strong SQL and Python expertise, experience across modern cloud data platforms including Databricks, Apache Spark and lakehouse architectures, and a proven abi... CRWG1_UKTJ ...

partnership with Inspire People, is hiring a Lead Data Engineer with strong SQL and Python expertise, experience across modern cloud data platforms including Databricks, Apache Spark and lakehouse xkybehq architectures, and a proven abi Do you have the skills to fill this role Read the complete details below ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Manchester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either ...

Swagger, alongside accessibility testing (WCAG 2.2 with assistive tech such as JAWS/Dragon), plus Infrastructure as Code and data platforms using Terraform, Apache Spark, Python/Airflow, Docker, security scanning (e.g., Trixy, Trend Micro, Wiz) and Juryter Notebooks, integrated with DWP Integration Team products (e.g.Data Access Layer … Azure cloud with Terraform for Infrastructure as Code, Java and Python services built as RESTful microservices (Spring Boot) supported by TDD/BDD, Apache Spark for data processing and Apache Airflow for orchestration, containerization with Docker, CI/CD and source control with GitLab/GitHub, streaming with ...

optimise scalable data pipelines within a Databricks Lakehouse environment. You’ll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams …/7 Collaborative office environment with regular social and charity events And Much More!!! DATA ENGINEER – ESSTENTIAL SKILLS Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion ...

delivery of data products. Develop scalable cloud-native solutions using AWS technologies. Build and maintain backend services and infrastructure using Python. Work with Apache Spark and Apache Airflow for data orchestration pipelines Implement infrastructure as code using Terraform and/or AWS CloudFormation . Manage IAM setups … experience focused on AWS-based data platforms. Strong experience with DevOps, cloud engineering and running production data platforms. Hands-on experience provisioning and managing Apache Airflow and Apache Spark . Experience with CI/CD pipelines, automated testing and agile software development practices. Comfortable working with large ...

Platforms IBM API Connect (APIC) IBM DataPower API Gateway (AG) Integration Technologies SOAP, REST, XML, JSON SSL certificates, security policies Application Infrastructure Apache, Oracle HTTP Server Operating Systems Linux, UNIX (Solaris exposure desirable) Common Mandatory Skills SQL Oracle databases, performance and troubleshooting queries Linux Scripting, process analysis, log review ...

Software Developer Permanent | Hybrid (willing to travel to Newcastle) | Python | Apache | Data | SC cleared Hybrid work arrangement. Office attendance is up to 60%. Location is flexible: London, Leeds, Newcastle, Sheffield, Blackpool, Manchester and Birmingham. You must be willing to travel to Newcastle when required. The Role ...

Directory Services (Active Directory, LDAP, etc.) Windows and/or *nix environments Scripting (e.g. PowerShell, Python, Bash) Databases (Oracle, MSSQL, MySQL, PostgreSQL) Web technologies (Apache, IIS, etc.) DevOps and software development practices Application integration Reporting and data analysis ...

workloads. Practical experience working with AWS cloud services, including compute, storage, and security tooling. Infrastructure-as-code experience using Terraform. Distributed data processing using Apache Spark. Workflow scheduling and orchestration with Apache Airflow. Containerisation and environment management using Docker. CI/CD pipeline implementation and maintenance using GitLab. ...

workloads. Practical experience working with AWS cloud services, including compute, storage, and security tooling. Infrastructure-as-code experience using Terraform. Distributed data processing using Apache Spark. Workflow scheduling and orchestration with Apache Airflow. Containerisation and environment management using Docker. CI/CD pipeline implementation and maintenance using GitLab. ...

including new capabilities like the E-7 AEW&C and the P-8A Maritime Patrol Aircraft, Autonomous Systems, C4ISR Services, Support for the Chinook & Apache Fleets, Logistic Information Services and Training Services and are very much in a growth phase. Responsibilities: As the Boundary Cell you shall ...

Software Developer Permanent | Hybrid (willing to travel to Newcastle) | Python | Apache | Data | SC cleared Hybrid work arrangement. Office attendance is up to 60%. Location is flexible: London, Leeds, Newcastle, Sheffield, Blackpool, Manchester and Birmingham. You must be willing to travel to Newcastle when required. The Role … looking for Software Developers with strong Python and data processing with Apache Spark responsible to lead the design, development, and operation of data-driven applications and pipelines in a collaborative Dev and DevOps environment. The role focuses on writing and improving application code while working closely with DevOps engineers ...

expand their Devops team (multiple roles). Key requirements: Strong experience with AWS services and infrastructure as code using Terraform Data engineering expertise using Apache Spark and Python, including development in Jupyter Notebooks Workflow orchestration and containerisation experience with Apache Airflow and Docker Version control and CI/ ...

interactive dashboards and reports using Power BI Build and optimise scalable ETL (Extract, Transform, Load) pipelines Develop and manage automated workflows using Python and Apache Airflow Manage and optimise SQL and Oracle database environments for performance, reliability, and scalability Lead end-to-end data and reporting initiatives from requirements … with Power BI Strong Python programming skills for data processing and automation Solid experience with SQL and Oracle database systems Hands-on experience with Apache Airflow for workflow orchestration Strong understanding of ETL processes, data pipelines, and data architecture Experience managing data-focused projects including planning, coordination, and risk ...

cases to GCP, ensuring minimal disruption and optimal performance. Build and manage data transformation workflows using DBT. Orchestrate pipelines using Cloud Composer (Apache Airflow). Required Skills & Experience Strong hands-on experience with Google Cloud Platform (BigQuery, Cloud Storage, etc.). Proven experience in DBT for data transformation. Expertise … Cloud Composer/Apache Airflow for workflow orchestration. Advanced proficiency in Python. Solid experience with Terraform for infrastructure provisioning. Demonstrated experience in migrating legacy systems (on-prem or other cloud) to GCP. Preferred Qualifications Experience in large-scale data transformation programs. Familiarity with CI/CD pipelines and DevOps ...

partnership with Inspire People, is hiring a Lead Data Engineer with strong SQL and Python expertise, experience across modern cloud data platforms including Databricks, Apache Spark and lakehouse architectures, and a proven ability to design, build and lead delivery of reliable data products. This is a permanent role based … Strong proficiency in SQL and Python - Experience with modern cloud data platforms and lakehouse architectures - Hands-on experience with big data technologies such as Apache Spark or Databricks - Strong knowledge of data warehousing concepts - Experience with build, test and deployment automation - Proven leadership capability leading or mentoring data engineering ...

teams and setting best practice standards Designing data models, ETL pipelines, warehousing solutions and distributed systems Building and supporting real-time streaming platforms using Apache Flink and related technologies Ensuring compliance with industry standards and government regulations Tracking delivery against agreed designs and managing design deviations Supporting pre-sales … data architecture on complex, secure programmes Strong hands-on AWS experience (EC2, S3, RDS, Lambda, Redshift); Azure or GCP a bonus Proven experience using Apache Flink for real-time, high-throughput data processing Experience leading, mentoring and developing technical teams Confident engaging with senior technical and non-technical stakeholders ...

requirements 3+ years of Python in production environments Strong AWS experience across core services Strong SQL skills for querying, transformation, and optimisation Experience with Apache Spark or serverless architectures Core responsibilities and skills Build and maintain real-time and batch ETL pipelines using Python on large, complex datasets Write … across large data volumes Model and transform data into well-structured, reusable datasets for downstream use Work with distributed data processing tools such as Apache Spark to handle high-volume workloads Improve existing pipelines by identifying bottlenecks and refactoring code and queries Develop and maintain data workflows, scheduling ...

ensuring best practices in data architecture, security, and cloud computing Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems Utilise Apache Flink and other streaming technologies to build real-time data processing systems that handle large-scale, high-throughput data Ensure all data solutions comply … Lambda, and Redshift. Experience with other cloud providers (e.g., Azure, GCP) is a plus In-depth knowledge and hands-on experience with Apache Flink for real-time data processing Proven experience in mentoring and managing teams, with a focus on developing talent and fostering a collaborative work environment Strong ...

Cloud Engineer – Azure Annual Salary: £55491 Location: Newquay - one day per week on site Job Type: Full-time Reed Technology are delighted to be working with a highly regarded organisation with their search for an ...

part of a team, and on your own projects Good programming experience in some or all the following programming technologies: Linux (Debian, Ubuntu), Apache, Database Administration (MySQL), Programming knowledge (Bash, Python, PHP, ReactJS and NodeJS) Experience of CI/CD pipelines, Bitbucket and JIRA environments Experience of at least … Technology, you will also lead and mentor the Developer and Graduate Developer working in your immediate team. The main development software technologies include Debian, Apache, MySQL, Python, PHP, ReactJS and NodeJS. As part of this role my client expect the successful candidate to continuously improve their skill ...

part of a team and on your own projects Good programming experience in some or all the following programming technologies: Linux (Debian, Ubuntu), Apache, Database Administration (MySQL), Programming knowledge (Bash, Python, PHP, ReactJS and NodeJS) Experience of CI/CD pipelines, Bitbucket and JIRA environments Experience of at least … Technology, you will also lead and mentor the Developer and Graduate Developer working in your immediate team. The main development software technologies include Debian, Apache, MySQL, Python, PHP, ReactJS and NodeJS. As part of this role my client expect the successful candidate to continuously improve their skillset in software ...