1 to 25 of 65 Apache Jobs in the UK excluding London

Engineer, Principal Data Engineer or Technical Lead within a large-scale, data-driven organisation Strong hands-on software engineering expertise with Python, PySpark and Apache Airflow Deep experience designing and building distributed data processing systems and large-scale data platforms on AWS Strong knowledge of modern AWS data technologies ...

years overall experience in data engineering or data architecture. 5+ years of hands-on architecture experience specifically in Databricks . Expert in Apache Spark , PySpark , Databricks SQL , Delta Lake, and distributed systems. Strong understanding of Lakehouse architecture , BI ecosystems, and modern data platforms. Cloud expertise in Azure/ ...

/CD pipelines and deployment automation. • Familiarity with monitoring, logging, and observability tools. • Awareness of application platforms and middleware such as Java, Tomcat, Apache, and NodeJS. • Experience using Git and collaborative development workflows. • Basic scripting skills using Shell or Python. • Understanding of containerisation concepts using Docker. • Strong problem-solving ...

platform role Strong hands-on experience with AWS (EC2, S3, RDS, Lambda, Redshift, Glue, Athena) Experience with real-time and batch data processing - Apache Flink, Kafka, Spark, or similar Proficiency in one or more of: Python, Java, Scala Experience with data modelling , ETL processes, and distributed systems Comfortable working ...

Lead Backend Software Engineer – Data Services Federated Data Services | Distributed Systems | Apache Spark | DataFusion | Python | Kubernetes Location: London (2 days per week onsite) Rate: £700–£800 per day (Outside IR35) Duration: Initial 6-month contract with likely extension Overview We're looking for an experienced Lead Backend Software Engineer … data services capable of securely querying and processing data across multiple environments. Design high-performance data processing and streaming workflows using technologies such as Apache Spark, Apache DataFusion, or similar distributed query frameworks. Design and implement Kubernetes-based services and containerised workloads. Build secure APIs and backend services ...

developing others. Desirable to have skills or experience in: - SAS Viya for data analytics. - Job Scheduling tooling (e.g. Berlin/JS7 Job Scheduler, TWS, Apache Airflow). - Denodo for data virtualisation. - Reporting and visualisation tooling (from Pentaho BA, Power BI, SAP Business Objects). - ALM Tooling (Jira, Confluence). ...

optimising ETL/ELT pipelines. Strong understanding of Lakehouse, Data Warehouse, and Data Lake architectures. Experience with Azure Data Factory, Azure Synapse, and Apache Spark. Knowledge of data modelling, semantic models, and enterprise reporting solutions. Experience implementing data governance, security, and quality frameworks. Strong understanding of modern data engineering ...

data into something they can actually use and act on. What you'll be doing: Designing and building performant data ingestion pipelines using Apache Spark, ideally within Azure Databricks Contributing to the platform's data modelling and architecture Building dashboards and semantic models, and presenting these directly to stakeholders ...

data into something they can actually use and act on. What you'll be doing: Designing and building performant data ingestion pipelines using Apache Spark, ideally within Azure Databricks Contributing to the platform's data modelling and architecture Building dashboards and semantic models, and presenting these directly to stakeholders ...

competencies: Proven experience writing highly maintainable, performant Python and JavaScript code; Experiencebuilding modern data pipelines using dbt, Kafka, Spark, AWS Kinesis, AWS Lambda, and Apache Airflow (or similar); Understanding of Data Modelling patterns; Deepknowledge of complex SQL, with emphasis on Common Table Expressions, window functions, and their performance; Experiencewith ...

competencies: Proven experience writing highly maintainable, performant Python and JavaScript code; Experiencebuilding modern data pipelines using dbt, Kafka, Spark, AWS Kinesis, AWS Lambda, and Apache Airflow (or similar); Understanding of Data Modelling patterns; Deepknowledge of complex SQL, with emphasis on Common Table Expressions, window functions, and their performance; Experiencewith ...

competencies: Proven experience writing highly maintainable, performant Python and JavaScript code; Experiencebuilding modern data pipelines using dbt, Kafka, Spark, AWS Kinesis, AWS Lambda, and Apache Airflow (or similar); Understanding of Data Modelling patterns; Deepknowledge of complex SQL, with emphasis on Common Table Expressions, window functions, and their performance; Experiencewith ...

Java/Groovy and Object Orientated Design principles Working in an SDLC with an integrated development team on CICD tooling (Git) Desirable Experience with Apache Nifi AWS experience, including familiarity with EMR, S3, SQS Awareness of domain driven design approaches and architecture Linux awareness and Scripting skills Postgress/ ...

alerting. Minimum requirements: 3+ years of experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of Python, SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code ...

Ability to build and deploy scalable applications or libraries Strong debugging, problem-solving, and performance optimisation skills Understanding of open-source licensing (MIT, GPL, Apache) Experience with cloud platforms such as AWS or Azure Ability to create clear, comprehensive technical documentation Experience working within development teams on both minor ...

ensuring data integrity across every layer Lead the transformation of legacy reporting (Python, SQL, Excel) into a secure,scalableand fully observable platform powered by Apache Airflow (WMAA). Define and publish data quality metrics that drive engineering decisions anddemonstrateplatform health to stakeholders Champion AI and modern data tooling ...

internal knowledge Competencies and Behaviours: 3+ years experience in data platform engineering, cloud engineering, or similar roles Strong hands-on experience with Databricks, including Apache Spark, Delta Lake, Workflows Proven experience designing and deploying data platforms on AWS and/or Azure (e.g. ADLS, S3, VNet/ ...

. Develop APIs and services that expose reliable data access, transformation, and orchestration capabilities. Contribute to geospatial data processing workflows using tools such as Apache Sedona and native Iceberg geospatial functionality. Assist in developing and maintaining shared platform tooling and libraries that improve productivity and promote self-service capabilities ...

. Develop APIs and services that expose reliable data access, transformation, and orchestration capabilities. Contribute to geospatial data processing workflows using tools such as Apache Sedona and native Iceberg geospatial functionality. Assist in developing and maintaining shared platform tooling and libraries that improve productivity and promote self-service capabilities ...

. Develop APIs and services that expose reliable data access, transformation, and orchestration capabilities. Contribute to geospatial data processing workflows using tools such as Apache Sedona and native Iceberg geospatial functionality. Assist in developing and maintaining shared platform tooling and libraries that improve productivity and promote self-service capabilities ...

. Develop APIs and services that expose reliable data access, transformation, and orchestration capabilities. Contribute to geospatial data processing workflows using tools such as Apache Sedona and native Iceberg geospatial functionality. Assist in developing and maintaining shared platform tooling and libraries that improve productivity and promote self-service capabilities ...

. Develop APIs and services that expose reliable data access, transformation, and orchestration capabilities. Contribute to geospatial data processing workflows using tools such as Apache Sedona and native Iceberg geospatial functionality. Assist in developing and maintaining shared platform tooling and libraries that improve productivity and promote self-service capabilities ...

record in designing, deploying, and maintaining production-grade, distributed ML systems (Sagemaker) Deep MLOps Proficiency: Expert-level knowledge of CI/CD, orchestration (e.g., Apache Airflow, Flink), and model monitoring/drift detection at scale. Software Engineering Rigor: Strong background in Python, distributed systems, and backend development, with ...

record in designing, deploying, and maintaining production-grade, distributed ML systems (Sagemaker) Deep MLOps Proficiency: Expert-level knowledge of CI/CD, orchestration (e.g., Apache Airflow, Flink), and model monitoring/drift detection at scale. Software Engineering Rigor: Strong background in Python, distributed systems, and backend development, with ...

record in designing, deploying, and maintaining production-grade, distributed ML systems (Sagemaker) Deep MLOps Proficiency: Expert-level knowledge of CI/CD, orchestration (e.g., Apache Airflow, Flink), and model monitoring/drift detection at scale. Software Engineering Rigor: Strong background in Python, distributed systems, and backend development, with ...