76 to 96 of 96 Apache Jobs in the UK

optimise scalable data pipelines within a Databricks Lakehouse environment. You’ll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams …/7 Collaborative office environment with regular social and charity events And Much More!!! DATA ENGINEER – ESSTENTIAL SKILLS Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion ...

models are always running, always accurate, and always improving. Key Responsibilities ML Pipeline Orchestration & Automation Own and extend Circadia’s ML pipeline orchestration using Apache Airflow, including training, evaluation, and deployment workflows. Build and maintain automated pipelines for model retraining, validation, and promotion across development, staging, and production environments. … closely related infrastructure role. Strong proficiency in Python for ML pipeline development, tooling, and automation. Hands-on experience with ML pipeline orchestration tools, particularly Apache Airflow. Experience with model registries and experiment tracking platforms (MLflow preferred). Experience deploying and operating ML workloads on AWS (Batch ...

Software Developer Permanent Hybrid (willing to travel to Newcastle) Python Apache Data SC cleared Hybrid work arrangement. Office attendance is up to 60%. Location is flexible: London, Leeds, Newcastle, Sheffield, Blackpool, Manchester and Birmingham. You must be willing to travel to Newcastle when required click apply for full ...

Description Software Developer Permanent | Hybrid (willing to travel to Newcastle) | Python | Apache | Data | SC cleared Hybrid work arrangement. Office attendance is up to 60%. Location is flexible: London, Leeds, Newcastle, Sheffield, Blackpool, Manchester and Birmingham. xkybehq You must be willing to travel to Newcastle when required. The Role ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

including new capabilities like the E-7 AEW&C and the P-8A Maritime Patrol Aircraft, Autonomous Systems, C4ISR Services, Support for the Chinook & Apache Fleets, Logistic Information Services and Training Services and are very much in a growth phase. Responsibilities: As the Boundary Cell you shall ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

white paper authorship. Our stack Agents: LangGraph with Pydantic-typed state, Claude via Vertex AI, Gemini for fast tagging Graph and data: Postgres plus Apache AGE today, with a Rust temporal graph database in active development as the long-term replacement Backend: FastAPI, Python 3.12, Pydantic everywhere Frontend: Next.js ...

choose the appropriate tools. Below are key tools/technologies that we currently use in our team: · Java 17/21, Spring boot · Python (Apache Airflow/Apache Spark) · Typescrpt (Lambda, AWS CDK) · AWS: S3, MSK (Kafka), Glue, Athena, Flink · CI/CD: Jenkins, Github Actions ...

Software Developer Permanent | Hybrid (willing to travel to Newcastle) | Python | Apache | Data | SC cleared Hybrid work arrangement. Office attendance is up to 60%. Location is flexible: London, Leeds, Newcastle, Sheffield, Blackpool, Manchester and Birmingham. You must be willing to travel to Newcastle when required. The Role … looking for Software Developers with strong Python and data processing with Apache Spark responsible to lead the design, development, and operation of data-driven applications and pipelines in a collaborative Dev and DevOps environment. The role focuses on writing and improving application code while working closely with DevOps engineers ...

Data Engineer within GCP environments Hands-on experience with BigQuery, Dataflow and Spanner Strong programming capability in Python, Java or Scala Experience with Apache Beam/Dataflow and distributed processing frameworks Experience designing and managing ETL/ELT pipelines Solid understanding of data modelling and database design Experience with … workflow orchestration tools such as Apache Airflow Strong understanding of data governance, security and scalability Desirable Skills for the GCP Data Engineer: Experience with Pub/Sub, Cloud Composer or Cloud Data Fusion Exposure to CI/CD, DevOps and Infrastructure as Code Experience with real-time streaming architectures ...

expand their Devops team (multiple roles). Key requirements: Strong experience with AWS services and infrastructure as code using Terraform Data engineering expertise using Apache Spark and Python, including development in Jupyter Notebooks Workflow orchestration and containerisation experience with Apache Airflow and Docker Version control and CI/ ...

financial services organisation Your new role We are seeking a Data Engineer to support the replacement of a legacy ETL tool with a modern Apache Spark based data platform. This is a hands-on engineering role focused on building and supporting Spark jobs, with an emphasis on performance, reliability … scalability.The role is focused on building nonperformance Apache Spark jobs, with a strong emphasis on performance optimisation. Working in containerised environments using Kubernetes is a key element also as well as experience across Python/Scala and Java.The role sits within a small Agile delivery team of four engineers ...

Build and maintain robust data pipelines using Snowpipe and COPY INTO. Develop modular, testable data transformations with dbt. Orchestrate workflows and manage dependencies using Apache Airflow. Leverage Snowpark for advanced data applications and processing. Use Terraform to manage infrastructure as code. Implement CI/CD pipelines to streamline deployments. … Build and maintain robust data pipelines using Snowpipe and COPY INTO. Develop modular, testable data transformations with dbt. Orchestrate workflows and manage dependencies using Apache Airflow. Leverage Snowpark for advanced data applications and processing. Use Terraform to manage infrastructure as code. Implement CI/CD pipelines to streamline deployments. ...

requirements 3+ years of Python in production environments Strong AWS experience across core services Strong SQL skills for querying, transformation, and optimisation Experience with Apache Spark or serverless architectures Core responsibilities and skills Build and maintain real-time and batch ETL pipelines using Python on large, complex datasets Write … across large data volumes Model and transform data into well-structured, reusable datasets for downstream use Work with distributed data processing tools such as Apache Spark to handle high-volume workloads Improve existing pipelines by identifying bottlenecks and refactoring code and queries Develop and maintain data workflows, scheduling ...

ensuring best practices in data architecture, security, and cloud computing Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems Utilise Apache Flink and other streaming technologies to build real-time data processing systems that handle large-scale, high-throughput data Ensure all data solutions comply … Lambda, and Redshift. Experience with other cloud providers (e.g., Azure, GCP) is a plus In-depth knowledge and hands-on experience with Apache Flink for real-time data processing Proven experience in mentoring and managing teams, with a focus on developing talent and fostering a collaborative work environment Strong ...

ensuring best practices in data architecture, security, and cloud computing Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems Utilise Apache Flink and other streaming technologies to build real-time data processing systems that handle large-scale, high-throughput data Ensure all data solutions comply … Lambda, and Redshift. Experience with other cloud providers (e.g., Azure, GCP) is a plus In-depth knowledge and hands-on experience with Apache Flink for real-time data processing Proven experience in mentoring and managing teams, with a focus on developing talent and fostering a collaborative work environment Strong ...

Knowledge graph internals. Primary entity consolidation, edge criteria, enrichment agents that decide when to call web search vs. internal tools, and the Cypher/Apache AGE query layer underneath. Agent infrastructure. LangGraph pipelines, Pydantic-typed state, prompt caching, the eval harness that keeps it honest. Product surface. The Next.js … Vercel Backend: FastAPI, Python 3.12, Pydantic everywhere Agents: LangGraph, Claude via Vertex AI, Gemini for cheap/fast tagging work Data: Postgres + Apache AGE (graph), moving toward AlloyDB Omni on GKE where it fits Infra: GCP - GKE, Cloud Run, Cloud SQL, Vertex AI, KMS Tooling: pnpm, Husky commit ...

Job Title: Full-Stack Engineer Location: Nottingham, UK Hybrid Role About the Role: We are seeking a talented and versatile Full-Stack Engineer to join a leading vehicle security systems business. In this role, you ...

Job Description: Have you delivered software products as a Systems Engineer? If so, this may be the role for you! We are seeking dedicated Systems Engineers, who will bridge the gap between systems engineering and ...