276 to 299 of 299 Apache Jobs in England

Development Contribute hands-on as a primary engineer utilizing our modern tech stack: Core Java (multi-threading, concurrency, memory optimization), CouchbaseDB, Kafka, and Apache Storm. Solve complex real-time risk calculation requirements, handling heavy stream processing and highly concurrent data flows. Required Experience extensive development experience, with a strong … including multi-threading, memory management, garbage collection tuning, and concurrency utilities. Solid experience with real-time stream processing and distributed data architectures (e.g., Kafka, Apache Storm, CouchbaseDB/NoSQL, Spring). Familiarity with modern infrastructure paradigms, such as containerization (OpenShift/Kubernetes) and cloud platforms (GCP/ ...

ensuring best practices in data architecture, security, and cloud computing Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems Utilise Apache Flink and other streaming technologies to build real-time data processing systems that handle large-scale, high-throughput data Ensure all data solutions comply … Lambda, and Redshift. Experience with other cloud providers (e.g., Azure, GCP) is a plus In-depth knowledge and hands-on experience with Apache Flink for real-time data processing Proven experience in mentoring and managing teams, with a focus on developing talent and fostering a collaborative work environment Strong ...

Spark/Scala data processing (also some Flink), Kubernetes and AWS native tooling.**What You'll Do:*** Write highly fault-tolerant Java code within Apache Spark to produce platform products used by our customers to query our event pipelines/ingestion for insight into active threat trends and related … between backend/cloud development and data platform engineering roles* 5+ years of experience building data platform product(s) or features with (one of) Apache Spark, Flink or Iceberg, or with comparable tools in GCP* 5+ years of experience programming with Java, Scala or Kotlin.* Proven experience owning robust ...

Testing Guild with common standards such as metrics and use of test tools Here’s a snapshot of the technologies that we use: Scala Apache Spark Databricks Apache Parquet Azure Cloud Platform Azure DevOps (Test plans, Backlogs, Pipelines) GIT We’d love to hear from ...

common technical standards and ways of working, and presenting these to the community Here’s a snapshot of the technologies that we use: Scala Apache Spark Databricks Apache Parquet Azure Cloud Platform Azure DevOps (Test plans, Backlogs, Pipelines) GIT What we’re looking for We’d love ...

/month in the officeWe’re looking for a **Confluent Solution Architect** to lead the design and architecture of enterprise-grade **streaming solutions** with **Apache Kafka** and the **Confluent Platform**.**What you’ll do:*** Design scalable, secure, and resilient data streaming ecosystems* Translate business requirements into technical solutions … Lead client engagements and guide implementation teams* Integrate Kafka with enterprise systems, cloud platforms, and microservices**Must-Have Skills:** 8+ years in Apache Kafka & Confluent Platform Deep knowledge of Kafka internals & KRaft architecture Experience with Confluent Cloud, stream governance, RBAC, and data lineage Expertise in stream processing (Apache ...

Senior DevOps & Systems Engineer - 1 or 2 days a week expected at Head Office in Blackburn - Salary: £60k-£65k Summary of Position The Senior DevOps & Systems Engineer will be responsible for the administration, reliability, security ...

with external clients across a variety of industry markets. Minimum of 5+ years of customer-facing experience would be preferred [Preferred] Experience working with Apache SparkTM to process large-scale distributed datasets Communication: Proven ability to communicate and teach complex technical concepts to both technical and non-technical audiences. … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter ,LinkedIn and Facebook . Benefits At Databricks, we strive to provide comprehensive ...

with external clients across a variety of industry markets. Minimum of 5+ years of customer‐facing experience would be preferred. [Preferred] Experience working with Apache SparkTM to process large‐scale distributed datasets. Communication: Proven ability to communicate and teach complex technical concepts to both technical and non‐technical audiences. … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

About this role: At Astronomer, we’re redefining how companies run Apache Airflow at scale. Our R&D organization is home to some of the most innovative minds in cloud infrastructure and open-source software. You can’t spell “Data Orchestration” without “Data”, and we’re looking … data platforms from cloud-native component parts - we have a healthy mix of build vs. buy; sometimes building is the right choice. Experience with Apache Airflow. #LI-Hybrid At Astronomer, we value diversity. We are an equal opportunity employer: we do not discriminate on the basis of race, religion ...

Ready to take your career global Make your mark at one of the biggest names in payments. We’re looking for Software Engineer - Java to join our ever-evolving WPG team and help shape the ...

intersection of consulting, technology, innovation, and strategic alliances and you will bring deep expertise in the Databricks Data Intelligence Platform, Lakehouse architecture, Delta Lake, Apache Spark, Unity Catalog, MLflow, Mosaic AI, data engineering, machine learning, GenAI and cloud-native delivery. As a key leader within our AI & Data Practice … translate business needs into Databricks-led solution designs, build prototypes and proof points. • Shape end-to-end solutions using Databricks Intelligence Platform, Delta Lake, Apache Spark, Unity Catalog, Databricks Workflows, Delta Live Tables/Lakeflow-style pipelines, MLflow, Feature Store, Model Serving and Mosaic AI capabilities. Team Leadership & Delivery ...

intersection of consulting, technology, innovation, and strategic alliances and you will bring deep expertise in the Databricks Data Intelligence Platform, Lakehouse architecture, Delta Lake, Apache Spark, Unity Catalog, MLflow, Mosaic AI, data engineering, machine learning, GenAI and cloud-native delivery. As a key leader within our AI & Data Practice … translate business needs into Databricks-led solution designs, build prototypes and proof points. Shape end-to-end solutions using Databricks Intelligence Platform, Delta Lake, Apache Spark, Unity Catalog, Databricks Workflows, Delta Live Tables/Lakeflow-style pipelines, MLflow, Feature Store, Model Serving and Mosaic AI capabilities. Build, lead, upskill ...

bespoke integration approaches for source-system onboarding. Define conceptual, logical and physical data models, including data flows, data domains and data ownership considerations. Specify Apache NiFi architecture patterns, flow standards, interface contracts and reusable ingestion components. Define governance, metadata, lineage, auditability, security monitoring and data quality requirements. Produce High … lake architectures on AWS. Strong knowledge of AWS security, IAM, networking, storage and data platform services relevant to secure data engineering. Extensive experience with Apache NiFi architecture, flow design, governance and operational considerations. Experience designing integrations using REST APIs, SOAP services, file transfers, batch ingestion, legacy adapters and bespoke ...

analytics tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium … Database Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working ...

Title: Databricks Engineer Location: Coventry UK (Hybrid) Employment type: contract (Inside Ir35) Job Description: Role: Configure Databricks Auto Loader or Apache Spark Structured Streaming to securely subscribe to the relevant SAP AEM topics. Develop the PySpark/SQL data pipelines to process the incoming JSON payloads through the Delta … Carry out data modelling in Databricks. Expose the Delta tables to the visualisation layer. Ensure that the data pipelines are optimised. Skillsets: Expert in Apache Spark Structured Streaming and Databricks Auto Loader. Fluent in PySpark and Databricks SQL. Proven experience building Databricks architecture patterns. Familiarity with Unity Catalog ...

developing, testing, debugging, and troubleshooting clean, web standards compliant solutions written in Java. Our Tech Stack includes Java, Spring Boot, Cassandra, MongoDB, Redis, Apache Ignite, Kafka, PostgreSQL, Nginx. (check details from Stack Share Profile ) Requirements BSc or MSc degree in Computer Science, Computer Engineering, Software Engineering or related disciplines … experience (Spring and RESTful APIs) Proficient with RDBMS and ability to write SQL (PostgreSQL is preferred) Strong experience with In Memory Database and Caches (Apache Ignite and Redis are preferred) Scalable and distributed web application experience (Reactive programming and Spring Reactor experience is preferred) Experience in developing with microservice ...

Limited (DDIL) communications environments, supporting local processing at the edge Building streaming ingestion, event pipelines, and batch/stream processing workloads using technologies like Apache Flink and/or Apache Spark Implementing metadata, lineage, and catalogue capabilities along with policy-based security and governance Job Requirements: Extensive experience ...

DIHOP, DIHOC, AWS Glue, DBT, Snowflake, Databricks).o Apply architectural patterns for data lakes, streaming, and batch processing.o Exposure to cloud technologies – Snowflake, Redshift, Apache Flink and Apache Kafka.**Technical POCs**o Technical assessment of Cloud data technologies to leverage considering Fraud Business and technical requirementso Design, execute ...

/frameworks (DIHOP, DIHOC, AWS Glue, DBT, Snowflake, Databricks).Apply architectural patterns for data lakes, streaming, and batch processing.Exposure to cloud technologies – Snowflake, Redshift, Apache Flink and Apache Kafka.Technical POCsTechnical assessment of Cloud data technologies to leverage considering Fraud Business and technical requirementsDesign, execute and lead ...

that process large-scale batch and real-time workloads. Today, those workloads span two ecosystems. Our streaming stack includes XStream and a growing managed Apache Flink footprint. Our batch stack includes Spark and Presto over Hive and Iceberg tables, Velox as a shared execution layer, and an internal workflow … 12+ years of experience in Product Management or equivalent relevant experience Experience with or direct product ownership of at least one of Google Dataflow, Apache Beam, Flink, Kafka, Spark Structured Streaming, Iceberg or comparable systems Demonstrated expertise in large-scale distributed data systems Critical thinking and analytical leadership experience ...

## Principal Systems Engineer (Software)Apply: GB - Luton - Cap. Green 300: GB - Bristol - Coldharbour Lane: Full time: Posted Today: R0032810**Job Description:**### Your impactHave you delivered software products as a Systems Engineer; or are ...

Skill Requirements:*** Strong experience in **Solution Architecture** and **Cloud-Native Architecture Design*** Hands-on expertise in **Snowflake Architecture*** Experience with **Data Lakehouse architectures**, including **Apache Iceberg*** Proficiency in designing and managing **S3-based Data Lakes*** Experience with **Apache Airflow/MWAA** for workflow orchestration* Strong knowledge ...

services remain secure, resilient, and aligned with business objectives. Key Responsibilities Define and maintain secure configuration standards across middleware technologies including WebSphere, IBM MQ, Apache, Tomcat, WebLogic, NGINX, and Node.js. Drive middleware security compliance and remediation activities. Develop platform strategy, roadmaps, and improvement plans. Manage and prioritise platform backlogs … guidance to stakeholders across the organisation. Essential Skills & Experience 5+ years' experience working with enterprise middleware technologies, including several of: IBM WebSphere IBM MQ Apache Tomcat WebLogic NGINX Node.js Strong background in middleware security and secure configuration management. Experience working with CIS Benchmarks . Previous experience leading technical teams. ...