126 to 150 of 151 Apache Jobs in England

Role Confluent Consulting Engineer Technology Apache Kafka, Confluent Platform, Stream Processing Location (Remote) UK Job Description Your role: As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data … engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: 5+ years of hands-on experience with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) Strong proficiency in Java, Python, or Scala Solid understanding of event-driven architecture and data streaming patterns Experience deploying Kafka ...

Role Confluent Consulting Engineer Technology Apache Kafka, Confluent Platform, Stream Processing Location (Remote) UK Job Description Your role: As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data … engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: 5+ years of hands-on experience with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) Strong proficiency in Java, Python, or Scala Solid understanding of event-driven architecture and data streaming patterns Experience deploying Kafka ...

Will Work With Designing, building and maintaining scalable data pipelines. Developing ETL/ELT processes to ingest and transform data from multiple sources. Apache Airflow for workflow orchestration, scheduling and automation. Azure SQL and cloud-based data platforms. Data modelling, warehousing and optimisation activities. Data quality, governance and validation … optimising data pipelines. Knowledge of ETL/ELT development and data integration. Python scripting for automation, transformation and data engineering tasks. Experience with Apache Airflow or similar orchestration tools. Understanding of data warehousing and data modelling principles, including dimensional modelling. Experience working with cloud-based data platforms. Familiarity with ...

good understanding of modern coding conventions such as OOP & MVC and have used or at least dabbled with development frameworks. Key Skills: PHP MySQL Apache Linux/Windows HTML CSS JavaScript MVC Laravel My client can offer a great working environment with a benefits package which includes regular training ...

Able to demonstrate software skills in some of the following technologies on both Windows and Linux:C++JavascriptPythonXMLJSONHTMLCSSWeb backend servers (Angular, Django, NodeJS, React, Apache or similar)Web SocketsDockerTCP-IP/UDPSQL or other databasesDev tools (Wireshark, system log interrogation etc..)DatabasesCyber SecurityDesirable:Exposure to IP video and video routingFamiliarity ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

environments Strong experience designing large-scale, cloud-based data platforms Deep expertise in AWS services, including EC2, S3, RDS, Lambda, Redshift Proven experience with Apache Flink and real-time streaming architectures Strong background in: Data modelling ETL/ELT processes Data warehousing and distributed systems Experience leading, mentoring …/security-focused environments Strong understanding of data governance, standards, and architecture frameworks Desirable Skills Experience with Azure or GCP Knowledge of Scala and Apache Spark Familiarity with DevOps practices and cloud-native delivery models Experience working alongside cyber security teams on secure systems Security Requirements Must currently hold ...

Responsibilities Data Integration & ETL Design, develop, and optimise ETL processes for efficient data integration Build and maintain data pipelines using tools such as FME, Apache NiFi, and SQL Loader Develop Python scripts and automated processes to support data ingestion Systems & Development Support data streaming solutions via REST APIs … data concepts Experience or knowledge of SQL and/or Python Good communication skills and attention to detail Desirable: Experience with ETL tools (e.g. Apache NiFi, FME, SQL Loader) Knowledge of AWS services (e.g. Lambda, APIs) Understanding of data modelling, data mining, or segmentation Hands-on experience with databases ...

coupled with a strong interest in continuous learning. Flexibility to travel up to 20% of the time. Preferred Technical and Professional Experience Experience with Apache Kafka and Apache Flink. Experience helping customers build distributed systems or streaming solutions that use Kafka alongside technologies such as Spark, Flink, Hadoop ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

involved in a modern data transformation programme, including a planned migration to Microsoft Fabric. Key Responsibilities Develop and maintain data pipelines using Apache Airflow. Design and optimise SQL-based data solutions. Build and enhance Power BI reports and dashboards. Work closely with stakeholders to gather requirements and deliver insights. … Support ongoing improvements to the data platform and reporting environment. Contribute to the organisation's future migration to Microsoft Fabric. Required Skills Experience with Apache Airflow. Strong Azure SQL skills. Power BI development and data modelling experience. Good understanding of ETL/ELT processes and data warehousing concepts. Strong ...

ensuring best practices in data architecture, security, and cloud computing Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems Utilise Apache Flink and other streaming technologies to build real-time data processing systems that handle large-scale, high-throughput data Ensure all data solutions comply … Lambda, and Redshift. Experience with other cloud providers (e.g., Azure, GCP) is a plus In-depth knowledge and hands-on experience with Apache Flink for real-time data processing Proven experience in mentoring and managing teams, with a focus on developing talent and fostering a collaborative work environment Strong ...

Architectural Leaders \n \n hipDefine and evolve the enterprise data architecture strategy, with a primary focus on Cloud-scale Distributed Data Processing using Apache Spark and PySpark at the core of the platf \n ormEstablish and maintain architectural artefacts, reference architectures, Architecture Decision Records (ADRs), technical standards, and architecture … large, complex, data-led organisation, operating at an influence and strategy level rather than hands-on de \n liveryExpert-level understanding of Apache Spark and PySpark as the foundation of distributed data processing architectures, including tuning, optimisation, and enterprise-scale deployment pa \n tternsDeep expertise in designing and evolving ...

designing and delivering modern data platforms, working closely with clients and technical teams to build scalable, secure and high-performing solutions using Databricks, Apache Spark and cloud technologies. You'll also play a key role in pre-sales activities, solution design, and helping to drive strategic Databricks initiatives across … Databricks and modern data platform delivery. Skills & Experience Required 7+ years' experience in Data Architecture or Solution Architecture. Strong commercial experience with Databricks and Apache Spark . Experience delivering enterprise data platforms on AWS, Azure or GCP. Strong understanding of data warehousing, data lakes and lakehouse architectures. Experience designing ...

ensuring best practices in data architecture, security, and cloud computing Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems Utilise Apache Flink and other streaming technologies to build real-time data processing systems that handle large-scale, high-throughput data Ensure all data solutions comply … Lambda, and Redshift. Experience with other cloud providers (e.g., Azure, GCP) is a plus In-depth knowledge and hands-on experience with Apache Flink for real-time data processing Proven experience in mentoring and managing teams, with a focus on developing talent and fostering a collaborative work environment Strong ...

strong focus on cost efficiency, scalability, and operational excellence. Key Responsibilities Design and build scalable, real-time data processing systems using technologies like Apache Flink, Kafka. Develop high-quality, maintainable code for Apache Flink (Java) data processing and .NET APIs. Lead and contribute to collaborative system design, while … cost. What We're Looking For Excellent collaboration and communication skills. Strong experience in distributed systems and event-driven architectures. Hands-on experience with: Apache Flink (or similar stream processing frameworks) Kafka or other messaging systems. Strong Proficiency in .NET or Java. Experience building systems that are highly observable ...

support high availability and load-balancing solutions. Configure and troubleshoot networking technologies including DNS, routing and Firewalls. Manage web services and Proxy technologies including Apache, NGINX and Squid. Oversee backup, recovery and disaster recovery processes using Veeam. Manage endpoint security and device compliance through Microsoft Intune. Maintain server infrastructure … VMware ESXi administration experience. Strong networking knowledge including DNS, load balancing, routing and troubleshooting. Experience with Veeam backup and disaster recovery solutions. Experience managing Apache, NGINX, Squid or similar web technologies. Scripting and automation experience. Strong understanding of infrastructure security, system hardening and access control. Proven experience leading ...

analytics tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium … Database Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working ...

responsibilities include: Demonstrate expertise in Airflow, Google Cloud Platform, Control-M or Automic and REST‐based API orchestration. Contribute to the integration of Apache Airflow into the IT landscape, driving adoption technically and organizationally. Design and implement concepts for improving or replacing existing processes from Control‐M or Automic … activities in a self‐reliant manner. Apply strong Airflow and workload‐automation architecture experience. Skills and experience required: Experience with workload‐automation tooling, preferably Apache Airflow, Control‐M and/or Google Cloud Composer using standard agile SDLC techniques. Knowledge of developing guidelines for Airflow clusters and DAGs, performance ...

with external clients across a variety of industry markets. Minimum of 5+ years of customer‐facing experience would be preferred. [Preferred] Experience working with Apache SparkTM to process large‐scale distributed datasets. Communication: Proven ability to communicate and teach complex technical concepts to both technical and non‐technical audiences. … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

support the tooling to create pipelines that are used for real time decision making in the milliseconds range. Some of the technologies we use: Apache Flink Apache Iceberg K8s operators Kafka Streams What do you need? We are fully aware that it is uncommon for a candidate ...