126 to 150 of 231 Apache Jobs in the UK

operating data pipelines and analytical systems using technologies such as Google BigQuery, Amazon Athena, or ClickHouse. Experience with distributed data processing frameworks such as Apache Spark and/or Apache Flink. Experience with messaging and streaming systems such as Apache Kafka or Apache Pulsar. Experience working ...

golden record creation, and distribution to downstream consumers across the firm. We operate on a modern cloud‐native stack centered on Snowflake , AWS , and Apache Airflow , and follow engineering best practices including CI/CD, code review, and automated testing. Key Responsibilities Design, build, and maintain scalable data pipelines … Security Master, Account Master, and Counterparty Master using Python and Apache Airflow . Develop and optimize complex data transformations, stored procedures, and views in Snowflake , ensuring high performance and data quality. Own the end‐to‐end lifecycle of reference data — from source ingestion and normalization through golden record creation ...

will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations. Design … build high-performance data platforms: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. Design and oversee the delivery of secure data warehouses and data lakehouses: Implement data models, data quality checks, and governance practices to ensure reliable ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full time on site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full time on site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Manchester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either ...

root‐cause analysis. Experience building or supporting production data pipelines in a collaborative engineering environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . Technology Environment The role will involve working with … should bring relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised ...

root‐cause analysis. Experience building or supporting production data pipelines in a collaborative engineering environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . Technology Environment The role will involve working with … should bring relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised ...

tools such as Jenkins, and automation testing tools such as Selenium, Cucumber, Flyway, or Concordion Knowledge of Linux, shell scripting, and application services including Apache, Tomcat, and Spring Boot Experience with user interface technologies (Angular, TypeScript, React) and user interface testing tools (Jasmine, Karma, Jest) Working experience with cloud ...

with cross-functional teams, and mentoring junior engineers. Ideal candidates will have over 7 years of experience in data engineering, proficiency in tools like Apache Spark and Azure Data Factory, and familiarity with AI and machine learning concepts. This role offers a dynamic work environment, promoting innovation and continuous ...

influence and guide stakeholders at all levels. Preferred Technical and Professional Experience Familiarity with or has experience contributing to the following open‐source technologies: Apache Iceberg, Velox, Substrait Experience/knowledge with public clouds (AWS, Azure or GCP) Computer Science Degree with Specialization in Database Technologies Equal Employment Opportunity ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

with downstream systems, including trader‐facing tools. Experience 5+ years software engineering experience in building distributed systems. Excellent Java skills. Experience with streaming technologies (Apache Flink preferred; Kafka Streams, Spark Streaming, etc.). Solid understanding of event‐driven architecture and asynchronous processing patterns. Experience handling data consistency challenges such ...

Develop and maintain data pipelines using Python, SQL, and Apache Airflow. • Containerise data applications and workflows using Docker. • Build and optimise data solutions using AWS services including: • Redshift, OpenSearch, Lambda, Glue, Step Functions, and Batch. • Collaborate with cross-functional teams to deliver robust, secure, and scalable data infrastructure. • Manage … improvement initiatives. • Ensure data quality, governance, and security best practices are followed. Requirements Strong programming skills in Python and proficiency in SQL. Experience with Apache Airflow for DAG orchestration and monitoring. Hands-on experience with Docker for containerisation. Proficient in AWS data services: Redshift, OpenSearch, Lambda, Glue, Step Functions ...

iManage Work 10, Preview Servers, RAVN, iManage Mobility, Threat Manager, Co-Authoring, Closing Folders, SPM, Litera CAM, GDSI Core Platforms: Windows Server 2016-2022, Apache, Linux, Windows OS, MacOS, AVD This role reports to the Senior Manager of Desktop and Application Services. Responsibilities include: Application Management Administer, configure ...

projects, designing production-grade systems, and working cross-functionally to meet customer needs. Ideal candidates will have expertise in data engineering, cloud ecosystems, and Apache Spark. #J-18808-Ljbffr ...

ideal candidate will have more than 10 years of experience in backend development and data platform engineering, with strong expertise in Java and Apache Spark. The role offers competitive compensation and benefits, reflecting the company's commitment to employee well-being. #J-18808-Ljbffr ...

serverless data platform company. Data teams write plain Python, and Tower handles packaging, dependency resolution, scheduling, and execution across a serverless runtime built on Apache Iceberg. The product aims to let local Python scripts run in production at scale without a Databricks detour. The team is small and senior ...

experience of installing, configuring and troubleshooting Linux based environments. Solid experience in the administration and performance tuning of application stacks (e.g., PHP 5 & 7, Apache, Python, NGINX). Experience of working across the full SDLC/STLC. Automation software (e.g., Puppet, cfengine, Chef). IaC (such as Terraform, CloudFormation ...

Role : Senior Data Manager/Lead Location : London (Hybrid) Comp : £115,000 P/A (FTC) Duration: 12 Months Skills: Python (Programming Language), SQL, Apache Spark, PySpark, Azure Databricks, Data Lakes, Data Warehouse Architecture, Leadership, Software Development, Management The role We're partnering with a large, data-driven organisation ...

strong skills in several of the following Modern JavaScript GitLab CI/CD Observability Technologies Web API Integration GitLab Version Control Database Technologies OpenShift Apache NiFi Message Broker Technologies Java Web Auth Distributed Architecture Kubernetes SecDevOps Cloud Native Technologies The Interview Process We believe in keeping the interview process ...

some of the following technologies on both Windows and Linux: C++ Javascript Python XML JSON HTML CSS Web backend servers (Angular, Django, NodeJS, React, Apache or similar) Web Sockets Docker TCP-IP/UDP SQL or other databases Dev tools (Wireshark, system log interrogation etc..) Databases Cyber Security Desirable ...

automation & configuration management; • Ansible (plus Puppet, Saltstack), Terraform, CloudFormation; • NodeJS, REACT/MaterialUI (plus Angular), Python, JavaScript; • Big data processing and analysis, e.g. Apache Hadoop (CDH), Apache Spark; • RedHat Enterprise Linux, CentOS, Debian or Ubuntu. • Java 8, Spring framework (preferably Spring boot), AMQP - RabbitMQ, • Open source technologies; • Experience ...