76 to 100 of 231 Apache Jobs in the UK

replication tool, and Waggle Dance, a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg, a high-performance open table format for large analytic datasets that underpins many modern Lakehouse architectures. We guarantee you’ll learn ...

Data Engineer to design, build, and maintain scalable data pipelines powering Moody’s next-generation digital content platform. You will work with DataBricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS, driving platform optimizations and cross-functional collaboration. In this role, you’ll collaborate with product owners ...

data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

batch data platforms Driving engineering best practice Mentoring engineers Working closely with senior business stakeholders Defining future-state data architecture Technical Environment Azure Databricks Apache Spark/PySpark Delta Lake Azure Data Factory Azure Data Lake Gen2 Azure Event Hubs Azure Synapse Python SQL Terraform CI/CD Medallion ...

with cloud platforms (AWS, Azure, GCP) Well versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team lead experience ...

what already exists Deep fundamentals in Python or a functional language like Scala Experience designing and building big data applications with stacks like Databricks, Apache Spark, HDFS, HBase, Snowflake Real command of test-driven development and code quality, this matters as much to us as your data stack does ...

experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise‐scale applications. You have team lead experience ...

latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experience For more information about ...

structures, partitioning strategies, consistency models, and performance optimisation, as well as OLTP databases such as PostgreSQL and MySQL. Distributed compute frameworks – strong experience with Apache Spark and distributed data processing, including optimisation, performance tuning, and large‐scale batch/streaming workloads. Cloud‐native data platforms – demonstrated experience with ...

cloud platforms (AWS, Azure, GCP). Well‐versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g., Apache NiFi, Airflow). Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have external ...

databases Experience with one of Azure/AWS/GCP ETL tools like Informatica, Alteryx and Business Glossary tools like Collibra, Azure Purview or Apache Atlas. TDD/BDD, Experience working in an Agile development environment Identity management and synchronisation will be an add on for the resources Experience ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

/CD •Terraform Cloud & Infrastructure: •AWS (or equivalent cloud platforms) Testing & Quality: •Cucumber •SonarQube Monitoring & Logging: •ELK Stack (Elasticsearch, Logstash, Kibana) •Grafana Dataflow & Integration: •Apache NiFi We don't expect candidates to know everything on the list. Experience across multiple areas is desirable, but most important is a strong ...

/CD •Terraform Cloud & Infrastructure: •AWS (or equivalent cloud platforms) Testing & Quality: •Cucumber •SonarQube Monitoring & Logging: •ELK Stack (Elasticsearch, Logstash, Kibana) •Grafana Dataflow & Integration: •Apache NiFi We don't expect candidates to know everything on the list. Experience across multiple areas is desirable, but most important is a strong ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter ,LinkedIn and Facebook . Benefits At Databricks, we strive to provide comprehensive ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter ,LinkedIn and Facebook . Benefits At Databricks, we strive to provide comprehensive ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical … Data Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required experience in the following: Apache Kafka Apache NiFI SQL and NoSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java Understand and interpret technical ...

delivering enterprise-scale data platform solutions. A strong background in Solution Architecture or Technical Architecture. Hands-on experience with open-source technologies such as Apache Spark, Trino, Airflow, Apache Superset, or similar data engineering platforms. Experience working with cloud platforms including Azure, AWS, or GCP. Experience producing architecture ...

work with Modern C++ Distributed systems Large-scale data processing High-performance microservices Data infrastructure and analytics pipelines Bonus points for SQL Boost ASIO Apache Arrow, Parquet, Protocol Buffers or FlatBuffers gRPC, REST or WebSockets Docker, Kubernetes, AWS or Google Cloud Rust, Python or Q This is an opportunity ...

managing open source projects on GitHub/GitLab. Strong understanding of Git and version control systems. Knowledge of open source licenses (MIT, GPL, Apache). Familiarity with cloud platforms (AWS or Azure). Skills: Ability to write clear technical documentation. Strong debugging, problem-solving, and performance optimisation skills. Excellent ...

open source projects on GitHub/GitLab. \n Strong understanding of Git and version control systems. \n Knowledge of open source licenses (MIT, GPL, Apache). \n Familiarity with cloud platforms (AWS or Azure). \n \n Skills:\n \n Ability to write clear technical documentation. \n Strong debugging ...

REST, SOAP APIs, intra and inter system). Experience with batch processes, Guidewire Messaging framework, OOTB plugins, infra concepts and deployment architecture (WMB, WAS, Apache). Strong knowledge of software architecture and design in Guidewire ecosystem. Ability to write SQL queries for data analysis. Working knowledge of GW Cloud ...

experience designing, deploying, and operating big data platforms at scale. You will have hands-on experience with OSS data ecosystems (e.g., Spark, Trino, Airflow, Apache Superset, and similar technologies). You will have knowledge of cloud platforms and traditional on-premise hosting; hands-on experience with Azure ...

operational stability using Java Excellent problem‐solving, analytical and communication skills Strong in Java 17+ and frameworks like Spring Boot, Spring MVC and Apache Deep understanding of RESTful services and understanding microservices architecture Deep understanding of relational databases, SQL language and ORM tools Deep understanding of message brokers Experience ...