51 to 75 of 230 Apache Jobs in the UK

engineering mindset and experience building production-grade systems Experience developing ETL processes and large-scale financial data pipelines Strong Azure experience Docker and Kubernetes Apache Airflow GitHub and CI/CD (GitHub Actions) Experience building cloud-native research or production platforms Experience working with market data, security master data ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. EEO Statement At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs ...

Collaborate with cross‐functional teams to align data architecture with financial regulations (e.g., GDPR, Basel III, MiFID II). Drive adoption of Delta Lake , Apache Spark , and MLflow for advanced analytics and machine learning use cases. Provide technical leadership and mentoring to data engineers and analysts across financial domains ...

large-scale lift-and-shift data migrations from legacy platforms to Databricks, ensuring minimal disruption and high data fidelity. Drive adoption of Delta Lake , Apache Spark , and MLflow for advanced analytics and machine learning use cases. Lead performance tuning, cost optimization, and security hardening of Databricks on Azure. Establish ...

demand generation strategies. Key Goals & Responsibilities: Data Integration and Automation: Leverage your expertise to build robust automation processes for seamless data integration. Utilize Apache Airflow to create and manage complex data workflows, ensuring efficient and reliable data processing and integration tasks. Take advantage of MS Power Automate to streamline ...

will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations.What You Will … lake & Fabric. Understand which Azure data focused components to use for which purpose.Microsoft certified architectDatabricksDesign and build high-performance data platforms: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.Ability to Design, Build and deploy AI/ ...

environment. Key Responsibilities Design, develop and maintain scalable data pipelines using Python and Databricks. Build, optimise and support enterprise ETL/ELT workflows using Apache Spark and Delta Lake. Design and develop robust data models and Lakehouse architectures. Implement and manage data workflows within the Databricks ecosystem. Ensure high … commercial experience developing data engineering solutions using Python . Extensive hands-on experience with Databricks , including Workflows, Notebooks and Delta Lake. Strong experience with Apache Spark/PySpark . Proven experience building scalable ETL/ELT pipelines. Strong SQL and data modelling skills. Experience designing modern Lakehouse architectures. Experience ...

configuration management and an interest in migrating to Ansible and cloud native tooling. Experience managing Kubernetes platforms and deploying containerised applications. Knowledge of GitLab, Apache NiFi, HashiCorp Vault, Trend Micro Deep Security Manager, Ivanti device control, and Ansible Tower/AWX. Windows Infrastructure Experience with Windows Server administration, deployment ...

configuration management and an interest in migrating to Ansible and cloud native tooling. Experience managing Kubernetes platforms and deploying containerised applications. Knowledge of GitLab, Apache NiFi, HashiCorp Vault, Trend Micro Deep Security Manager, Ivanti device control, and Ansible Tower/AWX. Windows Infrastructure Experience with Windows Server administration, deployment ...

strong philosophy around automated test coverage Knowledge of financial products equity, swaps, futures & fx Experience working with NoSQL database Mongo DB Experience working with Apache Flink #J-18808-Ljbffr ...

Databases: PostgreSQL, Graph Databases ( Neo4j , Kuzu ), and data mesh/metadata management platforms. Modern Tech Stack: Next.js 14, FastAPI (Python), Casbin RBAC, Pipeline Orchestration, Apache Iceberg, MCP AI Server Integration, and ODCS v2 Data Contracts layer. DevOps & Integration: Azure DevOps, CI/CD, Data Transformation/Quality frameworks, ITSM ...

strong philosophy around automated test coverage* Knowledge of financial products equity, swaps, futures & fx* Experience working with NoSQL database Mongo DB* Experience working with Apache Flink### About Us**Who we are**Brevan Howard Investment Management is one of the leading absolute return/hedge fund managers, overseeing assets ...

Months contract 2 Days a month onsite - Expenses to Newcastle depends on their hub. Start 3 from offer Experience required AWS Services Terraform Apache Spark Python Airflow Docker Nice to haves Gitlab Security Scanning Agents (eg Trivy, Trend Micro, Wiz etc) Jupyter Notebooks Integration with DWP Integration Team Products ...

ideal candidate will have a strong programming background in Python or Java, knowledge of SQL, and experience with data processing frameworks such as Apache Spark. Responsibilities include enhancing data pipelines, ensuring data quality, and collaborating with engineering teams. The position is located in London and offers significant growth opportunities ...

support data pipelines, ensuring they are production-ready and meet data quality standards. You will work with technologies such as Python, SQL, and Apache Spark, helping drive analytics and operational decision-making. Ideal candidates possess strong programming skills, a relevant degree, and a collaborative spirit, as you will partner ...

best practices and coding standards. Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using Apache Airflow, Spark, SQL, Python, and ETL tools. CI/CD & DevOps Design and implement CI/CD pipelines for data platforms. Automate code deployment ...

Ability to build and deploy scalable applications or libraries Strong debugging, problem-solving, and performance optimisation skills Understanding of open-source licensing (MIT, GPL, Apache) Experience with cloud platforms such as AWS or Azure Ability to create clear, comprehensive technical documentation Experience working within development teams on both minor ...

Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals Familiarity with CI/CD for production deployments Working knowledge of MLOps, ML/AI models ...

such as customer lifetime value, attribution modelling, real-time bidding, and audience targeting is a plus Familiarity with data pipeline orchestration tools such as Apache Airflow and Kubernetes is a plus You do your best work as part of a team and enjoy sharing knowledge just as much ...

deployment. Expert‐level Python and its data ecosystem (Numpy, Pandas), including designing frameworks for data tasks. Deep understanding of distributed data processing engines like Apache Spark. Ability to reason about the full data lifecycle from ingestion through to real‐time serving - your system designs will need to meet downstream ...

should have specialist experience in one or more of the following technologies Azure Databricks Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. Experience of Databricks ML and Azure … develop predictive models and drive business insights. Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks and Azure Data Factory. Azure Data Engineer Associate and Databricks Certified ...

/CI/CD tooling, gaming or media streaming tech stacks. Demonstrate experience and hands‐on skills in open-source software like Apache Web Server, MySQL/PostgreSQL, Redis, Nginx, Terraform. Communicate complex technical content effectively through writing, speaking, and presenting to diverse technical and business audiences. Benefits ...

replication tool, and Waggle Dance , a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg , a high-performance open table format for large analytic datasets that underpins many modern Lakehouse architectures. We guarantee you’ll learn ...

replication tool, and Waggle Dance, a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg, a high-performance open table format for large analytic datasets that underpins many modern Lakehouse architectures. We guarantee you’ll learn ...