126 to 150 of 169 Apache Jobs in England

maintaining scalable data pipelines and integrations. Developing robust ETL and data transformation processes to support analytics and reporting requirements. Working with Snowflake, DBT, Apache Airflow, AWS, SQL and Python to deliver high-quality data solutions. Collaborating with Data Architecture, DevOps and business stakeholders to ensure trusted and accessible data … ideally within AWS. Data modelling, transformation and orchestration methodologies. Delivering high-quality, well-documented and thoroughly tested data solutions. Experience with Snowflake, DBT and Apache Airflow. Interest in AI and emerging technologies within the data engineering landscape. THE BENEFITS: You will receive a salary ...

documentation and technical reports. MOD or Defence security standards and accreditation processes. Working with secure or safety-critical systems. Exposure to technologies such as Apache Kafka, Apache NiFi, Node.js, TypeScript, MongoDB, AI or Machine Learning would also be beneficial. Security Clearance Due to the nature of the work ...

experience supporting product launches from concept through to market. Strong intellectual property expertise, particularly copyright risk and open-source licensing, including CC-BY-4.0, Apache 2.0, and MIT. Strong understanding of AI-related legal, regulatory, and commercial considerations. Experience partnering closely with product, engineering, and technology teams. Track record ...

technical design reviews. Must Haves (Hard Skills) Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake. Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi‐structured financial data logs (JSON/… such as dbt) and scheduling tools (such as Airflow). Stream/Message Queues: Solid understanding of event‐driven architectures and streaming processing via Apache Kafka. Strong Programming Foundations: Proficiency in Python, SQL, or an Object‐Oriented language (Java/Scala). Nice to Haves Experience operating data assets ...

software development team Hands‐on experience designing and developing data integration/ETL pipelines from diverse data sources and formats Hands‐on experience with Apache Airflow, dbt, and Python Strong database skills with Postgres SQL, DynamoDB, Snowflake, and Databricks Experience collaborating with Agile teams, product owners, and cross‐functional … highly scalable data engineering solutions that power Moody’s next‐generation digital content platform. Design, develop, and maintain scalable data pipelines using DataBricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS Support platform optimization, infrastructure improvements, process control enhancements, and system upgrades Collaborate with Moody’s technical teams ...

Responsibilities Data Integration & ETL Design, develop, and optimise ETL processes for efficient data integration Build and maintain data pipelines using tools such as FME, Apache NiFi, and SQL Loader Develop Python scripts and automated processes to support data ingestion Systems & Development Support data streaming solutions via REST APIs … data concepts Experience or knowledge of SQL and/or Python Good communication skills and attention to detail Desirable: Experience with ETL tools (e.g. Apache NiFi, FME, SQL Loader) Knowledge of AWS services (e.g. Lambda, APIs) Understanding of data modelling, data mining, or segmentation Hands-on experience with databases ...

governance frameworks covering data ownership, stewardship, classification (PII, sensitive, public), and retention policies Establish data lineage and cataloguing standards, working with tooling such as Apache Atlas, Collibra, or Snowflake Horizon Catalog Design and enforce data quality rules and SLAs at ingestion, transformation, and consumption layers Collaborate with the Risk … documentation, incremental strategies Application Databases Data Integration AWS – S3, RDS, Aurora, Redshift (migration context), Glue, Lake Formation, IAM, VPC Data Governance Data lineage, cataloguing (Apache Atlas/Collibra/Snowflake Horizon), GDPR, BCBS 239, MDM AI/ML Data Query & Performance SQL optimisation, clustering keys, partitioning, query profiling, cost ...

follow up corrective actions Good knowledge of TCP/IP networking concepts including Routing, Switching, Firewalling, including Layer 7 firewalls Linux (CentOS/Ubuntu, Apache, MySQL) Desirable: Project planning and delivery experience Asterisk/VoIP platforms Windows Server and VMware intermediate level experience Hardware and/or software systems ...

strong and motivated FX Risk Lead Java Developer.**Key Responsibilities:*** Design, develop, and maintain Java-based microservices for high-throughput application* Integrate and optimize Apache Ignite based solution: in memory data grid for FX trades processing* Implement real time data ingestion and processing pipelines using Apache Kafka/… with JVM performance optimization and memory profiling* Familiarity with distributed systems architecture and in-memory computing concepts* Proven experience with in-memory caching solution Apache Ignite in production environment* Solid experience with MongoDB (CRUD, indexing, performance tuning)* Deep SQL knowledge and query optimization in Oracle database* Solid understanding ...

Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals Familiarity with CI/CD for production deployments Working knowledge of MLOps, ML/AI models … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

gRPC protocols. Develop fluid, highly intuitive user interfaces with JavaScript, TypeScript, HTML5, and CSS3, managing state with tools like Redux or Context API. Integrate Apache Kafka to enable real-time data streaming and event-driven architectures. Incorporate Apache Ignite to serve as an in-memory data grid ...

rather than “telling”, preferring to inspire stakeholders through built examples. Technical Expertise: Deep experience in core data & AI technologies, including languages (Python, SQL), frameworks (Apache Spark) and platforms (Databricks, etc.). Collaboration: You can orchestrate diverse teams to achieve a common goal and explain complex tech to non-technical … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

Spark/Scala data processing (also some Flink), Kubernetes and AWS native tooling.**What You'll Do:*** Write highly fault-tolerant Java code within Apache Spark to produce platform products used by our customers to query our event pipelines/ingestion for insight into active threat trends and related … between backend/cloud development and data platform engineering roles* 5+ years of experience building data platform product(s) or features with (one of) Apache Spark, Flink or Iceberg, or with comparable tools in GCP* 5+ years of experience programming with Java, Scala or Kotlin.* Proven experience owning robust ...

Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals Familiarity with CI/CD for production deployments Working knowledge of MLOps, ML/AI models … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs ...

Testing Guild with common standards such as metrics and use of test tools Here's a snapshot of the technologies that we use: Scala Apache Spark Databricks Apache Parquet Azure Cloud Platform Azure DevOps (Test plans, Backlogs, Pipelines) GIT We'd love to hear from ...

/month in the officeWe’re looking for a **Confluent Solution Architect** to lead the design and architecture of enterprise-grade **streaming solutions** with **Apache Kafka** and the **Confluent Platform**.**What you’ll do:*** Design scalable, secure, and resilient data streaming ecosystems* Translate business requirements into technical solutions … Lead client engagements and guide implementation teams* Integrate Kafka with enterprise systems, cloud platforms, and microservices**Must-Have Skills:** 8+ years in Apache Kafka & Confluent Platform Deep knowledge of Kafka internals & KRaft architecture Experience with Confluent Cloud, stream governance, RBAC, and data lineage Expertise in stream processing (Apache ...

teams and setting best practice standards Designing data models, ETL pipelines, warehousing solutions and distributed systems Building and supporting real-time streaming platforms using Apache Flink and related technologies Ensuring compliance with industry standards and government regulations Tracking delivery against agreed designs and managing design deviations Supporting pre-sales … data architecture on complex, secure programmes Strong hands-on AWS experience (EC2, S3, RDS, Lambda, Redshift); Azure or GCP a bonus Proven experience using Apache Flink for real-time, high-throughput data processing Experience leading, mentoring and developing technical teams Confident engaging with senior technical and non-technical stakeholders ...

Python development skills • Previous experience across UK policing data and technology programmes • AWS and cloud application development • OpenShift, Kubernetes or similar container platforms • Apache technologies, ideally Apache NiFi • Building secure applications that process, integrate or manage complex data • CI/CD, DevOps and modern software engineering practices ...

strong focus on cost efficiency, scalability, and operational excellence. Key Responsibilities Design and build scalable, real-time data processing systems using technologies like Apache Flink, Kafka. Develop high-quality, maintainable code for Apache Flink (Java) data processing and .NET APIs. Lead and contribute to collaborative system design, while … cost. What We1;re Looking For Excellent collaboration and communication skills. Strong experience in distributed systems and event-driven architectures. Hands-on experience with: Apache Flink (or similar stream processing frameworks) Kafka or other messaging systems. Strong Proficiency in .NET or Java. Experience building systems that are highly observable ...

Familiarity with PostgreSQL and Snowflake Preferred: Familiarity with Web Frameworks such as Django, Flask or FastAPI Preferred: Familiarity with event streaming platforms such as Apache Kafka Preferred: Familiarity with data pipeline platforms such as Apache Airflow Preferred: Familiarity with Java Preferred: Experience in one or more relevant financial ...

mortem analyses and follow-up actions Qualifications & Skills Degree in Computer Science or related field preferred Preferred: Familiarity with data pipeline platforms such as Apache Airflow Preferred: Familiarity with PostgreSQL and Snowflake Solid knowledge of algorithms and data structures Expert Python knowledge Highly preferred: Experience with … other testing methodologies Preferred: Familiarity with event streaming platforms such as Apache Kafka Proficiency with advanced SQL techniques Preferred: Experience in one or more relevant financial areas (market data, order management, algorithmic trading, financial systems integration, compliance, etc.) Deep Linux knowledge Preferred: Familiarity with Java Preferred: Familiarity with ...

driving our values through ML [Preferred] 2+ years customer-facing experience in a pre-sales or post-sales role [Preferred] Experience working with Apache SparkTM to process large-scale distributed datasets Can meet expectations for technical training and role-specific outcomes within 3 months of hire Can travel … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

with external clients across a variety of industry markets. Minimum of 5+ years of customer-facing experience would be preferred [Preferred] Experience working with Apache SparkTM to process large-scale distributed datasets Communication: Proven ability to communicate and teach complex technical concepts to both technical and non-technical audiences. … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter ,LinkedIn and Facebook . Benefits At Databricks, we strive to provide comprehensive ...

with external clients across a variety of industry markets. Minimum of 5+ years of customer‐facing experience would be preferred. [Preferred] Experience working with Apache SparkTM to process large‐scale distributed datasets. Communication: Proven ability to communicate and teach complex technical concepts to both technical and non‐technical audiences. … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

Fluency: A strong conceptual mastery of modern data platforms. You do not code, but you understand the architectural implications of AWS (S3), Databricks, dbt, Apache Iceberg, and legacy mainframe/SAS ecosystems well enough to guide technical decision-making. Stakeholder Influence: Proven ability to manage C-suite and senior … migrate ~11,000 tables, 4,400 SAS scripts, and 500 BTEQ scripts, ensuring full alignment with the programme’s «Lakehouse» architecture (AWS, Databricks, Apache Iceberg). Strategic Stakeholder Management: Act as the primary liaison between GlobalLogic’s delivery units and senior Barclays stakeholders. Provide transparent reporting on programme health ...