201 to 225 of 231 Apache Jobs in the UK

Spring/Spring Boot . Hands-on experience with Microservices architecture . Strong experience developing RESTful APIs . Kafka - Intermediate+ Hands-on experience with Apache Kafka and distributed streaming systems. Understanding of Real Time data processing and high-volume event streaming. SQL/NoSQL - Intermediate+ Strong SQL querying … data modelling skills. Experience working with relational and NoSQL databases. Databricks - Mandatory Hands-on experience with Databricks for data processing. Experience with Apache Spark and/or Flink is highly desirable. AWS - Mandatory ...

involved in a modern data transformation programme, including a planned migration to Microsoft Fabric. Key Responsibilities Develop and maintain data pipelines using Apache Airflow. Design and optimise SQL-based data solutions. Build and enhance Power BI reports and dashboards. Work closely with stakeholders to gather requirements and deliver insights. … Support ongoing improvements to the data platform and reporting environment. Contribute to the organisation's future migration to Microsoft Fabric. Required Skills Experience with Apache Airflow. Strong Azure SQL skills. Power BI development and data modelling experience. Good understanding of ETL/ELT processes and data warehousing concepts. Strong ...

designing and delivering modern data platforms, working closely with clients and technical teams to build scalable, secure and high-performing solutions using Databricks, Apache Spark and cloud technologies. Key Responsibilities Design and architect Databricks-based data platforms and solutions. Build scalable data lakehouse and data warehouse architectures. Design data … Databricks and modern data platform delivery. Skills & Experience Required 7+ years' experience in Data Architecture or Solution Architecture. Strong commercial experience with Databricks and Apache Spark . Experience delivering enterprise data platforms on AWS, Azure or GCP. Strong understanding of data warehousing, data lakes and lakehouse architectures. Experience designing ...

transparency. Skills & Experience Essential Proven in-depth commercial experience in the following key areas: Databricks- Lakehouse architecture, Spark, Delta Lake, workflows and performance tuning. Apache Spark & Scala- High-performance distributed data processing and optimisation. Cloud Data Engineering (AWS) - Cloud-native data platforms and distributed computing. Data Services Architecture & Engineering … knowledge of client core business functions Demonstrated leadership, project management, and development skills Relationship and consensus building skills Preferred Kafka/Event-Driven Architecture Apache Iceberg/Delta Lake Python AI/ML & LLM integration Financial Services/Capital Markets Education: Bachelor's degree/University degree or equivalent ...

rather than “telling”, preferring to inspire stakeholders through built examples. Technical Expertise: Deep experience in core data & AI technologies, including languages (Python, SQL), frameworks (Apache Spark) and platforms (Databricks, etc.). Collaboration: You can orchestrate diverse teams to achieve a common goal and explain complex tech to non-technical … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

Spark/Scala data processing (also some Flink), Kubernetes and AWS native tooling.**What You'll Do:*** Write highly fault-tolerant Java code within Apache Spark to produce platform products used by our customers to query our event pipelines/ingestion for insight into active threat trends and related … between backend/cloud development and data platform engineering roles* 5+ years of experience building data platform product(s) or features with (one of) Apache Spark, Flink or Iceberg, or with comparable tools in GCP* 5+ years of experience programming with Java, Scala or Kotlin.* Proven experience owning robust ...

Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals Familiarity with CI/CD for production deployments Working knowledge of MLOps, ML/AI models … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs ...

strong focus on cost efficiency, scalability, and operational excellence. Key Responsibilities Design and build scalable, real‐time data processing systems using technologies such as Apache Flink and Kafka. Develop high‐quality, maintainable code for Apache Flink (Java) data processing and .NET APIs. Lead and contribute to collaborative system … cost. What We’re Looking For Excellent collaboration and communication skills. Strong experience in distributed systems and event‐driven architectures. Hands‐on experience with Apache Flink (or similar stream processing frameworks) and Kafka or other messaging systems. Strong proficiency in .NET or Java. Experience building systems that are highly ...

/month in the officeWe’re looking for a **Confluent Solution Architect** to lead the design and architecture of enterprise-grade **streaming solutions** with **Apache Kafka** and the **Confluent Platform**.**What you’ll do:*** Design scalable, secure, and resilient data streaming ecosystems* Translate business requirements into technical solutions … Lead client engagements and guide implementation teams* Integrate Kafka with enterprise systems, cloud platforms, and microservices**Must-Have Skills:** 8+ years in Apache Kafka & Confluent Platform Deep knowledge of Kafka internals & KRaft architecture Experience with Confluent Cloud, stream governance, RBAC, and data lineage Expertise in stream processing (Apache ...

JavaScript, TypeScript, HTML5, CSS3 and state management tools like Redux or Context API. Integrate Kafka for event streaming and real‐time data processing. Utilize Apache Ignite for in‐memory data grid and caching solutions. Collaborate with cross‐functional teams to gather and analyze business requirements within the investment banking …/CD pipelines and automate deployments using Kubernetes and AWS. Mentor and provide technical guidance to junior developers on Core Java, ReactJS, Kafka, Apache Ignite and cloud-native best practices. Participate actively in Agile ceremonies including sprint planning, daily standups and retrospectives. Ensure adherence to security compliance standards ...

scale data platforms and end-to-end technical solutions within enterprise environments. \n Strong hands-on experience with open-source data technologies such as Apache Spark, Trino, Airflow, Apache Superset, or similar platforms. \n Demonstrable security architecture expertise, including threat modelling, IAM (RBAC/ABAC), encryption, secrets management ...

strong focus on cost efficiency, scalability, and operational excellence. Key Responsibilities Design and build scalable, real-time data processing systems using technologies like Apache Flink, Kafka. Develop high-quality, maintainable code for Apache Flink (Java) data processing and .NET APIs. Lead and contribute to collaborative system design, while … cost. What We1;re Looking For Excellent collaboration and communication skills. Strong experience in distributed systems and event-driven architectures. Hands-on experience with: Apache Flink (or similar stream processing frameworks) Kafka or other messaging systems. Strong Proficiency in .NET or Java. Experience building systems that are highly observable ...

bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than … class technical solutions to customer and prospect business problems. In this role, you will be exposed to a wide range of use cases where Apache Airflow sits at the center of the solution. The impacts you will make will enable customers to rapidly grow their businesses by adopting Astronomer ...

mortem analyses and follow-up actions Qualifications & Skills Degree in Computer Science or related field preferred Preferred: Familiarity with data pipeline platforms such as Apache Airflow Preferred: Familiarity with PostgreSQL and Snowflake Solid knowledge of algorithms and data structures Expert Python knowledge Highly preferred: Experience with … other testing methodologies Preferred: Familiarity with event streaming platforms such as Apache Kafka Proficiency with advanced SQL techniques Preferred: Experience in one or more relevant financial areas (market data, order management, algorithmic trading, financial systems integration, compliance, etc.) Deep Linux knowledge Preferred: Familiarity with Java Preferred: Familiarity with ...

driving our values through ML [Preferred] 2+ years customer-facing experience in a pre-sales or post-sales role [Preferred] Experience working with Apache SparkTM to process large-scale distributed datasets Can meet expectations for technical training and role-specific outcomes within 3 months of hire Can travel … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter ,LinkedIn and Facebook . Benefits At Databricks, we strive to provide comprehensive ...

with external clients across a variety of industry markets. Minimum of 5+ years of customer‐facing experience would be preferred. [Preferred] Experience working with Apache SparkTM to process large‐scale distributed datasets. Communication: Proven ability to communicate and teach complex technical concepts to both technical and non‐technical audiences. … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

with external clients across a variety of industry markets. Minimum of 5+ years of customer-facing experience would be preferred [Preferred] Experience working with Apache Spark to process large-scale distributed datasets Communication: Proven ability to communicate and teach complex technical concepts to both technical and non-technical audiences. … analytics and AI. the company is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn more, follow the company on Twitter, LinkedIn and Facebook. At the company, we strive to provide comprehensive ...

About this role: At Astronomer, we’re redefining how companies run Apache Airflow at scale. Our R&D organization is home to some of the most innovative minds in cloud infrastructure and open-source software. You can’t spell “Data Orchestration” without “Data”, and we’re looking … data platforms from cloud-native component parts - we have a healthy mix of build vs. buy; sometimes building is the right choice. Experience with Apache Airflow. #LI-Hybrid At Astronomer, we value diversity. We are an equal opportunity employer: we do not discriminate on the basis of race, religion ...

support the tooling to create pipelines that are used for real time decision making in the milliseconds range. Some of the technologies we use:\* Apache Flink\* Apache Iceberg\* K8s operators\* Kafka StreamsWhat do you need We are fully aware that it is uncommon for a candidate to have ...

support the tooling to create pipelines that are used for real time decision making in the milliseconds range. Some of the technologies we use: Apache Flink Apache Iceberg K8s operators Kafka Streams What do you need? We are fully aware that it is uncommon for a candidate ...

transformation . The ideal candidate will have solid programming skills in Java and/or Python , along with practical experience using Databricks and Apache Flink . Required Skills 4+ years of experience in Data Engineering/ETL Development. Strong hands-on experience in ETL and end-to-end data …/data formats. Experience ingesting data from multiple source systems . Hands-on experience with Databricks for data processing and transformation. Practical experience with Apache Flink for stream and batch processing . Strong understanding of data pipelines, transformation, and integration. ...

Control-M or Automic and a general understanding of industry practice around REST based API orchestrationBe an active, contributing engineer for the integration of Apache Airflow into the IT landscape by technically and organisationally helping to drive the adoptionDesign and implementation of new concepts for improvement or replacement … self-reliant mannerSound and relevant Airflow or Workload Automation architecture experience is a mustYour Skills and ExperienceExperience with Workload automation tooling, preferably Apache Airflow, Control-M and/or Google Cloud Composer using standard agile SDLC techniquesExperience in developing guidelines for Airflow clusters and DAG's, working knowledge ...

Fluency: A strong conceptual mastery of modern data platforms. You do not code, but you understand the architectural implications of AWS (S3), Databricks, dbt, Apache Iceberg, and legacy mainframe/SAS ecosystems well enough to guide technical decision‐making. Stakeholder Influence: Proven ability to manage C-suite and senior … migrate ~11,000 tables, 4,400 SAS scripts, and 500 BTEQ scripts, ensuring full alignment with the programme's "Lakehouse" architecture (AWS, Databricks, Apache Iceberg). Strategic Stakeholder Management: Act as the primary liaison between GlobalLogic's delivery units and senior Barclays stakeholders. Provide transparent reporting on programme health ...

analytics tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium … Database Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working ...

Large-scale Linux operating system upgrades. Kernel patching across extensive server estates. Automation of infrastructure operations and maintenance activities. Development of orchestration workflows using Apache Airflow. Building automation tooling using Python and Ansible. Enhancing observability, monitoring and operational controls. Supporting the introduction of live-patching technologies. The role requires … excellence. Automation Engineering Design, develop and maintain infrastructure automation solutions. Develop tooling and integrations using Python and Ansible. Build and enhance orchestration workflows within Apache Airflow. Create automated pre-change validation and post-change verification processes. Improve efficiency and reduce manual intervention through automation. Platform Observability Implement monitoring ...