351 to 372 of 372 Apache Spark Jobs in England

Data Scientist, Manager Location: Belfast*closing date 20th November 2026*About AxiomAxiom is a recognized leader in the business of law and defined the alternative legal services category more than 20 years ago. While not ...

team capability growth and development. What We’re Looking For Experience as a Data Engineer with strong skills in areas such as Python, NumPy, Spark and Apache Pig. Proven experience in designing, developing and deploying scalable systems. Familiarity with CI/CD, containerisation, deployment technologies and cloud platforms ...

team capability growth and development. What We’re Looking For Experience as a Data Engineer with strong skills in areas such as Python, NumPy, Spark and Apache Pig. Proven experience in designing, developing and deploying scalable systems. Familiarity with CI/CD, containerisation, deployment technologies and cloud platforms ...

retraining, and optimise models for reliability and cost efficiency in AWS. Collaboration & Enablement: Partner with data engineers to integrate ML workflows into wider platforms (Spark, Databricks), and share best practice and mentor other technical professionals. What You'll Love About This Role Think Big: Build ML and AI solutions … models underperform across data, features and architecture, and make reasoned trade-offs. Real-time & distributed ML: A strong grasp of production inference patterns, plus Spark and distributed data processing. Reproducibility & tooling: Reproducible environments (UV/Docker) and MLflow or equivalent, on AWS with Spark, Databricks and Snowflake. Engineering ...

operating large‐scale distributed platforms that power our research, trading and engineering teams across on‐premises and AWS environments, using technologies such as Spark, Trino, Kafka, ClickHouse and Airflow. Key Responsibilities Building, operating and scaling distributed analytics platforms across on‐premises and AWS environments Designing and implementing new platform … hours rota to support critical systems Core Skills and Technologies Experience running distributed data and analytics systems at scale using tools such as Spark, Kafka, Trino or Airflow Strong Linux skills and proficiency in Python for automation and integration Familiarity with infrastructure as code, using Terraform or Ansible Deep ...

experience, including query optimisation, throughput management, and a strong understanding of partitioning, indexing and consistency levels, plus the SQL API. Change Data Feed and Spark: Strong knowledge of the Cosmos DB Change Data Feed, including integrating and debugging Spark with it. PySpark: High proficiency in PySpark and Spark ...

hear from you! Advanced Stream Processing & Event-Driven Architecture: Proven track record building, deploying, and operating production‐grade, low-latency stream processing pipelines using Apache Kafka (or Kafka Streams, Flink, Spark Streaming). Idempotency & Event Reliability: Deep hands‐on experience handling duplicate events, out‐of‐order log processing ...

iterative delivery—making pragmatic trade‐offs and documenting them clearly. Technology Stack Languages: Predominantly Python and Node.js Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and cloud services Storage/search: MongoDB, OpenSearch Orchestration: Airflow, Dagster, NiFi Tooling: GitHub, GitHub Actions, Rundeck, Jira, Confluence Deployment … plus) Experience debugging moderately complex systems and improving reliability/performance Strong fundamentals: data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure ...

Customer Success and Sales, to limited interactions with external customers. Write production and offline analytical code in Python. Work with distributed data pipelines in Spark/Databricks/GCP. Requirements A degree in computer science or a comparable analytical field. 3+ years of post-undergrad work experience required. Strong … others' in a shared codebase in Python. Practical SQL knowledge. Design experiments and collect data. Experience with distributed analytics and data tooling such as Spark and Databricks. This role has on-call shifts, as part of our weekend rotation, Fri/Sat/Sun. While the number of shifts ...

interest or experience in data/network security would be a nice-to-have Datadog/Grafana/Prometheus Data related products (Airflow, Jupyter, Spark, dbt etc) The projects will be varied and we're looking for someone who can work autonomously and proactively to scope problems and solve … tracking CircleCI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Postgres/Aurora for our relational databases Spark for data processing dbt for data modelling SparkSQL for analytics Streamlit for data applications Are you ready for a career with us? We want ...

clear SLAs and backups. Own the observability platform (ClickHouse, OpenTelemetry): logs, metrics, traces, synthetics, SLOs and actionable alerting. Own the data platform: Glue pipelines, Apache Iceberg lakehouse, Redshift and CDC; serve BI users with traceable datasets and handle data requests with strong privacy practice. Operate platform security controls (identity … security practice; willing to participate in the on‐call rota. Excellent communication; comfortable prioritising, working with stakeholders and reporting upwards. Desirable ClickHouse, Redshift or Apache Iceberg; data engineering with AWS Glue or Spark. Delivering the technical side of a security standard (Cyber Essentials Plus, ISO 27001). Experience overseeing ...

Tripledot Studios is one of the largest independent mobile games companies in the world. We are a multi-award-winning organisation, with a global 2,500+ strong team across 12 studios. Our expanded portfolio includes ...

Experience in software engineering practices: automated testing, version control and breaking down larger software systems. Experience with graph databases and distributed computing systems (e.g. Spark) How you work You get a lot done and can motivate and lead a team to do the same. You lead by example technically … PyTorch, Pandas, NumPy Python/Linux environment MLOps tooling such as MLflow Jupyter Notebooks Relational and non‐relational databases: AWS Redshift, PostgreSQL, vector databases Apache Airflow for workflow orchestration AWS cloud infrastructure as well as on‐premise dedicated hardware Git Competitive salary Pension contribution - up to 6.5% of employer ...

Collaboration, and Observability portfolios. Your Impact As a Senior Software Engineer you will: Design, build, test, and operate near real time data streaming-based (Spark/Flink) solutions for some of the largest Networking customers in the world. Develop agentic workflows, reusable skills, tool integrations, and orchestration capabilities. Integrate … designing, building, testing, and operating) of real-time data processing pipelines, utilizing at least one core streaming or real-time analytics technology such as Apache Kafka (including Kafka Streams), Apache Flink, or ClickHouse. Experience designing and implementing APIs within distributed software architectures. Experience with Git, automated testing, Kubernetes ...

Collaboration, and Observability portfolios. Your Impact As a Senior Software Engineer you will: Design, build, test, and operate near real time data streaming-based (Spark/Flink) solutions for some of the largest Networking customers in the world. Develop agentic workflows, reusable skills, tool integrations, and orchestration capabilities. Integrate … designing, building, testing, and operating) of real-time data processing pipelines, utilizing at least one core streaming or real-time analytics technology such as Apache Kafka (including Kafka Streams), Apache Flink, or ClickHouse. Experience designing and implementing APIs within distributed software architectures. Experience with Git, automated testing, Kubernetes ...

matter - packed with personal touches and delivered with care. We're not just about selling cards or gifts - we're here to spread joy, spark smiles and make every celebration feel extra special. And with values that guide how we work and support one another, we've built … place where people (and ideas) can truly thrive. If you're looking to make an impact, bring your spark and be part of something meaningful – we'd love to have you on the team. About the Role Search helps millions of customers navigate and explore a huge catalogue ...

modeling and the creation of type-safe and easily testable batch jobs. The team also orchestrates a compute environment that simplifies the execution of Spark jobs, facilitating the analysis of terabytes of data with ease and cost-effectiveness. The runtime environment is based on Hadoop clusters on EC2 spot … Identifying and implementing computational improvements Making improvements and/or fixing bugs by submitting patches to open-source projects in our stack, such as Spark, Iceberg, Hadoop, Airflow, and many others Acting as an expert on Spark and Scala Mentoring engineers (including through pairing, design discussions, and knowledge ...

with downstream systems, including trader‐facing tools. Experience 5+ years software engineering experience in building distributed systems. Excellent Java skills. Experience with streaming technologies (Apache Flink preferred; Kafka Streams, Spark Streaming, etc.). Solid understanding of event‐driven architecture and asynchronous processing patterns. Experience handling data consistency challenges ...

SparkMLlib, and Python ML libraries (scikit‐learn, XGBoost), including modeldeployment. Design and develop highly scalable, Real time systemsusing Hadoop ecosystem components(Iceberg, Spark, Ozone, Trino, Hive,Ranger, Kafka, Flink and Nifi) Build robust data ingestion and transformationframeworks using Java, Spark, Python, and shell scripting for ingestingmulti model data ...

Company DescriptionWe're ASOS. We blend our flair for fashion with our love of cutting- edge technology, but more importantly were interested in how we can bring the best out of you.We exist to give ...

focus will be generating leads for our legal AI solutions across top-tier law firms and corporate legal departments. In this role, you’ll spark meaningful conversations, uncover business challenges, and position our solutions to meet the unique needs of each prospect—laying the foundation for successful, long-term … strategy. Partner closely with Enterprise Account Executives to build pipeline, align on strategy, and set up high-quality product demonstrations. Create awareness of, and spark interest in, Clio’s product suite with key decision-makers. Develop a deep understanding of your assigned segment, uncovering unique business challenges and tailoring ...

Our client is a global technology company. A problem isnt truly solved until its solved for all. Thats why colleagues build products that help create opportunities for everyone, whether down the street or across the ...