101 to 121 of 121 Apache Spark Jobs in England

APIs used by researchers and engineers across the firm. Ideal candidates have deep Python expertise, hands-on experience with modern cluster compute technologies (Kubernetes, Spark, Hadoop/Yarn, Ray, Airflow) and a track record of delivering scalable infrastructure in a multi-user #J-18808-Ljbffr ...

Java, data structures and concurrency, not just framework knowledge Hands-on experience with Kafka and event-streaming frameworks such as Flink, Kafka Streams or Spark Practical Kubernetes experience, including troubleshooting production issues Experience tuning JVM performance - garbage collection, CPU hotspots and heap dump analysis Why you'll love this ...

Java, data structures and concurrency, not just framework knowledge Hands-on experience with Kafka and event-streaming frameworks such as Flink, Kafka Streams or Spark Practical Kubernetes experience, including troubleshooting production issues Experience tuning JVM performance - garbage collection, CPU hotspots and heap dump analysis Why you'll love this ...

matter – packed with personal touches and delivered with care. We’re not just about selling cards or gifts – we’re here to spread joy, spark smiles and make every celebration feel extra special. And with values that guide how we work and support one another, we’ve built ...

Senior Databricks Architect Technology: Databricks (Spark, PySpark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus). Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data mesh architecture. The role … focuses on integrating legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such ...

model lifecycle: data prep, experimentation, deployment, and monitoring. Build and optimize feature pipelines and scoring jobs using Python, Databricks, Spark, Delta Lake, and AWS. Use AWS services (S3, Redshift, Lambda) for data automation, orchestration, and scalable processing. Ensure data quality, observability, lineage, and documentation across data and ML pipelines. … Direct experience with OpenAI APIs, LLM workflows, and prompt engineering. Solid machine learning fundamentals, including supervised learning, NLP, and feature engineering. Experience with Databricks, Spark, and Delta Lake. Strong SQL skills with experience working on large datasets. Experience with AWS, including S3 and Lambda. Familiarity with Redshift, Snowflake ...

reasoning engines, and data platforms, linking bioinformatics with modern AI to interpret variants, diseases, and literature. You’ll work across PostgreSQL, DuckDB, Redis, and Spark, delivering scalable, explainable AI systems. #J-18808-Ljbffr ...

experience owning and operating production data infrastructure at significant scale. Proven capability delivering large-scale streaming data solutions using technologies such as Kafka, Flink, Spark Streaming, Dataflow, or similar. Demonstrated success leading end-to-end migrations of live production systems. Strong knowledge of cloud platforms and distributed data architectures. … with data scientists, analysts, and business stakeholders. Strong understanding of data platform reliability, performance, scalability, and cost optimisation. Experience with technologies such as ClickHouse, Apache Iceberg, BigQuery, dbt, Elasticsearch, Druid, GCP, or AWS is highly desirable. If you're an experienced Senior Data Engineer looking to lead complex data ...

RESPONSIBILITIES Across AWS, Azure, and GCP, devise and execute flexible, protected data architectures. Give enterprise‐wide data models, pipelines, and artificial intelligence frameworks. Use Spark, Kinesis, Pub/Sub to organise real time and batch data processing. Create ML pipelines for effective model training, deployment, and monitoring. Construct … experts. EXPERIENCE & SKILLS REQUIRED Experience in AI/ML platform design, data engineering, and solution architecture. Skilled in current data technologies (Kafka, Spark, Snowflake, Databricks, BigQuery). Proficient in deep learning (TensorFlow, PyTorch) as well as artificial intelligence/machine learning platforms (SageMaker, Azure ML, Vertex AI). Good ...

Overview At Aztec, we are committed to building a diverse and inclusive workforce where everyone is valued, respected, and able to grow. We welcome applications from all individuals and encourage candidates who are excited about ...

Data Architect Inside IR35 up to £600+ Nottingham Hybrid Summary We're undertaking a fast paced data transformation into Databricks at E.ON Next using best practice data governance and architectural principles, and we are growing ...

coupled with a strong interest in continuous learning. Flexibility to travel up to 20% of the time. Preferred Technical and Professional Experience Experience with Apache Kafka and Apache Flink. Experience helping customers build distributed systems or streaming solutions that use Kafka alongside technologies such as Spark, Flink ...

Applying advanced techniques in LLMs, agentic systems, vector databases, fine‐tuning, and deployment tools (e.g., HuggingFace, Langchain). Hands‐on experience working with Distributed Spark based systems. Experience with data engineering concepts or a good understanding of data engineering concepts. Pre‐sales or post‐sales experience working with external … clients across a variety of industry markets. Minimum of 5+ years of customer‐facing experience would be preferred. [Preferred] Experience working with Apache SparkTM to process large‐scale distributed datasets. Communication: Proven ability to communicate and teach complex technical concepts to both technical and non‐technical audiences. Core Traits ...

At Databricks, our core values are at the heart of everything we do; creating a culture of proactiveness and a customer‐centric mindset guides us to create a unified platform that makes data science and ...

At the company, our core values are at the heart of everything we do. A culture of proactiveness and a customer‐centric mindset guides us in creating a unified platform that makes data science and ...

Applying advanced techniques in LLMs, agentic systems, vector databases, fine‐tuning, and deployment tools (e.g., HuggingFace, Langchain). Hands‐on experience working with Distributed Spark based systems. Experience with data engineering concepts or a good understanding of data engineering concepts. Pre‐sales or post‐sales experience working with external … clients across a variety of industry markets. Minimum of 5+ years of customer‐facing experience would be preferred. Experience working with Apache SparkTM to process large‐scale distributed datasets. Communication: Proven ability to communicate and teach complex technical concepts to both technical and non‐technical audiences. Core Traits: Passion ...

ability to mentor and develop others. You'll lead platform engineering initiatives while coaching a team of BI Developers in Fabric, Python and Spark, helping drive the organisation's data engineering capability forward. Key Responsibilities Development, support and enhancement of EDAP on Microsoft Fabric. Design and build scalable data … Python and Spark. Work with stakeholders to deliver robust, business-focused data solutions. Essential Skills Microsoft Fabric (hands-on platform engineering experience). Python. Apache Spark. Azure Data Factory, Databricks and Data Lake. Enterprise-scale data platform design and delivery. Experience coaching, mentoring and leading technical teams. Important This ...

replication tool, and Waggle Dance , a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg , a high-performance open table format for large analytic datasets that underpins many modern Lakehouse architectures.We guarantee you’ll learn … focus on scalability, reliability, and observability.Strong knowledge of the JVM and server-side Kotlin/Java programming.Solid understanding of the Hadoop ecosystem, including Spark, Hadoop, and Hive.Strong experience with cloud platforms and data infrastructure, especially AWS, including EMR, S3, and Glue.Experience working in Agile environments and contributing through code ...

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. We build and operate ground-breaking, ultra-secure ...

scalability Build and integrate RESTful microservices within a complex distributed architecture Work with large-scale data sets, leveraging SQL and big data tools (e.g., Spark, Kafka) Influence system design and contribute to the technical roadmap Collaborate closely with a highly skilled engineering team to deliver innovative solutions Requirements Strong … experience building and consuming RESTful services Solid SQL skills and familiarity with large-scale data processing Knowledge of big data technologies such as Spark and Kafka Experience in finance is preferred, but not essential Strong academic background, ideally in Computer Science or a related discipline #J-18808-Ljbffr ...

tuned foundational Large Language Models (LLMs), along with sub‐agents, tools, and MCP integrations Architect end‐to‐end ML pipelines, integrating data processing (e.g., Spark, Airflow) with model training, evaluation, and deployment workflows Drive experimentation frameworks, including A/B testing and offline evaluation, to continuously improve model performance … fine‐tuning Large Language Models (LLMs) and building production AI Agents. Proven experience designing scalable data and ML pipelines using tools such as Spark, Airflow, or similar distributed systems. Demonstrated ability to operate as a senior individual contributor, influencing technical strategy and decision‐making without direct authority. Experience partnering ...