326 to 350 of 372 Apache Spark Jobs in England

Degree Apprentice - Data Analytics Engineer

Hiring Organisation
Yunex Traffic
Location
1 VISCOUNT ROAD AVIATION BUS, BOURNEMOUTH INTERNATIONAL AI, CHRISTCHURCH, ENGLAND, United Kingdom
Employment Type
Degree Apprenticeship
Salary
£22,000 a year
year apprenticeship where you will be put onto the Machine Learning standard with a pathway into Software You will virtually attend Cambridge Spark on a 1-day a week basis with check ins and sessions each quarter Permanent employment after apprenticeship in out DevOps Team Apprenticeship Standard Machine learning … engineer (level 6) Training Provider CAMBRIDGE SPARK LIMITED Working Week Monday to Friday, 9.00am to 5.00pm. Hybrid working role where you may be able to work from home for 2 days a week. Expected Duration 4 Years Positions Available 1 Closing Date Thursday, 31st December 2026 Start Date Tuesday ...

capco Senior · Hybrid 04 de nov. Senior Azure Data Engineer (Databricks) python scala azure ci/cd +11

Location
Greater London, England, United Kingdom
solution quality while applying sound engineering judgement and responsible AI practices. What You'll Do Design and develop robust data pipelines using Delta Lake, Spark Structured Streaming, Unity Catalog, and Azure-native services. Build real-time, event-driven solutions using technologies such as Kafka and Azure Event Hubs, applying … productivity while maintaining appropriate human oversight, governance, and solution quality. Bonus Points For Development experience using Scala or Java. Familiarity with Cloudera, Hadoop, Hive, Spark, and related distributed data ecosystems. Experience working with sensitive data and applying data privacy regulations, including GDPR. Curiosity to explore new technologies, including responsible ...

Evergreen - FDE Brazil

Location
Greater London, England, United Kingdom
Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals Familiarity with CI/CD for production deployments Working knowledge of MLOps, ML/AI models ...

Big Data Architect

Location
City Of London, England, United Kingdom
Proven experience in consultative technical sales or professional services with a proven record of success Commercial solution architecture experience in Big Data technologies e.g. Spark, Hadoop, EMR, MapR etc. Strong verbal and written communications skills are a must, as well as the ability to lead effectively across internal ...

Machine Learning Engineer - Fulfillment

Location
Greater London, England, United Kingdom
with modeling tools such as Python, PyTorch, TensorFlow, scikit-learn etc. Hands-on experience building large-scale distributed machine learning systems such as Hadoop, Spark etc. Effective communication skills in Chinese. At JD.com, we’re committed to building a diverse and inclusive workplace where everyone can thrive. ...

Senior Kafka Platform Engineer

Location
Knutsford, England, United Kingdom
include: Contributing to disaster recovery, business continuity and platform resilience solutions for streaming environments. Working with streaming technologies such as Kafka Streams, Flink or Spark Streaming and applying real‐time data processing approaches to business requirements. Working collaboratively across engineering, architecture, security and infrastructure teams, sharing knowledge and contributing ...

Lead Data Engineer - Perm up to £100k

Hiring Organisation
Lorien Resourcing Limited
Location
Manchester, North West, United Kingdom
Employment Type
Permanent
hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver, gold) Terraform, CI/… pairing and design sessions Confidence communicating with technical and non-technical stakeholders, and challenging constructively Desirable: SQL Server or on-prem to cloud migration, Apache Flink, regulated industry experience If you'd rather shape a platform than inherit a finished one, and want a seat at the table while ...

Lead Data Engineer - Perm - AWS Migration

Location
Manchester, Lancashire, United Kingdom
hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver, gold) Terraform, CI/… pairing and design sessions Confidence communicating with technical and non-technical stakeholders, and challenging constructively Desirable: SQL Server or on-prem to cloud migration, Apache Flink, regulated industry experience If you'd rather shape a platform than inherit a finished one, and want a seat at the table while ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
technology estate Our Data Technology Stack Cloud: Microsoft Azure Data platforms: Azure Databricks, SQL Server, Cosmos DB and Blob Storage Data processing: Python, Spark and SQL Messaging: Azure Service Bus and Event Hubs DevOps and infrastructure: Azure DevOps, GitHub Actions and Terraform You don’t need to have worked … production data pipelines Strong understanding of ETL and ELT architectures and patterns Strong programming and data transformation skills, particularly using technologies such as Python, Spark and SQL Experience working with cloud-based data platforms Experience designing systems for reliability, observability, performance and data quality Strong understanding of data modelling ...

All-Source Intelligence Data Scientist

Location
Cambridgeshire and Peterborough, England, United Kingdom
such as Pipeline Builder or AIP, or similar platforms for application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS … such as Pipeline Builder or AIP, or similar platforms for application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS ...

Senior Data Scientist

Hiring Organisation
Data Careers
Location
South East London, London, United Kingdom
Employment Type
Permanent, Work From Home
Salary
£70,000
Senior Data Scientist - Python/Machine Learning Permanent Location: UK - Remote Salary: £65,000 - £70,000 (+ benefits) Skills: Python, Machine Learning, Statistical Modelling, AWS, Data Engineering An exciting opportunity has arisen for an experienced ...

Cloud Devops Engineer

Location
Greater London, England, United Kingdom
them is desirable GCP Cloud: Compute Engine, Kubernetes Engine, IAM, VPC Networks, BigQuery, Dataproc, CloudStorage, Cloud Functions, CloudSQL, Memorystore PubSub, Iceberg Infrastructure & Technologies: Apache Airflow, Druid/Imply, Kafka, Spark, Postgres, Jenkins, Scylla, Redis, Docker, Prometheus, Github, Linux. Languages: Python, Scala, C++, JavaScript, Java. What Blis can offer ...

Design Systems Analyst

Location
Greater London, England, United Kingdom
both your technical and non-technical skills through continuous learning, professional development support, and knowledge sharing and insights from experienced colleagues. If our designs spark your curiosity and you would like to contribute to solving complex challenges with local and global impact, we invite you to join our team. ...

Account Executive - Strategic

Location
Greater London, England, United Kingdom
bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLE We’re building a founding team of Strategic ...

Kafka Platform Engineer

Location
Knutsford, England, United Kingdom
Kafka Connect, Schema Registry, Cluster Linking and ksqlDB. Other highly valued skills may include Experience with streaming technologies such as Kafka Streams, Flink or Spark Streaming. Experience working with cloud-native technologies and Kubernetes-based platforms in enterprise environments. Effective collaboration, communication and problem-solving skills, with the ability ...

Solution Engineer - Public Sector - UK

Location
Greater London, England, United Kingdom
home affairs is highly desirable. Technical expertise in data storage, processing, and containerization technologies such as Cloud or On‐prem Distributed File Systems, Spark, Kubernetes, and Elasticsearch. Our perks and quirks. What makes you Q will help you to realize your full potential, flourish and enjoy what ...

Quantexa Data Engineer (Scala/Spark)

Hiring Organisation
Adecco
Location
London, United Kingdom
Employment Type
Contract
Title: Quantexa Data Engineer (Scala/Spark) Location: London Contract Length: Up to 11 months Working Pattern: 2-3 days in the office per week, via Umbrella Company Our client is investing in a major Quantexa-led financial crime and AML transformation programme and is looking for a hands … enhance a new Quantexa capability across EMEA. Key Responsibilities: Design, build and optimise scalable data pipelines and ETL processes. Develop solutions using Scala, Spark, Python and SQL. Support the implementation and growth of the Quantexa platform. Build reusable frameworks and shared engineering capabilities. Work across Azure, Databricks and cloud ...

Data Engineer

Location
Greater London, England, United Kingdom
play a key role in shaping the future of the engineering function. Skills required: Strong experience with Python Excellent SQL knowledge Experience with Apache technologies (Spark, Airflow or Kafka) Proven experience designing and building scalable data pipelines Strong understanding of data architecture and distributed systems Experience working within ...

Full Stack Blockchain Developer

Location
Greater London, England, United Kingdom
Hyperledger framework would be very appreciated A first experience using Mobile technologies in Android/iOS environment, Big Data technologies such as Cassandra/Spark/NoSQL is an asset Work within our team of passionate and talented developers Design, implement and test platforms and Apps Deal with cryptocurrencies ...

Staff Data Engineer

Location
Greater London, England, United Kingdom
scaling data-intensive pipelines and platforms in production environments. Deep understanding of stream and batch processing frameworks - hands-on experience with Flink or Spark is essential. Comfortable working across multiple programming languages - we primarily work with Kotlin, Python, and TypeScript. Equally comfortable designing high-level architecture as diving deep … core data infrastructure tooling such as Kafka, Redis, and/or clustered Postgres. Nice to have experience Familiarity with open lakehouse technologies, such as Apache Iceberg and dbt. Experience building data infrastructure to support AI agents - including low-latency retrieval and analytical interfaces. Experience leading teams or managing engineers ...

Data Engineer

Location
Greater London, England, United Kingdom
Highlights: Spearheading the evolution of the company's data platform as it scales beyond MVP Building and maintaining scalable data pipelines using Python, Java, Spark, SQL, and more Partnering with cross-functional teams (Product, Finance, Ops, Customer Success) to deliver actionable insights and reliable data solutions Designing data models … environments Proficiency in Python (preferred), with experience in other languages like Java, Scala, or TypeScript Strong knowledge of cloud-based big data tools (AWS, Spark, EMR, Lambda, etc.) Excellent communication and problem-solving skills, with a collaborative mindset A passion for supporting SMEs through innovative, data-led technology Background ...

Data Engineer

Location
Greater London, England, United Kingdom
related technologies. You will ingest structured and unstructured data into our data lake and collaborate with Machine Learning Engineers and Data Scientists in Hadoop, Spark, Teradata, GCP, and Azure environments. You should be passionate about developing new solutions, evaluating new tech, and translating data into analytics opportunities. What … high-quality, reusable data pipelines at scale and ingest data into the data lake Collaborate with Machine Learning Engineers and Data Scientists in Hadoop, Spark, Teradata, GCP, and Azure Evaluate new technologies and translate data into analytics-based opportunities Essential experience Good coding/scripting experience using Python ...

Quantexa Data Engineer - AVP

Hiring Organisation
Adecco
Location
London, United Kingdom
Employment Type
Contract
Title: Quantexa Data Engineer (Scala/Spark) Location: London Contract Length: Up to 11 months Working Pattern: 2-3 days in the office per week, via Umbrella Company Our client is investing in a major Quantexa-led financial crime and AML transformation programme and is looking for a hands … enhance a new Quantexa capability across EMEA. Key Responsibilities: Design, build and optimise scalable data pipelines and ETL processes. Develop solutions using Scala, Spark, Python and SQL. Support the implementation and growth of the Quantexa platform. Build reusable frameworks and shared engineering capabilities. Work across Azure, Databricks and cloud ...

Enterprise Data Architect

Location
Greater London, England, United Kingdom
**About the role:** **Reports to Head of Enterprise Architecture**At Aztec Group we credit our technology as one of the core ingredients to our award-winning outsourced solutions. We are currently looking for an Enterprise ...