76 to 85 of 85 Apache Spark Jobs in the South East

Data Engineer (Python Spark ETL) London/WFH to £90k Are you a tech savvy Data Engineer keen to make an impact, delivering Greenfield systems? You could be progressing your career at a successful and growing Cyber Security Risk Management tech company that specialises in solutions for SME's … ago. You'll take ownership of building a new Data Lake from scratch using a range of modern tools and technologies, primarily Python and Spark in an AWS environment. This is an impactful role where you'll be at the heart of the technology function to drive optimisations and … ELT processes and data pipeline orchestration You have strong Python and SQL coding skills You have experience with big data frameworks and tools including Spark You have a good knowledge of AWS data services (e.g. S3, Redshift, EMR, Glue) You have strong analytical, problem solving and critical thinking skills More ❯

efficient data models for real-time analytics. Proven experience in managing real-time data pipelines across multiple initiatives. Expertise in distributed streaming platforms (Kafka, Spark Streaming, Flink). Experience with GCP (preferred), AWS, or Azure for real-time data ingestion and storage. Strong programming skills in Python, Java, or … Scala . Proficiency in SQL, NoSQL, and time-series databases . Knowledge of orchestration tools (Apache Airflow, Kubernetes). If you are a passionate and experienced Senior Data Engineer seeking a Lead role, or a Lead Data Engineer aiming to make an impact like in a previous position, we More ❯

With us, you'll do meaningful work from Day 1. Our collaborative culture is built on three core behaviors: We Play to Win, We Get Better Every Day & We Succeed Together. And we mean it - we want you to grow More ❯

APIs. Establish best practices for versioning, documentation, security, and monitoring. Real-Time Data Architecture Build and manage data streaming pipelines using frameworks such as Spark, Kafka, or equivalents. Ensure high-availability and low-latency delivery of market and industry data. Azure Deployments Deploy and operate services on Azure using … with a proficiency in Python; comfortable working with other languages (e.g. C#, JavaScript) Hands-on experience building and operating real-time streaming solutions (e.g., Spark Streaming, Kafka, Event-Hub) Thorough understanding of Azure services (Functions, App Services, AKS). Proven design and integration with deploying API frameworks (e.g. FastAPI More ❯

Role: Backend Python & AI Engineer Location: London | Hybrid Working (2 days in Office) An ambitious and fast-growing financial technology company on a mission to transform how people understand and interact with their personal finances. By combining intelligent technology with More ❯

You'll Use: Languages & Tools: SQL, Python, Power BI/Tableau, XML, JavaScript Platforms & Frameworks: Azure Data Services, Microsoft Fabric (nice to have), Hadoop, Spark Reporting & Visualization: Power BI, Tableau, Business Objects Methodologies: Agile/Scrum, CI/CD pipelines What You'll Be Doing: Designing and building robust … Python, and BI platforms like Tableau or Power BI Strong background in data warehousing, data modelling, and statistical analysis Experience with distributed computing (Hadoop, Spark) and data profiling Skilled at explaining complex technical concepts to non-technical audiences Hands-on experience with Azure Data Services (or similar cloud platforms More ❯

in Terraform, Kubernetes, Shell/Powershell scripting, CI/CD pipelines (GitLab, Jenkins), Azure DevOps, IaC, and experience with big data platforms like Cloudera, Spark, and Azure Data Factory/DataBricks. Key Responsibilities: Implement and maintain Infrastructure as Code (IaC) using Terraform, Shell/Powershell scripting, and CI/… teams to design the overall solution architecture for end-to-end data flows. Utilize big data technologies such as Cloudera, Hue, Hive, HDFS, and Spark for data processing and storage. Ensure smooth data management for marketing consent and master data management (MDM) systems. Key Skills and Technologies: Terraform : Essential … streamlined development workflows. Azure Data Factory/DataBricks : Experience with these services is a plus for handling complex data processes. Cloudera (Hue, Hive, HDFS, Spark) : Experience with these big data tools is highly desirable for data processing. Azure DevOps, Vault : Core skills for working in Azure cloud environments. Strong More ❯

every one of our accomplishments —no matter how big or small —can be traced back to an idea’s single spark. It’s that spark —that inner drive —that sets our people apart from our competitors. It enables us not just to pull off game-changing feat after game … want you to find your spark. Because that’s what drives you to be better, be more and ultimately, be more fulfilled. Job title: Apache Hadoop Engineer Work model: Hybrid Location: London, UK Mode of Job: Fulltime/contract Job description: The Apache Hadoop project requires up to … designing and building platforms and supporting applications both in cloud environments and on-premises. These resources are expected to be open-source contributors to Apache projects, have an in-depth understanding of the code behind the Apache ecosystem, and be capable of identifying and fixing complex issues during More ❯

every one of our accomplishments —no matter how big or small —can be traced back to an idea’s single spark. It’s that spark —that inner drive —that sets our people apart from our competitors. It enables us not just to pull off game-changing feat after game … want you to find your spark. Because that’s what drives you to be better, be more and ultimately, be more fulfilled. Job title: Apache Hadoop Administrator Work model: Hybrid Location: London, UK Mode of Job: Fulltime/contract Job description: The Apache Hadoop project requires up to … designing and building platforms and supporting applications both in cloud environments and on-premises. These resources are expected to be open-source contributors to Apache projects, have an in-depth understanding of the code behind the Apache ecosystem, and be capable of identifying and fixing complex issues during More ❯

Graduate/Junior Quantitative Analyst – Sports betting - London *Please note this role cannot sponsor. Please do not apply if you are seeking sponsorship* Job Summary Graduate/Junior Quantitative Analyst is required for one of the leading providers of sports More ❯