1 to 25 of 30 Apache Spark Jobs in the South East

/CD pipelines (e.g. Azure DevOps) Excellent communication skills and the ability to engage confidently with senior and executive stakeholders Desirable Experience Agentic AI, Apache Spark, or enterprise architecture frameworks Enterprise data integration and Microsoft BI technologies Experience with AWS or GCP and additional CI/CD tooling ...

Seaborn) Ability to communicate complex analytical findings to diverse audiences Preferred Qualifications Experience with cloud platforms (AWS, GCP, Azure) Familiarity with big data technologies (Spark, Hadoop) Experience deploying models into production environments Knowledge of deep learning frameworks (TensorFlow, PyTorch) Experience working in Agile or cross-functional product teams ...

about other roles, please contact Nick Mandella at Harnham. KEYWORDS Python, SQL, AWS, GCP, Azure, Cloud, Databricks, Docker, Kubernetes, CI/CD, Terraform, Pyspark, Spark, Kafka, machine learning, statistics, Data Science, Data Scientist, Big Data, Artificial Intelligence, private equity, finance. ...

data engineering, data platforms and big data technologies Evaluate and improved existing data processes Essential Experiences: Advanced SQL skills Proficient in Databricks, including Spark, Delta Lake and MLflow Experience migrating SSIS to Databricks In depth understanding of ETL/ELT processes Knowledge of data warehousing concepts and architectures Able ...

/CD (Azure DevOps/GitHub). Excellent communication with technical and non-technical stakeholders. Desired Skills Power BI/Tableau Stakeholder management Spark/Hadoop Unit testing frameworks Azure advanced analytics Data warehousing experience Azure Data Engineer certification Agile/Scrum/Kanban exposure This is a London ...

Salesforce data ingestion experience Exposure to NoSQL databases such as MongoDB, Cassandra, or DynamoDB Experience supporting Power BI and Tableau reporting Proficiency in Python, Spark, or similar data engineering tools Understanding of AI and ML trends Strong communication and stakeholder management skills ...

ServiceNow Automation, Automation Anywhere, Camunda, or similar). Proven experience in AI/ML, data modeling, data lakes, event streaming, and analytics (e.g., Kafka, Spark, Python ML stack). Deep exposure to telecom protocols and domains Experience with cloud-native architectures (Azure/AWS/GCP), containerization, and DevSecOps ...

DevOps and broader software engineering standards. Cloud experience (any platform). Previous mentoring experience. Nice to have: Snowflake or Databricks Spark, PySpark, Hadoop or similar big data tooling BI exposure (PowerBI, Tableau, etc.) Interview Process The process is fully structured, transparent, and efficient: Video call - high-level overview ...

architectures using Delta Lake principles Ingest, transform, and curate data from multiple sources (APIs, databases, files, streaming) Develop scalable data transformations using PySpark and Spark SQL Implement data models optimized for analytics and reporting (e.g. star schemas) Monitor, troubleshoot, and optimize performance and cost of data workloads Apply data … version control (Git) and collaborative development workflows Nice to Have Experience with Power BI and semantic models Exposure to streaming technologies (Kafka, Event Hubs, Spark Structured Streaming) Infrastructure-as-code experience (Bicep, Terraform) CI/CD tooling (Azure DevOps, GitHub Actions) Familiarity with data governance and cataloging tools Experience ...

Azure Services Understanding of software architecture, design patterns, and agile delivery Experience with geospatial data, REST APIs, JSON and spatial query engines (e.g. Apache Spark) Experience with Generative AI technologies including Large Language Models (LLMs), Retrieval Augmented Generation (RAG) and Prompt/Context Engineering Passion for continuous improvement ...

Azure Services Solid understanding of software architecture, design patterns, and agile delivery practices Experience with geospatial data, REST APIs, JSON, and spatial engines (e.g., Apache Spark) Experience with Generative AI, including LLMs, RAG, and prompt/context engineering A passion for continuous improvement and delivering high-quality solutions ...

Data Science Strong Python skills and experience with cloud platforms (AWS, GCP, or Azure) Experience building and deploying production ML systems Familiarity with Databricks, Spark, or MLOps workflows (nice to have but not essential) Solid understanding of modern ML methods and data engineering fundamentals Strong academic background (ideally Russell ...

complex, data-driven platform used by enterprise customers. You will set technical direction and guide architecture across distributed systems, large-scale data processing (Scala, Spark, Databricks), machine learning pipelines, and cloud-native infrastructure on AWS. A core focus is driving high-quality execution through strong engineering practices including ...

please only apply if you hit this criteria. Required Experience Strong background in data engineering within distributed data environments Hands-on expertise with AWS , Spark , Glue , and Snowflake Experience building and optimising data pipelines & reporting workflows Ability to work closely with internal engineering and controls teams Experience upgrading … modernising existing workflows and frameworks For Lead-level: prior experience leading engineering teams or workstreams Tech Stack AWS (Glue, S3, Lambda, Step Functions) Apache Spark Snowflake Java if you are interested in this role then please apply here or email me your most recent and up to date ...

team Exposure to sectors such as defence, public sector and consumer/retail Familiarity with modern data and AI tooling such as Python, Spark, Databricks, Azure cloud, and Generative AI platforms (experience with specific tools is helpful but not essential) A mix of technical, product and operational experience - comfortable ...

team Exposure to sectors such as defence, public sector and consumer/retail Familiarity with modern data and AI tooling such as Python, Spark, Databricks, Azure cloud, and Generative AI platforms (experience with specific tools is helpful but not essential) A mix of technical, product and operational experience - comfortable ...

innovative thinking process and encourage it in others. Working within the agile framework at Chambers Skills and Experience Strong proficiency in SQL , including Spark SQL and MS SQL Server , for querying, data manipulation, and performance optimization. Hands-on experience with Python and PySpark for data processing, transformation, and automation … design, build, and maintain scalable data pipelines for batch and streaming data using modern frameworks. Experience working with Databricks for big data processing, Spark-based transformations, and collaborative analytics workflows. Familiarity with Azure Data Factory (ADF) for data orchestration and integration across cloud environments. Skilled in version control using ...

power, and deep knowledge of just about every industry. We believe a mix of data, analytics, automation, and responsible AI can do almost anything—spark digital metamorphoses, widen the range of what humans can do, and breathe life into smart products and services. Want to join our crew ...

power, and deep knowledge of just about every industry. We believe a mix of data, analytics, automation, and responsible AI can do almost anything—spark digital metamorphoses, widen the range of what humans can do, and breathe life into smart products and services. Want to join our crew ...

/ELT) pulling from core platforms, cloud storage, databases and APIs Turn raw, messy, disparate data into curated, analysis-ready datasets Work with Python, Spark and SQL every day Develop models and schemas using a medallion architecture approach Help shape our data architecture with the Data Architect Implement governance … solve a problem you'll fit right in. What you'll bring You'll likely have: Hands-on expertise with Databricks Confidence in Python, Spark and SQL Experience building pipelines in Azure A solid understanding of data modelling and scalable architectures But just as important: You're inclusive ...

team engineering organisations Strong background in distributed systems, large-scale data pipelines and ML model deployment Deep understanding of modern data stacks such as Spark, Databricks or cloud-native architectures Solid understanding of modern frontend engineering, DevOps knowledge and experience delivering machine learning systems Strong communication, organisation and stakeholder ...

team engineering organisations Strong background in distributed systems, large-scale data pipelines and ML model deployment Deep understanding of modern data stacks such as Spark, Databricks or cloud-native architectures Solid understanding of modern frontend engineering, DevOps knowledge and experience delivering machine learning systems Strong communication, organisation and stakeholder ...

locally-hosted solutions. Technical Requirements Languages Expert-level Python and advanced SQL . Data Engineering Experience with ETL/ELT and orchestration tools like Apache Airflow or NiFi . On-Prem Tech Proficiency with Hadoop/HDFS , Spark , and containerization via Docker/Kubernetes (K3s/OpenShift) . ...

relevant in data governance, compliance, or automation programs. Strong proficiency in Python for data engineering and automation. Hands-on experience with PySpark and Spark SQL in production environments. Solid knowledge of Hive, Impala, HDFS, and Parquet . Advanced SQL skills; experience with Oracle databases . Experience designing and supporting …/ELT pipelines and data quality frameworks . Working knowledge of Autosys & Apache Airflow Experience with CI/CD tools (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift) Familiarity with AWS S3 for large-scale data storage. Experience supporting Tableau dashboards. Nice-to-Have Experience in regulated or enterprise ...

relevant in data governance, compliance, or automation programs. Strong proficiency in Python for data engineering and automation. Hands-on experience with PySpark and Spark SQL in production environments. Solid knowledge of Hive, Impala, HDFS, and Parquet . Advanced SQL skills; experience with Oracle databases . Experience designing and supporting …/ELT pipelines and data quality frameworks . Working knowledge of Autosys & Apache Airflow Experience with CI/CD tools (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift) Familiarity with AWS S3 for large-scale data storage. Experience supporting Tableau dashboards. Nice-to-Have Experience in regulated or enterprise ...