51 to 75 of 372 Apache Spark Jobs in England

deliver scalable data architectures across AWS and Azure environments. Define and implement automated data pipelines using cloud-native technologies and frameworks such as Apache Spark. Design data integration solutions connecting cloud platforms with on-premises data sources. Establish event-driven architectures to support efficient data processing, workflow orchestration … Azure. Strong understanding of cloud data architecture, data integration and distributed data processing. Experience designing and implementing automated ETL/ELT pipelines. Experience with Apache Spark or equivalent distributed data processing technologies. Experience designing event-driven architectures and data processing workflows. Strong understanding of data pipeline orchestration, performance ...

possess hands‐on experience with one or more of the following technological areas (or their equivalent cloud‐native alternatives): Analytics & Platform Frameworks like Apache Spark or similar cloud-specific services. Transformation & Orchestration tools Database Technologies Libraries & Schema Management Storage Formats: Familiarity managing diverse data types through formats like ...

possess hands‐on experience with one or more of the following technological areas (or their equivalent cloud‐native alternatives): Analytics & Platform Frameworks like Apache Spark or similar cloud-specific services. Transformation & Orchestration tools Database Technologies Libraries & Schema Management Storage Formats: Familiarity managing diverse data types through formats like ...

Automated deployments across environments. Monitoring and logging. Release and configuration management. Production support and incident troubleshooting. Python or another scripting language. AWS certification. Terraform. Apache Airflow/MWAA. Databricks or Spark. Kafka/Kinesis. dbt. Experience working in Agile/Scrum environments. Experience 4+ years of experience in Data ...

machine learning or data science.Cloud certifications (e.g. Azure, GCP, AWS) and relevant AI/ML credentials.Experience with big data and distributed computing (e.g. Spark, Databricks, Hadoop or cloud-native alternatives).Experience with containerisation and DevOps/MLOps tools (e.g. Docker, Kubernetes, Git, CI/CD, MLflow, Airflow).Strong experience ...

learning or data science. Cloud certifications (e.g. Azure, GCP, AWS) and relevant AI/ML credentials. Experience with big data and distributed computing (e.g. Spark, Databricks, Hadoop or cloud-native alternatives). Experience with containerisation and DevOps/MLOps tools (e.g. Docker, Kubernetes, Git, CI/CD, MLflow, Airflow ...

platforms (AWS, GCP, or Azure) Experience with: Data warehousing and lake architectures ETL/ELT pipeline development SQL and NoSQL databases Distributed computing frameworks (Spark, Kinesis etc) Software development best practices including CI/CD, TDD and version control. Containerisation tools like Docker or Kubernetes Experience with Infrastructure ...

learning or data science.* Cloud certifications (e.g. Azure, GCP, AWS) and relevant AI/ML credentials.* Experience with big data and distributed computing (e.g. Spark, Databricks, Hadoop or cloud-native alternatives).* Experience with containerisation and DevOps/MLOps tools (e.g. Docker, Kubernetes, Git, CI/CD, MLflow, Airflow ...

experience with one or more cloud data ecosystems: Azure (Data Factory, Synapse, Fabric, ADLS, Databricks) AWS (Glue, Redshift, EMR) GCP (BigQuery, Dataflow) Databricks (Spark/PySpark) Snowflake (SQL, Snowpark, performance tuning) Strong SQL and/or Python capability, and familiarity with tools such as dbt, Git, CI/ ...

Azure) Experience with: o Data warehousing and lake architectures o ETL/ELT pipeline development o SQL and NoSQL databases o Distributed computing frameworks (Spark, Kinesis etc) o Software development best practices including CI/CD, TDD and version control. o Containerisation tools like Docker or Kubernetes o Experience ...

Automated system deployment using tools such as Ansible, Puppet or Chef Desirable Skills/Experience Familiar with the Big Data tech stacks, including: Trino Spark Apache Hive Apache Airflow Zeppelin notebooks Our Package Tailored benefits make a real difference. That’s why we offer a comprehensive range ...

Automated system deployment using tools such as Ansible, Puppet or Chef Desirable Skills/Experience Familiar with the Big Data tech stacks, including: Trino Spark Apache Hive Apache Airflow Zeppelin notebooks Our Package Tailored benefits make a real difference. That’s why we offer a comprehensive range ...

Automated system deployment using tools such as Ansible, Puppet or Chef Desirable Skills/Experience Familiar with the Big Data tech stacks, including: Trino Spark Apache Hive Apache Airflow Zeppelin notebooks Our Package Tailored benefits make a real difference. That’s why we offer a comprehensive range ...

Security In-depth knowledge of the financial services industry and their IT systems Practical cloud native experience Preferred qualifications, capabilities, and skills Advanced Apache Spark experience(PySpark/Spark SQL), including performance tuning (partitioning, shuffle optimization, caching), troubleshooting, and designing scalable batch/stream processing patterns. Deep ...

Management Stakeholder Collaboration Leadership & Mentorship Technology Stack The successful candidate will have experience working with some or all of the following technologies: Data Processing: Apache Spark/PySpark Workflow Orchestration: Apache Airflow Containerisation: Kubernetes Cloud Platform: Microsoft Azure Data APIs & Semantic Layer: CubeJS Programming Languages: Python ...

Company Description Company DescriptionPublicis Media harnesses the power of modern media through leading agency brands Dysrupt, Infinite Roar, Publicis Collective, Publicis Health Media, Spark Foundry, Starcom and Zenith , as well as global accelerator PMX ; immersive experience group PMCI and access to integrated platform-based technologies and offerings from … marketing platforms. Build and optimize schemas, transformations, and ETL logic for high-performance, reusable data workflows. Contribute directly to the DFP codebase (Python, SQL, Spark) — developing pipelines and infrastructure alongside the engineering team. Establish data versioning, testing, and governance frameworks ensuring reliability, lineage, and compliance. Data Engineering Leadership Drive ...

while collaborating with the Data & Analytics Lead, technical colleagues and business stakeholders. Experience in the following areas would also be useful: Materialised Lake Views Apache Spark or Python. APIs and cloud business system integration. Data governance, lineage and quality frameworks. What We Offer A hands-on role developing ...

able to guide how one could deploy infrastructure into different environments. Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop. Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes) Ability to create ...

team members Required qualifications, capabilities and skills Proven experience in designing and building data pipelines (ETL/ELT) using modern technologies (e.g., Python, SQL, Spark, Airflow, etc.). Strong analytical skills with the ability to interpret complex data and deliver business value. Experience integrating data from multiple sources ...

with data warehousing concepts and technologies (e.g., Azure Synapse Analytics, Azure Data Lake Storage). Familiarity with big data technologies and frameworks (e.g., Hadoop, Spark) is a plus. Knowledge of data governance and data security best practices. Strong problem-solving skills and attention to detail. Excellent communication and collaboration ...

programming skills, with experience developing and maintaining data pipelines Familiarity with ETL/ELT technologies and data streaming tools such as Airflow, Azure, SSIS, Spark or Kafka Experience working with databases and data platforms such as PostgreSQL, SQL Server, Oracle, Snowflake or similar technologies Knowledge of data visualisation tools ...

Azuretechnologies, including ADF, ADLS, Databricks, Stream Analytics, DeltaLive Tables, and Synapse Analytics. Advanced proficiency in SQL andprogramming languages such as Python, Scala, or Spark-SQL. Experience in designing anddeveloping scalable ETL pipelines and optimizing data workflows. Deep understanding of data migrationfrom on-premises to cloud and cloud to cloud. ...

maintain SC clearance. Desirable AWS certification at Associate or Professional level Experience with streaming and event‐driven data technologies Experience with technologies such as Spark, Kafka or Databricks Experience delivering data platforms within public sector, defence or other regulated environments Experience working within secure environments and understanding associated security ...

maintain SC clearance. Desirable • AWS certification at Associate or Professional level • Experience with streaming and event-driven data technologies • Experience with technologies such as Spark, Kafka or Databricks • Experience delivering data platforms within public sector, defence or other regulated environments • Experience working within secure environments and understanding associated security ...

Company Description Publicis Media harnesses the power of modern media through leading agency brandsDysrupt, Infinite Roar, Publicis Collective, Publicis Health Media, Spark Foundry, StarcomandZenith, as well as global acceleratorPMX; immersive experience group PMCI and access to integrated platform-based technologies and offerings fromCJ, EpsilonandInfluential.A key business solution of Publicis ...