226 to 250 of 571 Apache Spark Jobs in the UK

latest Databricks innovations and bringing fresh thinking to clients What We're Looking For You will likely have: Lakehouse Architecture Unity Catalog Spark MLflow Strong Python and SQL skills Experience building ETL/ELT pipelines, data lakes and modern analytics platforms Cloud expertise (any of the following: Azure ...

/ML offerings. Strong programming skills (Python, Java, C++) and experience with DevOps practices (CI/CD). Knowledge of big data technologies (Hadoop, Spark, Flink). Knowledge of NoSQL databases (MongoDB, Cassandra, DynamoDB), message queueing systems (Kafka, RabbitMQ), and version control systems (Git). Preferred Skills: Hugging Face ...

security Practical cloud‐native experience Preferred Qualifications, Capabilities, and Skills: Experience with modern data technologies such as Databricks or Snowflake Hands‐on experience with Spark/PySpark and other big data processing technologies Demonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial ...

Feature Store Containerisation and orchestration using Docker, Kubernetes or ECS Infrastructure as Code using Terraform or CloudFormation Large-scale data processing frameworks such as Spark or Dask Knowledge of data governance, compliance and regulated environments Experience delivering solutions within highly regulated industries such as government, finance or healthcare Security ...

problem-solving skills to collaborate across global teams and translate complex data insights into actionable outputs Familiarity with data platforms such as Databricks, Spark, Snowflake, or similar technologies Ability to communicate technical concepts clearly to non-technical stakeholders Basic understanding of artificial intelligence concepts, with curiosity and enthusiasm ...

large-scale datasetsPreferred QualificationsKnowledge or interest in investment banking or financial instrumentsExperience with big data concepts, such as Lakehouse, ETL data pipelines (e.g. Spark, AWS Glue)Experience with near real time and event-based systems like KafkaABOUT GOLDMAN SACHSAt Goldman Sachs, we commit our people, capital and ideas ...

auction systemsExcellent communication skills, able to explain complex technical systems to commercial, operations and senior leadership teams. Experience with Google Cloud, Docker, Kafka, Spark, Airflow, ElasticSearch, ClickHouse or similar production infrastructureExperience owning product roadmaps, release governance or cross-functional delivery across distributed teams and time zones. What ...

auction systems Excellent communication skills, able to explain complex technical systems to commercial, operations and senior leadership teams. Experience with Google Cloud, Docker, Kafka, Spark, Airflow, ElasticSearch, ClickHouse or similar production infrastructure Experience owning product roadmaps, release governance or cross-functional delivery across distributed teams and time zones. What ...

scale datasets Preferred Qualifications Knowledge or interestin investment banking or financial instruments Experience with big data concepts, such as Lakehouse, ETL data pipelines (e.g. Spark, AWS Glue) Experience with near real time and event-based systems like Kafka Goldman Sachs Highlights At Goldman Sachs, we commit our people, capital ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

transformation, and pipeline development. Experience with dashboarding and visualisation tools (e.g., Tableau, Qlik, or similar). Familiarity with big data tools (e.g., Snowflake, Databricks, Spark) and ETL processes. Proven ability to communicate analytical findings in clear, actionable narratives for both technical and non-technical audiences. Strong problem-solving skills ...

degree, or experience in a professional field or military Experience as technical specialist in design and architecture Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) Experience in consulting, design and implementation of serverless distributed solutions Experience in software development with object oriented language Experience in cloud based ...

degree, or experience in a professional field or military Experience as technical specialist in design and architecture Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) Experience in consulting, design and implementation of serverless distributed solutions Experience in software development with object oriented language Experience in cloud based ...

Data Intelligence Platform working against their real data and workloads, not slideware. Meet technical buyers on their own ground across modern data engineering (Spark, Delta, streaming), machine learning, and Generative AI, and integrate cleanly with their existing cloud and open-source stack. Move at start-up speed: qualify quickly ...

Company Description Company DescriptionPublicis Media harnesses the power of modern media through leading agency brands Dysrupt, Infinite Roar, Publicis Collective, Publicis Health Media, Spark Foundry, Starcom and Zenith, as well as global accelerator PMX; immersive experience group PMCI and access to integrated platform-based technologies and offerings from ...

hands‐on credibility to review a design and challenge an approach. Practical experience with a public cloud lakehouse or modern data platform; Databricks and Spark experience is an advantage. Solid grounding in relational databases at scale, ideally including Oracle and/or PostgreSQL. Real experience of DevOps practice applied ...

environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data using APIs, writing SQL queries etc. Experience in processing large amounts of structured ...

Company descriptionCompany DescriptionPublicis Media harnesses the power of modern media through leading agency brands Dysrupt, Infinite Roar, Publicis Collective, Publicis Health Media, Spark Foundry, Starcom and Zenith, as well as global accelerator PMX; immersive experience group PMCI and access to integrated platform-based technologies and offerings from CJ, Epsilon ...

environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data using APIs, writing SQL queries etc. Experience in processing large amounts of structured ...

work. Technologies and Tools Python Machine learning frameworks (e.g. PyTorch, TensorFlow, scikit-learn) ML/MLOps tooling (e.g. SageMaker, MLflow, TFServing) Spark and Databricks AWS services (e.g. IAM, S3, Redis, ECS) CI/CD tooling and best practices Streaming and batch data systems (e.g. Kafka, Airflow, RabbitMQ) Additional Information ...

libraries (e.g., scikit-learn, pandas, PyTorch or TensorFlow). Practical experience with Databricks, including MLflow for experiment tracking and model management, and Spark-based data processing. Familiarity with Generative AI concepts and tooling, including working with LLMs, prompt engineering, RAG patterns, and vector search. A solid understanding of MLOps ...

science and ML libraries (e.g., scikit-learn, pandas, PyTorch or TensorFlow).Practical experience with Databricks, including MLflow for experiment tracking and model management, and Spark-based data processing. Familiarity with Generative AI concepts and tooling, including working with LLMs, prompt engineering, RAG patterns, and vector search. A solid understanding ...

evolving platform stack — from data ingestion and event processing to REST services and internal tooling. Build and maintain streaming and batch processing systems (Flink, Spark, Kafka) that power real‐time and analytical workloads. Take responsibility for all aspects of software engineering: design, implementation, QA, and maintenance, with … Willingness and ability to take on new technologies as our stack evolves. Nice to Have Experience with stream processing frameworks such as Flink or Spark Streaming. Experience with task orchestration tools such as Apache Airflow or similar systems. Familiarity with additional technologies: GraphQL, React, HTML5, JavaScript, CSS, Postgres ...

Applying advanced techniques in LLMs, agentic systems, vector databases, fine-tuning, and deployment tools (e.g., HuggingFace, Langchain).Hands-on experience working with Distributed Spark based systemsExperience with data engineering concepts or a good understanding of data engineering concepts Pre-sales or post-sales experience working with external clients across … variety of industry markets. Minimum of 5+ years of customer-facing experience would be preferred[Preferred] Experience working with Apache Spark to process large-scale distributed datasetsCommunication: Proven ability to communicate and teach complex technical concepts to both technical and non-technical audiences. Core Traits: Passion for lifelong ...

platforms capable of processing billions of events per day and managing terabytes scale datasets. Develop modern Data Lakehouse platforms leveraging S3-compatible object storage, Apache Iceberg, Spark, and Trino. Build real-time streaming integration using Apache Kafka and Apache Flink for low-latency event processing, enrichment … OpenShift, Terraform, CI/CD, GitOps, and Infrastructure as Code. Lead metadata, lineage, and data discovery capabilities using technologies such as DataHub, OpenMetadata, or Apache Atlas to improve platform transparency and usability. Ensure platform security and regulatory compliance through fine-grained access controls, encryption, secrets management, auditing, and secure ...