151 to 175 of 372 Apache Spark Jobs in England

platforms. One or more Oracle certifications across OCI, Data Management, AI Services or Autonomous Database. Experience working with complementary technologies such as Python, Spark, Databricks, Azure, AWS, OpenShift, Kubernetes or MLOps platforms. Demonstrated ability to structure client problems, shape solutions and identify opportunities for further value creation. Ability ...

skills Experience with agentic AI coding tools (Claude Code, Copilot Agent Mode, Devin) and spec-driven development Big data/Lakehouse (Snowflake), ETL pipelines (Spark, Glue), or event streaming (Kafka) Interest in investment banking or financial instruments ABOUT GOLDMAN SACHS At Goldman Sachs, we commit our people, capital ...

Company description Publicis Media harnesses the power of modern media through leading agency brands Dysrupt, Infinite Roar, Publicis Collective, Publicis Health Media, Spark Foundry, Starcom and Zenith, as well as global accelerator PMX; immersive experience group PMCI and access to integrated platform-based technologies and offerings from CJ, Epsilon ...

work. Technologies and Tools Python Machine learning frameworks (e.g. PyTorch, TensorFlow, scikit-learn) ML/MLOps tooling (e.g. SageMaker, MLflow, TFServing) Spark and Databricks AWS services (e.g. IAM, S3, Redis, ECS) CI/CD tooling and best practices Streaming and batch data systems (e.g. Kafka, Airflow, RabbitMQ) Additional Information ...

familiarity with Lloyd’s, bordereaux, reinsurance, or regulatory and actuarial reporting. Hands‐on experience designing solutions on Azure Databricks, including Delta Lake, Unity Catalog, Spark (PySpark and Spark SQL) and Databricks SQL. Experience with core Azure data services and their integration with Databricks, such as ADLS Gen2, Azure ...

Engineering Strong experience working with AWS in data engineering environments. Hands‐on experience with AWS Glue for data integration and processing. Strong experience using Apache Airflow for workflow orchestration and pipeline management. Advanced Python development skills. Experience with Apache Spark or similar distributed data processing technologies would ...

e.g., Java, TypeScript, SQL) Experience building and consuming APIs and event‐driven services in a cloud environment Experience with data processing frameworks such as Apache Spark and working with large structured datasets Working knowledge of LLM‐based application development, including prompting, tool calling, retrieval, and evaluation Experience using … agent frameworks (e.g., Google ADK, LangGraph) and agent protocols such as MCP, A2A, or AG-UI Experience with Databricks, MLflow, and Delta Lake or Apache Iceberg Exposure to model serving on Kubernetes and to model monitoring (drift, latency, accuracy) Familiarity with CRM platforms such as Salesforce and their APIs ...

Experience with non-relational database technologies (for example, MongoDB) and associated query patterns Familiarity with large-scale data processing and analytics platforms (for example, Apache Spark or Hadoop) Experience implementing, or partnering closely on, data quality, metadata, and governance controls to improve reliability and auditability Understanding of modern ...

Warehouses Experience with enterprise data source integration — MS SQL Server (on-premises and Azure SQL) and Oracle Database ingestion into Azure landing zones Strong Apache Spark skills — PySpark or Scala, optimisation, partitioning, and job scheduling in Databricks Experience assessing and remediating partially built or vendor-abandoned data platform ...

Warehouses Experience with enterprise data source integration — MS SQL Server (on-premises and Azure SQL) and Oracle Database ingestion into Azure landing zones Strong Apache Spark skills — PySpark or Scala, optimisation, partitioning, and job scheduling in Databricks Experience assessing and remediating partially built or vendor-abandoned data platform ...

experience in software engineering, MLOps, and deploying machine learning models at scale. Proficiency in SQL, Python, and familiarity with big data technologies (e.g., Kafka, Spark) and/or cloud platforms (e.g., GCP, AWS, or Azure). Industry knowledge: Experience in gaming or digital entertainment is a strong plus. This ...

auction systems Excellent communication skills, able to explain complex technical systems to commercial, operations and senior leadership teams. Experience with Google Cloud, Docker, Kafka, Spark, Airflow, ElasticSearch, ClickHouse or similar production infrastructure Experience owning product roadmaps, release governance or cross-functional delivery across distributed teams and time zones. What ...

Scalable data storage & data lakes AWS Glue - Data integration, ETL & preparation Amazon Redshift & Athena - Data warehousing & serverless analytics Amazon EMR - Big data processing & Spark Amazon Bedrock - Generative AI & foundation models AWS Lambda - Serverless data & AI workflows Amazon QuickSight - BI, dashboards & visualisation Python, SQL, R & PySpark - Data science & analytics ...

auction systems Excellent communication skills, able to explain complex technical systems to commercial, operations and senior leadership teams. Experience with Google Cloud, Docker, Kafka, Spark, Airflow, ElasticSearch, ClickHouse or similar production infrastructure Experience owning product roadmaps, release governance or cross-functional delivery across distributed teams and time zones. Experience ...

including feature engineering, model training, serving, monitoring and MLOps platforms. Technical depth - Hands-on coding capability in data languages such as Python, SQL and Spark, enabling credibility with engineering teams and active participation in data work. Data engineering patterns - Strong understanding of ETL and ELT patterns, data quality frameworks ...

experience in software engineering, MLOps, and deploying machine learning models at scale.* Proficiency in SQL, Python, and familiarity with big data technologies (e.g., Kafka, Spark) and/or cloud platforms (e.g., GCP, AWS, or Azure).* Industry knowledge: Experience in gaming or digital entertainment is a strong plus.*This ...

/GraphQL) Machine Learning: Foundations of MLflow, Weights & Biases, LoRA, PEFT, SageMaker, Vertex AI, AzureML, Kubeflow, Airflow, Prefect, TorchServe, Triton, vLLM, SHAP, LIME, pandas, Spark, SQL LLM tooling: Familiarity with LangChain, Semantic Kernel, prompt chaining, vector search, and context management Performance & observability: Skilled in debugging distributed systems, tuning ...

processes, and the adoption of new tools and frameworks. What you need to succeed: Python, SQL and a distributed framework like Spark; we use Databricks. Experience with marketing or attribution data, and a working understanding of how bidding platforms consume the signal you send them. You don’t need ...

libraries (e.g., scikit-learn, pandas, PyTorch or TensorFlow). Practical experience with Databricks, including MLflow for experiment tracking and model management, and Spark-based data processing. Familiarity with Generative AI concepts and tooling, including working with LLMs, prompt engineering, RAG patterns, and vector search. A solid understanding of MLOps ...

Private cloud platforms (HPE Private AI, Nvidia AI Enterprise, Dell AI Factories) Understanding of data engineering practices (ETL, data lakes, big data tools like Spark). Knowledge of designing scalable, distributed systems. Familiarity with model lifecycle management and MLOps practices. Ability to align AI initiatives with business outcomes ...

Private cloud platforms (HPE Private AI, Nvidia AI Enterprise, Dell AI Factories) Understanding of data engineering practices (ETL, data lakes, big data tools like Spark). Knowledge of designing scalable, distributed systems. Familiarity with model lifecycle management and MLOps practices. Ability to align AI initiatives with business outcomes ...

Private cloud platforms (HPE Private AI, Nvidia AI Enterprise, Dell AI Factories) Understanding of data engineering practices (ETL, data lakes, big data tools like Spark). Knowledge of designing scalable, distributed systems. Familiarity with model lifecycle management and MLOps practices. Ability to align AI initiatives with business outcomes ...

years' experience delivering enterprise data platforms or analytics solutions. Strong commercial experience delivering Databricks solutions. Consulting or customer-facing delivery experience. Strong understanding of Apache Spark, modern Lakehouse architecture and Unity Catalog. Experience with Azure, AWS or GCP. Experience implementing CI/CD and deployment automation. Excellent communication ...

inputs/outputs, and adherence to resiliency and security expectations Preferred qualifications, capabilities, and skills Experience with data lakehouse architectures using Delta Lake, Apache Spark, or similar open‐source frameworks Familiarity with AWS‐native data services such as Glue, Lake Formation, Redshift, or Athena Exposure to data governance ...

services, with secure integration of enterprise data sources. AWS engineering experienceincluding containers, Kubernetes, CI/CD , a pplication resilience and security . Experience with Apache Spark or similar data-processing frameworks and large structured datasets. Sound judgement when using AI-assisted development tools , including validation of outputs ...