101 to 125 of 254 Apache Spark Jobs in London

scale datasets Preferred Qualifications Knowledge or interestin investment banking or financial instruments Experience with big data concepts, such as Lakehouse, ETL data pipelines (e.g. Spark, AWS Glue) Experience with near real time and event-based systems like Kafka Goldman Sachs Highlights At Goldman Sachs, we commit our people, capital ...

Data Intelligence Platform working against their real data and workloads, not slideware. Meet technical buyers on their own ground across modern data engineering (Spark, Delta, streaming), machine learning, and Generative AI, and integrate cleanly with their existing cloud and open-source stack. Move at start-up speed: qualify quickly ...

Company Description Company DescriptionPublicis Media harnesses the power of modern media through leading agency brands Dysrupt, Infinite Roar, Publicis Collective, Publicis Health Media, Spark Foundry, Starcom and Zenith, as well as global accelerator PMX; immersive experience group PMCI and access to integrated platform-based technologies and offerings from ...

work. Technologies and Tools Python Machine learning frameworks (e.g. PyTorch, TensorFlow, scikit-learn) ML/MLOps tooling (e.g. SageMaker, MLflow, TFServing) Spark and Databricks AWS services (e.g. IAM, S3, Redis, ECS) CI/CD tooling and best practices Streaming and batch data systems (e.g. Kafka, Airflow, RabbitMQ) Additional Information ...

power, and deep knowledge of just about every industry. We believe a mix of data, analytics, automation, and responsible AI can do almost anything- spark digital metamorphoses, widen the range of what humans can do, and breathe life into smart products and services. Want to join our crew ...

production. Experience working with large, complex and varied datasets. Experience with modern cloud and Data Science technologies such as AWS, Azure, Databricks, Snowflake, Spark or similar. Strong stakeholder management skills, with the ability to explain complex technical concepts clearly and influence decision-making. Strong commercial awareness and the ability ...

processes, and the adoption of new tools and frameworks. What you need to succeed: Python, SQL and a distributed framework like Spark; we use Databricks. Experience with marketing or attribution data, and a working understanding of how bidding platforms consume the signal you send them. You don't need ...

libraries (e.g., scikit-learn, pandas, PyTorch or TensorFlow). Practical experience with Databricks, including MLflow for experiment tracking and model management, and Spark-based data processing. Familiarity with Generative AI concepts and tooling, including working with LLMs, prompt engineering, RAG patterns, and vector search. A solid understanding of MLOps ...

Private cloud platforms (HPE Private AI, Nvidia AI Enterprise, Dell AI Factories) Understanding of data engineering practices (ETL, data lakes, big data tools like Spark). Knowledge of designing scalable, distributed systems. Familiarity with model lifecycle management and MLOps practices. Ability to align AI initiatives with business outcomes ...

years' experience delivering enterprise data platforms or analytics solutions. Strong commercial experience delivering Databricks solutions. Consulting or customer-facing delivery experience. Strong understanding of Apache Spark, modern Lakehouse architecture and Unity Catalog. Experience with Azure, AWS or GCP. Experience implementing CI/CD and deployment automation. Excellent communication ...

quality, lineage, and performance across the ML lifecycle. Preferred Qualifications & Skills Strong programming background in Python. Proficiency in distributed data-processing technologies (e.g., Ray, Apache Spark, Flyte, Dask). Hands-on experience with cloud infrastructure (AWS, GCP, or Azure), Kubernetes, and distributed training frameworks (Ray, RLLib, PyTorch ...

inputs/outputs, and adherence to resiliency and security expectations Preferred qualifications, capabilities, and skills Experience with data lakehouse architectures using Delta Lake, Apache Spark, or similar open‐source frameworks Familiarity with AWS‐native data services such as Glue, Lake Formation, Redshift, or Athena Exposure to data governance ...

data pipelines. Strong SQL, including performance tuning on large tables. Python for data transformation and pipeline orchestration. Experience with a distributed query engine (Presto, Spark, Hive or similar) and a workflowscheduler (Airflow or similar). Comfortable working in a code review based workflow with Git. Ability to work ...

architecture, distributed data systems, orchestration, governance, and scalable data product design Experience with technologies and ecosystems such as GCP, AWS, Azure, Databricks, Snowflake, Kafka, Spark, dbt, Kubernetes, Airflow, ML/AI enablement, or similar modern platform tooling Strong commercial acumen and ability to engage credibly with senior technical ...

implementations as lead or architect Deep Unity Catalog experience: you have configured it, not just used it, including RBAC on sensitive data Strong PySpark, Spark SQL and Delta Lake, including performance tuning at scale Production pipeline experience with Lakeflow/DLT, Workflows and DABs Desirable: Databricks Certified Data Engineer ...

concepts. Proficiency in programming languages like Python (with libraries like TensorFlow, PyTorch, scikit-learn). Experience with data wrangling tools and technologies (e.g., SQL, Spark). Excellent communication and collaboration skills to work effectively with cross-functional teams. A passion for innovation and a strong desire to apply ...

about you: Strong Python knowledge. Ability to read through code. Demonstrable experience collaborating with engineers. Experience with big data technologies such as Hadoop, Spark, or similar. Familiarity with cloud platforms (e.g., AWS, GCP, Azure) and data warehousing solutions. Strong knowledge in at least a few of the following areas ...

experience in software engineering, MLOps, and deploying machine learning models at scale.* Proficiency in SQL, Python, and familiarity with big data technologies (e.g., Kafka, Spark) and/or cloud platforms (e.g., GCP, AWS, or Azure).* Industry knowledge: Experience in gaming or digital entertainment is a strong plus. ...

read through code, especially Java. Demonstrable experience collaborating with engineering on services Experience working with large datasets and data processing technologies (e.g., Hadoop, Spark, SQL) Familiarity with anomaly detection, supervised and unsupervised learning methods, and real-time data analysis Experience with statistical analysis and good presentation skills to drive ...

designing and enforcing data contracts and quality SLAs in distributed data ecosystems. Proficiency in Python, Java, or Scala, and experience building pipelines with Databricks, Spark, or Kafka. Strong understanding of data governance principles, privacy regulations (GDPR, CCPA), and secure data handling practices. Familiarity with metadata management and data catalog ...

training, GPU workloads, and the full MLOps lifecycle (tracking, registry, serving, monitoring). Proficiency in Python and the ML ecosystem (PyTorch/Transformers, MLflow, Spark), and comfort building production-quality reference implementations. Experience with the Databricks platform — or the ability to ramp on it quickly — including Mosaic AI, Model ...

Feast, AWS Feature Store) Experience with containerisation (Docker) and orchestration (Kubernetes, ECS) Familiarity with Infrastructure as Code (Terraform, CloudFormation) Experience with data processing frameworks (Spark, Dask) for large-scale workloads Understanding of data governance and compliance frameworks Experience working in regulated industries (finance, healthcare, or similar) Security Clearance ...

software engineers and product managers to deliver robust data solutions. The role requires 7+ years in data engineering, including leadership, and strong expertise in Apache Spark and Azure Data Factory, with hands-on cloud experience across Azure/AWS/GCP. #J-18808-Ljbffr ...

support data pipelines, ensuring they are production-ready and meet data quality standards. You will work with technologies such as Python, SQL, and Apache Spark, helping drive analytics and operational decision-making. Ideal candidates possess strong programming skills, a relevant degree, and a collaborative spirit, as you will ...

scientists in the "PyData" ecosystem (Numpy, Pandas) is desirable. Familiarity with some of the other tools in our stack is desirable: Redis Postgres Airflow Spark This is a hybrid role based in London, UK. About Arrive Arrive, including brands like EasyPark, Flowbird, RingGo, ParkMobile and Parkopedia, is a leading ...