51 to 75 of 150 PySpark Jobs in England

securityPractical cloud-native experiencePreferred Qualifications, Capabilities, and Skills:Experience with modern data technologies such as Databricks or SnowflakeHands-on experience with Spark/PySpark and other big data processing technologiesDemonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial intelligence, machine learning ...

MLflow, Airflow, model monitoring, API monitoring, data validation, data drift detection, autoscaling and access management.Strong Python experience, with helpful knowledge of Spark or PySpark for working with large-scale data and machine learning systems.An understanding of feature stores and related data technologies used to support operational machine learning products.Clear ...

Agentic AI, applied within enterprise environments.Experience with energy system modelling, grid analytics, demand forecasting or energy market data.Familiarity with distributed computing, Spark, PySpark or cloud-native data platforms.Experience developing models for planning, scenario analysis, operational decision support, model governance or regulatory reporting.Why Join CapcoDeliver high-impact technology and analytics ...

strong understanding of the Data Science Life Cycle including feature engineering, model training, and evaluation metrics Familiarity with ML frameworks, e.g., PyTorch, TensorFlow, PySpark Experience with large scale data processing systems, e.g., Spark Work in a way that works for youWe promote a healthy work/life balance across ...

methodology. Platforms & Tools Experience with Databricks (preferred) or similar platforms: Snowflake, BigQuery, Redshift, Synapse, or equivalent Strong proficiency with: SQL (advanced level) Spark/PySpark Data pipeline orchestration tools (e.g., Airflow, ADF, etc.) Data Modelling Extensive experience designing: Fact and dimension tables Star and snowflake schemas Aggregation layers ...

experience in CRM Analytics, Data Analytics, or related roles, ideally within the fashion, retail, or luxury sectorStrong proficiency in Databricks (SQL, Python, or PySpark) for data transformation and analysisSolid understanding of CRM principles, customer segmentation, and campaign measurement. Experience working with customer databases, CDPs, and marketing automation systems (e.g. ...

apply for travel visas as required by travel needsPreferred qualifications • Additional data and analytics experience in Hadoop framework and coding using Impala, Hive, or PySpark • Experience generating new knowledge or creating innovative solutions for a firm • Relevant industry expertise • Working knowledge of Cloud platforms (AWS; Azure; Google Coud ...

delivery · Prepare and structure data so that it can be used effectively by AI-enabled analytics and data platform capabilities. · Work with SQL, Python, PySpark, notebooks or platform-native tooling to transform, test and expose data for downstream AI and analytics use cases. · Collaborate with data engineers and architects … understanding of data engineering or analytics engineering concepts, including data modelling, pipelines, ELT/ETL, data quality and analytical data products. · Experience using Python, PySpark, notebooks or equivalent platform tooling for data preparation, analysis, testing or automation. · Understanding of semantic models, business definitions, metrics, metadata and how they improve ...

securityPractical cloud-native experiencePreferred Qualifications, Capabilities, and Skills:Experience with modern data technologies such as Databricks or SnowflakeHands-on experience with Spark/PySpark and other big data processing technologiesDemonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial intelligence, machine learning ...

Machine Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications• Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications• Advanced Data Management – Strong SQL design, query ...

outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

actively building, modernising and optimising data workloads within a large-scale, complex environment. What we’re looking for: Strong Spark/PySpark engineering Large-scale data pipeline development & modernisation Python and strong software engineering fundamentals Performance, scalability & workload optimisation Cloud data engineering – ideally AWS CI/CD and modern ...

datasets & commercial forecasting processes.Familiarity with web-analytics tools & optimizing user interfaces.Experience with survey exchange platforms or online market research products.Experience with Databricks, Spark, or PySpark for scalable data processing.Additional Information#LI-Remote#LI-JC1Our ValuesCollaboration is our superpowerWe uncover rich perspectives across the worldSuccess happens togetherWe deliver across borders.Innovation ...

LLMs for open-end generation.Experience with probabilistic modeling, or advanced profiling techniques.Familiarity with online market research or survey exchange platforms.Experience using Databricks, Spark, or PySpark for large-scale workflows.Additional Information#LI-RemoteOur ValuesCollaboration is our superpowerWe uncover rich perspectives across the worldSuccess happens togetherWe deliver across borders.Innovation ...

complex data led organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design ...

solution design, workshops and Proof of Concepts. What you'll bring: Proven experience designing enterprise data platforms using Microsoft Fabric. Strong knowledge of Spark, PySpark, Delta Lake, SQL and modern data engineering. Expertise with Microsoft Azure Excellent stakeholder management and consultancy experience. What's in it for you? 📍Remote ...

Azure Data Platform and Databricks ecosystem. The ideal candidate should have strong hands-on experience with Structured Streaming, Delta Live Tables (DLT), PySpark architecture, Python, and SQL, and a proven track record of delivering large-scale enterprise data platforms. Youll be responsible for: Leading the design, development, and implementation ...

Skills – Able to extract meaningful insights from complex datasets and demonstrate clear business impact. Technical Expertise – Strong experience with SQL, Power BI, Python/PySpark; Databricks is a plus but not essential. Stakeholder Management – Confident in engaging with senior stakeholders, translating data into compelling narratives that drive business decisions. ...

experience with Azure AI Search or other vector/hybrid search solutions, including vector search, hybrid search, and retrieval evaluation.Experience with Databricks and PySpark for large-scale data processing.Experience designing evaluation frameworks for LLM systems, including offline metrics, hallucination detection, and production monitoring.Experience implementing responsible AI practices ...

coding languages eg. Python, R, Scala, etc.; (Python preferred)Proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies e.g. pySpark, Hive, etc.Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings, video, etc.Knowledge of machine learning modelling techniques ...

languages eg. Python, R, Scala, etc.(Python preferred) Strong proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies eg. pySpark, Hive, etc. Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings, video, etc. Knowledge of machine learning modelling techniques ...

work effectively with both technical teams and senior business stakeholders. Experience across areas such as Medallion Architecture, Microsoft Purview, data governance, Python/PySpark, real-time/streaming, metadata-driven engineering or AI-enabled data products would be advantageous, but we're not expecting one person to tick every ...

datasets for modelling and analysis. Strong background in NLP and GenAI techniques, including text classification, summarization, and embeddings. Advanced proficiency in SQL, Python, and PySpark, with a focus on software development best practises. Experience deploying data science models in a cloud environment (Azure preferred). Familiarity with database management ...

also contribute to engineering excellence through best practices, mentoring, and thoughtful technical direction.Job responsibilitiesDesign scalable, reusable data processing and data quality frameworks using Python, PySpark, and dbtBuild and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observabilityDevelop and operate workflow orchestration (e.g., Apache Airflow … data movement and transformationsModel and transform data for analytics using SQL and dbt to support business intelligence and reporting workloadsWrite production-grade Python/PySpark code with disciplined testing, performance tuning, and maintainable object-oriented designImplement infrastructure-as-code (e.g., Terraform) to provision and manage cloud-based data platform ...

responsibilitiesDesign and implement batch and streaming data pipelines using Databricks (Spark), Delta Lake, and orchestrators (e.g., Workflows, Airflow, ADF).Develop and optimize Spark jobs (PySpark/Scala) and SQL transformations for performance, reliability, and cost efficiency.Build and maintain curated data models (bronze/silver/gold), data quality checks … realized by automationRequired qualifications, skills and capabilitiesExperience with building data pipelines on Databricks and/or Apache Spark in production.Strong coding skills in Python (PySpark) and SQL (Scala a plus).Hands-on experience with Delta Lake (MERGE/UPSERT patterns, schema evolution, partitioning, Z-ORDER, OPTIMIZE/VACUUM).Experience ...