101 to 125 of 249 PySpark Jobs in the UK

experience with Azure AI Search or other vector/hybrid search solutions, including vector search, hybrid search, and retrieval evaluation. Experience with Databricks and PySpark for large‐scale data processing. Experience designing evaluation frameworks for LLM systems, including offline metrics, hallucination detection, and production monitoring. Experience implementing responsible ...

experience in CRM Analytics, Data Analytics, or related roles, ideally within the fashion, retail, or luxury sectorStrong proficiency in Databricks (SQL, Python, or PySpark) for data transformation and analysisSolid understanding of CRM principles, customer segmentation, and campaign measurement. Experience working with customer databases, CDPs, and marketing automation systems (e.g. ...

cloud‐native experience Preferred Qualifications, Capabilities, and Skills Experience with modern data technologies such as Databricks or Snowflake Hands‐on experience with Spark/PySpark and other big data processing technologies Demonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial intelligence, machine ...

Machine Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications• Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications• Advanced Data Management – Strong SQL design, query ...

schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks environment Build data transformation logic using PySpark/Python (data cleansing, standardisation, validation) Configure monitoring, logging, and alerting Execute unit and integration testing across pipelines Core Skills: Azure Databricks Python Desirable ...

schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks environment Build data transformation logic using PySpark/Python (data cleansing, standardisation, validation) Configure monitoring, logging, and alerting Execute unit and integration testing across pipelines Core Skills: Azure Databricks Python Desirable ...

schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks environment Build data transformation logic using PySpark/Python (data cleansing, standardisation, validation) Configure monitoring, logging, and alerting Execute unit and integration testing across pipelines Core Skills: Azure Databricks Python Desirable ...

outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

operational consistency across a teamStrong communication and stakeholder management skills with the ability to translate technical concepts into business-friendly insightsPreferred:Experience with Python, PySpark, or ScalaExperience training, tuning, or optimizing AI agents and workflows for analytics, reporting, or client-facing use casesExperience supporting enterprise-level reporting or analytics ...

datasets & commercial forecasting processes.Familiarity with web-analytics tools & optimizing user interfaces.Experience with survey exchange platforms or online market research products.Experience with Databricks, Spark, or PySpark for scalable data processing.Additional Information#LI-Remote#LI-JC1Our ValuesCollaboration is our superpowerWe uncover rich perspectives across the worldSuccess happens togetherWe deliver across borders.Innovation ...

LLMs for open-end generation.Experience with probabilistic modeling, or advanced profiling techniques.Familiarity with online market research or survey exchange platforms.Experience using Databricks, Spark, or PySpark for large-scale workflows.Additional Information#LI-RemoteOur ValuesCollaboration is our superpowerWe uncover rich perspectives across the worldSuccess happens togetherWe deliver across borders.Innovation ...

complex data led organisation* Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI* Expertise in Streaming Data, Event Driven Design ...

complex data led organisation Deep understanding & hands‐on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design ...

complex data led organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design ...

solution design, workshops and Proof of Concepts. What you'll bring: Proven experience designing enterprise data platforms using Microsoft Fabric. Strong knowledge of Spark, PySpark, Delta Lake, SQL and modern data engineering. Expertise with Microsoft Azure Excellent stakeholder management and consultancy experience. What's in it for you? 📍Remote ...

genuinely strong at data engineering as a craft, not generalists who have only used platforms at a surface level.You will have:Strong experience building PySpark-based pipelines that run reliably in production.A solid grasp of Spark execution behaviour, including partitioning, shuffles, joins and performance trade-offs.Hands-on experience with ...

interest in developing into an architectural role Experience working closely with Data Engineers, Analytics teams, and business stakeholders Exposure to Microsoft Fabric, Databricks, Python, PySpark, or dbt would be beneficial Experience with data modelling tools such as Sparx EA, Sparx Enterprise Architect, Enterprise Architect, ER/Studio, ERwin, Erwin ...

Skills – Able to extract meaningful insights from complex datasets and demonstrate clear business impact. Technical Expertise – Strong experience with SQL, Power BI, Python/PySpark; Databricks is a plus but not essential. Stakeholder Management – Confident in engaging with senior stakeholders, translating data into compelling narratives that drive business decisions. ...

experience with Axiom (plus) and regulatory reporting flows (plus) Excellent communication; proven stakeholder engagement Ability to learn/adapt to new technologies Skilled PySpark, HDFS, SQL, Airflow, data modeling, and ETL processing. Familiarity with GitLab and Jupyter Notebook is preferred, and knowledge of Java will be considered an added ...

experience with Azure AI Search or other vector/hybrid search solutions, including vector search, hybrid search, and retrieval evaluation.Experience with Databricks and PySpark for large-scale data processing.Experience designing evaluation frameworks for LLM systems, including offline metrics, hallucination detection, and production monitoring.Experience implementing responsible AI practices ...

coding languages eg. Python, R, Scala, etc.; (Python preferred)Proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies e.g. pySpark, Hive, etc.Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings, video, etc.Knowledge of machine learning modelling techniques ...

languages eg. Python, R, Scala, etc.(Python preferred) Strong proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies eg. pySpark, Hive, etc. Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings, video, etc. Knowledge of machine learning modelling techniques ...

languages eg. Python, R, Scala, etc.(Python preferred) Strong proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies eg. pySpark, Hive, etc. Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings, video, etc. Knowledge of machine learning modelling techniques ...

work effectively with both technical teams and senior business stakeholders. Experience across areas such as Medallion Architecture, Microsoft Purview, data governance, Python/PySpark, real-time/streaming, metadata-driven engineering or AI-enabled data products would be advantageous, but we're not expecting one person to tick every ...

datasets for modelling and analysis. Strong background in NLP and GenAI techniques, including text classification, summarization, and embeddings. Advanced proficiency in SQL, Python, and PySpark, with a focus on software development best practises. Experience deploying data science models in a cloud environment (Azure preferred). Familiarity with database management ...