226 to 250 of 250 PySpark Jobs in the UK

Streams, Snowpipe, Snowpark, Distributed UDF/Sproc, Time Travel, Cloning) Demonstratable experience of delivering end to end pipelines in Snowpark (transferable frameworks such as Pyspark, Polars or Dask are also welcome). DBT including Jinja templating or equivalent transformation frameworks Python including build tools, test automation frameworks and engineering … long-term. Docker Java/Scala Event streaming technologies such as Kafka, Pulsar, or Azure Event Hub Integration with Collibra Apache Iceberg Apache Arrow Pyspark AI engineering (Snowflake AI, Langchain, Llamaindex, Pinecone, etc) Insight is committed to being an inclusive employer and encourages applications from all suitably qualified applicants ...

ability to contribute across the length and breadth of a projectProficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as neededExperience with cloud platforms (preferably AWS) and working knowledge … knowledge of the financial services industry and their IT systemsPreferred qualifications, capabilities, and skillsExperience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelinesIn-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

systems, including LLM-based applications and agentic architectures in regulated environments Proficiency in one or more programming languages, particularly Python and/or PySpark Advanced knowledge of software application development and technical processes in disciplines such as cloud, AI/ML, or data engineering Experience in large-scale data … analytical skills Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Hands-on expertise with Spark/PySpark and big data processing technologies Knowledge of open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model ...

environment Technical SkillsYou’ll have experience with some of the following:Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you’ve held any of these … Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. ...

Technical Skills You'll have experience with some of the following: Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these … Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every CV sent to clients, we donate ...

contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as needed Experience with cloud platforms (preferably AWS) and working knowledge … financial services industry and their IT systems Preferred qualifications, capabilities, and skills Experience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelines In-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

Staff Data Engineer | AWS | PySpark | Data Modernisation | London | Contract | Inside IR35 We're supporting a global, technology‐led organisation undertaking a large‐scale cloud data transformation programme. This is not a traditional data engineering role. The organisation is modernising hundreds of complex data pipelines, establishing reusable engineering patterns … culture. Responsibilities Defining technical standards and engineering patterns for a large‐scale data modernisation programme Re‐engineering complex legacy data pipelines into production‐grade PySpark Building scalable, reusable data movement frameworks across multiple engineering teams Driving best practice around AWS Glue, Apache Spark and Apache Airflow Designing high‐quality ...

data setsProgramming experience (focus on machine learning): SQL and Python’s Data Science stack; good knowledge of at least one big data framework (e.g., PySpark, Hive, Hadoop) is a plus. R, SPSS, and SAS are considered nice-to-haveStrong understanding of machine learning methods and experience applying them … technologies into production or applied business environments is a plusWhile we advocate using the right tech for the right task, we often leverage: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such ...

seeking an experienced Cloud Data Engineer to design, build, and maintain scalable cloud-based data platforms and analytics solutions using AWS, Snowflake, dbt, PySpark, and SQL. The role focuses on ETL/ELT development, data warehousing, performance optimization, and regulatory domain experience, with hybrid work blending company offices, client ...

Data Scientist Slough - 2 days per week Up to £520 per day - inside IR35 Initial 6 month contract SQL/Python/PySpark/NLP/Gen AI/Azure This is a hands-on Data Scientist role within the Journey Insights team, focused on building and delivering data … techniques, including text classification, summarisation, entity extraction, embeddings, retrieval-augmented generation (RAG) and LLM-enabled workflows Strong programming expertise in SQL, Python and PySpark, applying software engineering best practices such as code readability, version control, testing and reproducibility Experience deploying data science models and products in cloud environments, ideally ...

pricing models with advanced data science techniques using WTW Radar and Emblem. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Create innovative data solutions and present actionable insights to stakeholders. Communicate results clearly to key decision-makers … Street Pricing. What we’re looking for: Experience in general insurance pricing with strong modelling skills. Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Experience with WTW Radar software is preferred. A quantitative degree in Mathematics ...

At M&G our purpose is to give everyone real confidence to put their money to work. As an international savings and investments business with roots stretching back more than 170 years, we offer a ...

structured investigations or prototypes.Curiosity and a learning mindset — tracking state-of-the-art advancements and evaluating their relevance.Strong data manipulation and engineering skills (e.g., PySpark, SQL, cloud-based data tooling).Strong communication skills, capable of explaining complex ideas to technical and non-technical audiences.Collaborative approach to working with … publications, workshops, industry collaborations).Familiarity with vector databases, embeddings, and retrieval techniques.Experience Working on large datasets (efficient loading, batching, and streaming) and related tooling (PySpark preferred).What you can expect from usWe won’t just meet your expectations. We’ll defy them. So you’ll enjoy the comprehensive rewards ...

prototypes. Curiosity and a learning mindset - tracking state‐of‐the‐art advancements and evaluating their relevance. Strong data manipulation and engineering skills (e.g., PySpark, SQL, cloud‐based data tooling). Strong communication skills, capable of explaining complex ideas to technical and non‐technical audiences. Collaborative approach to working with … industry collaborations). Familiarity with vector databases, embeddings, and retrieval techniques. Experience Working on large datasets (efficient loading, batching, and streaming) and related tooling (PySpark preferred). What you can expect from us We won't just meet your expectations. We'll defy them. So you'll enjoy ...

prototypes. Curiosity and a learning mindset - tracking state-of-the-art advancements and evaluating their relevance. Strong data manipulation and engineering skills (e.g., PySpark, SQL, cloud-based data tooling). Strong communication skills, capable of explaining complex ideas to technical and non-technical audiences. Collaborative approach to working with … industry collaborations). Familiarity with vector databases, embeddings, and retrieval techniques. Experience Working on large datasets (efficient loading, batching, and streaming) and related tooling (PySpark preferred). What you can expect from us We won't just meet your expectations. We'll defy them. So you'll enjoy ...

well as familiarity with software engineering best practices (such as version control, unit testing, CI/CD) and big data and cloud technologies (PySpark preferred). Experience training and deploying deep learning models in cloud environments (including GPU-enabled workflows) is a strong advantage.About us: Our vision at Tesco … well as familiarity with software engineering best practices (such as version control, unit testing, CI/CD) and big data and cloud technologies (PySpark preferred). Experience training and deploying deep learning models in cloud environments (including GPU-enabled workflows) is a strong advantage. About us Our vision ...

/operational information within related resolution and sampling timing and prescriptions for maintenanceImplement prognostic algorithms with different proprietary technologies and coding languages such a Pyspark , Python, PowerBIAnalyse diagnostics and maintenance dataMonitor prognostic system performances and statistical analysis on collected data to identify critical trends and conditions.Support prognostic algorithm verification … Electronics EngineeringExperience in railway domain (preferred) or other manufacturing industry such as avionics, automotive or R&D.Experience in coding with Python, SQL, preferably Pyspark, and versioning tools (SVN, Git)Familiar with PowerBI dashboard development.Able to interpret electrical drawings, system specification software specification (e.g., UML) and mechanical drawingsExperience in prediction ...

champion best practice methods; upskill the team through coaching and code reviews. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Communicate pricing proposals and insights clearly and persuasively to stakeholders at all levels. Collaborate with Modelling, Optimisation … insurance pricing. Strong technical expertise in predictive modelling techniques (e.g. GLMs and machine learning models). Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Experience with WTW Radar software and optimisation tools. A quantitative degree ...

custom data products — from client scoping and solution design to execution and ongoing delivery.Ensure high analytical and technical standards across the team, including SQL, PySpark, Python, and data validation best practices.Act as an escalation point for complex analytical challenges, providing hands-on guidance where needed.Partner closely with Engineering … perfect job for someone who has:Proven experience managing and mentoring data analysts or analytics teams.Strong hands-on experience with SQL and PySpark for data analysis — Must.Strong Python scripting experience — Must.Excellent communication skills in English, with the ability to translate complex analysis into clear business insights.Experience working directly with ...

champion best-practice methods; upskill the team through coaching and code reviews. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Communicate pricing proposals and insights clearly and persuasively to stakeholders at all levels. Collaborate with Modelling, Optimisation … problem solving capabilities with the ability to apply market standard pricing techniques to non-standard products. Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Technical expertise in predictive modelling techniques e.g. GLMs. Experience with WTW Radar ...

Quant Developer Location: London Hybrid Contract Opportunity (Inside IR35) Visa: Only British/ILR Role Overview We are seeking a technically strong Quant Developer to support Credit & Capital Management and Group Risk Analytics. You will ...

Technology Solutions Ltd. is seeking a Staff Data Engineer in London to lead modernisation of large-scale data pipelines. You will blend hands-on PySpark and Python with enterprise-wide technical influence across multiple teams. In this contract role, expect to define standards, build reusable data movement frameworks ...

Month FTC | £Market rate | 3 days per week Newcastle Assists in building and testing Lakehouse Core platform components under senior engineer direction. Implements defined PySpark transformation patterns and contributes to the shared platform library. Follows engineering standards and participates in peer review processes. Skills: PySpark basics; AWS data ...

Month FTC | £Market rate | 3 days per week Newcastle Assists in building and testing Lakehouse Core platform components under senior engineer direction. Implements defined PySpark transformation patterns and contributes to the shared platform library. Follows engineering standards and participates in peer review processes. Skills: PySpark basics; AWS data ...

production. Run discovery with senior stakeholders, shape scope, and translate ambiguous strategic problems into technical delivery plans. Build data integrations and pipelines using PySpark, Python and SQL, working with complex internal and third-party datasets. Design and implement AIP and workflow-driven solutions that put the platform deep into … solutions inside large enterprises. Lead-level Palantir (Foundry/AIP) experience strongly preferred , or an equivalent enterprise data platform background. Strong hands-on Python, PySpark and SQL. This is a building role, not an advisory one. A track record of owning engagements end to end rather than delivering ...