51 to 75 of 125 PySpark Jobs in the UK excluding London

skills Desirable SkillsExperience in data value management including governance, quality, and ownership Knowledge of cloud platforms such as Azure or AWS Familiarity with Python, PySpark, data lakes, and data warehousing concepts Understanding of DevOps, automated testing, and release management Knowledge of insurance principles or claims processes Experience working ...

implement batch and streaming data pipelines using Databricks (Spark), Delta Lake , and orchestrators (e.g., Workflows , Airflow, ADF). Develop and optimize Spark jobs (PySpark/Scala) and SQL transformations for performance, reliability, and cost efficiency. Build and maintain curated data models (bronze/silver/gold), data quality checks … Required qualifications, skills and capabilities Experience with building data pipelines on Databricks and/or Apache Spark in production. Strong coding skills in Python (PySpark) and SQL (Scala a plus). Hands-on experience with Delta Lake (MERGE/UPSERT patterns, schema evolution, partitioning, Z-ORDER, OPTIMIZE/VACUUM ...

Machine Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications• Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications• Advanced Data Management – Strong SQL design, query ...

Skills – Able to extract meaningful insights from complex datasets and demonstrate clear business impact. Technical Expertise – Strong experience with SQL, Power BI, Python/PySpark; Databricks is a plus but not essential. Stakeholder Management – Confident in engaging with senior stakeholders, translating data into compelling narratives that drive business decisions. ...

experience with Axiom (plus) and regulatory reporting flows (plus) Excellent communication; proven stakeholder engagement Ability to learn/adapt to new technologies Skilled PySpark, HDFS, SQL, Airflow, data modeling, and ETL processing. Familiarity with GitLab and Jupyter Notebook is preferred, and knowledge of Java will be considered an added ...

languages eg. Python, R, Scala, etc.(Python preferred) Strong proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies eg. pySpark, Hive, etc. Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings, video, etc. Knowledge of machine learning modelling techniques ...

work effectively with both technical teams and senior business stakeholders. Experience across areas such as Medallion Architecture, Microsoft Purview, data governance, Python/PySpark, real-time/streaming, metadata-driven engineering or AI-enabled data products would be advantageous, but we're not expecting one person to tick every ...

datasets for modelling and analysis. Strong background in NLP and GenAI techniques, including text classification, summarization, and embeddings. Advanced proficiency in SQL, Python, and PySpark, with a focus on software development best practises. Experience deploying data science models in a cloud environment (Azure preferred). Familiarity with database management ...

data modelling experience. Strong understanding of ETL/ELT architecture and data integration frameworks. AWS experience including services such as S3, Glue, EMR, and PySpark . Experience defining data standards, governance frameworks, and architectural roadmaps. Desirable Experience with Iceberg and modern lakehouse architectures. Exposure to AI-enabled data platforms ...

functional teams to deliver high-quality technical solutions. Support the ongoing maintenance and optimisation of platform services. Essential Skills & Experience Hands-on experience with PySpark for data transformation and processing. Experience working with AWS data services , including: AWS Glue Amazon S3 Experience using Terraform for Infrastructure as Code. Experience ...

skills Formal training or certification on software engineering concepts and proficient applied experience Proficiency in Python is essential, with strong working knowledge of SQL, PySpark, Snowpark, or similar tools for data engineering and analytical workflows Hands-on practical experience in system design, application development, testing, and operational stability Hands ...

continuous integration/continuous delivery, application resiliency, and securityDemonstrated knowledge of software applications and technical processes within a technical discipline (e.g., cloud, Databricks, PySpark, artificial intelligence, machine learning, mobile, etc.)Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, testing ...

reliable, accurate, and delivered in a timely manner.Write clean, efficient, and well-documented code and test cases using tools like Python, SQL, and Pyspark (optional).Understands containerization and Kubernetes deployment using ArgoCD. Collaborate Across TeamsPartner with Senior Engineers in code reviews, design discussions, planning sessions and team ceremonies, asking ...

Senior Data Scientist Welwyn Garden City, Hertfordshire or Slough, Berkshire Hybrid (2 Days Office) Python SQL PySpark Azure Databricks Machine Learning Statistics Time Series Forecasting Propensity Models Role: Senior Data Scientist, Lead Data Scientist, ML Scientist, AI Data Scientist, Statistical Data Scientist, Predictive Analytics Key Skills: Senior Data Scientist ...

/modelling to data Programming in Python - Ability to code in python and contribute to codebases Data Manipulation - Experience querying large datasets (SQL/Pyspark) Machine learning/AI expertise - Advanced knowledge of ML/AI algorithms and their applications Financial domain knowledge - Understanding of banking products, risk frameworks ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTLead Client Advisory: Sit directly alongside clients, goals and requirements ...

Kubernetes Experience in creating production grade coding and SOLID programming principles, including test-driven development (TDD) approaches Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Experience in source-control software, e.g., GitHub Proficient at communicating results in a concise manner both verbally and written Experience in data ...

travel visas as required by travel needsPreferred qualifications• Additional data and analytics experience working with Hadoop framework and coding using Impala, Hive, or PySpark or working with data visualization tools (e.g., Tableau, Power BI)• Experience in credit risk analytics and modeling, including development and validation of risk models• Experience ...

scalable, high-quality data platform from the ground up. The Role Design and build scalable ETL/ELT pipelines in Microsoft Fabric using PySpark and SQL Develop transformation logic within Fabric Lakehouses using Delta Lake and medallion architecture principles Integrate data from ecommerce, ticketing, and marketing platforms into … Microsoft Fabric (Lakehouse, Warehouse, pipelines). Azure Data Factory experience will also be considered if no working experience with fabric Advanced SQL and strong PySpark experience Proficiency in Python for data processing and API integration Experience building Power BI models and dashboards for business reporting Strong understanding ...

etc.Experience implementing process improvements and automationStrong Python development skills (including Pandas and related data-processing libraries).Experience with big data technologies such as Spark, PySpark, Hadoop, and Hive.Exposure to quantitative modelling or financial modelling is a plus but not required.Skills that will help:Global Risk Management experienceBenefits of working ...

within the Microsoft ecosystem or Azure Exposure to tools such as Sparx Enterprise Architect or similar modelling tools Familiarity with technologies such as DBT, PySpark or Python is beneficial Interest in progressing into a data architecture focused role Ability to engage with both technical and non technical stakeholders APPLY ...

statistical methods/modelling to dataProgramming in Python - Ability to code in python and contribute to codebasesData Manipulation - Experience querying large datasets (SQL/Pyspark)Some other highly valued skills may include:Machine learning/AI expertise - Advanced knowledge of ML/AI algorithms and their applicationsFinancial domain knowledge ...

statistical methods/modelling to dataProgramming in Python - Ability to code in python and contribute to codebasesData Manipulation - Experience querying large datasets (SQL/Pyspark)Some other highly valued skills may include:Machine learning/AI expertise - Advanced knowledge of ML/AI algorithms and their applicationsFinancial domain knowledge ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish their ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTClient Advisory & Translation: Sit directly alongside clients, distinguish their goals ...