176 to 200 of 327 PySpark Jobs in the UK

cloud‐native experience Preferred Qualifications, Capabilities, and Skills: Experience with modern data technologies such as Databricks or Snowflake Hands‐on experience with Spark/PySpark and other big data processing technologies Demonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial intelligence, #J ...

data ecosystem. You will lead a small team, mentor junior engineers, and collaborate with stakeholders to deliver scalable data pipelines on Databricks using PySpark and Spark SQL. The role involves guiding data strategy, migrating legacy processes, and delivering enterprise data solutions in a cloud-native environment, with hybrid #J ...

scalable applications. You will own data analysis, system design, and the full software lifecycle from requirements gathering to deployment. The role emphasizes strong Python, PySpark, SQL skills, and experience with ETL, data modeling, and regulatory reporting flows. Collaboration with the Axiom team is also key. #J-18808-Ljbffr ...

Databricks-centric data platform in the insurance/fintech space. You will own architecture, strategy and roadmap for scalable data pipelines using Python, PySpark and SQL, while guiding a team of Data Engineers and collaborating with Risk, Quantitative Finance, Compliance and Data Science teams. Strong governance and stakeholder communication ...

opportunities and shaping hypotheses through to data exploration, feature engineering, model development, and deployment. Working with large and complex datasets, you'll use Python, PySpark, SQL, and Azure Databricks to develop robust predictive models and analytical solutions. Just as importantly, you'll be able to explain your findings ...

passion for solving complex data challengesWhile we advocate using the right tech for the right task, we often leverage the following technologies: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such ...

genomic data. You have A BSc or MSc in computer science or related fields Expertise in Python, including popular Python libraries: NumPy, Pandas, PySpark and frameworks: Django, Django Rest Framework, FastAPI Hands-on experience with both relational (e.g. PostgreSQL) and non-relational databases (e.g. Elasticsearch, Redis) Extensive experience ...

Physics, Statistics, or a related quantitative field. Core Technical Stack: Hands-on proficiency with Python, SQL, and Excel, alongside exposure to platforms like Databricks, PySpark, Palantir Foundry, or R. Specialized Experience: Proven track record in delivering advanced analytics, algorithm design, operational research, or big data engineering solutions. Energy & Utilities ...

financial instruments and market data symbology, with an interest in developing further expertise in these areasProficiency with SQL and Python for exploratory data analysis (PySpark, pandas, Jupyter Notebooks)Ability to document and clearly explain complex data analysis findingsExceptional attention to detail and effective communication skillsAbility to think both independently ...

instruments and market data symbology, with an interest in developing further expertise in these areas Proficiency with SQL and Python for exploratory data analysis (PySpark, pandas, Jupyter Notebooks) Ability to document and clearly explain complex data analysis findings Exceptional attention to detail and effective communication skills Ability to think ...

production settings Experience with multimodal modelling (e.g. text + image) Familiarity with human-in-the-loop systems or moderation workflows Experience with Databricks, PySpark, or large-scale data processing systems Additional Information Health + Mental Wellbeing PMI and cash plan healthcare access with Bupa Subsidised counselling and coaching with ...

Engineer and Tech Lead to architect and build scalable cloud-native data platforms with Azure Databricks. You will lead ETL/streaming pipelines using PySpark, Delta Lake and Delta Live Tables, ensuring governance and cost control across enterprise workloads. You will mentor engineers, drive CI/ ...

hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well-governed data assets … data programme - designing, building, and maintaining data pipelines that process large volumes of data across a modern AWS-native stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics, you will help deliver reliable ...

Configure data ingestion processes and solutions. Lead the execution of Microsoft Fabric migration activities. Lead and guide migration engineers and QA resources. Develop Python, PySpark and Spark SQL code for data validation and curation within notebooks. Create data integration test cases and support testing activities. Implement and amend data … Databricks o Azure Functions o Azure App Service o Logic Apps o Azure Kubernetes Service (AKS) o Web Apps Hands-on expertise in PySpark, SQL and Python. Good knowledge of real-time streaming applications, preferably including Kafka, Azure Functions or Azure Service Bus. Strong understanding of Spark processing ...

associated Azure technologies. Build scalable ETL/ELT pipelines to ingest, transform, and load data from multiple enterprise systems. Develop data transformations using PySpark, Spark SQL, SQL, and Python. Create and maintain curated datasets that support business intelligence, reporting, and analytics. Implement data quality, reconciliation, validation, and monitoring processes. … business intelligence solutions. Strong proven commercial experience with Databricks. Strong experience developing ETL/ELT pipelines and data integration solutions. Experience using Apache Spark, PySpark, and Spark SQL. Strong SQL development and optimisation skills. Experience working with large and complex datasets from multiple source systems. Knowledge of data modelling ...

ideas flowing, typically once a quarter. Prefer being in the office more often? That works for us too. If you’ve strong experience with PySpark, Python and SQL, we’d love to hear from you. Core skills we’re looking for to succeed in the role: Cloud & Data Engineering … bring expertise in modern cloud platforms, delivering scalable and robust data solutions, with engineering and database skills in PySpark, Python, SQL Server and/or Azure (Data Factory, Synapse) and the associated ETL technologies. Problem‐Solving & Innovation: You’ll thrive on tackling complex challenges, finding creative solutions, and approaching ...

About the Opportunity Sun Chemical is seeking an experienced Data Architect II to join our Corporate IT team and drive the modernization of our enterprise data ecosystem. This is a unique opportunity to architect cutting ...

analyse trends to help teams derive value from data. The role involves working with SQL and Python, plus Power BI or Tableau, with PySpark, SparkSQL, and Git experience considered a bonus. The position is permanent, offering £50,000 to £65,000 plus a bonus, and is mainly remote with ...

CreateFuture is seeking a Senior Data Engineer to lead production data pipelines built on Microsoft Fabric, Python, and PySpark. You will translate data requirements into robust, maintainable solutions while mentoring engineers and shaping architecture with ...

more value from their data. You’ll need strong SQL and Python skills, along with experience using Power BI or Tableau. Experience with PySpark, SparkSQL, Git or LLM and AI tools would be a bonus. Permanent role with an ASAP start, paying £50,000 to £65,000 depending ...

deliver high-quality data products and insights. We are looking for people with extensive commercial experience with AWS Glue, developing Glue Jobs using PySpark and Python, AWS Glue Data Catalog, Crawlers, Workflows and triggers, Amazon S3 data lake implementation and management, AWS IAM roles, policies and security best practice. ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTClient Advisory & Translation: Sit directly alongside clients, distinguish their goals ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTClient Advisory & Translation: Sit directly alongside clients, distinguish their goals ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark ark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish ...

platform environments, ideally supporting production systems and external clients Advanced working knowledge of at least one data/query language (e.g. SQL, Python, or PySpark), with the ability to debug complex issues, analyse data, and build queries/scripts independently Deep experience working with data pipelines, transformations, and diagnosing ...