101 to 125 of 125 PySpark Jobs in the UK excluding London

Cyber Analytics team.You will need: A strong passion for big data, data modelling, data quality and ETLs. Solid programming experience with Python/PySpark along with proficiency in SQL. Extensive experience working with ETL and ELT frameworks and orchestration tools such as Airflow and dbt. Experience building robust data … Cyber Analytics team. You will need A strong passion for big data, data modelling, data quality and ETLs. Solid programming experience with Python/PySpark along with proficiency in SQL. Extensive experience working with ETL and ELT frameworks and orchestration tools such as Airflow and dbt. Experience building robust ...

Data Engineer £54-59,000 + bonus Hybrid Working – 1 day on-site per week West Midlands based I'm recruiting for a Data Engineer to join an established data team, working on the development ...

GBMs, Elastic Net GLMs, GAMs, Decision Trees, Random Forests, Neural Nets and Clustering Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Experience of WTW’s Radar software Proficient at communicating results ...

GBMs, GAMs, Random Forests, Neural Networks and clustering techniques Knowledge of statistics and distributions commonly used in insurance Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Proficient at communicating results in a concise manner both verbally and written Behaviours: Motivated by technical excellence Driven to deliver iterative ...

Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client is a global innovator and world leader … with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience is also key, as are excellent communication skills ...

ongoing performance and reliability of the SQL database estate. This role would suit a Data Engineer with strong Databricks, SQL and Python/PySpark expertise who enjoys solving technical challenges, improving data platforms and working collaboratively with both technical and non-technical stakeholders. Key Responsibilities Design, develop and maintain … Oxfordshire HQ Opportunity to join a growing Data & Innovation function Hands-on exposure to modern Microsoft data technologies including Databricks, SQL, Python and PySpark Opportunity to influence the development and maturity of the organisation's data platform Collaborative working environment with exposure to a broad range of data ...

Microsoft Fabric Data Engineer SQL, Python, PySpark Microsoft Fabric pipelines, Lakehouses, Warehouses and semantic models Microsoft Fabric Data Engineer – Contract (Hybrid 2-3 days/wk) Greater Manchester Our Financial Services client has a contract vacancy for an experienced Microsoft Fabric Data Engineer to join their Data & Business Architecture … quality and operational efficiency. Develop technical documentation, runbooks and support procedures. Skills & Experience Strong hands-on experience with Microsoft Fabric. Excellent SQL, Python and PySpark skills. Experience with Fabric Lakehouse, Warehouse, Pipelines and semantic models. Practical experience of Git, Azure DevOps and CI/CD. Strong troubleshooting and analytical ...

Data Engineer - Manchester (Hybrid) - Microsoft Fabric - Databricks - PySpark - Up to £55,000 We're partnering with a highly successful, private equity-backed organisation that is investing heavily in its data and technology capabilities. With a business-wide data transformation programme underway, this is a rare opportunity to join … Designing and building scalable ETL/ELT data pipelines. Microsoft Fabric, including Data Factory, Dataflow Gen2 and Fabric Notebooks. Databricks Workflows and Lakehouse technologies. PySpark, SQL and Delta Lake environments. Data ingestion, transformation and orchestration processes. Data governance, security and quality initiatives. Enterprise-wide analytics and reporting solutions, including ...

capabilities, and skills Hands-on experience delivering system design, application development, testing, and operational stability at enterprise scale Expertise in Python and/or PySpark Advanced knowledge of software application development and technical processes, with depth in disciplines such as cloud, AI/ML, or data engineering Experience … scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks ...

capabilities, and skills Hands-on experience delivering system design, application development, testing, and operational stability at enterprise scale Expertise in Python and/or PySpark Knowledge of software application development and technical processes, with depth in disciplines such as cloud, AI/ML, or data engineering Experience in large … scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks ...

capabilities, and skills Hands-on experience delivering system design, application development, testing, and operational stability at enterprise scale Expertise in Python and/or PySpark Knowledge of software application development and technical processes, with depth in disciplines such as cloud, AI/ML, or data engineering Experience in large … scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks ...

systems, including LLM-based applications and agentic architectures in regulated environments Proficiency in one or more programming languages, particularly Python and/or PySpark Advanced knowledge of software application development and technical processes in disciplines such as cloud, AI/ML, or data engineering Experience in large-scale data … analytical skills Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Hands-on expertise with Spark/PySpark and big data processing technologies Knowledge of open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model ...

Streams, Snowpipe, Snowpark, Distributed UDF/Sproc, Time Travel, Cloning) Demonstratable experience of delivering end to end pipelines in Snowpark (transferable frameworks such as Pyspark, Polars or Dask are also welcome). DBT including Jinja templating or equivalent transformation frameworks Python including build tools, test automation frameworks and engineering … long-term. Docker Java/Scala Event streaming technologies such as Kafka, Pulsar, or Azure Event Hub Integration with Collibra Apache Iceberg Apache Arrow Pyspark AI engineering (Snowflake AI, Langchain, Llamaindex, Pinecone, etc) Insight is committed to being an inclusive employer and encourages applications from all suitably qualified applicants ...

Data Engineer Up to £60,000 We are working with an organisation that is going through an exciting period of growth and continued investment across its technology and data landscape. With data playing an increasingly ...

Data Engineer Up to £60,000 We are working with an organisation that is going through an exciting period of growth and continued investment across its technology and data landscape. With data playing an increasingly ...

Data Engineer Up to £60,000 We are working with an organisation that is going through an exciting period of growth and continued investment across its technology and data landscape. With data playing an increasingly ...

Data Engineer Up to £60,000 We are working with an organisation that is going through an exciting period of growth and continued investment across its technology and data landscape. With data playing an increasingly ...

working partnersTechnical skills preferred in any or all of the following: Microsoft Excel, Google Suite, Atlassian Jira/Confluence, SQL, Python (Jupyter Notebook, Pandas, PySpark, etc.), Databricks, Bloomberg, Pitchbook, or other common financial services systems and applicationsHands-on SQL & Data Warehouse Experience: Strong proficiency using SQL and Databricks (PySpark ...

systems, including LLM-based applications and agentic architectures in regulated environments Proficiency in one or more programming languages, particularly Python and/or PySpark Advanced knowledge of software application development and technical processes in disciplines such as cloud, AI/ML, or data engineering Experience in large-scale data … analytical skills Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Hands-on expertise with Spark/PySpark and big data processing technologies Knowledge of open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model ...

contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as needed Experience with cloud platforms (preferably AWS) and working knowledge … financial services industry and their IT systems Preferred qualifications, capabilities, and skills Experience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelines In-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

ability to contribute across the length and breadth of a projectProficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as neededExperience with cloud platforms (preferably AWS) and working knowledge … knowledge of the financial services industry and their IT systemsPreferred qualifications, capabilities, and skillsExperience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelinesIn-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

blend of experience is expected as the business transitions to Microsoft Fabric, with key skills and core technologies including: SQL, Microsoft Fabric, Python/PySpark, Data Factory, etc. Exposure to and working with AI based tools such as Microsoft Copilot will certainly enhance candidate applications. Managerial and leadership experience … forward your most recent CV for consideration. BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/MICROSOFT FABRIC/PYTHON/PYSPARK/DATA WAREHOUSE/DATA LAKE/DATA FACTORY/HOME/BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/ ...

Month FTC | £Market rate | 3 days per week Newcastle Assists in building and testing Lakehouse Core platform components under senior engineer direction. Implements defined PySpark transformation patterns and contributes to the shared platform library. Follows engineering standards and participates in peer review processes. Skills: PySpark basics; AWS data ...

champion best-practice methods; upskill the team through coaching and code reviews. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Communicate pricing proposals and insights clearly and persuasively to stakeholders at all levels. Collaborate with Modelling, Optimisation … problem solving capabilities with the ability to apply market standard pricing techniques to non-standard products. Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Technical expertise in predictive modelling techniques e.g. GLMs. Experience with WTW Radar ...

Month FTC | £Market rate | 3 days per week Newcastle Assists in building and testing Lakehouse Core platform components under senior engineer direction. Implements defined PySpark transformation patterns and contributes to the shared platform library. Follows engineering standards and participates in peer review processes. Skills: PySpark basics; AWS data ...