176 to 200 of 313 PySpark Jobs in the UK

Physics, Statistics, or a related quantitative field. Core Technical Stack: Hands-on proficiency with Python, SQL, and Excel, alongside exposure to platforms like Databricks, PySpark, Palantir Foundry, or R. Specialized Experience: Proven track record in delivering advanced analytics, algorithm design, operational research, or big data engineering solutions. Energy & Utilities ...

financial instruments and market data symbology, with an interest in developing further expertise in these areasProficiency with SQL and Python for exploratory data analysis (PySpark, pandas, Jupyter Notebooks)Ability to document and clearly explain complex data analysis findingsExceptional attention to detail and effective communication skillsAbility to think both independently ...

instruments and market data symbology, with an interest in developing further expertise in these areas Proficiency with SQL and Python for exploratory data analysis (PySpark, pandas, Jupyter Notebooks) Ability to document and clearly explain complex data analysis findings Exceptional attention to detail and effective communication skills Ability to think ...

production settings Experience with multimodal modelling (e.g. text + image) Familiarity with human-in-the-loop systems or moderation workflows Experience with Databricks, PySpark, or large-scale data processing systems Additional Information Health + Mental Wellbeing PMI and cash plan healthcare access with Bupa Subsidised counselling and coaching with ...

Engineer and Tech Lead to architect and build scalable cloud-native data platforms with Azure Databricks. You will lead ETL/streaming pipelines using PySpark, Delta Lake and Delta Live Tables, ensuring governance and cost control across enterprise workloads. You will mentor engineers, drive CI/ ...

hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well-governed data assets … data programme - designing, building, and maintaining data pipelines that process large volumes of data across a modern AWS-native stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics, you will help deliver reliable ...

Configure data ingestion processes and solutions. Lead the execution of Microsoft Fabric migration activities. Lead and guide migration engineers and QA resources. Develop Python, PySpark and Spark SQL code for data validation and curation within notebooks. Create data integration test cases and support testing activities. Implement and amend data … Databricks o Azure Functions o Azure App Service o Logic Apps o Azure Kubernetes Service (AKS) o Web Apps Hands-on expertise in PySpark, SQL and Python. Good knowledge of real-time streaming applications, preferably including Kafka, Azure Functions or Azure Service Bus. Strong understanding of Spark processing ...

associated Azure technologies. Build scalable ETL/ELT pipelines to ingest, transform, and load data from multiple enterprise systems. Develop data transformations using PySpark, Spark SQL, SQL, and Python. Create and maintain curated datasets that support business intelligence, reporting, and analytics. Implement data quality, reconciliation, validation, and monitoring processes. … business intelligence solutions. Strong proven commercial experience with Databricks. Strong experience developing ETL/ELT pipelines and data integration solutions. Experience using Apache Spark, PySpark, and Spark SQL. Strong SQL development and optimisation skills. Experience working with large and complex datasets from multiple source systems. Knowledge of data modelling ...

ideas flowing, typically once a quarter. Prefer being in the office more often? That works for us too. If you’ve strong experience with PySpark, Python and SQL, we’d love to hear from you. Core skills we’re looking for to succeed in the role: Cloud & Data Engineering … bring expertise in modern cloud platforms, delivering scalable and robust data solutions, with engineering and database skills in PySpark, Python, SQL Server and/or Azure (Data Factory, Synapse) and the associated ETL technologies. Problem‐Solving & Innovation: You’ll thrive on tackling complex challenges, finding creative solutions, and approaching ...

About the Opportunity Sun Chemical is seeking an experienced Data Architect II to join our Corporate IT team and drive the modernization of our enterprise data ecosystem. This is a unique opportunity to architect cutting ...

analyse trends to help teams derive value from data. The role involves working with SQL and Python, plus Power BI or Tableau, with PySpark, SparkSQL, and Git experience considered a bonus. The position is permanent, offering £50,000 to £65,000 plus a bonus, and is mainly remote with ...

CreateFuture is seeking a Senior Data Engineer to lead production data pipelines built on Microsoft Fabric, Python, and PySpark. You will translate data requirements into robust, maintainable solutions while mentoring engineers and shaping architecture with ...

more value from their data. You’ll need strong SQL and Python skills, along with experience using Power BI or Tableau. Experience with PySpark, SparkSQL, Git or LLM and AI tools would be a bonus. Permanent role with an ASAP start, paying £50,000 to £65,000 depending ...

deliver high-quality data products and insights. We are looking for people with extensive commercial experience with AWS Glue, developing Glue Jobs using PySpark and Python, AWS Glue Data Catalog, Crawlers, Workflows and triggers, Amazon S3 data lake implementation and management, AWS IAM roles, policies and security best practice. ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTClient Advisory & Translation: Sit directly alongside clients, distinguish their goals ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTClient Advisory & Translation: Sit directly alongside clients, distinguish their goals ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark ark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish ...

platform environments, ideally supporting production systems and external clients Advanced working knowledge of at least one data/query language (e.g. SQL, Python, or PySpark), with the ability to debug complex issues, analyse data, and build queries/scripts independently Deep experience working with data pipelines, transformations, and diagnosing ...

data. What Were Looking For Degree in Statistics, Mathematics, Physics, Economics, or a related quantitative field. Strong programming skills Python and SQL are essential; PySpark experience is highly advantageous. Experience with version control tools (e.g. GIT). Solid understanding of analytical technologies, tools, and techniques. Excellent logical thinking ...

What We\’re Looking For Degree in Statistics, Mathematics, Physics, Economics, or a related quantitative field. Strong programming skills — Python and SQL are essential; PySpark experience is highly advantageous. Experience with version control tools (e.g. GIT). Solid understanding of analytical technologies, tools, and techniques. Excellent logical thinking ...

unlock business value. You will collaborate with data scientists, analysts and software engineers, implement governance and security, and contribute to engineering standards. Strong PySpark and SQL skills, plus experience with cloud platforms are essential for success. #J-18808-Ljbffr ...

clientsFull SDLC process experienceExcellent communications skills, both written and verbalBonus Points: Experience with the Go Lang eco-system tools and librariesExperience with Pandas and PySpark libraries would be a plusTechnical experience with Databricks or any similar Delta Lake platforms. Experience working with large datasetsExperience with AWS cloud deployments ...

This is a hands-on architecture role combining technical leadership, solution design, stakeholder engagement, and delivery oversight. Essential Technical Skills Data Integration & Development Python PySpark SQL and T-SQL Spark SQL XML XSD (XML Schema Definition) XPath XSLT JSON REST APIs Data warehousing methodologies Master Data Management (MDM) Metadata … experience designing and implementing enterprise-scale Azure data platforms. Strong hands-on experience with Azure Data Factory. Strong hands-on experience with Azure Databricks, PySpark, and Delta Lake. Proven experience architecting complex ETL/ELT data integration solutions. Strong experience working with XML, XSD schema validation, XPath, and XSLT ...

WhereLeamington SpaWhatI.T. & CommunicationsTypePermanentSalaryAnnualSenior Data Engineer - Remote(Senior Data Engineer, Data Engineer, SQL, T-SQL, SQL Server, Azure SQL, Python, PySpark, Microsoft Fabric, Databricks, Synapse, Delta/Parquet, Power BI, Agentic AI, Infrastructure as code, IaC, CI/CD, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data … experienced Data Engineer with a deep knowledge of SQL and T-SQL on SQL Server/Azure SQL, data modelling experience and strong Python (PySpark, notebooks). Exposure to Microsoft Fabric is required, or at least Databricks/Synapse and the Delta/Parquet ecosystem, as well as Power ...

Senior Data Engineer – Remote (Senior Data Engineer, Data Engineer, SQL, T-SQL, SQL Server, Azure SQL, Python, PySpark, Microsoft Fabric, Databricks, Synapse, Delta/Parquet, Power BI, Agentic AI, Infrastructure as code, IaC, CI/CD, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … experienced Data Engineer with a deep knowledge of SQL and T-SQL on SQL Server/Azure SQL, data modelling experience and strong Python (PySpark, notebooks). Exposure to Microsoft Fabric is required, or at least Databricks/Synapse and the Delta/Parquet ecosystem, as well as Power ...