51 to 75 of 153 PySpark Jobs in the UK excluding London

data architecture, data warehousing and cloud data platforms Hands-on experience with Azure technologies Experience developing ETL/ELT solutions Experience with Python, PySpark, Microsoft Fabric, streaming technologies or large-scale enterprise environments would be advantageous. In return they are offering A salary of up to £50,000 Hybrid ...

Azure/GCPExposure to LLM models like ChatGPT, Google Bard etc. Exposure to Langchain, RAG and Fine Tuning of the LLM Models. Exposure to PySpark and Databricks for Data pipeline creation. Familiarity with modern front-end technologiesExposure to cloud technologiesExperience with ReactJS front-end development is a plusJ.P. Morgan ...

/GCP Exposure to LLM models like ChatGPT, Google Bard etc. Exposure to Langchain, RAG and Fine Tuning of the LLM Models. Exposure to PySpark and Databricks for Data pipeline creation.Familiarity with modern front-end technologies Exposure to cloud technologies Experience with ReactJS front-end development is a plus ...

scaling patterns and reuse. Preferred qualifications, capabilities, and skillsExperience with modern data platforms such as Databricks or SnowflakeDeep hands-on experience with Spark/PySpark and other big data processing technologiesExpertise in open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks and model ...

Experience debugging moderately complex systems and improving reliability/performance Strong fundamentals: data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code ...

complex data led organisation* Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI* Expertise in Streaming Data, Event Driven Design ...

complex data led organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design ...

experience with Databricks — running queries, navigating Unity Catalog, reading Spark job outputs and understanding what they mean for data quality Working knowledge of PySpark or Spark SQL — enough to read pipeline code, understand transformations, and trace where data issues originate Understanding of Lakehouse/medallion architecture (bronze-silver-gold ...

Platforms: Google Cloud Platform, Amazon Web Services, Microsoft Azure, and Databricks. Experience in one or more of the listed Languages such as: Python, R, PySpark Experience in one or more of the following Agentic & Gen AI Platforms: such as Microsoft Copilot Studio, Adept AI, UiPath, OpenAI GPT-5 Agents ...

/GCP Exposure to LLM models like ChatGPT, Google Bard etc. Exposure to Langchain, RAG and Fine Tuning of the LLM Models. Exposure to PySpark and Databricks for Data pipeline creation. Familiarity with modern front-end technologies Exposure to cloud technologies Experience with ReactJS front-end development ...

Machine Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query ...

months Location: Northampton, UK --------------------------------------- JOB DETAILS Role Title: Sr Data Engineer • Minimum 6-8 years of experience working as Sr Data Engineer • Bigdata Technologies – PySpark, Spark • Coding Languages – Python, SQL • AWS services – Glue, Cloud formation, Lake Formation, IAM, Lambda, Redshift • Exposure to cloud technologies – Snowflake, Redshift, Apache Flink ...

successful candidate will design and implement modern data lakehouse architectures, ensuring high performance and scalability. Key responsibilities include developing data pipelines using Python and PySpark, working with AWS services, and implementing CI/CD pipelines. Strong experience in AWS Data Engineering and knowledge of data quality frameworks are essential. ...

understanding of DAG (Directed Acyclic Graphs) and their role in pipeline orchestration It would be nice if you could bring (desirables): Professional experience with PySpark, MySQL, Docker, Kubernetes Experience with best-practice pipeline orchestration software (Airflow, Dagster). Experience migrating code from prototype notebooks to .py, while maintaining logic ...

Skills – Able to extract meaningful insights from complex datasets and demonstrate clear business impact. Technical Expertise – Strong experience with SQL, Power BI, Python/PySpark; Databricks is a plus but not essential. Stakeholder Management – Confident in engaging with senior stakeholders, translating data into compelling narratives that drive business decisions. ...

experience with Axiom (plus) and regulatory reporting flows (plus) Excellent communication; proven stakeholder engagement Ability to learn/adapt to new technologies Skilled PySpark, HDFS, SQL, Airflow, data modeling, and ETL processing. Familiarity with GitLab and Jupyter Notebook is preferred, and knowledge of Java will be considered an added ...

languages eg.?Python, R, Scala, etc.(Python preferred) Strong proficiency in database technologies eg.?SQL, ETL, No-SQL, DW, and Big Data technologies eg.?pySpark, Hive, etc. Experienced working with structured and also unstructured data eg.?Text, PDFs, jpgs, call recordings, video,?etc. Knowledge of machine learning modelling techniques ...

commercial or Agile environment. To be successful in this role it’s essential that you will: Have significant experience of AWS , Python, SQL, Gitand PySpark Desirable experience needed will be: SISS or SAS experience Quality Assurance and Test Automation experience Experience of Database technologies Experience in Financial Services organisation ...

commercial or Agile environment. To be successful in this role it’s essential that you will: Have significant experience of AWS , Python, SQL, Gitand PySpark Desirable experience needed will be: SISS or SAS experience Quality Assurance and Test Automation experience Experience of Database technologies Experience in Financial Services organisation ...

Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics. You will implement Delta Live Tables, write PySpark and SQL in Fabric Notebooks and Databricks clusters, and ensure data access control, quality checks, and governance through Unity Catalog. #J-18808-Ljbffr ...

Delta Lake, with governance, security, and real-time processing at scale. The role sits in the Enterprise Data Team and requires strong SQL and PySpark, plus experience with cloud-native data platforms. Hybrid working available, with 2 days in the office and 3 days from home. #J-18808-Ljbffr ...

functional teams to deliver high-quality technical solutions. Support the ongoing maintenance and optimisation of platform services. Essential Skills & Experience Hands-on experience with PySpark for data transformation and processing. Experience working with AWS data services , including: AWS Glue Amazon S3 Experience using Terraform for Infrastructure as Code. Experience ...

hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well-governed data assets … data programme - designing, building, and maintaining data pipelines that process large volumes of data across a modern AWS-native stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics, you will help deliver reliable ...

Building and maintaining scalable data pipelines, pulling data in from core business systems and third-party sources. Designing and developing data solutions with Python, PySpark, SQL, notebooks and dataflows across a modern medallion architecture (Bronze, Silver, Gold). Creating and optimising data models that power high-quality Power … future analytics, AI and machine learning capability. Candidate Essential Experience, Qualifications and Skills Commercial data engineering experience (4+ years) SQL (4+ years) Python and PySpark (3+ years) Microsoft Fabric or an equivalent Azure data platform (2+ years) Medallion/layered lakehouse architecture (2+ years) Dimensional data modelling for analytics ...

Choose a partner with intimate knowledge of your industry and first-hand experience of defining its future.Your locationYour locationIndustriesChoose a partner with intimate knowledge of your industry and first-hand experience of defining its future.Birmingham ...