251 to 275 of 321 Permanent PySpark Jobs

bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise … help mature a growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ ...

bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise … help mature a growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ ...

plus 10% bonus and an extensive benefits package. What you'll be doingDesign, build and maintain scalable data pipelines and data products using Databricks, PySpark, Spark SQL and Delta Lake.Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems.Shape enterprise data … engineer and help mature a growing data function.What you need to bring“Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc)Advanced SQL and Python coding skills.A track record of building and optimising enterprise-scale data pipelines and ETL/ ...

bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise … help mature a growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ ...

query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery Support the performance … engineering, integration and analytics challenges Collaborate with experienced engineers, architects and data specialists in supportive, multidisciplinary teams Develop expertise across cloud-native data services, PySpark, SQL and modern engineering practices Access mentoring, knowledge sharing and development opportunities to help you grow your career Contribute to solutions that deliver measurable ...

Data Engineer (Azure | Databricks | PySpark | SQL) Contract | Remote | UK Public Sector Project We are seeking a Data Engineer to support delivery of key data components within our evolving data ecosystem. This role will work closely with architects, analysts, engineers, and wider delivery teams to implement pipeline builds, data models … resolution. Ensure documentation meets acceptance standards and is approved centrally. Actively engage in Agile ceremonies and governance forums. Mandatory Requirements Strong experience with Python, PySpark & SQL for data engineering. Hands-on experience with Azure Databricks. Strong knowledge of Azure Data Factory & Fabric. Experience with Microsoft Purview. Familiarity with Event ...

What you'll do Data Engineering Delivery: Design, build and optimise scalable data pipelines, ETL/ELT workflows and data transformation solutions using Databricks, PySpark, SQL and dbt Cloud, delivering trusted, high-quality data products that support reporting, analytics, AI and data science. Data Architecture & Modelling: Develop and maintain … Advanced Data Engineering Experience (5-8 Years): Strong hands-on experience designing, building and optimising enterprise-scale data pipelines and data platforms using Databricks, PySpark and advanced SQL. Cloud Data Platforms & Architecture: Proven experience working with Azure-based data technologies and designing scalable lakehouse architectures, data models and modern ...

ensure reporting is accurate and useful, and improve engineering standards while supporting colleagues. What you'll do ·Build and optimise pipelines using Azure Databricks, PySpark, SQL, ADF and ADLS Gen2. ·Develop governed lakehouse solutions using Delta Lake, medallion architecture and Unity Catalog. ·Own Power BI semantic models, DAX measures … documentation, Git and CI/CD. ·Mentor colleagues and share good practice across the team. What you'll bring ·Strong production experience with Databricks, PySpark, Delta Lake and Unity Catalog. ·Hands-on Power BI expertise, including data modelling, DAX, RLS and performance optimisation. ·Strong SQL skills and experience with ...

Senior Data Engineer - Python, SQL, Airflow, Azure, Pyspark, Kubernetes Salary: Up to 80,000 per annum Benefits: Excellent benefits package including annual bonus, free onsite gym, and company pension scheme. About the Role We are seeking an experienced Senior Data Engineer to join an innovative SaaS business that … Leadership & Mentorship Technology Stack The successful candidate will have experience working with some or all of the following technologies: Data Processing: Apache Spark/PySpark Workflow Orchestration: Apache Airflow Containerisation: Kubernetes Cloud Platform: Microsoft Azure Data APIs & Semantic Layer: CubeJS Programming Languages: Python, SQL Essential Skills & Experience Degree ...

Senior Data Engineer - Python, SQL, Airflow, Azure, Pyspark, Kubernetes Salary: Up to £80,000 per annum Benefits: Excellent benefits package including annual bonus, free onsite gym, and company pension scheme. About the Role We are seeking an experienced Senior Data Engineer to join an innovative SaaS business that … Leadership & Mentorship Technology Stack The successful candidate will have experience working with some or all of the following technologies: Data Processing: Apache Spark/PySpark Workflow Orchestration: Apache Airflow Containerisation: Kubernetes Cloud Platform: Microsoft Azure Data APIs & Semantic Layer: CubeJS Programming Languages: Python, SQL Essential Skills & Experience Degree ...

will play a key role in data-related activities for datasets used by Quants and Traders. The role requires strong SQL and Python skills (PySpark, Pandas, Jupyter Notebooks), plus experience with Airflow, Linux/Bash, and data-quality practices. You will collaborate with stakeholders and help improve data pipelines. ...

Arbuthnot Latham is seeking a Senior Data Engineer to develop and maintain data systems that support the Bank's operations and reporting needs. The role involves ensuring compliance with standards while mentoring junior team members. ...

data science, statistical modelling and using data to solve problems. Some experience with programming languages or analytical tools, such as Python, SQL, SAS or PySpark, gained through university projects, placements, internships or employment. An understanding of statistical concepts and an interest in predictive modelling or machine learning. Strong analytical ...

experience you will need for success Technical knowledge and experience: Proven experience using Databricks (essential) Strong programming skills in Python (essential) Experience working with: PySpark, Large‐scale data processing environments, Complex behavioural datasets Experience cleaning, preparing and processing: Large datasets, Real‐world data containing inconsistencies and anomalies, Data with ...

scale a global organization through resourcing/location strategy. Qualifications Proven track record delivering solutions in complex organizations. Experience with AWS, Databricks, DBT, PySpark, React, JavaScript Terraform, etc. Fast learner, thrives in ambiguity, translates vision into product scope. Passion for automation and user experience innovation. Builds high-performing teams ...

comfortable with large datasets, distributed processing and applying software engineering discipline to data products; Foundry experience is highly desirable but strong Python/PySpark engineers who can learn Foundry quickly are encouraged to apply. Extensive experience with Python and PySpark/Apache Spark. Proven track record designing ...

This is a hands-on architecture role combining technical leadership, solution design, stakeholder engagement, and delivery oversight. Essential Technical Skills Data Integration & Development Python PySpark SQL and T-SQL Spark SQL XML XSD (XML Schema Definition) XPath XSLT JSON REST APIs Data warehousing methodologies Master Data Management (MDM) Metadata … platforms. Strong hands-on experience with Azure Data Factory. Hands on knowledge of the Microsoft Fabric architecture. Strong hands-on experience with Azure Databricks, PySpark, and Delta Lake. Proven experience architecting complex ETL/ELT data integration solutions. Strong experience working with XML, XSD schema validation, XPath, and XSLT ...

solutions that enhance business decision-making. This is an exciting opportunity for a hands-on engineer with strong expertise in Databricks, Python, SQL, and PySpark , combined with practical experience using modern AI-assisted development tools such as GitHub Copilot, ChatGPT, Claude Code, Cursor, and VS Code . Key Responsibilities … practices. Required Skills & Experience 3+ years of experience within Data Engineering, Analytics Engineering, or Data Analytics. Strong hands-on experience with: Databricks SQL Python PySpark Delta Lake Experience designing ETL/ELT pipelines and data transformation frameworks. Strong understanding of data modelling, performance optimisation, and data quality practices. Experience ...

progressing its implementation and ongoing development. Developing and extending a medallion lakehouse architecture across bronze, silver and gold data layers. Working hands-on with PySpark notebooks, SQL, Dataflows Gen2 and data integration technologies. Developing robust ETL/ELT pipelines, bringing data together from multiple business systems and sources. Applying … ideally bring: Strong hands-on experience with Microsoft Fabric, including Lakehouse architecture and its wider data engineering capabilities. Good working knowledge of PySpark and Spark notebooks, with the ability to understand, troubleshoot and extend existing code. A solid understanding of data warehousing, ETL/ELT processes, data integration ...

understand their needs and translate them into technical solutions Transform data in Lakehouses and deliver clean, high-quality data for analysis and reporting Utilize PySpark to transform raw data into high-quality, analysis-ready products Implement rigorous automated data quality checks and proactive monitoring to ensure clean Data … Built and maintained data products using the Microsoft Data Stack (Azure Data Factory, Data Lake Storage, Fabric or Synapse Analytics) Expert-level proficiency in PySpark/Python Applied experience of DBT, AirFlow, or similar for data transformation and orchestration Deep understanding of data modeling, warehousing concepts, and the Medallion ...

Job Title Senior Data Engineer Job Description Summary Senior Data Engineer | Databricks | Agentic AI | EMEA & APAC We are the team leading the data transformation of our EMEA and APAC business, and we are hiring a ...

Join us, be part of more. We’re so much more than an energy company. We’re a family of brands revolutionising how we power the planet. We’re energisers. One team of 21,000 ...

Description Join us, be part of more. We're so much more than an energy company. We're a family of brands revolutionising how we power the planet. We're energisers. One team of 21 ...

Warehouse, pipelines, Dataflows Gen2, notebooks) Very good knowledge of Power BI: data modeling, DAX, semantic models Good SQL skills and experience with Python/PySpark Experience integrating data from various sources (APIs, files, databases, SaaS platforms) Experience with or a genuine interest in GenAI solutions for data, including text ...

Cognizant in London is seeking a Lead Developer to design, implement and optimize Python and cloud-based solutions using AWS and PySpark for data-intensive, regulatory-focused applications. Hybrid day shift model in Stratford London (3 days a week). You will own end-to-end technical delivery, ensure ...