51 to 75 of 126 PySpark Jobs

will have the following skills and experience: Deep expertise with Azure Databricks, including development, deployment, and platform-level engineering. Strong software engineering capability across Pyspark, Spark SQL and Azure Data Factory. Solid understanding of DevOps practices including CI/CD and automated testing. Experience with monitoring, logging, and alerting ...

improvement initiatives to uplift practices and delivery maturity. Required Technical Skills & Expertise AWS Data & Analytics (Hands-On Expertise) AWS Glue (ETL/ELT development, PySpark, Glue Catalog) Apache Spark AWS Redshift (modelling, optimisation) AWS Lambda AWS RDS AWS Step Functions Experience with Open Table Formats: Delta Lake Apache Hudi ...

data modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established … influence within the team and communicate clearly with technical and non-technical stakeholders. Data Engineer (New Technology/Microsoft) Strong experience with Databricks (Spark, PySpark, Delta Lake, and Unity Catalog advantageous). Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous). Experience contributing ...

basis, clarifying ownership and integration points, and capturing this information in a way that supports risk assessment and decommissioning decisions. Responsibilities: Python and PySpark are required as supporting capabilities, used where needed to analyse data pipelines and confirm how data moves and transforms in practice. The role also requires ...

Solid understanding of data architecture principles (data modelling, lineage, metadata) Experience designing enterprise data platforms and frameworks Hands-on experience with Python and Spark (PySpark preferred) Experience working in Agile environments with distributed teams Strong problem-solving and solution design capabilities Excellent communication and stakeholder management skills Nice ...

notebooks) Experience building or working within modern data warehouse architectures Ability to get up and running quickly without heavy onboarding Nice to have: Python, PySpark or Spark experience Exposure to APIs and external data integration Experience working in evolving or transforming data environments Most importantly, youll be someone ...

notebooks) Experience building or working within modern data warehouse architectures Ability to get up and running quickly without heavy onboarding Nice to have: Python, PySpark or Spark experience Exposure to APIs and external data integration Experience working in evolving or transforming data environments Most importantly, you’ll be someone ...

teams. What we're looking for: Strong people leadership experience (5+ team size) Solid Data Engineering/DataOps background Experience with AWS, Python/PySpark, ETL/ELT pipelines Strong understanding of data platforms (Data Lake/Lakehouse/EDW) Hybrid working (3 days in office) + strong bonus ...

xkybehq What we're looking for: Strong people leadership experience (5 team size) Solid Data Engineering/DataOps background Experience with AWS, Python/PySpark, ETL/ELT pipelines Strong understanding of data platforms (Data Lake/Lakehouse/EDW) Hybrid working (3 days in office) strong bonus ...

xkybehq What we're looking for: Strong people leadership experience (5+ team size) Solid Data Engineering/DataOps background Experience with AWS, Python/PySpark, ETL/ELT pipelines Strong understanding of data platforms (Data Lake/Lakehouse/EDW) Hybrid working (3 days in office) + strong bonus ...

Kubernetes Experience in creating production grade coding and SOLID programming principles, including test-driven development (TDD) approaches Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Experience in source-control software, e.g., GitHub Proficient at communicating results in a concise manner both verbally and written Experience in data ...

commercial or Agile environment. To be successful in this role it's essential that you will: Have experience of AWS , Python, SQL, Gitand PySpark Desirable experience needed will be: SISS or SAS experience Quality Assurance and Test Automation experience Experience of Database technologies Experience in Financial Services organisation About ...

commercial or Agile environment. To be successful in this role it's essential that you will: Have experience of AWS , Python, SQL, Gitand PySpark Desirable experience needed will be: SISS or SAS experience Quality Assurance and Test Automation experience Experience of Database technologies Experience in Financial Services organisation About ...

scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality, governance and observability practices. Modernise legacy systems and support large-scale migrations into Azure. Provide technical leadership … Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed processing. Proven experience in CI/CD practices using industry-standard tools (e.g., GitHub Actions ...

Data Engineer. Strong proficiency in Python and SQL , with solid experience working in cloud environments (AWS preferred). Skilled in transformation tools such as PySpark or Pandas . Knowledge of graph databases is an advantage but not required. Key skills & experience Experience using data quality frameworks (e.g., Great Expectations ...

machine learning operations. Excellent communication skills with the ability to influence cross-functional teams and stakeholders. Experience with Python, SQL, Java, HQL, Hive, Pyspark, or similar programming languages preferred Well-versed in design thinking principles Great problem-solving and analytical skills ...

data for critical client projects. How to develop and enhance your knowledge of agile ways of working and working in open source stack (PySpark/PySql). Quality engineering professionals utilise Accenture delivery assets to plan and implement quality initiatives to ensure solution quality throughout delivery. As a Data ...

Data Architect - Databricks - Hybrid A leading Microsoft partnered consultancy is seeking an experienced Data Architect to design and deliver modern data solutions built on Databricks Lakehouse Architecture. You'll work with a variety of enterprise ...

Data Architect - Databricks - Hybrid - Up to £125,000 A leading Microsoft partnered consultancy is seeking an experienced Data Architect to design and deliver modern data solutions built on Databricks Lakehouse Architecture. You'll work with ...

Data Architect - Databricks - Hybrid - Up to £125,000 A leading Microsoft partnered consultancy is seeking an experienced Data Architect to design and deliver modern data solutions built on Databricks Lakehouse Architecture. You'll work with ...

What We're Looking For Strong Data Engineering experience Python or Java + SQL + AWS Experience with Kafka/streaming frameworks Exposure to PySpark/data transformation tools Why Apply? Work on high-impact fraud prevention systems Modern tech stack (AWS, streaming, real-time data) Strong engineering culture ...

using Octopus Deploy or Azure functions/DevOpS is ideal. Experience working with big datasets. Develop and maintain data processing workloads using Python and PySpark, including notebook-based development where appropriate. Support the migration and modernisation of legacy databases and ETL processes to cloud-based architectures. Strong analytical ...

engineering is done across the organisation. Skills & Experience Strong hands-on experience with Azure data platforms Advanced SQL skills Commercial experience using Databricks and PySpark Proven background building and maintaining scalable data pipelines If you're looking for a role where you can combine technical depth, ownership, and influence ...

support reporting, analytics, and business operations. This includes developing ETL/ELT workflows using both low-code tools and code-based approaches (SQL, Python, PySpark), ensuring performance, scalability, and reliability across the data platform. You will take ownership of data modelling and architecture , designing scalable data warehouse and lakehouse … understanding of data modelling (star schema, dimensional modelling, lakehouse design) Experience building and optimising ETL/ELT pipelines using SQL, Python, and/or PySpark Knowledge of data governance, quality, and security best practices Experience implementing CI/CD pipelines and DevOps practices Ability to work independently and manage ...

AWS Data Engineer (Innovation Group) Location: London (Hybrid – 3 days per week) Duration: 6 Months Initial Contract Rate: TBD Are you a Data Engineer who thrives on building more than just standard ETL pipelines? Our ...