1 to 25 of 27 Permanent PySpark Jobs in the South East

transformation and orchestration pipelines, integrating data from cloud, on‐premises and third‐party business systems. Strong hands‐on capability with SQL, Python, Spark and PySpark for data engineering, analytics and automation workloads. Experience with Azure Databricks and/or Microsoft Fabric engineering workloads, including notebooks, Delta Lake, data transformation ...

standards and best practices. About you Extensive experience designing and delivering enterprise-scale data engineering solutions Strong hands-on experience with Azure Databricks, including PySpark, Delta Live Tables and Databricks Workflows and orchestration Microsoft Fabric experience, including Lakehouse, Data Factory, Warehouse and Spark Knowledge of Azure Data Platform services ...

pipelines, stored procedures and reporting solutions to cloud-based platforms. Exposure to Azure DevOps, Git and CI/CD practices. Experience with Python, PySpark, Power BI or real estate technology platforms would be advantageous. Previous exposure to commercial real estate, investment management or alternative asset management environments is highly ...

Python/Data Engineering professionals with a solid Azure foundation and the ability to learn and work across the wider platform. Desirable Databricks/PySpark NoSQL/Cosmos DB Infrastructure as Code/DevOps automation AI/ML data integration Automotive or insurance industry experience #J-18808-Ljbffr ...

EXPERIENCE You should have: Previous experience leading or managing Data Engineers Strong consulting or client-facing experience Advanced SQL and Python skills Experience with PySpark Experience with Azure, Microsoft Fabric and Databricks (or strong cloud data engineering experience) CI/CD and Git experience Power BI knowledge Experience building ...

hands-on experience with modern cloud data platforms (e.g. Databricks or Snowflake), ideally within AWS environments Advanced programming and data engineering skills in Python, PySpark and SQL, with a solid understanding of ETL pipelines and data transformation Proven experience in data modelling (end-to-end), including performance optimisation using ...

Strong hands-on experience with Quantexa implementation and development. Proven experience building and supporting big data platforms . Advanced knowledge of Apache Spark/PySpark . Strong programming skills in Scala and/or Python . Expertise in SQL and large-scale data modelling. Strong cloud experience across ...

particularly interested in engineers with strong hands-on Databricks experience. Essential Skills Commercial experience building solutions within Databricks. Strong hands-on expertise with PySpark, Spark SQL, and Delta Lake. Experience designing and supporting production-grade ETL/ELT pipelines. Strong Python and SQL development skills. Experience working with large ...

particularly interested in engineers with strong hands-on Databricks experience. Essential Skills Commercial experience building solutions within Databricks. Strong hands-on expertise with PySpark, Spark SQL, and Delta Lake. Experience designing and supporting production-grade ETL/ELT pipelines. Strong Python and SQL development skills. Experience working with large ...

solutions Strong stakeholder engagement and communication skills Agile delivery experience Desirable Experience Financial Services, Banking or Investment Management experience Microsoft Fabric Databricks Python or PySpark Data migration and transformation programmes Team leadership or mentoring experience Contract Details £650-£750 per day Inside IR35 6-Month Initial Contract Hybrid Working ...

Looking For Strong SQL Data Engineering or Analytics Engineering experience Databricks or comparable platforms such as Snowflake, Hadoop or SQL Server Python and ideally PySpark ETL/ELT and data modelling Strong problem-solving and critical-thinking skills Good understanding of data architecture and infrastructure Ability to work independently ...

data pipelines using Databricks, and develop ETL processes that prepare data for reporting and analytics. The role requires strong Databricks, SQL and Python/PySpark expertise, plus experience with relational databases and data modelling. #J-18808-Ljbffr ...

understanding of DAG (Directed Acyclic Graphs) and their role in pipeline orchestration It would be nice if you could bring (desirables): Professional experience with PySpark, MySQL, Docker, Kubernetes Experience with best-practice pipeline orchestration software (Airflow, Dagster). Experience migrating code from prototype notebooks to .py, while maintaining logic ...

data platform while delivering scalable, secure, and high-quality data solutions. What You'll Do Design, develop, and optimise Azure Databricks solutions using PySpark, Python, SQL, and Azure-native technologies. Build and maintain enterprise-grade ETL/ELT pipelines supporting ingestion, transformation, CDC, validation, and data delivery across multiple … that support organisational growth and strategic decision-making. What You'll Bring Proven experience designing and delivering solutions within Azure Databricks environments. Strong Python, PySpark, SQL, and T-SQL development skills. Expertise building and supporting large-scale ETL/ELT pipelines and cloud-based data platforms. Strong understanding ...

pipelines and collaborate with cross-functional squads to enable GenAI applications and analytics initiatives. You will work with modern cloud platforms, SQL, Python and PySpark to optimise data flows, ensure data quality and support data-driven decision making across the business. #J-18808-Ljbffr ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark ark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Client Advisory & Translation: Sit directly alongside clients, distinguish ...

maintaining data pipelines in Databricks Developing and optimising ETL/ELT processes across ingestion, transformation and integration Building data solutions in SQL, Python and PySpark Monitoring and improving data quality, reliability and platform performance Supporting SQL database administration, maintenance and optimisation Tuning queries, indexes and execution plans where performance … mature automation, documentation, development standards and CI/CD practice Essential Skills and Experience Strong experience with Databricks SQL server experience Solid Python and PySpark skills Experience using MS stack, Azure and Spark Familiarity with CI/CD and DevOps Why Apply? Base salary up to £60,000 Work ...

data modelling, semantic layers and Power BI delivery. You'll have the opportunity to: ·Design and build production-grade pipelines using Azure Databricks, Python, PySpark and SQL ·Develop scalable Lakehouse architecture using Delta Lake and Unity Catalog ·Build data and BI products from scratch and own them through … Claude and OpenRouter to support development, code review and documentation To succeed, you'll need: ·Strong production experience with Azure Databricks ·Advanced Python, PySpark and SQL skills ·Advanced Power BI, DAX and data-modelling experience ·Experience building and owning complex data or BI solutions end to end ·Confidence translating ...

using modern data engineering patterns Develop robust orchestration workflows for dependable data ingestion, transformation, quality checks, and downstream consumption Apply strong SQL, Python, and PySpark skills to transform complex data into reliable, reusable, and performant data products SQL, Data Modelling & Analytics Enablement Create well-modelled, trusted datasets that support … analytics foundations Advanced SQL skills with the ability to design performant queries, data models, and transformation logic Hands‐on knowledge of Python and PySpark for large‐scale data processing and automation Curious, hands‐on problem solver who can engage with business stakeholders to understand the real requirement and deliver ...

/ELT processes for data ingestion and transformation. Supporting and enhancing a business-critical reporting and analytics platform. Developing SQL and Python/PySpark-based data solutions. Managing and optimising SQL database environments, ensuring performance, reliability and scalability. Collaborating with Data Analysts, BI professionals and stakeholders across the organisation. … skills and experience working with complex relational databases. Hands-on experience building and supporting ETL/ELT pipelines. Strong Python and/or PySpark development experience. Experience with SQL Server or similar database technologies. Excellent problem-solving skills and the ability to engage effectively with both technical ...

GBMs, Elastic Net GLMs, GAMs, Decision Trees, Random Forests, Neural Nets and Clustering Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Experience of WTW’s Radar software Proficient at communicating results ...

ongoing performance and reliability of the SQL database estate. This role would suit a Data Engineer with strong Databricks, SQL and Python/PySpark expertise who enjoys solving technical challenges, improving data platforms and working collaboratively with both technical and non-technical stakeholders. Key Responsibilities Design, develop and maintain … Oxfordshire HQ Opportunity to join a growing Data & Innovation function Hands-on exposure to modern Microsoft data technologies including Databricks, SQL, Python and PySpark Opportunity to influence the development and maturity of the organisation's data platform Collaborative working environment with exposure to a broad range of data ...

capabilities, and skills Hands-on experience delivering system design, application development, testing, and operational stability at enterprise scale Expertise in Python and/or PySpark Knowledge of software application development and technical processes, with depth in disciplines such as cloud, AI/ML, or data engineering Experience in large … scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks ...

Data Engineer Up to £60,000 We are working with an organisation that is going through an exciting period of growth and continued investment across its technology and data landscape. With data playing an increasingly ...

Description About us Analytium is a boutique UK data and analytics consultancy - 14 people, 150 projects delivered for 50 clients. We are embedded in a UK tier-one bank, modernising one of the largest SAS ...