4 of 4 Contract Spark SQL Jobs in the UK

gather requirements, enhance processes, and deliver scalable, high-impact data solutions. Job Responsibilities/Objectives Build and maintain batch/streaming pipelines (PySpark, Spark SQL, DLT) across bronze, silver, and gold layers Implement CDC, incremental loads, and performance tuning (Z-Order, OPTIMIZE, VACUUM) Develop curated datasets … dimensional models for BI Optimise SQL warehouse performance and maintain data models Ensure data quality, governance, and documentation standards Collaborate with stakeholders and support CI/CD processes Required Skills/Experience The ideal candidate will have the following: Strong Databricks and Spark (PySpark/Spark ...

experience required Strong experience in data engineering Proven, hands-on experience working with Palantir Foundry in a production environment. Strong proficiency in Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema ...

building data pipelines in production environments. Proficiency with Microsoft Fabric, including Data Factory, lakehouses, warehouses, notebooks and semantic models. Strong skills in PySpark, Spark SQL and T-SQL for data transformation. Experience with medallion architecture or equivalent layered data processing patterns. Working knowledge ...

Your new company One of the most influential Central Government Organisations in the current economic climate Your new role Data Scientist - SC Cleared - SQL, Python & R What you'll need to succeed My client is looking for an Analytical Data Scientist, leading/working alongside a team … Existing SC or DV Clearance. Essential Criteria: Experience of delivering high-quality coding projects that make use of at least two of: SQL, Python & R Experience of engaging with stakeholders across government to scope and deliver impactful analysis Experience of leading teams through complex data science projects ...