10 of 10 Contract PySpark Jobs

+ environment configurations. Analysing current Data Engineering solutions + identifying data migration requirements. Onboarding datasets, users + workloads onto target platform. Data Engineering: Python, PySpark, SQL, Data Pipeline Development, ETL/ELT Design, Data Modelling, Data Quality, Data Validation. AWS Cloud Platform, S3, IAM, CI/CD concepts, DevOps ...

Data Platforms: Hands-on experience with Databricks and Azure Data Lake . ETL: Proven ability to build efficient pipelines (ADF, SSIS, APIs). Desirable: PySpark, Dimensional Modelling, DAX/SSAS, or an interest in AI/ML applications. Interested in learning more? Send me a DM or comment below ...

looking for: Strong background in data engineering and software development Proven experience working with Databricks (essential) Hands-on expertise with tools such as Python, PySpark, Spark, and SQL Experience building and maintaining data pipelines and data platforms Solid understanding of data modelling and data architecture principles Experience working with ...

assure enterprise-aligned data integration architectures Optimise cloud platforms (Azure, AWS, Databricks) for performance and cost Build and own ETL/ELT pipelines using PySpark, SQL and orchestration frameworks Automate and modernise legacy data processes with reusable patterns Design robust data models (Delta Lake, schema evolution, metadata, lineage) Ensure … reviews Collaborate with stakeholders to translate complex technical decisions clearly Support strategic roadmap, tooling and continuous improvement initiatives Core Skills & Expertise Data Engineering Advanced PySpark and SQL, performance tuning and best practice coding Data modelling (conceptual, logical, physical) and integration design Data quality, testing frameworks and automated validation Strong ...

Capital Markets background Experience across Market Risk, CCR, PnL, Trade Lifecycle and Reconciliations Knowledge of derivatives, swaps, futures, options and fixed-income products Desirable PySpark or distributed data processing Exposure to quantitative models and pricing systems Global banking environment experience 9-15 years' relevant experience Please note: Candidates without ...

ownership of data pipelines and automation of data workflows. Finally have 5 years Strong programming experience at an advanced level in Python, PySpark, and SQL scripting. Benefits Salary: 55,000 - 60,000 per annum 25 day's holiday Company car/Allowance Private medical insurance Variable annual bonus based … leveraging tools such as Foundry Code Workbooks, Pipelines, and Object Explorer for efficient data processing and integration. Strong coding skills in Python (Pandas) and PySpark: Essential experience in using Python (Pandas) and PySpark for data manipulation, transformation, and pipeline development within Palantir Foundry, ensuring high performance and scalability ...

Azure experience to join their team for a contract until the end of the year. Job Responsibilities/Objectives Mandatory Skills: Databricks (PySpark/Spark SQL) , DBT , Azure DevOps (Repos, Pipelines, CI/CD), SQL ,Azure Data Services (Data Lake, Data Factory) Strong experience with Databricks (PySpark/ ...

with Infrastructure as Code (Terraform) Experience working with GitLab and implementing CI/CD pipelines Practical experience building data pipelines in AWS (e.g. EMR, PySpark) Solid understanding of ETL tooling (e.g. Informatica or similar) Strong background in data processing and transformation Proficiency in Python and PySpark Essential Requirements ...

Staff Data Engineer | AWS | PySpark | Data Modernisation | London | Contract | Inside IR35 We're supporting a global, technology-led organisation undertaking a large-scale cloud data transformation programme. This isn't a traditional Data Engineering role. The organisation is modernising hundreds of complex data pipelines, establishing reusable engineering patterns … responsible for Defining technical standards and engineering patterns for a large-scale Data Modernisation programme Re-engineering complex legacy data pipelines into production-grade PySpark Building scalable, reusable data movement frameworks across multiple engineering teams Driving best practice around AWS Glue, Apache Spark and Apache Airflow Designing high-quality ...

agentic AI systems using modern LLM frameworks Develop and deploy Generative AI solutions across production environments Work with structured and unstructured data using Python & PySpark Implement Claude Code/LLM-based workflows for real-time decision-making Collaborate with cross-functional teams to integrate AI capabilities into existing platforms … with Agentic AI architectures Hands-on expertise with LLMs (e.g. Claude, OpenAI, etc.) Proven background in Generative AI (GenAI) Advanced proficiency in Python and PySpark Experience working with Claude Code or similar LLM orchestration tools Strong engineering mindset with experience deploying into production environments Desirable Experience working within Financial ...