301 to 321 of 321 Permanent PySpark Jobs

systems, databases and third‐party APIs, shaping it into trusted datasets used across the business. You’ll work with Microsoft Fabric, SQL, Python/PySpark and Power BI, ensuring data quality, lineage and scalable models that support dashboards and decisions across teams. #J-18808-Ljbffr ...

Inside IR35 via umbrella Remote Must be eligible to work in the UK Start ASAP Must have: Strong hands-on Databricks, SQL, Python/PySpark ETL/ELT Data-pipeline migration Legacy-to-cloud modernisation Production troubleshooting Dependency analysis Pipeline repointing Error handling and recovery Data validation/reconciliation … Clear handover into BAU CIS/SCI Integration & Post-Migration Stabilisation Data Engineer Key Skills: Must Have: Strong hands-on Databricks, SQL, Python/PySpark ETL/ELT Data-pipeline migration Legacy-to-cloud modernisation Production troubleshooting Dependency analysis Pipeline repointing Error handling and recovery Data validation/reconciliation ...

Technical Skills You'll have experience with some of the following: Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these … Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every CV sent to clients, we donate ...

contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as needed Experience with cloud platforms (preferably AWS) and working knowledge … financial services industry and their IT systems Preferred qualifications, capabilities, and skills Experience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelines In-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

forecasting, gradient boosting, clustering, NLP and Bayesian methods Strong MLOps: orchestration, experiment tracking, hyperparameter tuning and automated retraining pipelines Object-oriented Python, Polars or PySpark, and data versioning (e.g. DVC), plus experience designing data storage Hands-on experience with at least two of AWS, Azure and GCP, including deployment … solid grasp of CI/CD, testing and containerisation Nice to have A Masters or PhD Experience with parallel processing frameworks such as PySpark or Ray Serverless deployments (e.g. Fargate, Lambda) and infrastructure automation with tools like Terratest or Ansible Whats on offer Salary: Up to £113,000 Hybrid ...

sets Programming experience (focus on machine learning): SQL and Python’s Data Science stack; good knowledge of at least one big data framework (e.g., PySpark, Hive, Hadoop) is a plus. R, SPSS, and SAS are considered nice‐to‐have Strong understanding of machine learning methods and experience applying them … into production or applied business environments is a plus While we advocate using the right tech for the right task, we often leverage: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open‐source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such ...

role: Lead Developer role for a global organization, responsible for designing, implementing and optimizing Python and cloud based solutions using AWS and PySpark for data intensive and regulatory focused applications. The role requires strong experience in PL SQL and AWS services, owning end to end technical delivery, code quality … solutions on AWS cloud that leverage core services to support highly available data processing pipelines and transaction workflows aligned with enterprise standards. Implement optimized PySpark jobs for large scale data transformations, ensuring efficient resource usage, predictable performance and alignment with agreed data models and quality rules. Create and refine ...

KDR Talent Solutions Ltd. in Greater London is hiring a Senior Data Engineer on a hybrid, permanent basis with a salary of £80,000–£85,000 plus a generous bonus. You will be hands-on ...

blend of experience is expected as the business transitions to Microsoft Fabric, with key skills and core technologies including: SQL, Microsoft Fabric, Python/PySpark, Data Factory, etc. Exposure to and working with AI based tools such as Microsoft Copilot will certainly enhance candidate applications. Managerial and leadership experience … forward your most recent CV for consideration. BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/MICROSOFT FABRIC/PYTHON/PYSPARK/DATA WAREHOUSE/DATA LAKE/DATA FACTORY/HOME/BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/ ...

working as a Data Analyst, ideally within FinTech or Financial Services Exposure to Derivatives or other Financial instruments Strong SQL experience Strong Python experience (PySpark, Pandas, Jupyter Notebooks etc.) Airflow/Algo for workflow management Git Any exposure to compressed file formats, such as Parquet or HDF5, is highly … Bash skills are highly desirable Job title: Data Analyst Client: Elite FinTech Salary: £65,000-£100,000 + Bonus Location: London Skills: SQL, Python, PySpark, Airflow, Linux #J-18808-Ljbffr ...

Job Description Purpose of the role To design, develop, implement, and support mathematical, statistical, and machine learning models and analytics used in business decision-making Accountabilities Design analytics and modelling solutions to complex business problems ...

this area will be required to support the Data Scientists to run a Proof of Concept (PoC) Migration Phase. Support in transforming Programme PySpark for the respective use cases, as part of migration preparation. Work collaboratively with nominated Data Scientists (Programme) to validate the functionality/performance … important the resources work collaboratively with the nominated Data Scientists to help with model/data pipeline build standardisation, issue resolution, etc. PySpark experience. The pipeline is written in PySpark, it is vital that the engineers can quickly get up to speed on the pipeline, advise on efficiency ...

Role: Senior Developer - Python, AWS & PySpark Location: London (Hybrid) About the role We are looking for a Senior Developer to join a global organization and take ownership of end-to-end technical delivery. You will design, implement and optimize Python and cloud-based solutions using AWS and PySpark. These … term reuse and evolution. Develop secure, efficient AWS solutions that use core services to support highly available data pipelines and transaction workflows. Implement optimized PySpark jobs for large-scale data transformations, with efficient resource usage and predictable performance. Create and refine PL/SQL procedures and queries that protect ...

month contract in the United Kingdom with remote work options. The role focuses on building and maintaining large-scale data pipelines using Databricks, PySpark and SQL, handling transaction and loyalty data, and ensuring robust production stability. You will contribute to data integration, migration stabilisation, orchestration, monitoring and data quality ...

AWS Data EngineerLondon | Hybrid | Competitive salary, DOE | Fast interview processJoin an established market leading business with a start-up environment that is building a unique data platform with AI at the core. An innovative consumer ...

Ceox in the United Kingdom is seeking a hands-on Senior Data Engineer to join a growing Data & Analytics practice. You will design, build, optimise and maintain enterprise-scale data solutions across the full data ...

Developer to own end-to-end technical delivery in London. You will design and build scalable Python applications and secure AWS data pipelines, leveraging PySpark for large-scale transformations. Work closely with product owners to translate regulatory requirements into robust technical solutions, review code to uphold standards, and partner ...

data products — from client scoping and solution design to execution and ongoing delivery. Ensure high analytical and technical standards across the team, including SQL, PySpark, Python, and data validation best practices. Act as an escalation point for complex analytical challenges, providing hands‐on guidance where needed. Partner closely with … perfect job for someone who has: Proven experience managing and mentoring data analysts or analytics teams. Strong hands‐on experience with SQL and PySpark for data analysis — Must. Strong Python scripting experience — Must. Excellent communication skills in English, with the ability to translate complex analysis into clear business insights. ...

science team and project group to knowledge share and get the best possible outcome Skills & Experience Intermediate SQL, Python, and scikit‐learn and basic PySpark coding skills with a good understanding of standard coding practices. Database experience Code optimisation and standard software development skills such as writing tests … learning how data is validated and how models are versioned, monitored and improved over time. Intermediate SQL, Python, and scikit‐learn and basic PySpark coding skills with a good understanding of standard coding practices. Database experience Code optimisation and standard software development skills such as writing tests for code ...

. The role focuses on building data models and pipelines in Snowflake, including Snowflake ML, and collaborating with Data Scientists to migrate and validate PySpark-based use cases during the September–December window. Ideal candidates will bring Snowflake expertise, PySpark experience, and DBT knowledge. #J-18808-Ljbffr ...

Engineers/data science backgrounds with transaction monitoring background The role combines transaction monitoring domain expertise with technical skills in Data Science, Machine Learning, PySpark programming. Experience in designing and deploying AI/ML products, hands-on and as a manager Develop and maintain AI driven monitoring engines that … Machine Learning models on Transaction Monitoring systems. Significant experience as a Data Scientist for complex financial services environments. Technical skills in AI/ML, PySpark, Data Science and knowledge on banking regulatory compliances and financial crime domain knowledge. ...