351 to 375 of 387 Permanent PySpark Jobs

systems, including LLM-based applications and agentic architectures in regulated environments Proficiency in one or more programming languages, particularly Python and/or PySpark Advanced knowledge of software application development and technical processes in disciplines such as cloud, AI/ML, or data engineering Experience in large-scale data … analytical skills Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Hands-on expertise with Spark/PySpark and big data processing technologies Knowledge of open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model ...

contribute to engineering standards and help drive best practices across the team. You'll build scalable data pipelines and frameworks using Azure, Databricks and PySpark, working across the full engineering lifecycle from design through to production. You'll also support other engineers through code reviews, knowledge sharing and pair … reliable data solutions that create real business value. Skills & Experience Strong experience building cloud-native data platforms, ideally on Azure Commercial experience with Databricks, PySpark and Python Strong SQL and data engineering expertise Experience designing and delivering scalable ETL and data pipeline solutions #J-18808-Ljbffr ...

contribute to engineering standards and help drive best practices across the team. You'll build scalable data pipelines and frameworks using Azure, Databricks and PySpark, working across the full engineering lifecycle from design through to production. You'll also support other engineers through code reviews, knowledge sharing and pair … reliable data solutions that create real business value. Skills & Experience Strong experience building cloud-native data platforms, ideally on Azure Commercial experience with Databricks, PySpark and Python Strong SQL and data engineering expertise Experience designing and delivering scalable ETL and data pipeline solutions If you're looking ...

deployment Productionise models developed by Data Scientists, transforming notebooks and prototypes into modular, tested and production-ready code Develop scalable ML solutions using Python, PySpark, Databricks and MLflow Deploy machine learning models into batch and real-time environments through APIs, scheduled workflows and production pipelines Manage model versioning, promotion … commercial experience as an ML Engineer, with a clear focus on engineering and productionising machine learning models Strong hands-on development skills across Python, PySpark and SQL Commercial experience working with Databricks, MLflow and Delta Lake Proven experience building and operating distributed data and machine learning pipelines Experience taking ...

Technical Skills You'll have experience with some of the following: Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these … Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every CV sent to clients, we donate ...

contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as needed Experience with cloud platforms (preferably AWS) and working knowledge … financial services industry and their IT systems Preferred qualifications, capabilities, and skills Experience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelines In-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as needed Experience with cloud platforms (preferably AWS) and working knowledge … financial services industry and their IT systems Preferred qualifications, capabilities, and skills Experience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelines In-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon … platforms - here you will design, build, maintain, and optimise scalable data products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your ...

purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon … platforms - here you will design, build, maintain, and optimise scalable data products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your ...

Tria is seeking an experienced Senior Data Engineer to design and deliver scalable data pipelines using Python, PySpark and SQL in a cloud-based environment. The role focuses on Airflow orchestration, Kubernetes deployment on Azure, data modeling and building a modern data warehouse to support analytics and product insights. ...

EPAM Systems in London seeks a Senior Data Engineer - Tech Lead to shape cloud-native data platforms using Azure Databricks, PySpark and Lakehouse principles. You will lead architecture, drive modernization, and mentor engineers while delivering scalable pipelines for high-volume workloads. You will collaborate with stakeholders to translate business ...

Services ambitions. This role focuses on turning data into stable, scalable products that empower stakeholders and customers. You will work with Python, SQL and PySpark to build data products, collaborate across Product, Analytics, Security and Software, and help optimize ETL pipelines in a Lakehouse architecture using Databricks and Delta ...

engineers, analysts and client stakeholders to deliver robust data solutions for government, defence and regulated sectors. You’ll work with AWS and Azure services, PySpark, SQL and Java/Python, implement data quality and monitoring, and contribute to runbooks, data dictionaries and scalable #J-18808-Ljbffr ...

Job Requirements: Requires a Bachelors degree in Computer Science Engineering or a directly related field plus three (3) years of data engineering experience. Must have at least two (2) years of experience with the following ...

proactive Data Engineer to design, develop, and maintain cloud-native data solutions and lakehouse platforms. You will build scalable data pipelines using Python and PySpark, optimize workflows with AWS Glue, Athena, Redshift, and collaborate across agile teams. The role supports a primarily remote setup with a monthly requirement ...

expertise in marketing analytics, building MMM model via Meridian, Robynand/or PyMc, multi touch attribution, customer lifecycle modelling. Proficiency in SQL, Python, R, PySpark and dashboarding in PowerBI/Looker. Experienced running Geolift test, causal inference model, and other forms of experimental design. Solid foundation in machine learning … strategies. Preferred experience in the eCommerce, technology or marketing industry. So if youre an expert in Data Science, have strong Python/SQL/Pyspark skills and considerable knowledge in test design, implementation and reporting, can work with initiative and can build great working relationships within the business, this ...

Description About us Analytium is a boutique UK data and analytics consultancy - 14 people, 150 projects delivered for 50 clients. We are embedded in a UK tier-one bank, modernising one of the largest SAS ...

data warehouse solutions specifically on AWS. You will be at the forefront of developing high-performance data engineering solutions. The focus is on utilising PySpark, Spark, Python, and various AWS services to enable secure, reliable, and efficient data processing and analytics across enterprise platforms. This position is crucial … enhancing data capabilities within Capgemini's extensive operations. Requirements Proven experience in designing, building, and maintaining scalable data pipelines. Strong proficiency with PySpark, Spark, and Python. Extensive experience with AWS services, particularly those related to data engineering. Ability to develop high-performance data solutions for enterprise platforms. Understanding ...

learning techniques within a general insurance pricing environment. Pricing Technology & Data Platforms: Proficiency in pricing and data tools such as WTW Radar, Databricks, Python, PySpark, SQL or similar platforms. Leadership & People Management: Proven ability to lead technical delivery through others, balancing hands‐on review with effective delegation, coaching … investigation. You’ll promote continuous improvement across technical pricing processes, tools, reporting and ways of working, including the appropriate use of Databricks, Python/PySpark, Radar and other relevant platforms. You’ll comply with the requirements, and act in accordance with the Group Code of Conduct and Fitness ...

hackajob is partnering directly with Barclays to hire for this role. Join us at Barclays as an Integrated Financial Crime Model Developer. You will design, build and deploy machine learning models that support scalable, high ...

hackajob is partnering directly with Barclays to hire for this role. Join us at Barclays as an Integrated Financial Crime Model Developer. You will design, build and deploy machine learning models that support scalable, high ...

Job Description Purpose of the role To design, develop, implement, and support mathematical, statistical, and machine learning models and analytics used in business decision-making Accountabilities Design analytics and modelling solutions to complex business problems ...

help shape its modern data platform in St Helens, with a hybrid model requiring 1–2 days on site. The role focuses on Python, PySpark and Microsoft Fabric to build pipelines and data products on top of a growing Fabric/Azure environment. You’ll contribute to a team ...

this area will be required to support the Data Scientists to run a Proof of Concept (PoC) Migration Phase. Support in transforming Programme PySpark for the respective use cases, as part of migration preparation. Work collaboratively with nominated Data Scientists (Programme) to validate the functionality/performance … important the resources work collaboratively with the nominated Data Scientists to help with model/data pipeline build standardisation, issue resolution, etc. PySpark experience. The pipeline is written in PySpark, it is vital that the engineers can quickly get up to speed on the pipeline, advise on efficiency ...

this area will be required to support the Data Scientists to run a Proof of Concept (PoC) Migration Phase. Support in transforming Programme PySpark for the respective use cases, as part of migration preparation. Work collaboratively with nominated Data Scientists (Programme) to validate the functionality/performance … important the resources work collaboratively with the nominated Data Scientists to help with model/data pipeline build standardisation, issue resolution, etc. PySpark experience. The pipeline is written in PySpark, it is vital that the engineers can quickly get up to speed on the pipeline, advise on efficiency ...