Permanent PySpark Job Vacancies

26 to 50 of 137 Permanent PySpark Jobs

Job Opening: Azure Data Engineer for our client in , Local On

Dallas, Texas, United States
Boston Technology Corporation
your interest level. Location: Dallas, TX Local Onsite Interview Duration: 12 Months+ - Hybrid Onsite Onsite Interview needed 10 years of experience 4+ recent Azure experience ADF and Python/Pyspark AI Model & Machine Learning experience Qualifications: 10 or more years of relevant software development experience required. 5 or more years of in-depth experience with MS SQL Server and More ❯
Employment Type: Any
Salary: USD Annual
Posted:

Senior Data Engineer

London, United Kingdom
Arbuthnot Latham
on experience with the Azure Data Stack, critically ADF and Synapse (experience with Microsoft Fabric is a plus) Highly developed python and data pipeline development knowledge, must include substantial PySpark experience Demonstrable DevOps and DataOps experience with an understanding of best practices for engineering, test and ongoing service delivery An understanding of Infrastructure as Code concepts (Demonstrable Terraform experience More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Lead Data Scientist

London, England, United Kingdom
Harnham
For further details or to enquire about other roles, please contact Nick Mandella at Harnham. KEYWORDS Python, SQL, AWS, GCP, Azure, Cloud, Databricks, Docker, Kubernetes, CI/CD, Terraform, Pyspark, Spark, Kafka, machine learning, statistics, Data Science, Data Scientist, Big Data, Artificial Intelligence, private equity, finance. More ❯
Posted:

Lead Data Scientist

London, South East, England, United Kingdom
Harnham - Data & Analytics Recruitment
For further details or to enquire about other roles, please contact Nick Mandella at Harnham. KEYWORDS Python, SQL, AWS, GCP, Azure, Cloud, Databricks, Docker, Kubernetes, CI/CD, Terraform, Pyspark, Spark, Kafka, machine learning, statistics, Data Science, Data Scientist, Big Data, Artificial Intelligence, private equity, finance. More ❯
Employment Type: Full-Time
Salary: £140,000 - £150,000 per annum
Posted:

Senior Application Developer

Pittsburgh, Pennsylvania, United States
Federated Hermes, Inc
Federated Hermes Global Technology Organization, you will be responsible to: Design, build, and maintain scalable data pipelines on Databricks (using Spark, Delta Lake, etc.) Write clean, efficient and maintainable PySpark or SQL code for data transformation Design robust data models for analytics and reporting Ensure data quality, consistency, and governance Handle batch and streaming data workflows Provide architectural guidance More ❯
Employment Type: Any
Salary: USD Annual
Posted:

Senior Data Engineer

Bedford, Bedfordshire, England, United Kingdom
Hybrid / WFH Options
Reed Talent Solutions
data tooling such as Synapse Analytics, Microsoft Fabric, Azure Data Lake Storage/One Lake, and Azure Data Factory. Understanding of data extraction from vendor REST APIs. Spark/Pyspark or Python skills a bonus or a willingness to develop these skills. Experience with monitoring and failure recovery in data pipelines. Excellent problem-solving skills and attention to detail. More ❯
Employment Type: Full-Time
Salary: £62,000 per annum
Posted:

Data Engineer with Security Clearance

Denton, Texas, United States
Hybrid / WFH Options
M1 Support Services, LLP
expertise with: o Azure Synapse Analytics, Data Factory, Databricks, Event Hubs, Data Lake Storage (Gen2). o Database technologies (SQL Server, PostgreSQL, Cosmos DB). o Programming languages (Python, PySpark, SQL). Strong experience in data security, access management, and compliance frameworks (FedRAMP, NIST, DoD, CMMC). Prior experience mentoring and developing junior engineers. Skills and Competencies Strong architectural More ❯
Employment Type: Permanent
Salary: USD Annual
Posted:

Data Engineer

Leeds, West Yorkshire, Yorkshire, United Kingdom
Hybrid / WFH Options
Forward Role
financial datasets Python experience, particularly for data processing and ETL workflows Hands-on experience with cloud platforms- Azure Experience designing and maintaining data pipelines using tools like Databricks and PySpark Knowledge of data warehousing solutions - Snowflake experience would be brilliant Understanding of CI/CD processes for deploying data solutions Some exposure to big data technologies and distributed processing More ❯
Employment Type: Permanent, Work From Home
Salary: £55,000
Posted:

Azure Data Engineer

Newcastle Upon Tyne, Tyne and Wear, England, United Kingdom
Hybrid / WFH Options
True North Group
business needs. Contribute to pre-sales, proposals, and thought leadership activities. Requirements Strong experience designing and maintaining data platforms and ETL/ELT solutions. Solid knowledge of Databricks, Python, PySpark, Spark SQL, Azure and/or AWS. Data modelling expertise (Inmon, Kimball, Data Vault). Familiar with DataOps practices and pipeline monitoring. Experience with sensitive data and applying security More ❯
Employment Type: Full-Time
Salary: Salary negotiable
Posted:

Data Engineer

Birmingham, West Midlands, United Kingdom
Hybrid / WFH Options
Amtis Professional Ltd
Troubleshoot issues and continuously improve data infrastructure Explore AI-driven enhancements to boost data accuracy and productivity Requirements: Strong experience with: Azure Databricks, Data Factory, Blob Storage Python/PySpark SQL Server, Parquet, Delta Lake Deep understanding of: ETL/ELT, CDC, stream processing Lakehouse architecture and data warehousing Scalable pipeline design and database optimisation A proactive mindset, strong More ❯
Employment Type: Permanent, Work From Home
Salary: £80,000
Posted:

Principal Consultant

Reading, England, United Kingdom
HD TECH Recruitment
engineering and Azure cloud data technologies. You must be confident working across: Azure Data Services, including: Azure Data Factory Azure Synapse Analytics Azure Databricks Microsoft Fabric (desirable) Python and PySpark for data engineering, transformation, and automation ETL/ELT pipelines across diverse structured and unstructured data sources Data lakehouse and data warehouse architecture design Power BI for enterprise-grade More ❯
Posted:

Programmer/Analyst: IV (Lead)

Columbus, Ohio, United States
Genesis10
Warehouse, including understanding of enterprise data warehousing best practices and standards. 7+ years of experience with database programming languages and advanced analytics 5+ years of experience with Python/PySpark, IBM DataStage and SQL development. 3+ years of experience in cloud infrastructure projects with hands on migration expertise on public clouds such as AWS and Azure, preferably Snowflake. Preferred More ❯
Employment Type: Permanent
Salary: USD 7,000 Hourly
Posted:

Senior AWS Data Engineer - London - £125,000

London, South East, England, United Kingdom
Tenth Revolution Group
complex data sets. Collaborate with data scientists to deploy machine learning models. Contribute to strategy, planning, and continuous improvement. Required Experience: Hands-on experience with AWS data tools: Glue, PySpark, Athena, Iceberg, Lake Formation. Strong Python and SQL skills for data processing and analysis. Deep understanding of data governance, quality, and security. Knowledge of market data and its business More ❯
Employment Type: Full-Time
Salary: £120,000 - £130,000 per annum
Posted:

Senior AWS Data Engineer - London - £125,000

City of London, London, United Kingdom
Tenth Revolution Group
complex data sets. Collaborate with data scientists to deploy machine learning models. Contribute to strategy, planning, and continuous improvement. Required Experience: Hands-on experience with AWS data tools: Glue, PySpark, Athena, Iceberg, Lake Formation. Strong Python and SQL skills for data processing and analysis. Deep understanding of data governance, quality, and security. Knowledge of market data and its business More ❯
Employment Type: Permanent
Salary: £120000 - £130000/annum +bonus
Posted:

Data Solution Architect

Atherstone, Warwickshire, England, United Kingdom
Hybrid / WFH Options
Aldi
end-to-end ownership of demand delivery Provide technical guidance for team members Providing 2nd or 3rd level technical support About You Experience using SQL, SQL Server DB, Python & PySpark Experience using Azure Data Factory Experience using Data Bricks and Cloudsmith Data Warehousing Experience Project Management Experience The ability to interact with the operational business and other departments, translating More ❯
Employment Type: Full-Time
Salary: £61,985 - £80,400 per annum
Posted:

Generative AI Data Scientist Lead

Mc Lean, Virginia, United States
Genesis10
PDFs, video, and audio sources for use in LLM-powered workflows-leveraging best practices like semantic chunking and privacy controls Orchestrate multimodal pipelines using scalable frameworks (e.g., Apache Spark, PySpark) for automated ETL/ELT workflows appropriate for unstructured media Implement embeddings drives-map media content to vector representations using embedding models, and integrate with vector stores (AWS KnowledgeBase More ❯
Employment Type: Permanent
Salary: USD Annual
Posted:

Data Engineer

City of London, London, United Kingdom
Hybrid / WFH Options
Hexegic
and validate data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What’s in it for you? Base salary of More ❯
Posted:

Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Hexegic
and validate data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What’s in it for you? Base salary of More ❯
Posted:

Data Engineer

slough, south east england, united kingdom
Hybrid / WFH Options
Hexegic
and validate data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What’s in it for you? Base salary of More ❯
Posted:

Data Engineer

london, south east england, united kingdom
Hybrid / WFH Options
Hexegic
and validate data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What’s in it for you? Base salary of More ❯
Posted:

Data Engineer

london (city of london), south east england, united kingdom
Hybrid / WFH Options
Hexegic
and validate data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What’s in it for you? Base salary of More ❯
Posted:

Lead AI Engineer

London Area, United Kingdom
Hybrid / WFH Options
KPMG UK
language processing or other relevant AI fields. Proven track record of designing, developing, and deploying AI systems in production environments. Proficient in Python and key ML libraries (e.g. PyTorch, PySpark, scikit-learn, Hugging Face Transformers). Hands-on experience with modern data platforms and AI tooling such as Azure ML, Databricks, MLflow, LangChain, LangGraph. Proven experience with modern engineering More ❯
Posted:

Lead AI Engineer

City of London, London, United Kingdom
Hybrid / WFH Options
KPMG UK
language processing or other relevant AI fields. Proven track record of designing, developing, and deploying AI systems in production environments. Proficient in Python and key ML libraries (e.g. PyTorch, PySpark, scikit-learn, Hugging Face Transformers). Hands-on experience with modern data platforms and AI tooling such as Azure ML, Databricks, MLflow, LangChain, LangGraph. Proven experience with modern engineering More ❯
Posted:

Lead AI Engineer

london, south east england, united kingdom
Hybrid / WFH Options
KPMG UK
language processing or other relevant AI fields. Proven track record of designing, developing, and deploying AI systems in production environments. Proficient in Python and key ML libraries (e.g. PyTorch, PySpark, scikit-learn, Hugging Face Transformers). Hands-on experience with modern data platforms and AI tooling such as Azure ML, Databricks, MLflow, LangChain, LangGraph. Proven experience with modern engineering More ❯
Posted:

Lead AI Engineer

london (city of london), south east england, united kingdom
Hybrid / WFH Options
KPMG UK
language processing or other relevant AI fields. Proven track record of designing, developing, and deploying AI systems in production environments. Proficient in Python and key ML libraries (e.g. PyTorch, PySpark, scikit-learn, Hugging Face Transformers). Hands-on experience with modern data platforms and AI tooling such as Azure ML, Databricks, MLflow, LangChain, LangGraph. Proven experience with modern engineering More ❯
Posted:
PySpark
10th Percentile
£42,625
25th Percentile
£51,250
Median
£67,500
75th Percentile
£87,500
90th Percentile
£95,000