PySpark Jobs

1 to 25 of 49 PySpark Jobs

Lead Data Engineer

London, United Kingdom
Square One Resources
and data scientists. The ideal candidate will have: Proven experience with ETL/ELT processes and medallion architecture Strong skills in SQL Server, Python, PySpark, and T-SQL Familiarity with Azure Synapse, Azure Data Lake, and Azure ML Studio Experience with Azure DevOps and CI/CD processes Excellent more »
Employment Type: Permanent
Salary: £90000 - £110000/annum
Posted:

Senior Data Engineer

Manchester, North West, United Kingdom
Hybrid / WFH Options
Cloud Decisions
Experience developing data pipelines, working with APIs, multiple file formats, and databases. Specific experience with ( most of these ): Fabric, Azure Synapse Analytics, ADLS2, Databricks, PySpark, Python, Azure Data Factory (including metadata-driven pipelines), Azure SQL, Keyvault, Azure Security, Microservices, CI/CD and Azure DevOps Experience mentoring and guiding more »
Employment Type: Permanent, Work From Home
Salary: £65,000
Posted:

Senior Data Engineer

Leeds, West Yorkshire, United Kingdom
Hybrid / WFH Options
VIQU Limited
a Senior Data Engineer with a strong focus on Databricks. Proficiency in Python and SQL for data processing and analysis. Spark Python API/PySpark Hands-on experience with AWS services related to data storage and processing (e.g., S3, Redshift, Glue). In-depth knowledge of Databricks Delta Lake more »
Employment Type: Contract
Rate: £450 - £520/day Outside IR35
Posted:

Data Engineer

United Kingdom
Hybrid / WFH Options
Kraken
ETL and familiarity with design principles (Apache Airflow is a big plus!)Excellent SQL and data manipulation skills using common frameworks like Spark/PySpark, or similar.Proficiency in a major programming language (e.g. Scala, Python, Golang,..) Experience with business requirements gathering for data sourcing.#LI-Remote #LI-GL1 #USCANUKEUKraken more »
Salary: £ 100 K
Posted:

Data Engineering Lead

London, United Kingdom
RedCat Digital
cross functional teams entrusted with business-critical platforms.Desirable skills & experienceWorking to an Agile methodology and familiarity with Azure DevOpsDeep automation knowledge with PythonSkilled in Pyspark and SynapseExperience with data modelling and visualisation in Power BI (or alternative)A strong understanding of architecting data platforms, BI, MI, or analytics solutionsStrong more »
Salary: £ 100 K
Posted:

Senior / Lead Data Engineer

South West London, London, United Kingdom
Crowd Link Consulting Ltd
and maintenance of ETL/ELT processes Experience with SQL Server and relational databases Experience of the Azure data engineering stack Experience in Python, PySpark and T-SQL Knowledge of wider Azure Data Solutions such as Azure ML Studio Excellent written and verbal communication skills The role requires that more »
Employment Type: Permanent
Posted:

Lead Data Scientist

Exeter, Devon, South West, United Kingdom
Hybrid / WFH Options
Staffworx Limited
Ability to optimise workflows and analysis for map reduce processing Experience with BI software (Power BI, Tableau, Qlik Sense) Any experience with data engineering, PySpark, Databricks, Delta Lakes beneficial Confident presenting complex problems in ways suitable to target audience Experience leading or managing a small analysis team Familiarity working more »
Employment Type: Permanent, Work From Home
Posted:

Lead Data Scientist

Exeter, England, United Kingdom
Staffworx Limited
Ability to optimise workflows and analysis for map reduce processing Experience with BI software (Power BI, Tableau, Qlik Sense) Any experience with data engineering, PySpark, Databricks, Delta Lakes beneficial Confident presenting complex problems in ways suitable to target audience Experience leading or managing a small analysis team Familiarity working more »
Posted:

Principal Data Engineer (12M FTC)

London, United Kingdom
Chelsea and Westminster Hospital NHS Foundation Trust
datasets Knowledge and experience of Azure Data Factory creating and deploying pipelines Knowledge and experience of Cloud Services (Azure Data Services) Desirable Python,/Pyspark development experience or use of other programming languages Skills and knowledge Essential Knowledge of information management gained through senior management experience Understanding of role more »
Employment Type: Fixed-Term
Salary: £58698.00 - £65095.00 a year
Posted:

Lead Data Analyst / Data Modeller - Devon - £70K + bonus, bens

Devon, South West, United Kingdom
Hybrid / WFH Options
Staffworx Limited
Ability to optimise workflows and analysis for map reduce processing Experience with BI software (Power BI, Tableau, Qlik Sense) Any experience with data engineering, PySpark, Databricks, Delta Lakes beneficial Confident presenting complex problems in ways suitable to target audience Experience leading or managing a small analysis team Familiarity working more »
Employment Type: Permanent, Work From Home
Posted:

Lead Data Engineer

City Of London, United Kingdom
Hybrid / WFH Options
Premier IT
data modelling Technical Skills Proficient in SQL Server and relational database management Experience with cloud platforms like Azure (Synapse, Data Lake) Programming in Python, PySpark, and T-SQL Additional Skills Familiarity with data analysis tools and workflows Strong communication and collaboration skills Experience in fast-paced, team-oriented environments more »
Employment Type: Permanent
Salary: £80000 - £100000/annum
Posted:

Lead Azure Data Engineer - £75,000

Durham, County Durham, United Kingdom
Nigel Frank International
you will have. Strong Azure Data Platform experience Experience leading/managing a team Strong understanding of Databricks Coding experience with both Python/PySpark and SQL Experience working with Azure Data Factory for creating ETL solutions This is just a brief overview of the role. For the full more »
Employment Type: Permanent
Salary: £65000 - £75000/annum
Posted:

Lead Azure Data Engineer - £75,000

Sunderland, Tyne and Wear, Tyne & Wear, United Kingdom
Nigel Frank International
you will have. Strong Azure Data Platform experience Experience leading/managing a team Strong understanding of Databricks Coding experience with both Python/PySpark and SQL Experience working with Azure Data Factory for creating ETL solutions This is just a brief overview of the role. For the full more »
Employment Type: Permanent
Salary: £65000 - £75000/annum
Posted:

Lead Azure Data Engineer - Newcastle - £75,000

Newcastle upon Tyne, Tyne and Wear, Tyne & Wear, United Kingdom
Nigel Frank International
you will have. Strong Azure Data Platform experience Experience leading/managing a team Strong understanding of Databricks Coding experience with both Python/PySpark and SQL Experience working with Azure Data Factory for creating ETL solutions This is just a brief overview of the role. For the full more »
Employment Type: Permanent
Salary: £70000 - £75000/annum
Posted:

BI Analyst

Greater Manchester, Warrington, Cheshire, United Kingdom
Langham Recruitment
in understanding, gathering, and analysing business requirements Bonus experience with any of the following: NoSQL, Progress, MariaDB, MongoDB, Spark SQL, ERP and CRM systems, PySpark, Pandas Package: Competitive salary Bonus Company car/car allowance 25 days holiday (rising to 28 days after 5 years of service) Private healthcare more »
Employment Type: Permanent
Posted:

BI Analyst

West Midlands, Bickenhill, West Midlands (County), United Kingdom
Langham Recruitment
in understanding, gathering, and analysing business requirements Bonus experience with any of the following: NoSQL, Progress, MariaDB, MongoDB, Spark SQL, ERP and CRM systems, PySpark, Pandas Package: Competitive salary Bonus Company car/car allowance 25 days holiday (rising to 28 days after 5 years of service) Private healthcare more »
Employment Type: Permanent
Posted:

BI Analyst

York, Fulford, City of York, North Yorkshire, United Kingdom
Langham Recruitment
in understanding, gathering, and analysing business requirements Bonus experience with any of the following: NoSQL, Progress, MariaDB, MongoDB, Spark SQL, ERP and CRM systems, PySpark, Pandas Package: Competitive salary Bonus Company car/car allowance 25 days holiday (rising to 28 days after 5 years of service) Private healthcare more »
Employment Type: Permanent
Posted:

Palantir Data Engineer

City of London, London, United Kingdom
Hybrid / WFH Options
83zero Limited
data integration pipelines, transformations, pipeline scheduling, Ontology, and applications in Palantir Foundry Design, develop and deploy data solutions in Palantir with excellent skills in PySpark and Spark SQL for data transformations Experience in designing and building interactive data applications working with Ontology, actions, functions, object views, automate, indexing, data more »
Employment Type: Permanent, Work From Home
Salary: £75,000
Posted:

Palantir Data Engineer

Manchester, North West, United Kingdom
Hybrid / WFH Options
83zero Limited
data integration pipelines, transformations, pipeline scheduling, Ontology, and applications in Palantir Foundry Design, develop and deploy data solutions in Palantir with excellent skills in PySpark and Spark SQL for data transformations Experience in designing and building interactive data applications working with Ontology, actions, functions, object views, automate, indexing, data more »
Employment Type: Permanent, Work From Home
Salary: £75,000
Posted:

Palantir Data Engineer

Birmingham, West Midlands, United Kingdom
Hybrid / WFH Options
83zero Limited
data integration pipelines, transformations, pipeline scheduling, Ontology, and applications in Palantir Foundry Design, develop and deploy data solutions in Palantir with excellent skills in PySpark and Spark SQL for data transformations Experience in designing and building interactive data applications working with Ontology, actions, functions, object views, automate, indexing, data more »
Employment Type: Permanent, Work From Home
Salary: £75,000
Posted:

Azure Data Engineer

City Of London, United Kingdom
Hybrid / WFH Options
Premier IT
data modelling Technical Skills Proficient in SQL Server and relational database management Experience with cloud platforms like Azure (Synapse, Data Lake) Programming in Python, PySpark, and T-SQL Additional Skills Familiarity with data analysis tools and workflows Strong communication and collaboration skills Experience in fast-paced, team-oriented environments more »
Employment Type: Permanent
Salary: £60000 - £70000/annum
Posted:

Lead Data Engineer - £100K - Hybrid

City of London, London, United Kingdom
Hybrid / WFH Options
Develop
Modeling within a cloud-based data platform Strong experience with SQL Server Azure data engineering stack, including Azure Synapse and Azure Data Lake Python, PySpark and T-SQL In return you will be offered a competitive salary and benefits package, remote working options and an opportunity to work with more »
Employment Type: Permanent, Work From Home
Salary: £80,000
Posted:

Azure Data Engineer - £65,000

Durham, County Durham, United Kingdom
Nigel Frank International
To be successful in the role you will have. Strong Azure Data Platform experience Strong understanding of Databricks Coding experience with both Python/PySpark and SQL Experience working with Azure Data Factory for creating ETL solutions This is just a brief overview of the role. For the full more »
Employment Type: Permanent
Salary: £55000 - £65000/annum
Posted:

Azure Data Engineer - £65,000

Sunderland, Tyne and Wear, Tyne & Wear, United Kingdom
Nigel Frank International
To be successful in the role you will have. Strong Azure Data Platform experience Strong understanding of Databricks Coding experience with both Python/PySpark and SQL Experience working with Azure Data Factory for creating ETL solutions This is just a brief overview of the role. For the full more »
Employment Type: Permanent
Salary: £55000 - £65000/annum
Posted:

Azure Data Engineer - £65,000

Newcastle upon Tyne, Tyne and Wear, Tyne & Wear, United Kingdom
Nigel Frank International
To be successful in the role you will have. Strong Azure Data Platform experience Strong understanding of Databricks Coding experience with both Python/PySpark and SQL Experience working with Azure Data Factory for creating ETL solutions This is just a brief overview of the role. For the full more »
Employment Type: Permanent
Salary: £55000 - £65000/annum
Posted:
PySpark
10th Percentile
£52,500
25th Percentile
£63,750
Median
£90,000
75th Percentile
£115,000
90th Percentile
£142,500