201 to 225 of 489 PySpark Jobs in the UK

SSMS Data warehousing, ETL processes, best practice data management Azure cloud technologies (Synapse, Databricks, Data Factory, Power BI) Microsoft Fabric (not essential) Python/PySpark Proven ability to work in hybrid data environments Experience in finance or working with finance teams Ability to manage and lead on and offshore More ❯

coding languages eg. Python, R, Scala, etc.; (Python preferred) Proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies e.g. pySpark, Hive, etc. Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings, video, etc. Knowledge of machine learning modelling techniques More ❯

understanding of data definition, observability and data quality best practices. Proficiency in development languages suitable for intermediate-level data engineers, such as: Python/PySpark/SQL etc. Exposure to data science concepts and techniques is highly desirable. Strong problem-solving skills and attention to detail. Excellent communication and More ❯

requirements. Preferred Skills and Experience Databricks Azure Data Factory Data Lakehouse Medallion architecture Microsoft Azure T-SQL Development (MS SQL Server 2005 onwards) Python, PySpark Experience of the following systems would also be advantageous: Azure DevOps MDS Kimball Dimensional Modelling Methodology Power Bi Unity Catalogue Microsoft Fabric Experience of More ❯

have delivered business-critical software to large enterprises You are comfortable manipulating large data sets and handling raw SQL Experience using technologies such as Pyspark/AWS/Databricks is essential Experience creating ETL pipelines from scratch E-commerce and Financial Services industry experience preferred English fluency, verbal and More ❯

external data engineers and data scientists, who may not be familiar with the datasets, to accelerate development. Our technology stack consists of: Python and Pyspark AWS glue jobs assembled into Step functions Pydeequ for data quality testing Amazon Athena for querying data Hosted on AWS, using S3, Glue, Step More ❯

/Argo). Prior experience writing documentation for senior stakeholders; the ability to accurately abstract and summarize technical information is critical. Python programming skills: PySpark, Pandas, Jupyter Notebooks (3+ years in a professional environment). Prior experience working with git in a professional environment. Ability to work independently in More ❯

and reliable operations. Required: 6-10 years of experience in software development with a focus on production-grade code. Proficiency in Java, Python, and PySpark; experience with C++ is a plus. Deep expertise in Azure services, including Azure Storage, and familiarity with AWS S3. Strong understanding of data security More ❯

and reliable operations. Required: 6-10 years of experience in software development with a focus on production-grade code. Proficiency in Java, Python, and PySpark; experience with C++ is a plus. Deep expertise in Azure services, including Azure Storage, and familiarity with AWS S3. Strong understanding of data security More ❯

and reliable operations. Required: 6-10 years of experience in software development with a focus on production-grade code. Proficiency in Java, Python, and PySpark; experience with C++ is a plus. Deep expertise in Azure services, including Azure Storage, and familiarity with AWS S3. Strong understanding of data security More ❯

and reliable operations. Required: 6-10 years of experience in software development with a focus on production-grade code. Proficiency in Java, Python, and PySpark; experience with C++ is a plus. Deep expertise in Azure services, including Azure Storage, and familiarity with AWS S3. Strong understanding of data security More ❯

Cloud Technologies, AWS Data Lake. Experienced in a variety of Database technologies (Postgres, Oracle, Snowflake). Awareness of scripting languages such as Python and PySpark and uses within the context of data transfer/manipulation. Ability to assimilate technical and business information and to help translate these into practical More ❯

the financial services sector. •Proficient in data profiling, data cleansing, and data validation techniques. •Hands-on experience with SQL and working knowledge of Python, PySpark, or data wrangling tools. •Familiarity with modern data quality platforms (e.g. Purview, Informatica, Talend, Collibra DQ). •Ability to analyse and interpret data to More ❯

and DBA) Azure Databricks Azure Data Factory Microsoft Fabric Power BI, DAX Azure Data Lake Supporting: Azure ML Azure AI Services Azure Infrastructure Python, PySpark Microsoft Purview Principles: Relational and Dimensional Modelling Data Warehouse Theory Data platform Architecture models such as Lakehouse Data Science Master Data Management Data Governance More ❯

and reliable operations. Required: 6-10 years of experience in software development with a focus on production-grade code. Proficiency in Java, Python, and PySpark; experience with C++ is a plus. Deep expertise in Azure services, including Azure Storage, and familiarity with AWS S3. Strong understanding of data security More ❯

with NLP, image processing, information retrieval, and deep learning models Experience with experiment design and conducting A/B tests Experience with Databricks and PySpark Experience working with AWS or another cloud platform (GCP/Azure) Additional Information Health + Mental Wellbeing PMI and cash plan healthcare access with More ❯

and reliable operations. Required 6-10 years of experience in software development with a focus on production-grade code. Proficiency in Java, Python, and PySpark; experience with C++ is a plus. Deep expertise in Azure services, including Azure Storage, and familiarity with AWS S3. Strong understanding of data security More ❯

skills Excel proficiency Desirable but non-essential skills: Additional software engineering, cloud platform & data skills – (e.g. Linux, SQL, AWS (s3, CDK, Lambda, Glue, Athena), PySpark) Master’s degree, PhD or other additional qualification WORKING AT ZENOBE We’re passionate about sustainability and are proud to offer Team Zenobē a More ❯

as a Product Owner or Product Manager. Practical cloud-native development experience. Expertise in Computer Science, Engineering, Mathematics, or related fields. Deep knowledge of Pyspark, AWS Cloud, Databricks, Java. Experience in implementing scaled platforms. Excellent communication skills for diverse stakeholders. Preferred Qualifications, Capabilities, and Skills Hands-on coding experience. More ❯

software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.) Preferred qualifications, capabilities, and skills Familiarity with Pyspark and Databricks About the company J.P. Morgan is a leader in financial services, offering solutions to clients in more than 100 countries with one More ❯

a leadership or management role . Strong leadership skills , with experience in managing, mentoring, and developing engineering teams . Deep expertise in Databricks (SQL & PySpark) and Azure data services (ADF, Synapse, ADLS). Proven ability to drive data engineering strategies, best practices, and architectural decisions . Experience in building More ❯

etc.) In-depth knowledge of the financial services industry and their IT systems Practical cloud native experience Preferred Qualifications, Capabilities, And Skills Knowledge of PySpark & Databricks is desirable Knowledge with MQ, Kafka ABOUT US J.P. Morgan is a global leader in financial services, providing strategic advice and products to More ❯

Owner or Product Manager Practical cloud native experience Expertise in Computer Science, Computer Engineering, Mathematics, or a related technical field Deeper understanding of technologies: Pyspark, AWS Cloud, Databricks, Java Experience implementing scaled platforms Excellent communication skills to cater to diverse stakeholders Preferred Qualifications, Capabilities, and Skills Experience working at More ❯

effectiveness, including Azure DevOps. Considerable experience designing and building operationally efficient pipelines, utilising core Azure components, such as Azure Data Factory, Azure Databricks and Pyspark etc. Proven experience in modelling data through a medallion-based architecture, with curated dimensional models in the gold layer built for analytical use. Strong More ❯

and access controls. Monitor and optimize performance of data workflows using CloudWatch, AWS Step Functions, and performance tuning techniques. Automate data processes using Python, PySpark, SQL, or AWS SDKs. Collaborate with cross-functional teams to support AI/ML, analytics, and business intelligence initiatives. Maintain and enhance CI/… a cloud environment. Required Skills & Qualifications: 5+ years of experience in data engineering with a strong focus on AWS cloud technologies. Proficiency in Python, PySpark, SQL, and AWS Glue for ETL development. Hands-on experience with AWS data services, including Redshift, Athena, Glue, EMR, and Kinesis. Strong knowledge of More ❯