51 to 75 of 99 PySpark Jobs in England

Machine Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query ...

Kubernetes Experience in creating production grade coding and SOLID programming principles, including test-driven development (TDD) approaches Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Experience in source-control software, e.g., GitHub Proficient at communicating results in a concise manner both verbally and written Experience in data ...

machine learning operations. Excellent communication skills with the ability to influence cross-functional teams and stakeholders. Experience with Python, SQL, Java, HQL, Hive, Pyspark, or similar programming languages preferred. Well-versed in design thinking principles. Great problem-solving and analytical skills. The total cash range for this position ...

efficient, and user-friendly reports that serve a demanding user base. * Creating and automating analytical pipelines using Power BI (DAX, Power Query), SQL, and PySpark to optimise data processing and reporting. * Integrating diverse data sources into a central environment, providing real-time insights into customer, financial, and operational metrics. ...

considering: We are looking for an experienced AWS Databricks Engineer with strong hands-on expertise in Databricks, AWS cloud services, PySpark, Spark SQL, Delta Lake, Python, SQL, and data engineering. The candidate will be responsible for designing, developing, optimizing, and supporting scalable data pipelines and lakehouse solutions … time. Your Role: Design, develop, and maintain scalable data pipelines using Databricks on AWS. Build and optimize data processing frameworks using PySpark, Spark SQL, Python, Delta Lake, and Databricks notebooks. Develop end-to-end ETL/ELT pipelines for ingestion, transformation, validation, and consumption. Work with AWS services such ...

junior engineers while translating Vision and Data Strategy into IT solutions and driving delivery across programs. The role requires hands-on work with Databricks, PySpark, Python and SQL, with a focus on data modeling, integration and cloud data services. #J-18808-Ljbffr ...

architecture experience. Dimensional data modelling experience. Kimball/Inmon Azure Data engineering with exposure to Synapse, Databricks, Data Factory Azure SQL. Python Scripting for Pyspark C# Experience Experience with TDD and Unit Testing. Desirables - Experience working on Multi Cloud Solutions Azure Integration experience with Azure Function Apps/Logic ...

architecture experience. Dimensional data modelling experience. Kimball/Inmon Azure Data engineering with exposure to Synapse, Databricks, Data Factory Azure SQL. Python Scripting for Pyspark C# Experience Experience with TDD and Unit Testing. Desirables - Experience working on Multi Cloud Solutions Azure Integration experience with Azure Function Apps/Logic ...

analytical and root cause analysis mindset - instinctively asks "why did this actually happen" rather than stopping at "it works now." Familiarity with Python or PySpark for notebook-based transformation logic a plus, not essential. Experience with Informatica (PowerCenter, IICS, or similar) as we break apart an old process ...

analytical and root cause analysis mindset - instinctively asks "why did this actually happen" rather than stopping at "it works now." Familiarity with Python or PySpark for notebook-based transformation logic a plus, not essential. Experience with Informatica (PowerCenter, IICS, or similar) as we break apart an old process ...

What we expect from you Degree in Statistics, Mathematics, Physics, Economics, or a related quantitative field Strong programming skills - Python and SQL are essential; PySpark experience is highly advantageous Experience with version control tools (e.g. GIT) Solid understanding of analytical technologies, tools, and techniques Excellent logical thinking and problem ...

/PnL/Trade lifecycle/Reconciliation Understanding of financial products such as: Derivatives (swaps, futures, options), bonds Good-to-Have Exposure to PySpark or large-scale data processing Experience working with quants or pricing models Basic scripting (Unix/Bash) Prior experience in global banking environments Experience ...

experience with joining, analysing, manipulating commercial and regulatory data for visualisation (Tableau) and apps Demonstrable experience in utilising data analytics tools and libraries (Pandas, PySpark, etc) Understanding of financial markets Experience in applying machine learning techniques to market data Experienced in developing user-friendly analytical products, e.g self-service ...

curious, data-driven minds with the following experience: Proven experience in General Insurance Pricing (Personal Lines preferred) Strong coding skills in Python, R, SQL, PySpark and SAS Experience with modelling techniques (GLMs, GBMs, Decision Trees, Neural Nets, Clustering) Exposure to or expertise in WTW's Radar or Emblem software ...

prototypes. Curiosity and a learning mindset tracking state-of-the-art advancements and evaluating their relevance. Strong data manipulation and engineering skills (e.g., PySpark, SQL, cloud-based data tooling). Collaborative approach to working with ML engineers, product managers, academic partners, and leadership stakeholders. A mindset that blends scientific ...

Design, build and maintain scalable and secure data pipelines on the Azure platform. Develop and deploy data ingestion processes using Azure Data Factory, Databricks (PySpark), and Azure Synapse Analytics . Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake … Required Skills & Experience - Azure Data Engineer: Proven commercial experience as a Data Engineer delivering enterprise-scale solutions in Azure Azure Data Factory Azure Databricks (PySpark) SQL & Python Understanding of CI/CD in a data environment , ideally with tools like Azure DevOps. Experience working within consultancy or client-facing ...

London, United Kingdom | Posted on 23/07/2026 Contract Role: Senior AI/ML Research Engineer Contract Location: London Contract Duration: 6 months initially (with potential extension) Contract Start Date: Immediate Contract Classification ...

team. This role offers a genuine blend of leadership and engineering, with around 30-50% hands‐on development. Key Skills: Python & Databricks Spark/PySpark Technical leadership Data architecture & Lakehouse Agile delivery Stakeholder management #J-18808-Ljbffr ...

London is hiring a Data Technical Lead to own the Azure Databricks data platform, with hands-on experience in Structured Streaming, Delta Live Tables, PySpark, Python and SQL. The role is onsite three days per week on an initial contract basis through the end of the year. You will ...

visible role where you'll combine strong technical skills with commercial thinking to drive meaningful product improvements. Your Skills & Experience Strong SQL skills Python (PySpark experience is beneficial) Experience in Product Analytics Strong knowledge of A/B testing and experimentation Excellent statistical analysis skills, with exposure to modelling ...

comfortable with large datasets, distributed processing and applying software engineering discipline to data products; Foundry experience is highly desirable but strong Python/PySpark engineers who can learn Foundry quickly are encouraged to apply. Essential qualifications • Extensive experience with Python and PySpark/Apache Spark. • Proven track record ...

ecosystem. This role will focus on building enterprise-grade data pipelines, migration frameworks and transformation processes using Azure Synapse Analytics, Azure Data Factory (ADF), PySpark, Python and SQL. You will work closely with technical and business stakeholders to ensure successful delivery of data migration and integration initiatives. Key Responsibilities … Data Factory (ADF). Develop Change Data Capture (CDC) solutions to support incremental and delta data loads. Create data transformation and cleansing processes using PySpark and Spark DataFrames. Develop Python-based utilities and automation scripts to support migration and validation activities. Design and optimise data models, SQL queries, stored ...

Senior Data Scientist Welwyn Garden City, Hertfordshire or Slough, Berkshire | Hybrid (2 Days Office) | Python | SQL | PySpark | Azure | Databricks | Machine Learning | Statistics | Time Series Forecasting | Propensity Models Role: Senior Data Scientist, Lead Data Scientist, ML Scientist, AI Data Scientist, Statistical Data Scientist, Predictive Analytics Key Skills: Senior Data Scientist … Data Scientist, Machine Learning, Artificial Intelligence, Predictive Analytics, Statistical Modelling, Python, SQL, PySpark, Azure, Databricks, MLflow, GitHub Actions, CI/CD, Time Series Forecasting, Propensity Modelling, Feature Engineering, Data Engineering, Azure Machine Learning, Azure Data Platform, Experiment Design, A/B Testing, Hypothesis Testing, Predictive Modelling, Customer Analytics, Marketing ...

Senior Databricks Architect Technology: Databricks (Spark, PySpark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus). Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data mesh architecture. The role … integrating legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such ...

Level Required in Years: 10 - 15 years Mandatory Required Skills Hands-on experience with Quantexa platform/Decision Intelligence Strong in Apache Spark/PySpark Proficiency in Python/Scala Experience in ETL, Data Engineering, Data Warehousing Knowledge of entity resolution, graph analytics, link analysis Experience working with large …/HDFS) Detailed Job Description Design and develop solutions using Quantexa Decision Intelligence Platform Build data ingestion, transformation, and ETL pipelines using Spark/PySpark Work on entity resolution, network analytics, and graph-based data models Integrate multiple structured/unstructured data sources for analytics use cases Ensure data ...