1 to 25 of 34 PySpark Jobs in London

segmentation , and AI , we want to hear from you! At E.ON Next, you'll have the opportunity to leverage your skills in Databricks and PySpark to tackle operational and customer experience-related challenges, driving impactful solutions in a dynamic and collaborative environment. Join us in revolutionising the energy sector … stakeholders and fostering strong business partnerships. Leveraging predictive modeling, segmentation techniques, and advanced AI algorithms to unlock valuable insights. Demonstrating proficiency in Databricks and PySpark to streamline data processing and analysis. A taste of what you’ll be doing: ● Consultative Leadership: Build a strategic understanding of the business, employ … Strong communication skills with the ability to engage with non-technical stakeholders. ● Expertise in predictive modeling, segmentation, and AI techniques. ● Proficiency in Databricks and PySpark for data manipulation and analysis. ● Experience solving operational or customer experience-related problems such as workforce management, demand forecasting, or root cause analysis. ● BSc more »

segmentation , and AI , we want to hear from you! At E.ON Next, you'll have the opportunity to leverage your skills in Databricks and PySpark to tackle operational and customer experience-related challenges, driving impactful solutions in a dynamic and collaborative environment. Join us in revolutionising the energy sector … stakeholders and fostering strong business partnerships. Leveraging predictive modeling, segmentation techniques, and advanced AI algorithms to unlock valuable insights. Demonstrating proficiency in Databricks and PySpark to streamline data processing and analysis. A taste of what you’ll be doing: ● Consultative Leadership: Build a strategic understanding of the business, employ … Strong communication skills with the ability to engage with non-technical stakeholders. ● Expertise in predictive modeling, segmentation, and AI techniques. ● Proficiency in Databricks and PySpark for data manipulation and analysis. ● Experience solving operational or customer experience-related problems such as workforce management, demand forecasting, or root cause analysis. ● BSc more »

Azure Search, Azure Stream Analytics Delta Lake and Data Lakes Apache Spark Pools, SQL Pools (dpools and spools) Experience in Python, C# coding, Spark, PySpark, Unix shell/Perl scripting experience Experience in API data sourcing using REST, Soap, and other API methodologies Experience working with structured and unstructured more »

minimum criteria) Extensive experience working as a Data Engineer Experience designing and building Databricks data products Strong programming skills in languages such as Python (PySpark preferred), Scala, or SQL Experience in owning, designing and implementing data pipelines ingesting enterprise levels of data volume. In-depth knowledge of data engineering more »

and ensuring best practices and understood and followed. Technical Skills and Qualifications Expert knowledge in python including libraries/frameworks such as pandas, numpy, pyspark Good understanding of OOP, software design patterns, and SOLID principles Good experience in Docker Good experience in Linux Good experience in Airflow Good knowledge more »

Principal Data Engineer – National Salary Circa £80,000. London Salary Circa £100,000. Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity for an Engineer Manager with significant more »

building a massively distributed cloud-hosted data platform that would be used by the entire firm. Tech Stack: Python/Java, Dremio, Snowflake, Iceberg, PySpark, Glue, EMR, dbt and Airflow/Dagster. Cloud: AWS, Lambdas, ECS services This role would focus on various areas of Data Engineering including: End more »

Ideal Qualifications Extensive experience working with large data sets with hands on technology skills to design and build robust Big Data solutions using Spark PySpark framework and Industry standard frameworks like Databricks Azure DevOps and other tools technologies on Azure Cloud Platform Understand the requirement and analyze the source … up with a high-performance Data Architecture Good to have the Retail functional Knowledge Must have Good Knowledge and Hands on experience in Python PySpark ADF and ADB Good to have Knowledge in ADF CI CD Experience in designing architecting and implementing large scale data processing data storage data … delivery teams Supporting business development and ensuring high levels of client satisfaction during delivery Skills Must have strong hands-on technical Skills in Python Pyspark Azure Databricks Spark ETL Cloud Azure preferred Good to have knowledge on ADF CI CD Please send your resumes to sri@s3staff.com for immediate more »

Data Engineer | up to £85,000 basic | London - Flexible Working | Join us in a complete greenfield project as a Data Engineer designing and developing solutions from scratch! You'll also play an important part in helping lay the foundations for more »

requirements and deliver solutions that drive business value. Requirements: 7+ years in a Data Engineering Role Excellent proficiency in SQL, Python, Microsoft Azure, Databricks, PySpark, Experience managing a team Details: Start Date: ASAP Duration: 3 months, option for permanent extension Day rate: Up to £400Ltd, depending on experience Annual more »

Ideal Candidate Profile: Proven track record in big data engineering with a solid understanding of ETL pipelines and data system projections. Proficiency in Python, PySpark, SQL, and familiarity with data science tools like R, ML, AI. Strong foundation in database management (SQL and No-SQL databases such as Aurora more »

understand consumers. Hands-on data engineering/development experience, preferably in a cloud/big data environment Skilled in at least one of Python, PySpark, SQL or similar Experience in guiding or managing roles in insight or data functions, delivering data projects and insight to inspire action and drive more »

month contract. Essential Skills: Insurance/Financial Services experience is highly desirable Design efficient and scalable data models. Azure Databricks (preferably), SQL, Python, PySpark, dimensional/star schema data modelling. Understanding of Conceptual, Logical and Physical Data Models Experience in ETL/ELT as well as Entity Relationship (ER more »

Must have experience of leading a team- Must also be hands on Apache JMeter with Groovy scripting TestCafe (Node Package Manager) – JavaScript/TypeScript PySpark – Python and Spark AWS Elastic Kubernetes Service (EKS) and Docker setup, administration, configuration AWS PostGres & Grafana setup, administration and configuration to store and visualise more »

enterprise strategy and overall industry trends. Big Data Technologies such as Hadoop, Spark, Kafka, etc. Hadoop: 5+ years Kafka: 3+ years Spark: 4+ years PySpark: 3+ years more »

A 6-month initial contract working on a range of greenfield projects, within a systematic trading firm based in the City. This is an Outside IR35 Position, offering circa £700 per day. You’re going to be playing a crucial more »

modern NLP methods required. Specifically: Transformers models (ex. BERT), LLMs, RAG & Fine-Tuning, OpenAI Stack, Langchain etc. Experience with Big Data technologies a plus —PySpark, H20.ai, Cloud AI platforms, Kubernetes Must be able to translate business requirements into analytical problems Must have proven ability to merge and transform disparate more »

understand the benefits, pros and cons of various technical options. Required skills: Strong experience within a Data Engineering role Excellent understanding of Databricks and Pyspark Strong knowledge of Azure Cloud Services Excellent understanding of SQL Good exposure to Azure Data Lake technologies such as ADF, HDFS and Synapse Good more »

London, UK Do you strive for engineering excellence and are ready to lead a modern tech transformation ? Do you have experience as a Azure, Pyspark, Cloud? We have the perfect role for you- Data Engineer - Tech Lead Careers at TCS: It means more TCS is a purpose-led transformation … design, development, and maintenance of Azure-based data pipelines and analytical solutions using Databricks, Synapse, and other relevant services. Perform Data Transformations: Leverage SQL, PySpark, and Python to perform data transformations, aggregations, and analysis on large datasets. Architect Data Storage Solutions: Architect data storage solutions using Azure SQL Database more »

segmentation , and AI , we want to hear from you! At E.ON Next, you'll have the opportunity to leverage your skills in Databricks and PySpark to tackle operational and customer experience-related challenges, driving impactful solutions in a dynamic and collaborative environment. Join us in revolutionising the energy sector … stakeholders and fostering strong business partnerships. Leveraging predictive modeling, segmentation techniques, and advanced AI algorithms to unlock valuable insights. Demonstrating proficiency in Databricks and PySpark to streamline data processing and analysis. A taste of what you’ll be doing: ● Consultative Leadership: Build a strategic understanding of the business, employ … Strong communication skills with the ability to engage with non-technical stakeholders. ● Expertise in predictive modeling, segmentation, and AI techniques. ● Proficiency in Databricks and PySpark for data manipulation and analysis. ● Experience solving operational or customer experience-related problems such as workforce management, demand forecasting, or root cause analysis. ● BSc more »

candidate needs experience and confidence to speak up when several teams can be involved in delivering the project. There is a massive emphasis on Pyspark and Databricks for this particular role. Technical Skills Required: Azure (ADF, Functions, Blob Storage, Data Lake Storage, Azure Data Bricks) Databricks Spark Delta Lake … SQL Python PySpark ADLS Day To Day Responsibilities: Extensive experience in designing, developing, and managing end-to-end data pipelines, ETL (Extract, Transform, Load), and ELT (Extract, Load, Transform) solutions. Maintains a proactive approach to staying updated with emerging technologies and a strong desire to continuously learn and adapt more »

to 3 years of experience required Degree in Statistics, Maths, Physics, Economics or similar field Programming skills (Python and SQL are a must have, Pyspark is recommended) Analytical Techniques and Technology Experience with and passion for connecting your work directly to the customer experience, making a real and tangible more »

continual improvement of their performance. REQUIRED SKILLS AND EXPERIENCE Proficiency in Python, including its associated data and machine learning packages such as numpy, pandas, pyspark, matplotlib, scikit-learn, Keras, TensorFlow, and more. Experience working with object-oriented programming languages. Experience in Forecasting and propensity. Expertise in utilizing SQL for more »

team might face. Skills and Experience Strong stakeholder management Experience implementing data strategy Strong experience managing Data Engineering teams Hands on experience working with Pyspark and Azure What's in it for you? £90,000 - £100,000 Please send your CV in for initial screening. Data Engineering Manager Desired more »

Are you looking for an exciting opportunity in Solution Architecture ? Are you passionate about everything cloud and data ? Join us as an AWS Cloud Data Platform Solution Architect Careers at TCS: It means more TCS is a purpose-led transformation more »