226 to 250 of 265 PySpark Jobs in England

star schema and other best practices to optimise data usability. Sets best practices and standards on how we use SQL & dbt/Python/Pyspark and/or other languages to solve business problems. Becomes an expert in the business subject area the team are working on, holding expertise … team click. Were a group that chooses to lift each other up and think smart every day. Extensive experience in SQL/Python/Pyspark and/or other languages relevant to data processing Extensive experience in dbt and ideally Airflow (or other orchestration tools) Extensive experience in Entity ...

The PureGym Way The PureGym Group is a global gym business with a community of more than 700 gyms and over 2 million members. At PureGym, everything we do comes back to one simple idea ...

seeking an experienced Senior Data Engineer to design, build, and maintain scalable data pipelines and distributed data processing solutions. Mandatory/Primary Skills: Python PySpark AWS SQL Experience 4 to 7 years of hands‐on experience in Data Engineering and building scalable data solutions. Strong experience working with … based data engineering services and cloud data platforms . Technical Skills Strong hands‐on expertise in Python and PySpark for large-scale data processing. Advanced proficiency in SQL , including writing complex queries, query optimization, and data analysis. Strong experience with AWS services relevant to data engineering and cloud-based ...

Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud platforms. Expertise in automating ETL/ELT pipelines using PySpark and Spark SQL across Azure-based data environments. You and your role As a Data Engineer, you will design build and enhance scalable …/ELT pipelines using Python and PySpark, ensuring data solutions are reliable, efficient and aligned with engineering best practice. You'll work closely with stakeholders to understand complex business requirements, transforming data into trusted, high-quality datasets that enable valuable insights, reporting and decision-making. You will manage ...

Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud platforms. Expertise in automating ETL/ELT pipelines using PySpark and Spark SQL across Azure-based data environments. You and your role As a Data Engineer, you will design build and enhance scalable …/ELT pipelines using Python and PySpark, ensuring data solutions are reliable, efficient and aligned with engineering best practice. You'll work closely with stakeholders to understand complex business requirements, transforming data into trusted, high-quality datasets that enable valuable insights, reporting and decision-making. You will manage ...

Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud platforms. Expertise in automating ETL/ELT pipelines using PySpark and Spark SQL across Azure-based data environments. You and your role As a Data Engineer, you will design build and enhance scalable …/ELT pipelines using Python and PySpark, ensuring data solutions are reliable, efficient and aligned with engineering best practice. You'll work closely with stakeholders to understand complex business requirements, transforming data into trusted, high-quality datasets that enable valuable insights, reporting and decision-making. You will manage ...

Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud platforms. Expertise in automating ETL/ELT pipelines using PySpark and Spark SQL across Azure-based data environments. You and your role As a Data Engineer, you will design build and enhance scalable …/ELT pipelines using Python and PySpark, ensuring data solutions are reliable, efficient and aligned with engineering best practice. You'll work closely with stakeholders to understand complex business requirements, transforming data into trusted, high-quality datasets that enable valuable insights, reporting and decision-making. You will manage ...

Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud platforms. Expertise in automating ETL/ELT pipelines using PySpark and Spark SQL across Azure-based data environments. You and your role As a Data Engineer, you will design build and enhance scalable …/ELT pipelines using Python and PySpark, ensuring data solutions are reliable, efficient and aligned with engineering best practice. You'll work closely with stakeholders to understand complex business requirements, transforming data into trusted, high-quality datasets that enable valuable insights, reporting and decision-making. You will manage ...

pipelines to ingest, transform, and prepare data Develop and optimise datasets for reporting and analytics Implement data transformations using SQL and Python (incl. PySpark) Monitor, troubleshoot, and improve performance of data pipelines and queries Apply data quality controls and maintain clear documentation Contribute to ongoing improvements in data architecture … with AWS data services (e.g. Redshift, Athena, S3, Glue, Lambda) Strong SQL skills Exposure to SnapLogic or similar integration platforms Proficiency in Python (including PySpark) Familiarity with modern data tooling (e.g. open table formats, DuckDB beneficial) Experience with version control (Git/CodeCommit preferred) Awareness of BI tools (e.g. ...

Snowflake – Warehouses, Streams/Tasks, Snowpipe, Snowpark, UDFs/Stored Procedures, Time Travel and Cloning. Snowpark and end‐to‐end pipeline development. Experience with PySpark, Polars or Dask is also valuable. Python, including testing, build tooling and engineering best practices. SQL, including Snowflake‐optimised SQL. dbt, including Jinja templating … champion better ways of working. Nice to Have Experience with Docker, Java/Scala, Kafka, Pulsar, Azure Event Hub, Collibra, Apache Iceberg, Apache Arrow, PySpark or AI engineering technologies such as Snowflake AI, LangChain, LlamaIndex or Pinecone would be advantageous. This is a great opportunity to join a collaborative ...

Remote - United Kingdom JOB ID: FEQ427R333 Location: The customer is based in Leeds or Manchester, United Kingdom Industry: Enterprise Retail or CPG (UKI Enterprise) - The customer is based in Leeds. You will be visiting the ...

seeking an experienced Senior Data Engineer to design, build, and maintain scalable data pipelines and distributed data processing solutions. You will use Python, PySpark, AWS, and SQL to ingest, transform, and analyze large datasets from multiple sources, ensuring data quality, performance, and reliability. The role requires ...

verbal communication skills, including the ability to explain complex methodology to diverse audiences. You might also have Familiarity with Databricks, DBT, Spark/PySpark, or similar large‐scale data platforms. Modified infrastructure‐as‐code (e.g. Terraform) or contributing to production data pipelines. Mentored junior data scientists or engineers. Knowledge … passion for, the cryptocurrency and blockchain space. Technologies we use Python SQL Databricks DBT PySpark/Spark Terraform AWS Postgres We encourage applicants across any race, ethnicity, gender/gender expression, age, spirituality, ability, experience and more. If you need any accommodations to make our interview process more accessible ...

Technical Skills You'll have experience with some of the following: Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these … Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every CV sent to clients, we donate ...

purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon … platforms - here you will design, build, maintain, and optimise scalable data products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your ...

purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon … platforms - here you will design, build, maintain, and optimise scalable data products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your ...

sets Programming experience (focus on machine learning): SQL and Python’s Data Science stack; good knowledge of at least one big data framework (e.g., PySpark, Hive, Hadoop) is a plus. R, SPSS, and SAS are considered nice-to-have Strong understanding of machine learning methods and experience applying them … into production or applied business environments is a plus While we advocate using the right tech for the right task, we often leverage: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such ...

Capgemini in Northampton is seeking an experienced Data Engineer to design, develop, and maintain scalable data pipelines using Python, PySpark, and SQL. You will work with large datasets and distributed computing frameworks, delivering data-driven solutions for business needs. The role requires 7–9 years in data engineering, strong … Python, PySpark and SQL skills, and exposure to Scala; cloud platform experience and DevOps practices are a plus. #J-18808-Ljbffr ...

Capgemini is seeking an experienced Data Engineer in Northampton to design, develop and optimize scalable data pipelines using Python, PySpark and SQL. You will work across big data technologies, collaborate with stakeholders, and help modernize data platforms in a hybrid environment. Ideal candidates will have 7–9 years … data engineering, strong Python and PySpark skills, expert SQL, and exposure to Scala and cloud platforms such as Azure, AWS, or GCP. #J-18808-Ljbffr ...

deploying the STRATOS platform to their needs Design and implement scalable generative AI workflows using platforms like Palantir AIP Execute complex data integration using PySpark and other distributed technologies Collaborate directly with clients to understand context, priorities, and key outcome Requirements Minimum 2-4 years of solid experience … tier consultancy. The ability to translate complex and sometimes ambiguous business requirements into clean and maintainable data pipelines Excellent knowledge of PySpark, Python and SQL fundamentals The ability to get to grips with new technologies quickly Preferred Skills and Qualifications Experience in dashboarding tools, Typescript and API development Familiarity ...

role: Lead Developer role for a global organization, responsible for designing, implementing and optimizing Python and cloud based solutions using AWS and PySpark for data intensive and regulatory focused applications. The role requires strong experience in PL SQL and AWS services, owning end to end technical delivery, code quality … solutions on AWS cloud that leverage core services to support highly available data processing pipelines and transaction workflows aligned with enterprise standards. Implement optimized PySpark jobs for large scale data transformations, ensuring efficient resource usage, predictable performance and alignment with agreed data models and quality rules. Create and refine ...

expertise in marketing analytics, building MMM model via Meridian, Robynand/or PyMc, multi touch attribution, customer lifecycle modelling. Proficiency in SQL, Python, R, PySpark and dashboarding in PowerBI/Looker. Experienced running Geolift test, causal inference model, and other forms of experimental design. Solid foundation in machine learning … strategies. Preferred experience in the eCommerce, technology or marketing industry. So if youre an expert in Data Science, have strong Python/SQL/Pyspark skills and considerable knowledge in test design, implementation and reporting, can work with initiative and can build great working relationships within the business, this ...

Description About us Analytium is a boutique UK data and analytics consultancy - 14 people, 150 projects delivered for 50 clients. We are embedded in a UK tier-one bank, modernising one of the largest SAS ...

Office location – London or Horsham, 3 days a week. Build and automate ML pipelines for feature engineering, model training, and model scoring using Python, PySpark, Databricks, and MLflow. Productionise Data Science models, converting notebooks into modular, tested, production-ready code. Deploy models into batch and real-time environments, managing … quality, reproducibility, and operational reliability. Your skills and experience: Experience with ML platforms including Databricks, MLflow, Delta Lake, and cloud environments. Proficient in Python, PySpark, and SQL, following production coding best practices. Understanding of data, distributed ML pipelines, and model deployment patterns, including monitoring, drift detection, and lifecycle operations. ...

Office location – London or Horsham, 3 days a week. Build and automate ML pipelines for feature engineering, model training, and model scoring using Python, PySpark, Databricks, and MLflow. Productionise Data Science models, converting notebooks into modular, tested, production-ready code. Deploy models into batch and real-time environments, managing … quality, reproducibility, and operational reliability. Your skills and experience: Experience with ML platforms including Databricks, MLflow, Delta Lake, and cloud environments. Proficient in Python, PySpark, and SQL, following production coding best practices. Understanding of data, distributed ML pipelines, and model deployment patterns, including monitoring, drift detection, and lifecycle operations. ...