76 to 100 of 150 PySpark Jobs in England

Senior Data Engineer Who we areArtefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain ...

experience using Pandas. Experience working with SQL and cloud-based data warehousing technologies. Knowledge of Google BigQuery would be highly beneficial. Exposure to PySpark and distributed data processing environments. Ability to analyse, transform, and optimise complex datasets. Strong problem-solving and stakeholder communication skills. How to Apply ...

passion for solving complex data challengesWhile we advocate using the right tech for the right task, we often leverage the following technologies: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such ...

They are also a key driver in translating Vision and Data Strategy into IT solutions and delivering on them.Strong hands-on expertise in Databricks, PySpark, Python and SQL is central to this role.Key Skills:Azure StackELT ExperienceData ModelingData Integration & IngestionData Manipulation and ProcessingGitHub, GitHub Actions, Azure DevOpsData Factory, Databricks ...

Comprised of big data storage platforms like Apache Hadoop and Ceph, OpenSearch and Elasticsearch, and a significant number of in-house developed applications in pyspark, scala and other languages to simplify our user’s interactions with the platform. These are built on a large remote Linux (predominantly) estate. ...

data platforms and influencing architecture direction across multiple engineering and data teams. Key experience: Enterprise-scale Data Architecture AWS cloud data platforms Spark/PySpark/Python Airflow & ELT/data processing Data Lakehouse & Data Products Streaming/Event-Driven Architecture Data Governance Architecture standards, patterns & technical design reviews ...

architecture experience. Dimensional data modelling experience. Kimball/Inmon Azure Data engineering with exposure to Synapse, Databricks, Data Factory Azure SQL. Python Scripting for Pyspark C# Experience Experience with TDD and Unit Testing. Desirables - Experience working on Multi Cloud Solutions Azure Integration experience with Azure Function Apps/Logic ...

architecture experience. Dimensional data modelling experience. Kimball/Inmon Azure Data engineering with exposure to Synapse, Databricks, Data Factory Azure SQL. Python Scripting for Pyspark C# Experience Experience with TDD and Unit Testing. Desirables - Experience working on Multi Cloud Solutions Azure Integration experience with Azure Function Apps/Logic ...

within the Microsoft ecosystem or Azure Exposure to tools such as Sparx Enterprise Architect or similar modelling tools Familiarity with technologies such as DBT, PySpark or Python is beneficial Interest in progressing into a data architecture focused role Ability to engage with both technical and non technical stakeholders APPLY ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTClient Advisory & Translation: Sit directly alongside clients, distinguish their goals ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark ark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTClient Advisory & Translation: Sit directly alongside clients, distinguish their ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark ark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTClient Advisory & Translation: Sit directly alongside clients, distinguish their ...

promote best practice across the analytics function. Independently own projects from discovery through to delivery. Skills & Experience Strong SQL skills. Python and/or PySpark experience. Experience within Product Analytics or Digital Analytics. Strong understanding of experimentation and A/B testing. Good grounding in statistics and analytical methodologies. ...

harness data.What we expect from you Degree in Statistics, Mathematics, Physics, Economics, or a related quantitative fieldStrong programming skills — Python and SQL are essential; PySpark experience is highly advantageousExperience with version control tools (e.g. GIT)Solid understanding of analytical technologies, tools, and techniquesExcellent logical thinking and problem‐solving abilitiesStrong ...

What we expect from you Degree in Statistics, Mathematics, Physics, Economics, or a related quantitative field Strong programming skills - Python and SQL are essential; PySpark experience is highly advantageous Experience with version control tools (e.g. GIT) Solid understanding of analytical technologies, tools, and techniques Excellent logical thinking and problem ...

Private equity-backed organisation with ambitious growth plans Essential Skills & Experience Strong experience as a Data Engineer within modern cloud data environments Expertise in PySpark, SQL and data transformation practices Experience building production-grade data pipelines Knowledge of Microsoft Fabric Experience working with Delta Lake and Lakehouse architectures ...

understand the 15/60 PM counter granularity and able to write codes for aggregation Build and optimize distributed data processing jobs using PySpark on AWS EMR with deployment of these jobs on Data warehouse platforms like Amazon Redshift & ClickHouse Work with Amazon MSK (Kafka) for real‐time data ...

clientsFull SDLC process experienceExcellent communications skills, both written and verbalBonus Points:Experience with the Go Lang eco-system tools and librariesExperience with Pandas and PySpark libraries would be a plusTechnical experience with Databricks or any similar Delta Lake platforms.Experience working with large datasetsExperience with AWS cloud deployments and APIExperience ...

skill further when working with non-technical audiences. Experience using at least one data-focused programming or analytical language, such as Python, R, SQL, PySpark or similar. Role is placed within the Advanced Analytics function, supporting the strategic Insights Engine programme. The project aims to move retail colleagues away ...

e.g. Mathematics, Statistics, Computer Science). Nice to Have: Familiarity with production environments, MLOps, or data pipelines. Experience working with large-scale data using PySpark or equivalent distributed data processing tools. Experience in gaming, e-commerce, or subscription-based products.Benefits: Discretionary bonus opportunityPrivate Medical InsuranceDental Scheme25 days holiday ...

business acts on.Fluency with large, complex behavioural datasets and the craft to work with them at scale: Python, SQL, and distributed processing (e.g. PySpark), plus standard ML tooling as the work requires.Excellent stakeholder communication: you can make a rigorous causal argument land with a non-technical commercial audience ...

with architects, engineers, and analysts to deliver secure, scalable, and high-performing migration solutions, leveraging technologies such as AWS Glue, Apache Iceberg, Python/PySpark, SQL, and YAML-based configurations.You will thrive in a collaborative, client-facing environment, with a passion for solving complex data challenges, ensuring delivery excellence … including AWS Glue and Apache IcebergValidate data feed pipeline migrations transitioning to new AWS Data Lakehouse architecturesTest pipelines underpinned by:AI ETL acceleratorsPython/PySpark transformationsSQL-based logicYAML configuration-driven orchestrationExecute and validate:Initial bulk data loadsSubsequent incremental/delta migrationsDevelop and run SQL-based validation and reconciliation queries ...

designing, developing and maintaining cutting-edge data solutions within Microsoft Fabric. You'll build and optimise data pipelines, lakehouses and data warehouses, using PySpark, Python, T-SQL and DAX to deliver scalable, high-performing solutions that drive business intelligence and analytics. Working closely with stakeholders across the business … years' experience in Data Engineering and hands-on experience with Microsoft Fabric, Databricks, Snowflake or similar cloud platforms. You'll have strong Python/PySpark skills, experience integrating with APIs, and a background in Agile development. If you're a detail-oriented problem solver with excellent analytical skills ...

designing, developing and maintaining cutting-edge data solutions within Microsoft Fabric. You'll build and optimise data pipelines, lakehouses and data warehouses, using PySpark, Python, T-SQL and DAX to deliver scalable, high-performing solutions that drive business intelligence and analytics. Working closely with stakeholders across the business … years' experience in Data Engineering and hands-on experience with Microsoft Fabric, Databricks, Snowflake or similar cloud platforms. You'll have strong Python/PySpark skills, experience integrating with APIs, and a background in Agile development. If you're a detail-oriented problem solver with excellent analytical skills ...

visible role where you'll combine strong technical skills with commercial thinking to drive meaningful product improvements. Your Skills & Experience Strong SQL skills Python (PySpark experience is beneficial) Experience in Product Analytics Strong knowledge of A/B testing and experimentation Excellent statistical analysis skills, with exposure to modelling ...