76 to 100 of 112 PySpark Jobs in England

teamWhat could set you apartExperience in the use of credit bureau dataExperience using Google Cloud Platform and/or Google Cloud Engineer qualificationsExperience of PySpark, BigQuery, Git and any/all of: DataFlow, DataProc, Airflow (or equivalents)We believe great things happen when teams connect. Our schedule is built ...

teamWhat could set you apartExperience in the use of credit bureau dataExperience using Google Cloud Platform and/or Google Cloud Engineer qualificationsExperience of PySpark, BigQuery, Git and any/all of: DataFlow, DataProc, Airflow (or equivalents)We believe great things happen when teams connect. Our schedule is built ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTLead Client Advisory: Sit directly alongside clients, goals and requirements ...

Physics, Statistics, or a related quantitative field. Core Technical Stack: Hands-on proficiency with Python, SQL, and Excel, alongside exposure to platforms like Databricks, PySpark, Palantir Foundry, or R.Specialized Experience: Proven track record in delivering advanced analytics, algorithm design, operational research, or big data engineering solutions. Energy & Utilities Affinity ...

integration and multi-market SCI knowledge desirable. Role 2: BNA Production-Readiness, MLOps & Integration Engineer Must Have: Strong hands-on background in Databricks, PySpark, Python and SQL Production pipeline engineering and troubleshooting Workflow orchestration and dependency management Idempotency, retry/restart and failure-recovery patterns CI/CD, version … platforms Role 3: CIS/SCI Integration & Post-Migration Stabilisation Engineer Must Have worked with: Strong hands-on background with Databricks, SQL, Python/PySpark ETL/ELT Data-pipeline migration Legacy-to-cloud modernisation Production troubleshooting Dependency analysis Pipeline repointing Error handling and recovery Data validation/reconciliation ...

query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery Support the performance … engineering, integration and analytics challenges Collaborate with experienced engineers, architects and data specialists in supportive, multidisciplinary teams Develop expertise across cloud-native data services, PySpark, SQL and modern engineering practices Access mentoring, knowledge sharing and development opportunities to help you grow your career Contribute to solutions that deliver measurable ...

deliver high-quality data products and insights. We are looking for people with extensive commercial experience with AWS Glue, developing Glue Jobs using PySpark and Python, AWS Glue Data Catalog, Crawlers, Workflows and triggers, Amazon S3 data lake implementation and management, AWS IAM roles, policies and security best practice. ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTClient Advisory & Translation: Sit directly alongside clients, distinguish their goals ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark ark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTClient Advisory & Translation: Sit directly alongside clients, distinguish their ...

bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise … help mature a growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ ...

bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise … help mature a growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ ...

bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise … help mature a growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ ...

query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery Support the performance … engineering, integration and analytics challenges Collaborate with experienced engineers, architects and data specialists in supportive, multidisciplinary teams Develop expertise across cloud-native data services, PySpark, SQL and modern engineering practices Access mentoring, knowledge sharing and development opportunities to help you grow your career Contribute to solutions that deliver measurable ...

Senior Data & AI Engineer Up to £90,000 - London/Hybrid An exciting opportunity has arisen for a Senior Data & AI Engineer to join an innovative technology business looking to expand its data engineering and ...

ensure reporting is accurate and useful, and improve engineering standards while supporting colleagues. What you'll do ·Build and optimise pipelines using Azure Databricks, PySpark, SQL, ADF and ADLS Gen2. ·Develop governed lakehouse solutions using Delta Lake, medallion architecture and Unity Catalog. ·Own Power BI semantic models, DAX measures … documentation, Git and CI/CD. ·Mentor colleagues and share good practice across the team. What you'll bring ·Strong production experience with Databricks, PySpark, Delta Lake and Unity Catalog. ·Hands-on Power BI expertise, including data modelling, DAX, RLS and performance optimisation. ·Strong SQL skills and experience with ...

Azure Data Engineer - 1/2 days onsite 18 month FTC Summary: Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines ...

Azure Data Engineer - 1/2 days onsite 18 month FTC Summary: Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines ...

Senior Data Engineer - Python, SQL, Airflow, Azure, Pyspark, Kubernetes Salary: Up to £80,000 per annum Benefits: Excellent benefits package including annual bonus, free onsite gym, and company pension scheme. About the Role We are seeking an experienced Senior Data Engineer to join an innovative SaaS business that … Leadership & Mentorship Technology Stack The successful candidate will have experience working with some or all of the following technologies: Data Processing: Apache Spark/PySpark Workflow Orchestration: Apache Airflow Containerisation: Kubernetes Cloud Platform: Microsoft Azure Data APIs & Semantic Layer: CubeJS Programming Languages: Python, SQL Essential Skills & Experience Degree ...

data science, statistical modelling and using data to solve problems. Some experience with programming languages or analytical tools, such as Python, SQL, SAS or PySpark, gained through university projects, placements, internships or employment. An understanding of statistical concepts and an interest in predictive modelling or machine learning. Strong analytical ...

comfortable with large datasets, distributed processing and applying software engineering discipline to data products; Foundry experience is highly desirable but strong Python/PySpark engineers who can learn Foundry quickly are encouraged to apply. Extensive experience with Python and PySpark/Apache Spark. Proven track record designing ...

progressing its implementation and ongoing development. Developing and extending a medallion lakehouse architecture across bronze, silver and gold data layers. Working hands-on with PySpark notebooks, SQL, Dataflows Gen2 and data integration technologies. Developing robust ETL/ELT pipelines, bringing data together from multiple business systems and sources. Applying … ideally bring: Strong hands-on experience with Microsoft Fabric, including Lakehouse architecture and its wider data engineering capabilities. Good working knowledge of PySpark and Spark notebooks, with the ability to understand, troubleshoot and extend existing code. A solid understanding of data warehousing, ETL/ELT processes, data integration ...

highly visible to senior leadership. You Will Work With Designing and scaling Azure Databricks-based data platforms Building robust data pipelines using Databricks, PySpark, Delta Lake and Airbyte Developing AI and LLM-powered capabilities within customer-facing products Delivering data products that support commercial decision-making Optimising Azure … senior-level engineer who can operate independently and make an immediate impact. Essential experience: Strong Azure Databricks expertise Advanced Python, SQL and PySpark skills Experience designing and building modern data platforms and pipelines Databricks optimisation, performance tuning and cost management Experience with Delta Lake and Lakehouse architectures Strong Azure ...

Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will focus on common IDs, Golden Records, entity … entity matching, deduplication, and survivorship rules. Integrate data from multiple source systems into the Databricks Lakehouse . Develop and optimize data pipelines using Databricks, PySpark, SQL, and Delta Lake . Build and enhance Bronze, Silver, and Gold data layers. Implement data quality, standardization, reconciliation, and validation processes. Support Unity ...

Experience: 610+ Years Key Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will focus on common … entity matching, deduplication, and survivorship rules. Integrate data from multiple source systems into the Databricks Lakehouse . Develop and optimize data pipelines using Databricks, PySpark, SQL, and Delta Lake . Build and enhance Bronze, Silver, and Gold data layers. Implement data quality, standardization, reconciliation, and validation processes. Support Unity ...

Data Engineer Up to £65,000 An exciting opportunity has arisen for a Data Engineer to join an organisation undertaking a significant transformation of its data and analytics landscape. As a Data Engineer, you will ...