76 to 100 of 468 PySpark Jobs in the UK

Strong hands‐on experience with Quantexa implementation and development. Proven experience building and supporting big data platforms . Advanced knowledge of Apache Spark/PySpark . Strong programming skills in Scala and/or Python . Expertise in SQL and large-scale data modelling. Strong cloud experience across ...

documented solutions, while continuously improving how data is collected, transformed and consumed. What You'll Need Essential Strong SQL skills Python and/or PySpark experience Microsoft Fabric delivery experience ETL/ELT and data pipeline development API integrations Data modelling and transformation expertise Git/source control experience ...

particularly interested in engineers with strong hands-on Databricks experience. Essential Skills Commercial experience building solutions within Databricks. Strong hands-on expertise with PySpark, Spark SQL, and Delta Lake. Experience designing and supporting production-grade ETL/ELT pipelines. Strong Python and SQL development skills. Experience working with large ...

particularly interested in engineers with strong hands-on Databricks experience. Essential Skills Commercial experience building solutions within Databricks. Strong hands-on expertise with PySpark, Spark SQL, and Delta Lake. Experience designing and supporting production-grade ETL/ELT pipelines. Strong Python and SQL development skills. Experience working with large ...

data feed pipeline migrations repointing from an existing Data Warehouse to a new AWS Data Lakehouse architecture, underpinned with AI ETL accelerators, Python/PySpark, SQL and YAML configs.Test initial bulk then deltas from legacy to new.Execute automated test suites as part of sprint-based delivery and regression cyclesDefect ...

JSON over HTTPS Strong understanding of the SDLC Strong communication and collaboration skills for cross-team working Azure certifications are a plus C#, python, pyspark or similar preferable. We’ve been nationally recognised as a 5 star housebuildersince 2010 for supplying high-quality homes for all generations. That ...

JSON over HTTPS Strong understanding of the SDLC Strong communication and collaboration skills for cross-team working Azure certifications are a plus C#, python, pyspark or similar preferable. We’ve been nationally recognised as a 5 star housebuildersince 2010 for supplying high-quality homes for all generations. That ...

Need to Be Successful Deep, hands‐on experience building and running production data platforms and products A good level of experience in Python (particularly pyspark) for building data pipelines Strong AWS and Terraform experience, with infrastructure-as-code as your default way of working rather than something ...

utilities, nuclear, or defence) Clear exposure to project controls data (cost, schedule, risk, change, earned value) Hands-on skills in: Azure Data Factory, Databricks (PySpark), Synapse or equivalent Strong SQL and Python for transformations Building enterprise-ready datasets for Power BI Nice-to-Have Skills Familiarity with Primavera ...

clear technical tasks. Mentorship: A proactive mindset, eager to provide guidance to less experienced developers and support collaborative pair-programming. Desirable Skills Experience with PySpark or PySQL. Experience in Dimensional Modelling and data warehousing principles. Experience with SQL Server SSAS Tabular and DAX. Exposure to SQL Server RDBMS ...

clear technical tasks. Mentorship: A proactive mindset, eager to provide guidance to less experienced developers and support collaborative pair-programming. Desirable Skills Experience with PySpark or PySQL. Experience in Dimensional Modelling and data warehousing principles. Experience with SQL Server SSAS Tabular and DAX. Exposure to SQL Server RDBMS ...

enterprise-scale data products, defining technical strategy, architectural patterns and engineering standards while providing technical leadership across teams. Expert programming experience with Python/PySpark and advanced proficiency in SQL for large-scale data transformation, optimisation and analytics workloads. Extensive experience designing and implementing scalable data solutions on cloud ...

Azure Synapse, Azure Data Factory, and Databricks. Knowledge of SSRS, SSAS, SSIS, DAX, or MDX. Experience with Azure DevOps and Git. Exposure to Databricks, PySpark, or advanced analytics technologies. Microsoft Data and AI certifications, particularly Microsoft Fabric certifications. What can we offer you? Healthcare cash plan. This will give ...

premises data sources. Engineer reliable data pipelines and models: Design batch, incremental and near-real-time ETL/ELT using SQL, Python and PySpark; apply medallion, dimensional/Kimball, normalised and data-product patterns as appropriate; and use production-grade techniques such as CDC, SCD, schema-change handling, idempotency … implementation. Strong Microsoft Fabric experience across OneLake, Lakehouse, Warehouse, Data Pipelines, Notebooks and Dev/Test/Production workspace patterns. Advanced SQL, Python and PySpark, with practical experience of Delta/Parquet, medallion architecture and production-grade batch/incremental ETL/ELT. Strong Git and CI/ ...

premises data sources. Engineer reliable data pipelines and models: Design batch, incremental and near-real-time ETL/ELT using SQL, Python and PySpark; apply medallion, dimensional/Kimball, normalised and data-product patterns as appropriate; and use production-grade techniques such as CDC, SCD, schema-change handling, idempotency … implementation. Strong Microsoft Fabric experience across OneLake, Lakehouse, Warehouse, Data Pipelines, Notebooks and Dev/Test/Production workspace patterns. Advanced SQL, Python and PySpark, with practical experience of Delta/Parquet, medallion architecture and production-grade batch/incremental ETL/ELT. Strong Git and CI/ ...

Resiliency, and SecurityIn-depth knowledge of the financial services industry and their IT systemsPractical cloud native experiencePreferred qualifications, capabilities, and skillsAdvanced Apache Spark experience (PySpark/Spark SQL), including performance tuning (partitioning, shuffle optimization, caching), troubleshooting, and designing scalable batch/stream processing patterns.Deep lakehouse and data platform expertise ...

technical leader and mentor , raising standards across the data engineering community What you’ll bring Deep expertise in Databricks (Spark/PySpark, Delta Lake, Unity Catalog, Workflows) Strong experience building ETL/ELT pipelines , both batch and streaming Advanced Python and SQL skills Hands-on experience with cloud platforms ...

designs & builds data solutions and mentor junior engineers. We’re looking for someone who can offer the following skills & experience. Strong experience in Python, PySpark/Spark, Databricks, Azure Data Factory, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest. Experience designing, building and supporting scalable data ...

Data Engineering Foundation: Practical experience with data modelling, ETL/ELT, and various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow, Spark, Databricks, Fabric. Cloud Capability: Experience with at least one major cloud provider (AWS, Azure ...

/reporting outputs such as Tableau dashboards (data validation, extract refresh checks, reconciliation to source). Nice-to-Have Experience with tools such as PySpark, Spark SQL, Hive, Impala, HDFS, Parquet, and Oracle databases. Exposure to data governance concepts: critical data elements (CDEs), lineage, data quality dimensions, audit frameworks. ...

experience, including design and delivery of complex pipelines and data models in a cloud environment Strong proficiency in SQL; solid Python and/or PySpark capabilityDemonstrable experience with Databricks, Apache Spark, and Delta Lake architectureProven ability to design and own enterprise-grade canonical data models across multiple upstream source ...

testing, environment management Solid statistical foundations Insurance experience, ideally Lloyd's or London Market, is a big plus. So is deploying LLM based solutions, PySpark or Power BI. Permanent, up to £90,000 plus 20% bonus, three days a week in the office in the City. #J-18808-Ljbffr ...

such as S3, Kinesis, DMS, SNS, Glue, Athena, RDS • Experience with Data Warehouse databases like Snowflake/Redshift/BigQuery • Experience with Python/PySpark • Experience with implementing Rest APIs. • Experience with using and integrating BI tools such as QuickSight, Looker, Power BI, Tableau • Business Intelligence (BI) knowledge/ ...

Hands-on expertise in Snowflake and Databricks Proficient in Microsoft Azure, including Azure Data Factory and Azure Data Lake Advanced SQL and Python or PySpark skills Experience building enterprise-level ETL/ELT pipelines Knowledge of data modelling, governance, and data quality Previous consultancy or client-facing delivery experience ...

data platforms (AWS preferred).Exposure to data warehousing, data lakes and modern data architecture. Understanding of workflow orchestration and automation tools. Python experience (including PySpark) is beneficial but not essential. Exposure to BI platforms such as Power BI, Tableau or QuickSight, with an understanding of how backend data models ...