101 to 125 of 329 PySpark Jobs in England

troubleshooting, and collaboration with analysts and engineers to raise data quality. The ideal candidate has 6+ years in data engineering, strong SQL, Python/PySpark, and experience with Databricks and Azure, with a passion #J-18808-Ljbffr ...

pipeline development, data modelling, semantic layers and Power BI delivery. This role focuses on building a modern data platform using Azure Databricks, Python, PySpark and SQL, tying together marketing, sales and operations data to drive commercial performance. #J-18808-Ljbffr ...

tools, and emerging technologies. \* Develop reference architectures, solution blueprints, and best-practice playbooks for Databricks implementations. \* Architect scalable ETL/ELT pipelines using PySpark, Spark SQL, Delta Live Tables, and Databricks Workflows. \* Implement performance optimization strategies for notebooks, clusters, job orchestration, and data storage. \* Guide teams in building curated ...

Data Engineer Key skills: Python SQL Server/SQL Data Warehousing & Data Modelling Data Architecture Data Pipelines & Integration Solutions Microsoft Fabric Azure Cloud Technologies PySpark ETL/ELT Development Data Governance & Security Source Control (Git) Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good ...

Data Engineer Key skills: * Python * SQL Server/SQL * Data Warehousing & Data Modelling * Data Architecture * Data Pipelines & Integration Solutions * Microsoft Fabric * Azure Cloud Technologies * PySpark * ETL/ELT Development * Data Governance & Security * Source Control (Git) * Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good ...

Lake and Lakehouse architecture for efficient data management; experience with ETL processes and optimizing data pipelines for performance Be strong in Python, SQL, and PySpark Be passionate about building data products for stakeholders and customers, ensuring they are stable, scalable, secure, accurate, observable, and performant Enjoy collaborating closely with ...

about its values Values | PA ConsultingWe use a range of different tools and technologies depending on the specific task, these include: Data Bricks, Python, PySpark, R, Excel, Palantir Foundry and PowerBI.QualificationsEssential requirements Even if you don't meet every requirement below, feel free to still apply ...

about its values Values | PA ConsultingWe use a range of different tools and technologies depending on the specific task, these include: Data Bricks, Python, PySpark, R, Excel, Palantir Foundry and PowerBI.QualificationsEssential requirements Even if you don't meet every requirement below, feel free to still apply ...

insights clearly to both technical and non-technical audiences. Some other highly valued skills include: Strong SQL and database experience. Knowledge of Python/PySpark and data analytics. Experience working in a Call Centre or Contact Centre environment. Strong communication and stakeholder management skills. Ability to lead technical teams ...

PostgreSQL, MySQL, and Aurora. Integrating and migrating data using AWS DMS, Glue Connectors, EventBridge, SNS, and SQS. Strong programming capability in Python and PySpark for large-scale data processing. Proficiency in writing complex SQL queries, analytical functions, and performance tuning for large datasets. Familiarity with NoSQL databases such ...

Associate in Internal Audit - Data Engineering to design and implement robust data pipelines and analytics. You will work with Python, Pandas, Polars and PySpark to deliver scalable data products and AI-ready insights for audit teams. You will collaborate with data owners, develop data models, and ensure data quality ...

looking for a Senior Data Engineer - Tech Lead (Databricks, PySpark) to join our team in London, UK, in a hybrid working mode. In this role, you will lead the design, development and optimization of scalable cloud-native data architectures, focusing on Azure Databricks, PySpark and Lakehouse principles. … design and build of large-scale data platforms using Azure Databricks and modern cloud technologies Implement and optimize ETL workflows and streaming pipelines with PySpark and Delta Live Tables following Lakehouse principles Enhance performance, manage cloud costs and ensure platform reliability for structured streaming workloads Define data governance, security ...

build scalable data platforms and develop complex pipelines using Microsoft Fabric, Azure and Databricks. The role requires 6+ years in data engineering, strong Python, PySpark and SQL, and a solid understanding of Lakehouse and Medallion architectures. Collaboration with stakeholders and mentoring other engineers are key. #J-18808-Ljbffr ...

management, network design and access control; Databricks and OCI, or comparable platforms Strong Python and SQL, and experience building and monitoring production pipelines using PySpark or Spark Experience with infrastructure as code, CI/CD and a Git and GitHub workflow A track record of setting engineering standards ...

client sites or in our office, with hybrid work plan of at least two days per week. Use tools such as Data Bricks, Python, PySpark, R, Excel, Palantir Foundry and PowerBI to deliver scalable, high‐performance applications. Qualifications Essential requirements A degree, Masters or PhD in data science, mathematics ...

data architecture, data warehousing and cloud data platforms Hands-on experience with Azure technologies Experience developing ETL/ELT solutions Experience with Python, PySpark, Microsoft Fabric, streaming technologies or large-scale enterprise environments would be advantageous. In return they are offering A salary of up to £50,000 Hybrid ...

Data Lake Storage (Gen2), Purview, Cosmos DB, OpenAI, AzureML, AIFoundry, Kubernetes Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database technologies, data modelling and SQL Confident communicator who is able to explain technical terms to non‐technical audiences and mentor junior colleagues Leads ...

fields.· Proven track record of designing, developing, and deploying AI systems in production environments.· Proficient in Python and key ML libraries (e.g. PyTorch, PySpark, scikit-learn, Hugging Face Transformers).· Hands-on experience with modern data platforms and AI tooling such as Azure ML, Databricks, MLflow, LangChain, LangGraph.· Proven ...

Databricks) to design and deliver data pipelines, analytics solutions, and dashboards for diverse client engagements in the UK. You will work with Databricks and PySpark, build and optimize data workflows, and publish dashboards using Power BI, Tableau, and cloud services. Travel to client sites and collaboration with stakeholders ...

consultancy seeking a Senior Data Engineering Consultant (Databricks) to join on client-site delivery in London. You will design and optimise data pipelines with PySpark in Databricks, build dashboards in Power BI, and lead technical and project teams while engaging stakeholders. The role requires multi-disciplinary data expertise, strong ...

experience with cloud data platforms such as Azure or AWS, with a focus on Databricks. Highly skilled with Pythonic data processing tools such as Pyspark and SparkSQL. Strong understanding of data modelling concepts relational and non-relational databases. Proficiency in SQL and experience with data integration and ETL tools. ...

cloud-native experience Preferred Qualifications, Capabilities, and Skills: Experience with modern data technologies such as Databricks or Snowflake Hands-on experience with Spark/PySpark and other big data processing technologies Demonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial intelligence, machine ...

securityPractical cloud-native experiencePreferred Qualifications, Capabilities, and Skills: Experience with modern data technologies such as Databricks or SnowflakeHands-on experience with Spark/PySpark and other big data processing technologiesDemonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial intelligence, machine learning ...

MLflow, Airflow, model monitoring, API monitoring, data validation, data drift detection, autoscaling and access management. Strong Python experience, with helpful knowledge of Spark or PySpark for working with large‐scale data and machine learning systems. An understanding of feature stores and related data technologies used to support operational machine ...

Experience debugging moderately complex systems and improving reliability/performance Strong fundamentals: data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code ...