1,176 to 1,200 of 1,467 Permanent Databricks Jobs

using Apache Flink, Apache Kafka, Spark Structured Streaming, or similar technologies Knowledge of modern data lakehouse architectures and ecosystem such as Kafka, Flink, Spark, Databricks, Snowflake, DBT, Airflow, Debezium, Delta/Iceberg, and comfort with Python/Java and SQL Experience with networking and security concepts within AWS, including VPCs … SaaS or FinTech company Technologies we use: AWS Services: MSK, EC2, VPC, IAM, S3, SQS, Managed Flink, EKS Data Lakehouse: Kafka, Flink, Spark, Databricks, DBT, Debezium #J-18808-Ljbffr ...

time Sector and subsector: IT | Test & QA Salary: Competitive salary You will own the quality assurance of Sagacity's client data platform deployments — the Databricks Lakehouse pipelines, gold-layer views, and analytics datasets that drive marketing, billing, credit and debt outcomes for our clients across financial services, retail, energy, telecoms … volume checks, data quality rules, and migration parity — using SPHERE's YAML-driven test framework Investigate test failures systematically: trace root causes through the Databricks Lakehouse stack (bronze → silver → gold), distinguish pipeline bugs from data issues, and produce clear, evidenced findings for the development team Manage QA work items ...

standards, risk & control libraries, evaluation checklists). Configure/enable client tools (e.g., Microsoft Purview for governance/lineage/labels; Azure ML/Databricks/Fabric for MLOps, model registry, monitoring; Power BI governance). Contribute to assurance reviews and quality gates; maintain well-structured evidence for audits … risk management, ISO/IEC 27001, UK GDPR/DPA 2018). Hands-on exposure to one or more platforms: Microsoft Purview, Azure ML, Databricks/MLflow, Azure Fabric, Power BI governance; plus experience with data catalogues (e.g., Collibra, Alation) is a bonus. Exposure to MLOps processes (model registry, approval ...

Lead Data Engineer 5+ Years Experience Scalable Batch & Streaming Pipelines Cloud Architecture (AWS, Databricks, Kubernetes) This Jobot Job is hosted by: Jim Quirk Are you a fit? Easy Apply now by clicking the "Quick Apply" button and sending us your resume. Salary: $180,000 - $250,000 per year … pipelines to collect and transform our rapidly growing Big Data set within our hybrid cloud architecture utilizing Kubernetes/EKS, Kafka/MSK, and Databricks/Spark. Mentor junior engineers in software and data engineering best practices. Produce clean, well-tested, and documented code with a clear design to support ...

builds and governs the data foundation that powers the business. You'll work within our stack — Python ingestion pipelines, Airflow orchestration, and Snowflake/Databricks — helping move data reliably and securely from source to decision-ready output.You'll implement features and fixes against a given design, handle known classes … root-causing pipeline issues independently before escalating Experience with workflow orchestration tools (Airflow or similar) and a cloud data warehouse/lakehouse (Snowflake, Databricks, or similar) Solid understanding of data pipeline concepts: idempotency, schema evolution, backfills, and data quality/testing Experience giving substantive code review feedback, not just style ...

several of the areas below and working knowledge across the rest. AI platform & cloud architecture Architect AI andDataPlatforms using a mix of technologies including Databricks, Snowflake,Claude Enterpriseand the native services of Azure,AWSand GCP-selecting the right tool for the workload rather than defaulting to a single vendor. Design … role — including accountability for end-to-end solution design,resourcingand commercial outcomes. Proven ability to architect enterprise AI platforms across a mix of technologies (Databricks, Snowflake, Azure, AWS, GCP) withstrong designcapability across cloud,dataand AI domains. Working understanding of how AI integrates with major operational systems such as SAP,Salesforceand ...

Sigma dashboards to provide Brand Operations with self-serve, ongoing visibility into productivity, profitability, and pricing trends Write and maintain SQL (Spark SQL/Databricks) queries to support both recurring and ad hoc analytics requests within tight reporting cycles Support new item planning by sizing SKU proliferation risk, flagging margin … years of experience in retail/CPG analytics, business intelligence, or brand/marketing analytics Advanced SQL skills (Spark SQL or Databricks experience strongly preferred) with hands-on experience building in a modern BI platform (Sigma, Tableau, or Power BI) Advanced proficiency in Microsoft Excel, including Power Pivot and complex ...

Umsetzung von Data Use Cases – von der Ideenfindung und Anforderungsaufnahme über Entwicklung und Testing bis hin zur Bereitstellung auf unserer Datenplattform (Databricks, Azure). Enge Zusammenarbeit mit den Entwicklungsteams für Data Products, um Datenqualität, Konsistenz und Verfügbarkeit vorgelagerter Datenprodukte sicherzustellen, z. B. Asset Master Data (AMD), Near Real Time SCADA … datengetriebenen, Analytics-, Consulting- oder Change-Management-Umfeldern. Fundiertes Verständnis von Data Analytics, Business Intelligence, KPI-Frameworks, operativem Reporting, Datenvisualisierung sowie modernen Cloud-Datenplattformen, einschließlich Databricks, Azure, Power BI, Snowflake und Python. Fähigkeit, komplexe geschäftliche Anforderungen in klare Produktanforderungen, User Stories und datengetriebene Initiativen zu übersetzen sowie Erkenntnisse in konkrete Handlungsempfehlungen ...

Umsetzung von Data Use Cases – von der Ideenfindung und Anforderungsaufnahme über Entwicklung und Testing bis hin zur Bereitstellung auf unserer Datenplattform (Databricks, Azure). Enge Zusammenarbeit mit den Entwicklungsteams für Data Products, um Datenqualität, Konsistenz und Verfügbarkeit vorgelagerter Datenprodukte sicherzustellen, z. B. Asset Master Data (AMD), Near Real Time SCADA … datengetriebenen, Analytics-, Consulting- oder Change-Management-Umfeldern. Fundiertes Verständnis von Data Analytics, Business Intelligence, KPI-Frameworks, operativem Reporting, Datenvisualisierung sowie modernen Cloud-Datenplattformen, einschließlich Databricks, Azure, Power BI, Snowflake und Python. Fähigkeit, komplexe geschäftliche Anforderungen in klare Produktanforderungen, User Stories und datengetriebene Initiativen zu übersetzen sowie Erkenntnisse in konkrete Handlungsempfehlungen ...

coverage expands naturally with each deployment increment rather Role Overview you will own the quality assurance of Sagacity’s client data platform deployments — the Databricks Lakehouse pipelines, gold-layer views, and analytics datasets that drive marketing, billing, credit and debt outcomes for our clients across financial services, retail, energy, telecoms … Technical Strong SQL skills — comfortable writing and reading complex analytical queries (window functions, CTEs, aggregations) to interrogate data andverify correctness Hands-on experience with Databricks — running queries, navigatingUnity Catalog, reading Spark job outputs and understanding what they Working knowledge of PySpark or Spark SQL — enough to read pipelinecode, understand transformations ...

Specialists is seeking a Senior Data Engineer for a hybrid, banking-sector contract role in London. You will build scalable data pipelines using Python, Databricks and Spark, and own critical data platforms end-to-end. The role demands strong SQL, Databricks expertise and experience delivering enterprise-grade data solutions ...

Evidensia UK is seeking a Data Engineer to advance our Databricks-based data platform and deliver scalable data pipelines across Azure SQL Server. You will work closely with SMEs and the Data Architect to shape our data management strategy and meet business needs. Ideal candidates bring deep experience with Databricks ...

Marks Sattin (UK) Ltd partners with an international digital infrastructure organisation to hire an Azure Databricks Data Engineer on a 6-month contract in London, with hybrid onsite/remote working. The role focuses on designing and delivering Databricks-based data solutions to support reporting, analytics, and future AI initiatives. ...

Atos is seeking an Azure Databricks Developer to design, develop, and support scalable data engineering solutions on the Azure data platform. You will build data ingestion, transformation, and processing pipelines to enable advanced analytics, AI, and BI capabilities. Collaborate with Data Architects, Data Engineers, and Solution Architects to deliver trusted ...

Associates seeks an experienced Senior Data Engineer for a contract role in London with flexible remote work. You will own Azure Databricks-based data products within a product team, shaping analytics and AI capabilities. You will design scalable data products, build and maintain production-grade pipelines on Databricks & Spark ...

London, United Kingdom is seeking a highly skilled Azure Databricks Data Engineer to design, develop and deliver cloud-based data integration and analytics solutions within our Insurance portfolio. You will work across data engineering, modelling, and transformation initiatives—building scalable pipelines, optimising performance, and ensuring best practices in data quality … governance. This is a hands-on technical role requiring strong Azure and Databricks experience, coupled with #J-18808-Ljbffr ...

experienced team delivering a critical public sector engagement at the forefront of data analytics and AI. The role focuses on designing and delivering advanced Databricks solutions within the Azure ecosystem. You will design, build, and optimize end-to-end data pipelines in Azure Databricks, mentor juniors, and take ownership ...

Consulting Limited is seeking a Technology Architect with deep expertise in Databricks to lead data engineering and cloud transformation initiatives. The ideal candidate will have over 12 years of experience and will be responsible for defining scalable architectural solutions and guiding engineering teams. The role focuses on designing data platforms … using Databricks Lakehouse architecture and optimizing ETL pipelines. Ideal candidates are expected to evaluate technologies and implement best practices while ensuring data governance. This is a hybrid role with 3 days in the office per week. #J-18808-Ljbffr ...

Our Story Hello there. We’re Zopa. We started our journey back in 2005, building the first ever peer-to-peer lending company. Fast forward to 2020 and we launched Zopa Bank. A bank that ...

Job Role: Cyber Data Engineer Location: Reading,Havant, Glasgow, Perth Duration: 6 months Office requirement: 2/3 day onsite in a week. Description: This role will support the technical delivery of cyber metrics by ...

Job Role: Cyber Data Engineer Location: Reading,Havant, Glasgow, Perth Duration: 6 months Office requirement: 2/3 day onsite in a week. Description: This role will support the technical delivery of cyber metrics by ...

Job Role: Cyber Data Engineer Location: Reading,Havant, Glasgow, Perth Duration: 6 months Office requirement: 2/3 day onsite in a week. Description: This role will support the technical delivery of cyber metrics by ...

Job Description Do you have experience in process improvement and want to leverage your skills in a new role? Then you found the right position! As an Automation and Testing Senior Associate within the Margin ...

Do you have experience in process improvement and want to leverage your skills in a new role? Then you found the right position! As an Automation and Testing Senior Associate within the Margin Services team ...

Senior Azure DevOps Engineer – Shared Records Reporting To: Chief Software Engineer Department: Development Location: Milton Keynes/Homebased - with occasional travel to the office in Milton Keynes Overview Graphnet Health is the leading UK supplier ...