676 to 700 of 1,462 Permanent Databricks Jobs

TypeScript) and CloudFormation aws-lambda-powertools for observability CI/CD via AWS CodePipeline Grafana dashboards and CloudWatch alarms Product and analysis Databricks SQL, dashboards and notebooks for reporting Jupyter, numpy, pandas, plotly for investigation Cursor, Copilot, and a healthy amount of custom scripting How we work Small, highly collaborative ...

connecting microservices and AI agents. Background in secure containers, sandboxing, or confidential computing for regulated workloads. Experience with data‐intensive systems such as Spark, Databricks, or Data Mesh. Programming experience in Go, Python, or TypeScript. Contributions to open‐source or CNCF community projects. Job Benefits How we work: Hybrid working ...

vector databases and semantic search pipeline design. Essential - Experience with Model Context Protocol (MCP). Essential - Experience with large‐scale data platforms such as Databricks and search engines such as Elasticsearch, in an analytical or AI feature engineering context. Essential - Demonstrated ability to design enterprise‐grade AI systems with strong ...

Deep public sector experience, ideally in defence, intelligence, or national security. Solution architecture depth across cloud (AWS or Azure), data engineering (Python, SQL, Spark, Databricks), complex system integrations (REST APIs, SSO/SAML), and containerized deployments (Kubernetes, Docker). A track record partnering with commercial teams on pre-sales, capture ...

reliable partner to the wider organisation. Responsibilities Technical Delivery Design and build ingestion pipelines across a variety of sources using ADF and Databricks orchestration patterns. Build and optimise data transformations in Databricks, including fact/dimension modelling for data marts. Implement metadata-driven engineering practices that use platform contracts … review. Skills & Technologies Core Data Engineering Data warehouse and data mart modeling: fact/dimension design, slowly changing dimensions, schema evolution. Platform Stack Databricks notebooks and workflows; Azure Data Factory pipelines. Metadata-driven orchestration patterns and platform contract design. Analytics Consumption Power BI/Fabric semantic model and report delivery ...

experienced Senior Data Engineer to join them on a contract basis , taking end‐to‐end ownership of business‐critical data products on their Azure Databricks‐based data platform . This is a hands‐on role embedded directly within a product team, working closely with product managers and lead engineers … functional product team Act as a senior technical partner to product managers and lead data engineers Build and maintain high‐quality data pipelines using Databricks & Spark Convert requirements into clear technical designs and conceptual data models Ingest large, complex datasets and automate manual processes Improve data quality, observability, reliability ...

data development, data integrations, SQL, Python, data warehousing, & Azure data platforms is required by a leading company near Warrington. Any experience with Snowflake, Kimball, Databricks, & ThoughtSpot would be a bonus. The role can be Hybrid, with 2 days in the office. As part of an ongoing investment in data … data warehousing concepts and methodologies. * Experience working with relational databases and database schema design. * Experience building and maintaining ETL/ELT processes. Desirable Skills: * Databricks experience. * Azure Data Platform technologies, Azure Data Lake, Azure Analysis Services. * Snowflake, ThoughtSpot. * Knowledge of Kimball and Inmon data warehousing methodologies. * Exposure to AI-assisted ...

CACI Information Intelligence Group is seeking a Data Architect (Senior Technical Consultant) to design and deliver modern cloud data platforms with Snowflake and Databricks. You will lead platform architecture, governance, and security across multi-cloud ...

Senior Data Engineer to help shape the future of its data platform. You'll take ownership of building scalable data solutions in Databricks primarily, establishing a single source of truth, and enabling trusted, self-service access to data across the business. Location: UK, remote with very occasional visits … plus 10% bonus and an extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape ...

Data Science Festival is seeking a Data Solutions Architect to guide design and architecture across a large-scale data platform in Greater London. This senior role emphasizes shaping how data solutions are crafted while working ...

data migration activities. Perform data analysis and profiling. Configure Azure DevOps/GitHub environments and CI/CD processes for Azure Data Factory and Databricks code. Essential Skills & Experience: We are looking for candidates with: Strong experience designing and delivering Azure-based data platform solutions. Experience with technologies including … Microsoft Fabric o Power Apps o Azure Synapse o Azure Data Factory (ADF) o Databricks o Azure Functions o Azure App Service o Logic Apps o Azure Kubernetes Service (AKS) o Web Apps Hands-on expertise in PySpark, SQL and Python. Good knowledge of real-time streaming applications, preferably including ...

Responsibilities Develop and maintain scalable data pipelines using Azure Data Factory. Build and manage ETL processes using SQL and Python. Work with Azure Databricks and Azure SQL/SQL Server to process and manage large datasets. Design and implement data models using Kimball, 3NF and dimensional modelling approaches. Develop metadata … security throughout the data lifecycle. Experience Required Strong commercial experience working within Azure data environments. Hands-on experience with Azure Data Factory, Azure Databricks and Azure SQL/SQL Server. Strong SQL and Python skills. Previous experience working within Financial Services environments (Banks/Insurance/FinTech) Good understanding ...

Responsibilities Develop and maintain scalable data pipelines using Azure Data Factory. Build and manage ETL processes using SQL and Python. Work with Azure Databricks and Azure SQL/SQL Server to process and manage large datasets. Design and implement data models using Kimball, 3NF and dimensional modelling approaches. Develop metadata … security throughout the data lifecycle. Experience Required Strong commercial experience working within Azure data environments. Hands-on experience with Azure Data Factory, Azure Databricks and Azure SQL/SQL Server. Strong SQL and Python skills. Previous experience working within Financial Services environments (Banks/Insurance/FinTech) Good understanding ...

analytical skills, a passion for data, and the ability to translate complex information into clear business insights. Experience with Python (PySpark) and/or Databricks would be particularly advantageous. The Business Intelligence Data Engineer will: Design, develop and optimise ETL pipelines and data integrations. Build and maintain data models that … Engineering or similar role. Strong SQL skills and experience working with relational databases. Experience in working with & supporting modern cloud data platforms e.g. Snowflake, Databricks, Fabric Experience of data warehousing, data modelling and big data concepts. Experience with BI tools such as Qlik, Tableau or Power BI. You'll also ...

that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. We are building a governed, interoperable data estate that enables self‐service … well‐controlled outputs in a regulated environment. You will have strong SQL and advanced Excel skills as standard, with experience of Power BI and Databricks being a distinct advantage. You should be comfortable engaging stakeholders to shape requirements as you are building the solution hands‐on, motivated by the opportunity ...

that will be used across the organisation, including taking ownership of our data transformation and orchestration tooling; batch and streaming infrastructure and exploration tools (Databricks, Airflow, dbt) and look after our Datalake (ingestion, storage, governance, privacy). You’ll work with a modern, cutting‐edge data stack and play … have a strong grasp of their needs and how they operate Big data technologies, with expertise in tools & platforms such as Airflow, dbt, Kafka, Databricks and data observability & catalogue) solutions (e.g. Monte Carlo, Atlan, Datahub) Cloud Platform proficiency: familiarity with AWS, GCP, or Microsoft Azure, with hands‐on experience building ...

your team. Key Responsibilities Discipline Expertise and Leadership Technology breadth : Deep, production‐grade experience across AWS & or Azure native services, with expert-level Databricks and/or Snowflake and an Agile delivery mindset. On AWS, you’re fluent across the core services, for example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker … metadata management and cataloguing, through to advanced analytics and decision‐making. AI : You understand how AI is built and deployed in modern data platforms (Databricks, Snowflake) and cloud‐native services like Amazon Bedrock, with enough depth to guide teams and advise clients, spanning LLMs and SLMs, agentic automation, Human ...

Principal or Senior Architect designing large-scale, high-throughput, and mission-critical enterprise distributed systems.**Deep Technical Breadth & Depth:*** Advanced data architecture experience using Databricks, Microsoft Fabric, and large-scale data processing (Data Mesh/Lakehouse patterns).* Strong background in data integration and relational platforms* Proven experience designing highly … will be architecting solutions within a broadly evolving and heterogeneous technology landscape, notably encompassing:Compute & Services: Java, .NET, Python, Cloud-native microservicesData & Analytics: Databricks, Microsoft Fabric, AWS Glue, Athena, Event Streaming (e.g., Kafka)AI & ML: Azure OpenAI, LLM Integration patterns, Vector DatabasesIntegration & Storage: Azure Data Factory (ADF), SQL Server, Enterprise ...

s. Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and 3 years applied experience. Good working knowledge of AWS, Databricks, and Python. Experience across the data lifecycle. Demonstrated experience using enterprise-authorized AI capabilities within the work environment to support data engineering workflows with strong ...

Title: Senior Databricks Platform Engineer Location: (Seattle, Los Angeles or New York) 3 days a week onsite Duration: Temp - 7 months Pay Range: $60/hr. $65/hr. Job ID: 409750 About BCforward BCforward is a leading global IT consulting and workforce solutions firm providing services and support … India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity. Job Description We are seeking a Senior Databricks Platform Engineer to join our dynamic team. The ideal candidate will have strong experience in Databricks platform engineering, data pipeline development, CI/ ...

opportunity to shape one of the most significant public sector data modernization programs in the UK, establishing a modern data product ecosystem on a Databricks Lakehouse platform that promotes data democratization, self-service consumption, and enterprise-wide reuse. About the Role As a Data Products Architect – Databricks , you will lead … maintaining strong governance and security standards. Key Responsibilities Data Product Architecture & Design Lead the architecture and design of enterprise data products built on the Databricks Lakehouse platform Define and maintain standards, templates, and reference architectures that ensure data products are scalable, reusable, and interoperable Design data products that are discoverable ...

Senior Data Engineer – Databricks & DLT (Delta Live Tables) Certain Advantage are recruiting on behalf of our trading client for a Senior Data Engineerwith strong analytical capabilities and hands‐on experience in building scalable data solutions using a programming language like Python or Scala as well as experience in Databricks … Streaming, Autoloader). Programming skills inPython,SQL, or Proficiency indata modelling, ETL/ELT processes, and data architecture. Experience in MS Copilot, AI Foundry , Databricks (MosiacAI, MLflow, Agentbricks, Genie) Strong analytical background with problem‐solving skills. Performance tuning concepts like watermarking, late data handling, parallelism & checkpointing. Hands‐on expertise inADF ...

governance. You will collaborate with senior stakeholders to translate data into actionable recommendations. You will coach junior scientists, review code, and apply Python, Azure, Databricks, and ML techniques in a collaborative, hybrid environment based in London. #J-18808-Ljbffr ...

Databricks is seeking a Solutions Architect to lead the technical strategy for key accounts in London, driving platform adoption and delivering production-grade data and AI solutions. You will partner with customer architects and Directors, design scalable architectures, and influence product direction with insights from engagements across data engineering ...

engagement, ensuring accuracy and timeliness in all outputs. The ideal candidate will possess strong SQL and Excel skills, with experience in Power BI and Databricks being advantageous. The position supports a hybrid working model, fostering a culture of continuous improvement and collaboration. #J-18808-Ljbffr ...