101 to 125 of 144 Databricks Jobs in Scotland

reliability, performance, and security across data platforms while collaborating with cross-functional teams in an agile environment. You will guide SRE practices, manage AWS Databricks deployments, and enhance observability, automation, and incident response within the enterprise-scale data ecosystem. #J-18808-Ljbffr ...

J.P. Morgan is hiring a software engineer to design and deliver scalable solutions, leveraging Databricks, AWS, and a modern CI/CD toolchain. You will build secure production code, review peers, and drive AI-assisted engineering practices to improve quality and delivery speed. The role emphasizes containerized deployments, data pipelines ...

into dbt models and orchestrating workflows with Airflow. You will collaborate with system analysts, automation engineers, and data architects to deliver governed warehousing in Databricks, ensuring data quality and regulatory compliance across complex environments. #J-18808-Ljbffr ...

integrations, authentication and web security. Git/version control experience and strong troubleshooting skills. Desirable Experience Microsoft Dynamics 365 CRM Azure Subscription billing platforms Databricks or cloud data platforms Payment gateway integrations CI/CD pipelines and automated testing SEO and web performance optimisation What's on Offer ...

models Strong communications skills - with a focus on influencing, and bringing together technical and business areas Hands- on experience with AWS, Datawarehouse , Data migration, Databricks Expertise in Test tooling - eg Jira Experience in Banking sector Agile Key responsibilities Generating Test Strategy, Designs and Reports, working with teams across Business ...

excellence. Together, we'll create solutions that make a difference. Job Responsibilities Design and deliver scalable, secure, and reliable data pipelines using Python and Databricks to support enterprise-level business needs. Develop and maintain data models and architectures that enable high-quality analytics and reporting across multiple business functions. Drive … Formal training or certification on data engineering concepts and advanced applied experience. Hands-on experience developing and maintaining data pipelines using Python. Proficiency with Databricks for large-scale data processing and analytics. Experience working with both relational and NoSQL databases. Proficiency across the full data lifecycle, including ingestion, transformation, storage ...

team culture — one built on excellence, collaboration, and continuous improvement. Job responsibilities Develop workflows and extract, load, and transform pipelines using Python and Databricks to support scalable and reliable data solutions Support the review of controls to ensure sufficient protection of enterprise data across the data lifecycle Implement data security ...

experience[Preferred] Specific experience with LLMs and agentic systems[Preferred] Hands-on experience with technologies in the modern AI/LLM ecosystem, such as Databricks, Langchain, or MLFlow[Preferred] Advanced understanding of the probabilistic systems underpinning modern LLMs[Preferred] Experience building AI products in highly accuracy-sensitive domains such ...

opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems.Scale and maintain a managed AWS Databricks platform, and provides engineering and operational support for the platform to Application/Engineering teams.Drives reuse-first adoption of enterprise-authorized AI capabilities within … reinforce organization-level practices for reviewing AI-assisted recommendations and escalating uncertain decisions while maintaining resiliency, security, and auditability outcomes.Extensive experience with AWS, Databricks, or Snowflake platform administration and engineering support is a MUST.Experience with monitoring tools, automation frameworks, and CI/CD pipelines.Proficient in Python application program development with ...

eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems. Scale and maintain a managed AWS Databricks platform, and provides engineering and operational support for the platform to Application/Engineering teams. Drives reuse-first adoption of enterprise-authorized AI capabilities within … reinforce organization-level practices for reviewing AI-assisted recommendations and escalating uncertain decisions while maintaining resiliency, security, and auditability outcomes. Extensive experience with AWS, Databricks, or Snowflake platform administration and engineering support is a MUST. Experience with monitoring tools, automation frameworks, and CI/CD pipelines. Proficient in Python application ...

journey. Let’s create tomorrow, together, today. About the role and team: Role overview CreateFuture is delivering the migration of an ML estate from Databricks to an AWS SageMaker-based MLOps platform, working alongside AWS. The Senior Data Engineer (ML) sits in the Databricks workstream team (Delivery Manager, Lead … platforms. This is hands‐on delivery in a regulated iGaming environment: production pipelines, not notebooks. Key responsibilities Migrate ML data pipelines from Databricks (Spark/Delta Lake) to the SageMaker-based "golden template" architecture, working to the pattern set by the Lead ML Ops Engineer Build and amend feature engineering ...

testing coverage in a complex data migration environment. The role requires strong communication, banking sector experience, and hands-on experience with AWS, Databricks and data workflows within an Agile framework. #J-18808-Ljbffr ...

business decisions? We're seeking a Senior Data Engineer to play a pivotal role in the ongoing development of a large-scale Azure and Databricks data estate. This is a genuinely hands-on position where you'll spend your time building pipelines, modelling data, solving complex engineering challenges, and driving … best practice across the platform. What you'll be doing Designing, building and optimising Databricks pipelines and jobs Creating scalable Delta Lake solutions using Medallion architecture Developing and maintaining Azure Data Factory pipelines Owning data models across bronze, silver and gold layers Driving CI/CD, deployment and release processes ...

hands-on leadership role where you'll shape data engineering standards, design scalable lakehouse architectures, and drive innovation across Azure, Microsoft Fabric and Databricks environments. You'll work closely with data scientists, architects and engineering teams to deliver robust, secure, and high-performing data solutions while acting as the technical … authority for data engineering best practice. Key Skills: Extensive Azure Data Engineering experience Microsoft Fabric, Azure Data Lake & Databricks Python, SQL and modern data pipeline development Azure DevOps & CI/CD Data governance, security and quality assurance Strong stakeholder engagement and technical leadership Desirable: Spark, Terraform/Bicep, streaming/ ...

eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems. Scale and maintain a managed AWS Databricks platform, and provides engineering and operational support for the platform to Application/Engineering teams. Drives reuse-first adoption of enterprise-authorized AI capabilities within … reinforce organization‐level practices for reviewing AI‐assisted recommendations and escalating uncertain decisions while maintaining resiliency, security, and auditability outcomes. Extensive experience with AWS, Databricks, or Snowflake platform administration and engineering support is a MUST. Experience with monitoring tools, automation frameworks, and CI/CD pipelines. Proficient in Python application ...

Senior Data Engineer - AWS Location: Glasgow (Hybrid) | Practice Area: Technology & Engineering | Type: Permanent Engineer future-ready data platforms that power financial transformation. The Role We’re looking for a Senior Data Engineer with AWS to ...

Databricks is seeking a senior-level Enterprise Account Executive to own and grow Public Sector business across the Republic of Ireland and Scotland. You will inherit an established book of strategic government accounts and drive expansion with the growth team. Working with government stakeholders, cloud providers, and partners, you will ...

Our roster has an opening with your name on itWe are seeking a Data Engineering Manager to lead a team of data engineers in building high-quality, scalable data products and infrastructure. In this hybrid ...

production - training, packaging, deployment, monitoring, retraining, and decommissioning - in real-world business applications. Proven experience working with large datasets and distributed compute (Spark/Databricks or equivalent), with SQL fluency and an understanding of partitioning, performance, and cost. Hands-on experience using enterprise-authorized AI-assisted software development tools within … solid understanding of agile delivery practices including CI/CD, Application Resiliency, and Security. Preferred qualifications, capabilities, and skills Production experience with Databricks (Delta Lake, Unity Catalog, MLflow, Databricks Jobs) and workflow orchestration with Apache Airflow. Strong working knowledge of both supervised and unsupervised techniques, including tree-based and kernel ...

internal teams to assess architectural designs, technical capabilities, and fit within existing systems and information architecture.Build scalable feature engineering and data pipelines on Databricks using data lake sources, leveraging Spark/Delta and Databricks workflows/jobs.Required qualifications, capabilities, and skillsFormal training or certification in software engineering concepts with applied … CERT, and testing environments.Database experience with PostgreSQL (including RDS/Aurora) and MongoDB; ability to write automation/operations scripts in Python and Bash. Databricks experience including Spark, Delta, notebooks, workflows/jobs, and performance tuning; familiarity with GraphQL.Provide technical support during software development, including debugging environment-specific issues ...

internal teams to assess architectural designs, technical capabilities, and fit within existing systems and information architecture. Build scalable feature engineering and data pipelines on Databricks using data lake sources, leveraging Spark/Delta and Databricks workflows/jobs. Required qualifications, capabilities, and skills Formal training or certification in software engineering … testing environments. Database experience with PostgreSQL (including RDS/Aurora) and MongoDB; ability to write automation/operations scripts in Python and Bash. Databricks experience including Spark, Delta, notebooks, workflows/jobs, and performance tuning; familiarity with GraphQL. Provide technical support during software development, including debugging environment-specific issues ...

skills preferred in any or all of the following: Microsoft Excel, Google Suite, Atlassian Jira/Confluence, SQL, Python (Jupyter Notebook, Pandas, PySpark, etc.), Databricks, Bloomberg, Pitchbook, or other common financial services systems and applicationsHands-on SQL & Data Warehouse Experience: Strong proficiency using SQL and Databricks (PySpark) to navigate complex ...

annuities propositions, and providing collective fund solutions to third party customers. Job Purpose We are looking for a Platform Engineer with hands-on Azure, Databricks, and IaC experience, to support our transformation and the future growth of the Canada Life UK business. We are on a journey of simplifying … welcome. This role would suit someone with a background in platform engineering, cloud infrastructure, DevOps, or enterprise data platform support, particularly where Azure, Databricks, Azure Data Factory automation (or equivalent technology), and operational governance are central to the work. This is not a narrow support role or a generic cloud ...

opportunity, inclusion, and respect Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and applied experience. Extensive experience with AWS Databricks platform administration and engineering support is a MUST. Strong understanding of SRE principles, including SLIs, SLOs, error budgets, and incident management. Experience with monitoring tools … Spark, Glue, MapReduce etc. Excellent troubleshooting, analytical, and communication skills. Preferred qualifications, capabilities, and skills Experience in Data pipelines using Spark Exposure to AWS & Databricks Platform administration. Knowledge of containerization (Docker, Kubernetes) and orchestration. Familiarity with distributed systems and large-scale data processing. ABOUT US J.P. Morgan is a global ...

work across others as needed Experience with cloud platforms (preferably AWS) and working knowledge of both relational and distributed data platforms (e.g., Oracle, Databricks) Advanced understanding of agile methodologies, CI/CD pipelines, application resiliency, and secure software development practices Proficient in all aspects of the Software Development Life Cycle … PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelines In-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with hands-on experience in query optimization, PL/SQL, and shell scripting in a cloud-native AWS environment Demonstrated ability to lead or contribute ...