Apache Jobs in Scotland

9 of 9 Apache Jobs in Scotland

AWS Lead Data Engineer

Glasgow, Scotland, United Kingdom
Hybrid/Remote Options
Square One Resources
CloudFormation (mandatory) UI development experience (mandatory) Strong SQL, Python, and PySpark Experience with GitLab and unit testing Knowledge of modern data engineering patterns and best practices Desirable (Databricks Track) Apache Spark Databricks (Delta Lake, Unity Catalog, MLflow) Experience with Databricks migration or development AI/ML understanding (nice to have More ❯
Posted:

Data Engineer

Glasgow, Scotland, United Kingdom
Hybrid/Remote Options
NLB Services
REST APIs and integration techniques · Familiarity with data visualization tools and libraries (e.g., Power BI) · Background in database administration or performance tuning · Familiarity with data orchestration tools, such as Apache Airflow · Previous exposure to big data technologies (e.g., Hadoop, Spark) for large data processing · Strong analytical skills, including a thorough understanding of how to interpret customer business requirements and More ❯
Posted:

Data Engineer (DataBricks)

Glasgow, Scotland, United Kingdom
Synechron
APIs and integration techniques. Additional Assets (Preferred): Familiarity with data visualization tools (e.g., Power BI). Experience in database administration or performance tuning. Knowledge of data orchestration tools like Apache Airflow. Exposure to big data technologies such as Hadoop or Spark. Why Join Synechron? Be part of a dynamic, innovative team driving digital transformation in the financial sector. We More ❯
Posted:

Senior Data Engineer

Glasgow, Scotland, United Kingdom
Lorien
optimizing scalable data solutions using the Databricks platform. Key Responsibilities: • Lead the migration of existing AWS-based data pipelines to Databricks. • Design and implement scalable data engineering solutions using Apache Spark on Databricks. • Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. • Optimize performance and cost-efficiency of Databricks workloads. • Develop and maintain … best practices for data governance, security, and access control within Databricks. • Provide technical mentorship and guidance to junior engineers. Must-Have Skills: • Strong hands-on experience with Databricks and Apache Spark (preferably PySpark). • Proven track record of building and optimizing data pipelines in cloud environments. • Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM More ❯
Posted:

Sr.Databricks Engineer (AWS)

Glasgow, Lanarkshire, Scotland, United Kingdom
eTeam Inc
optimizing scalable data solutions using the Databricks platform. Key Responsibilities: Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on Databricks. Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. Optimize performance and cost-efficiency of Databricks workloads. Develop and maintain … best practices for data governance, security, and access control within Databricks. Provide technical mentorship and guidance to junior engineers. Must-Have Skills: Strong hands-on experience with Databricks and Apache Spark (preferably PySpark). Proven track record of building and optimizing data pipelines in cloud environments. Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM More ❯
Employment Type: Contractor
Rate: £350 - £400 per day
Posted:

Senior Databricks engineer

Glasgow, Scotland, United Kingdom
Hybrid/Remote Options
Undisclosed
data solutions using the Databricks platform. Key Skills/requirements Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on Databricks. Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. Optimize performance and cost-efficiency of Databricks workloads. Develop and maintain … best practices for data governance, security, and access control within Databricks. Provide technical mentorship and guidance to junior engineers. Must-Have Skills: Strong hands-on experience with Databricks and Apache Spark (preferably PySpark). Proven track record of building and optimizing data pipelines in cloud environments. Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM More ❯
Posted:

Senior Databricks Engineer CGEMJP

Glasgow, Lanarkshire, United Kingdom
Hybrid/Remote Options
Experis IT
data solutions using the Databricks platform. Key Skills/requirements Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on Databricks. Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. Optimize performance and cost-efficiency of Databricks workloads. Develop and maintain … best practices for data governance, security, and access control within Databricks. Provide technical mentorship and guidance to junior engineers. Must-Have Skills: Strong hands-on experience with Databricks and Apache Spark (preferably PySpark). Proven track record of building and optimizing data pipelines in cloud environments. Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM More ❯
Employment Type: Contract
Rate: GBP Daily
Posted:

Databricks Engineer

Glasgow, Scotland, United Kingdom
Capgemini
optimizing scalable data solutions using the Databricks platform. YOUR PROFILE Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on Databricks. Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. Optimize performance and cost-efficiency of Databricks workloads. Develop and maintain … within Databricks. Provide technical mentorship and guidance to junior engineers Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on Databricks. • Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. Optimize performance and cost-efficiency of Databricks workloads. Develop and maintain More ❯
Posted:

Principal Engineer

glasgow, central scotland, united kingdom
Hybrid/Remote Options
NHS National Services Scotland
over 100 physical and virtual servers mainly running Red Hat Enterprise Linux or Solaris with attached storage arrays. The servers run a variety of applications including Oracle databases, Weblogic, Apache and Tomcat. You will have a strong background in systems administration with skills covering: Solaris and Red Hat server management VMware vCenter Server up to version 8.0 Storage management … experience with Pure, Netapp and Nimble would be advantageous Experience of ldap technologies Web and application servers - mainly Apache and Tomcat. Also advantageous would be experience of working in a hybrid cloud environment especially MS Azure. Experience of container technologies such as Docker, and automation products such as Ansible would be desirable. The postholder will work within the IT More ❯
Posted: