4 of 4 Remote/Hybrid Apache Spark Jobs in Scotland

AI Engineer

Location
Glasgow, Scotland, United Kingdom
code. LLMOps & AI Model Management: Familiarity with tools like MLflow, LangChain, Hugging Face, Kubeflow, or similar platforms. Data Processing: Working knowledge of Databricks/Spark or comparable large-scale data processing tools. SQL: Solid capabilities in data querying and preparation. Nice to have: Time-series forecasting or optimisation, ideally ...

Data Engineer

Location
Glasgow, Scotland, United Kingdom
role: Python SQL Cloud platform architecture (AWS, Azure, GCP) Data Lakes/Lakehouses and analytical tools (Databricks, Azure Fabric/OneLake, AWS Lake Formation, Spark, Athena, etc.) CI/CD and other DevOps practices such as IaC Testing Additional experience with the following would be beneficial but not essential … vector databases Streaming technologies (Kafka, Kinesis, Flink, etc.) Containers and related services (Docker, Kubernetes, container Registries, etc) Data modelling approaches (Kimball, Imnon) Orchestration tools - Apache Airflow, Prefect or cloud-native tools Backend software development (Java, APIs, Scalability, Logging and Monitoring etc.) MLFlow and other MLOps/Machine Learning Engineering ...

Senior Azure Data Engineer (Databricks) - Real-Time Pipelines

Location
City of Edinburgh, Scotland, United Kingdom
contribute to best practice engineering across cross-functional teams. Based in Scotland with hybrid work from Edinburgh or Glasgow, you’ll work with DeltaLake, Spark, Kafka, and Unity Catalog, applying DevOps ideas to CI/CD pipelines and GDPR-compliant data #J-18808-Ljbffr ...

Senior Azure Data Engineer (Databricks)

Location
City of Edinburgh, Scotland, United Kingdom
need to potentially work in either Edinburgh or Glasgow depending on client expectations. What You’ll Do Design and develop robust pipelines using DeltaLake, Spark Structured Streaming, and Unity Catalog Build real‐time event‐driven solutions with tools such as Kafka and Azure Event Hubs Apply DevOps principles … knowledge of DevOps tools and CI/CD processes Bonus Points For Development experience in Scala or Java Familiarity with Cloudera, Hadoop, HIVE, and Spark ecosystem Understanding of data privacy regulations, including GDPR, and experience working with sensitive data Ability to learn and adapt new technologies quickly to meet ...