22 of 22 Apache Jobs in Glasgow

/ML use cases. Required Skills & Experience Strong hands-on experience in Data Engineering with delivery of production-grade solutions. Expertise in PySpark, Apache Spark, Python, and SQL. Strong experience designing and optimizing complex data pipelines and ETL/ELT frameworks. Hands-on experience with AWS services including ...

control systems such as Git. Knowledge of cloud-based data platforms and modern data engineering practices. Desirable Skills Experience with Scala development. Experience with Apache Spark or other distributed data processing frameworks. Experience with Kafka, Event Hubs, or other streaming technologies. Exposure to cloud platforms such as Azure ...

Data Engineering experience with Snowflake and Databricks native solutions.Experience on Snowflake Cortex is must.Proficiency in programming skills in Python.Experience with data processing frameworks like Apache Spark or Hadoop.Knowledge of database systems (SQL and NoSQL).Familiarity with cloud platforms (AWS, Azure) and their data services.Understanding of data modeling and data ...

data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar). Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.). Strong understanding of data quality, security ...

hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI) Familiarity with emerging technologies in data engineering ...

scripts, with a particular focus on building and optimizing multi-threaded, multi-process, concurrent, and asynchronous solutions. Experience with distributed computing tools (such as Apache Spark for Python) is a plus.Good to have experience in designing and developing AI-powered solutions using Large Language Models (LLMs), retrieval-augmented generation ...

build tools (Maven/Gradle). Desirable skills: Scala: Hands-on experience or a strong functional programming background using Scala. Big Data: Exposure to Apache Spark, Kafka, or Hadoop ecosystems. Cloud: Experience with AWS, Azure, or Google Cloud Platform. Experience in banking or financial services industry. Soft Skills Strong ...

hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI) Familiarity with emerging technologies in data engineering ...

SnowflakeDeep hands-on experience with Spark/PySpark and other big data processing technologiesExpertise in open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI)Familiarity with emerging technologies in data engineeringAbility ...

hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI) Familiarity with AI evaluation and observability practices ...

Layer: Design and implementation for governed reusable data views. Data Governance Tools: Collibra, Alation, Talend or equivalent. Expertise in ETL tools and processes (e.g., Apache NiFi, Talend, Informatica)Security: Data Privacy, Data Protection & Encryption frameworks & governanceEnterprise Architecture Frameworks: TOGAF, Zachman; familiarity with ITIL processes. Additional Helpful Skills: Cloud Platform ...

SnowflakeDeep hands-on experience with Spark/PySpark and other big data processing technologiesExpertise in open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI)Familiarity with AI evaluation and observability practices: evals ...

Application Resiliency, and Security. Preferred qualifications, capabilities, and skills Production experience with Databricks (Delta Lake, Unity Catalog, MLflow, Databricks Jobs) and workflow orchestration with Apache Airflow. Strong working knowledge of both supervised and unsupervised techniques, including tree-based and kernel methods (gradient boosting, random forest, SVM) and anomaly-detection ...

Code, Cursor, or AI-assisted coding CLI workflows) to accelerate code generation, refactoring, and daily execution. Message-Driven Architecture: Hands-on experience with Kafka, Apache Flink, or equivalent real-time event-streaming platforms. Containers & Data: Proficiency with Docker, Kubernetes, and relational databases (MS SQL, Sybase). Delivery Automation & Monitoring ...

Databricks or SnowflakeHands-on expertise with Spark/PySpark and big data processing technologiesKnowledge of open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks and model serving infrastructure or managed endpointsFamiliarity with AI evaluation and observability practices for LLM workloadsUnderstanding of agentic design ...

Snowflake Hands-on expertise with Spark/PySpark and big data processing technologies Knowledge of open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model serving infrastructure or managed endpoints Familiarity with AI evaluation and observability practices for LLM workloads Understanding ...

Development Java 17+, Spring Boot, Microservices AWS Cloud webMethods Integration Server & Flow Services File processing & data transformation SQL, database performance tuning & optimisation ETL/Apache Flink or equivalent REST APIs, messaging & event-driven architecture CI/CD, Git & DevOps Frontend: Angular/React, JavaScript, HTML, CSS Responsibilities: Develop ...

integration tools such as Jenkins, and automation testing tools such as Selenium, Cucumber, Flyway, or ConcordionKnowledge of Linux, shell scripting, and application services including Apache, Tomcat, and Spring BootExperience with user interface technologies (Angular, TypeScript, React) and user interface testing tools (Jasmine, Karma, Jest)Working experience with cloud-native ...

tools such as Jenkins, and automation testing tools such as Selenium, Cucumber, Flyway, or Concordion Knowledge of Linux, shell scripting, and application services including Apache, Tomcat, and Spring Boot Experience with user interface technologies (Angular, TypeScript, React) and user interface testing tools (Jasmine, Karma, Jest) Working experience with cloud ...

tools such as Jenkins, and automation testing tools such as Selenium, Cucumber, Flyway, or Concordion Knowledge of Linux, shell scripting, and application services including Apache, Tomcat, and Spring Boot Experience with user interface technologies (Angular, TypeScript, React) and user interface testing tools (Jasmine, Karma, Jest) Working experience with cloud ...

help strengthen pre and post-change validation, enhance observability, and support the continuous improvement of automation capabilities. Technology Stack Linux/UNIX Python Ansible Apache Airflow Prometheus Grafana Loki VMware F5 What We're Looking For We're looking for engineers with: Strong Linux/UNIX administration fundamentals Experience ...

DIHOP, DIHOC, AWS Glue, DBT, Snowflake, Databricks).o Apply architectural patterns for data lakes, streaming, and batch processing.o Exposure to cloud technologies – Snowflake, Redshift, Apache Flink and Apache Kafka.**Technical POCs**o Technical assessment of Cloud data technologies to leverage considering Fraud Business and technical requirementso Design, execute ...