26 to 50 of 360 Apache Jobs

Secure Data Engineer

Location
Newcastle upon Tyne, England, United Kingdom
will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations.We are looking ...

Senior – Principal Consultant - Architecture

Location
West of England, England, United Kingdom
engineering Site Reliability Engineering principles Data & Analytics Experience with technologies such as: Databricks Microsoft Fabric Azure Data Factory Synapse Analytics Snowflake BigQuery Redshift Kafka Apache Spark Knowledge of: Data modelling Data governance Data integration Data migration Data warehousing Master Data Management Applications & Integration Experience designing solutions using ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands ...

Data Platform Specialist

Hiring Organisation
Anson Mccade
Location
South East, United Kingdom
Employment Type
Permanent Contract, On-site
technical leadership of data engineering teams. Experience with AWS, Azure or GCP. Knowledge of Databricks, Snowflake or modern cloud data platforms. Strong experience with Apache Spark, SQL, Kafka and ETL/ELT pipelines. Understanding of Lakehouse, Medallion and Data Mesh architectures. Experience with Terraform, CI/CD, data quality ...

Data Engineer / AI Engineer

Location
Bracknell, England, United Kingdom
builder and owner before IT infrastructure is fully in place — a 'zero-to-one' mindset. Nice to Have Familiarity with orchestration tools such as Apache Airflow, dbt, or Azure Data Factory. Exposure to LLM frameworks (LangChain, OpenAI API, Azure OpenAI).Experience with version control (Git/GitHub ...

Azure Databricks Developer

Location
United Kingdom
Support platform engineering activities, including CI/CD implementation, environment promotion, performance optimisation, and operational support. Skills we can’t do without: Azure Databricks, Apache Spark, PySpark, and Spark SQL expertise. Experience building enterprise-scale ETL/ELT pipelines within Azure environments. Strong Python and SQL development skills. Experience ...

Azure Databricks Developer (Remote) - Data Engineering & AI

Location
United Kingdom
Support platform engineering activities, including CI/CD implementation, environment promotion, performance optimisation, and operational support. Skills we can’t do without: Azure Databricks, Apache Spark, PySpark, and Spark SQL expertise. Experience building enterprise-scale ETL/ELT pipelines within Azure environments. Strong Python and SQL development skills. Experience ...

Senior Data Engineering Consultant

Location
United Kingdom
ability to see the end-to-end solution whilst leading a project. Required Tools and Technologies: Microsoft Azure and cloud computing concepts Apache Spark - Databricks, Microsoft Fabric or another Spark engine Python - we build most of our solutions in Python SQL - writing complex high-performance queries, understanding how queries ...

Senior Data Engineer

Hiring Organisation
We Are Dcoded Limited
Location
South East, United Kingdom
Employment Type
Permanent Contract, Hybrid
Salary
£75,000
production pipelines Strong SQL and Python, plus hands-on Git Production experience with at least one of Databricks, Snowflake, Azure Data Factory, AWS Glue, Apache Airflow or PySpark Cloud-native orchestration and distributed data processing Infrastructure as code (e.g. Terraform) CI/CD and DevOps or DevSecOps practice ...

Application Developers | Data engineers

Location
United Kingdom
management (GraphQL, REST, etc.)2 + years Hands-on experience with Redis-backed state management and event-driven processing.2 + years of experience in Apache Spark (PySpark/Spark SQL)2+ years building and deploying Cloud based solutions using - Azure Databricks with UC, Snowflake, Functions, Service Bus2+ years ...

Data Engineer IT · London ·

Location
Greater London, England, United Kingdom
ideally also have: Experience with Microsoft Fabric components, such as: Data Factory, including pipelines and orchestration. Data Engineering, including Lakehouse, notebooks and Apache Spark. Data Warehouse, including SQL endpoints and schemas. Real-Time Intelligence, including KQL databases and event ingestion. OneLake and Delta tables, including security and governance within ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
query optimisation, with the ability to diagnose and resolve performance bottlenecks. Experience implementing orchestration, scheduling, dependencies and failure handling using tools such as Airflow, Apache NiFi, Talend or platform-native workflows. Strong data warehousing, modelling and schema design skills, with experience creating curated datasets for analytics and an understanding ...

Lead Data Engineer

Location
Manchester, England, United Kingdom
possess hands‐on experience with one or more of the following technological areas (or their equivalent cloud‐native alternatives): Analytics & Platform Frameworks like Apache Spark or similar cloud-specific services. Transformation & Orchestration tools Database Technologies Libraries & Schema Management Storage Formats: Familiarity managing diverse data types through formats like JSON ...

Lead Data Engineer

Location
Swansea, Wales, United Kingdom
possess hands‐on experience with one or more of the following technological areas (or their equivalent cloud‐native alternatives): Analytics & Platform Frameworks like Apache Spark or similar cloud-specific services. Transformation & Orchestration tools Database Technologies Libraries & Schema Management Storage Formats: Familiarity managing diverse data types through formats like JSON ...

Lead Data Engineer

Location
Greater London, England, United Kingdom
possess hands‐on experience with one or more of the following technological areas (or their equivalent cloud‐native alternatives): Analytics & Platform Frameworks like Apache Spark or similar cloud-specific services. Transformation & Orchestration tools Database Technologies Libraries & Schema Management Storage Formats: Familiarity managing diverse data types through formats like JSON ...

Data Engineer

Hiring Organisation
Adecco
Location
London, United Kingdom
Employment Type
Contract
Contract Rate
£500 - £600/day
SQL. Well-versed in software engineering and systems design principles. Hands-on experience with Azure cloud data platforms is essential. Familiarity with Spark and Apache Airflow is required. Proficient in Linux/Unix/*nix environments. Strong knowledge of ETL tools and data modelling techniques. Candidates will need ...

Senior Full-Stack Developer

Location
United Kingdom
Desirable qualifications Experience with additional languages such as TypeScript, Go, Java or Rust. Experience with big data and real-time processing technologies, such as Apache Spark, Flink or Kafka Streams. Relevant cloud certifications, such as AWS Certified Solutions Architect – Professional, Azure Solutions Architect Expert or Google Cloud Professional Cloud ...

Databricks Data Engineer

Hiring Organisation
GIS Recruiter Ltd
Location
London, United Kingdom
Employment Type
Permanent
Salary
£75000 - £95000/annum Hybrid Working
Delta Lake, Delta Tables and Delta Live Tables/Lakeflow Declarative Pipelines. Experience implementing Medallion Architecture (Bronze, Silver and Gold). Strong knowledge of Apache Spark architecture, optimisation and performance tuning. Hands-on experience with Unity Catalog, access controls and data governance. Experience implementing incremental data loads ...

Data Engineer

Location
Milton Keynes, England, United Kingdom
schemas for both structured and unstructured data with a snowflake environment Enhance cloud data capabilities, working with AWS S3, Azure Data Lake, and Apache Spark Collaborate with cross-functional teams to ensure data availability for advanced analytics and reporting Automate workflows, implement CI/CD pipelines, and maintain data ...

Data Engineer

Location
West Kirby, England, United Kingdom
designing and building data pipelines. Proficiency in programming languages such as Python, SQL, or Java. Experience with ETL tools and processes, such as Apache Airflow, Talend, or Informatica. Strong knowledge of databases (SQL and NoSQL) and data warehousing solutions (e.g., Amazon Redshift, Google BigQuery, Snowflake). Familiarity with cloud ...

Data Engineer

Location
Liverpool, England, United Kingdom
designing and building data pipelines. Proficiency in programming languages such as Python, SQL, or Java. Experience with ETL tools and processes, such as Apache Airflow, Talend, or Informatica. Strong knowledge of databases (SQL and NoSQL) and data warehousing solutions (e.g., Amazon Redshift, Google BigQuery, Snowflake). Familiarity with cloud ...

Lead Data Platform Engineer - AWS, Spark

Location
Nottingham, England, United Kingdom
SQS. Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD pipelines, Git and Jenkins. Strong experience developing on Apache Spark or Hadoop. Significant programming experience using Scala or Python. Experience with Configuration as Code principles and API integration. Strong understanding of cloud security, data ...

Lead Data Engineer

Location
City Of London, England, United Kingdom
able to guide how one could deploy infrastructure into different environments. Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop. Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes) Ability to create data ...

AI/ML engineer

Location
Greater London, England, United Kingdom
gateways for AI applications Infrastructure as Code experience with Terraform, Ansible, or other IaC tools Experience building and managing data pipelines using tools like Apache Spark AI safety and governance experience with model evaluation, LLM judges, bias detection, and responsible AI practices Familiarity with statistical fundamentals and running ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
Hands‐on experience as a Data Engineer or Data Platform Developer, including direct contributions to production codebases. Expert‐level proficiency in Python, SQL, and Apache Spark for data pipeline development. Proven experience building ELT workflows using Fivetran, Airflow, DBT, or Databricks. Solid understanding of data modeling, dimensional design ...