26 to 50 of 304 Apache Jobs in England

gateways for AI applications Infrastructure as Code experience with Terraform, Ansible, or other IaC tools Experience building and managing data pipelines using tools like Apache Spark AI safety and governance experience with model evaluation, LLM judges, bias detection, and responsible AI practices Familiarity with statistical fundamentals and running ...

Hands‐on experience as a Data Engineer or Data Platform Developer, including direct contributions to production codebases. Expert‐level proficiency in Python, SQL, and Apache Spark for data pipeline development. Proven experience building ELT workflows using Fivetran, Airflow, DBT, or Databricks. Solid understanding of data modeling, dimensional design ...

management and international regulatory compliance. YOUR SKILLS AND EXPERIENCE ESSENTIAL CRITERIA Strong experience designing, building and maintaining scalable data pipelines and integration solutions using Apache Airflow (or similar orchestration platforms), Python, SQL and bash/linux. Experience developing cloud-native data platforms and solutions on AWS, including working with ...

management and international regulatory compliance. YOUR SKILLS AND EXPERIENCE ESSENTIAL CRITERIA Strong experience designing, building and maintaining scalable data pipelines and integration solutions using Apache Airflow (or similar orchestration platforms), Python, SQL and bash/linux. Experience developing cloud-native data platforms and solutions on AWS, including working with ...

Snowflake and Databricks, Python and SQL, ETL development and data modelling. Experience with cloud-based data platforms and data governance. Nice to have: Apache Airflow, Spark, AWS/Azure, data visualisation and experience delivering solutions within Defence or secure Government environments. Clearance: Due to the sensitive nature ...

similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written and verbal English skills Last ...

Lambda, EventBridge and SQS.Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD pipelines, Git and Jenkins.Strong experience developing on Apache Spark or Hadoop.Significant programming experience using Scala or Python.Strong understanding of cloud security, data privacy, access control and governance principles in data platform environmentsDesired ...

skills in Python, and experience with Java or Scala. Data Engineering at Scale: Solid ELT/ETL design experience and hands-on work with Apache Spark. Bonus points if you have: Multi-Cloud Exposure: Experience with Azure alongside GCP. Container Orchestration: Experience packaging and deploying workloads with Helm ...

designs, explaining technical trade‐offs and reviewing others’ work The knowledge, experience and qualifications that will help Ingestion and orchestration tools such as Ansible, Apache NiFi or Cribl Docker, Kubernetes and AWS services such as S3, Lambda, Step Functions and SageMaker Working with Cyber Security and Infrastructure data, such ...

Ansible for repeatable, automated provisioning of GPU clusters and AI platform environments; GitOps (ArgoCD) for continuous, declarative platform delivery. Pipeline orchestration: Kubeflow Pipelines, Apache Airflow, or Argo Workflows to orchestrate multi-stage training, fine-tuning, and inference pipelines. Cluster & workload scheduling: Slurm, Run:ai, and NVIDIA Base Command Manager ...

United Kingdom A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well … complex, cloud-based data programme - designing, building, and maintaining data pipelines that process large volumes of data across a modern AWS-native stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics ...

engineering or business intelligence solutions. Strong proven commercial experience with Databricks. Strong experience developing ETL/ELT pipelines and data integration solutions. Experience using Apache Spark, PySpark, and Spark SQL. Strong SQL development and optimisation skills. Experience working with large and complex datasets from multiple source systems. Knowledge ...

agent frameworks. Inference and edge: TensorRT, ONNX Runtime, vLLM, Nvidia Triton Inference Server, KServe, Nvidia Jetson (e.g. Jetson Thor). Data and platforms: Databricks, Apache Spark, MLflow, SQL, AWS, GCP, Docker. Working at Rowden We are committed to building a flexible, inclusive, and enabling company. ...

into actionable insights, and power high-impact trading and AI decisions. Ideal Candidate: 5+ years of experience in data engineering with MPP databases or Apache Spark Strong skills in Python and SQL, with solid data modeling experience Extensive knowledge of AWS/cloud services (ECS, EKS, Lambda, Kinesis, DynamoDB ...

adhere to the D.R.Y principle, minimising manual intervention and promote automation. We're looking for these essential skills Hands‐on experience with DBT and Apache Airflow, building scalable data transformations and DAGs to orchestrate complex, reliable data pipelines. Manage task dependencies, automated retries and error handling to ensure reliable ...

analytics and AI/ML at enterprise scale.* Develop and optimise batch and streaming ETL/ELT pipelines using Azure Data Factory, PySpark, SQL, Apache Spark and Airflow, integrated with modern tooling like dbt and Git-based CI/CD.* Implement data cataloguing, lineage tracking and governance frameworks through ...

with monitoring/logging tools (ELK stack, Prometheus, Splunk) Familiarity with service mesh and modern networking (Istio, Envoy) Exposure to data engineering and integration (Apache ecosystem, SQL, Python) Recognised technical certifications (AWS/Azure Architect, Kubernetes CKA/CKAD, Terraform) Experience in influencing technical standards, best practices, or contributing ...

inputs/outputs, and adherence to resiliency and security expectations Preferred qualifications, capabilities, and skills Experience with data lakehouse architectures using Delta Lake, Apache Spark, or similar open‐source frameworks Familiarity with AWS‐native data services such as Glue, Lake Formation, Redshift, or Athena Exposure to data governance practices ...

adhere to the D.R.Y principle, minimising manual intervention and promote automation. **We're looking for these essential skills** * Hands-on experience with DBT and Apache Airflow, building scalable data transformations and DAGs to orchestrate complex, reliable data pipelines.* Manage task dependencies, automated retries and error handling to ensure reliable ...

legal advisors to ensure holistic solutions Your areas of knowledge and expertise Proven experience designing and implementing data lakehouse architectures (Databricks, Delta Lake, Apache Flink, or similar technologies) Strong, hands-on AWS cloud experience including services such as S3, Glue, Lake Formation, Athena, and Redshift Demonstrated expertise ...

internal knowledge Competencies and Behaviours: 3+ years experience in data platform engineering, cloud engineering, or similar roles Strong hands-on experience with Databricks, including Apache Spark, Delta Lake, Workflows Proven experience designing and deploying data platforms on AWS and/or Azure (e.g. ADLS, S3, VNet/ ...

designing end-to-end modern data platforms or lakehouses. Modern lakehouse mindset: Deep understanding of open lakehouse design and open table formats (such as Apache Iceberg or Delta Lake), keeping data open and portable. Practical, multi-paradigm data modelling: Deep, hands-on experience designing data models across Data Vault ...

bulletproof data quality, and oversee mission-critical downstream activation. Requirements You have deep expertise in building large-scale data engineering solutions using SQL, Python, Apache Spark, and Databricks. You bring proven experience designing resilient workflows with strict dependency management and idempotent processing. You are comfortable establishing robust CI/ ...

Robust knowledge of data engineering, including data modelling, ETL/ELT, pipeline orchestration, testing, and data quality management.* Hands-on experience with Databricks and Apache Spark to build and operate scalable data pipelines and analytics or AI workflows.* Proven proficiency in applied AI, demonstrated through delivered solutions using machine ...

them is desirable GCP Cloud: Compute Engine, Kubernetes Engine, IAM, VPC Networks, BigQuery, Dataproc, CloudStorage, Cloud Functions, CloudSQL, Memorystore PubSub, Iceberg Infrastructure & Technologies: Apache Airflow, Druid/Imply, Kafka, Spark, Postgres, Jenkins, Scylla, Redis, Docker, Prometheus, Github, Linux. Languages: Python, Scala, C++, JavaScript, Java. What Blis can offer Comprehensive ...