1 to 25 of 80 Apache Jobs in England

experience in Provide file-based storage: Provide NFS exports and SMB file shares to specific systems and users. Hands on experience in Apache HTTPD web service: Configure Apache HTTPD to provide Transport Layer Security (TLS)-enabled websites and virtual hosts. Hands on experience in Execute shell scripting ...

Skills & Experience Strong experience with Python and/or SQL in a production environment. Hands-on experience with modern data engineering frameworks such as: Apache Spark, Databricks Airflow/Prefect/Dagster Kafka/EventHub/Kinesis Experience building data solutions on at least one major cloud platform ...

Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data availability. Develop, maintain ...

driving innovation in data engineering. Desirable Criteria Experience delivering data pipelines on Hortonworks/Cloudera on-prem and leading cloud migration initiatives. Familiarity with: - Apache Airflow - Data modelling and metadata management Experience influencing enterprise data strategy and contributing to architectural governance. To apply for this position please submit your ...

driving innovation in data engineering. Desirable Criteria Experience delivering data pipelines on Hortonworks/Cloudera on-prem and leading cloud migration initiatives. Familiarity with: Apache Airflow Data modelling and metadata management Experience influencing enterprise data strategy and contributing to architectural governance. To apply for this position please submit your ...

deployment and management. Strong understanding of data modelling methodologies such as Kimball and Data Vault in data warehouse environments. Familiarity with frameworks such as Apache Beam and dbt. 3. Future-Focused & AI Awareness Interest in the evolution of modern data platforms and emerging technologies. Understanding of, or interest ...

experience deploying and running ML systems in production, including model serving and monitoring. Cloud Platforms: Familiarity with AWS or Azure, including services like Apache Airflow, Terraform, or SageMaker. Data Quality Management: Experience with data versioning and quality assurance practices. You enjoy working in fast-moving environments where ...

provisioning automation. Nice to Have Skills: Experience with Power BI, DAX, and data modeling for optimized reporting. Knowledge of big data orchestration tools like Apache Airflow. Previous exposure to regulated environments such as finance, healthcare, or gaming. Experience in a lottery or similar domain is a plus. Preferred Education ...

practice routes Required Skills & Experience Active SC Clearance - mandatory and non-negotiable Strong hands-on experience with Databricks in production environments Expert knowledge of Apache Spark , including PySpark and Spark SQL Proficiency with Python for data engineering Experience delivering solutions on cloud data platforms ( AWS preferred , Azure acceptable) Understanding ...

pipelines Proficiency with at least one cloud platform: Amazon Web Services (AWS) Microsoft Azure (Azure) Google Cloud Platform (GCP) Experience with orchestration tools (e.g., Apache Airflow) Experience with version control (e.g., Git) Solid understanding of data warehousing concepts and dimensional modeling To apply for this role please submit your ...

/CD pipelines (e.g. Azure DevOps) Excellent communication skills and the ability to engage confidently with senior and executive stakeholders Desirable Experience Agentic AI, Apache Spark, or enterprise architecture frameworks Enterprise data integration and Microsoft BI technologies Experience with AWS or GCP and additional CI/CD tooling (e.g. ...

Data Vault, Dimensional modelling, OLAP design. • Hands-on experience building data pipelines using technology such as Azure Data Factory, AWS Glue, GCP Dataflow and Apache Spark (preferably in Databricks). • Extensive experience with CI/CD platforms such as GitLab CI, GitHub Actions, AWS CodeBuild, Azure Pipelines, GCP Cloud ...

Excellence Lead the evolution of the enterprise data landscape using modern platforms such as Databricks, Snowflake, Azure Synapse, and BigQuery. Oversee data engineering with Apache Airflow, dbt, and Prefect, ensuring performance, governance, and alignment with enterprise metadata standards (Collibra, Alation, Microsoft Purview). Drive adoption of Delta Lake, Iceberg ...

locally-hosted solutions. Technical Requirements Languages Expert-level Python and advanced SQL . Data Engineering Experience with ETL/ELT and orchestration tools like Apache Airflow or NiFi . On-Prem Tech Proficiency with Hadoop/HDFS , Spark , and containerization via Docker/Kubernetes (K3s/OpenShift) . ...

Responsibilities will include; Design, implement, and optimize end-to-end solutions using Fabric components: o Data Factory (pipelines, orchestration) o Data Engineering (Lakehouse, notebooks, Apache Spark) o Data Warehouse (SQL endpoints, schemas, MPP performance tuning) o Real-Time Analytics (KQL databases, event ingestion) o Manage and enhance OneLake architecture ...

Agile Development using SCRUM. Experience of Oracle/Relational Databases and/or Mongo. Experience of GitLab CI/CD Pipelines. Experience of Apache NiFi. Experience in the use of Atlassian Suite - Bitbucket, Jira, Confluence. Experience of Elasticsearch and Kibana. Experience of Hibernate. Experience of AWS Services such ...

Agile Development using SCRUM. Experience of Oracle/Relational Databases and/or Mongo. Experience of GitLab CI/CD Pipelines. Experience of Apache NiFi. Experience in the use of Atlassian Suite - Bitbucket, Jira, Confluence. Experience of Elasticsearch and Kibana. Experience of Hibernate. Experience of AWS Services such ...

other engineers What we are looking for Strong experience in Python and Linux Experience in Python data processing pipelines such as Dagster or Apache Airflow Knowledge of security, encryption and compliance standards for AS networks Experience building and maintaining bespoke Docker containers Experience using server-less AWS cloud services ...

solutions while remaining hands-on. You should have: Proven experience building production-ready solutions on Google Cloud Expertise with batch and streaming frameworks like Apache Spark or Beam Strong understanding of data storage, pipeline patterns, and event-driven architectures Experience with CI/CD, version control, automated testing ...

Azure or AWS Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice to haves: Azure/AWS Data Engineering certifications Databricks certifications What ...

development lifecycle from requirements to deployment Tech Stack Includes: Java, Python, Linux, Git, JUnit, GitLab CI/CD, Oracle, MongoDB, JavaScript/TypeScript, React, Apache NiFi, Elasticsearch, Kibana, AWS, Hibernate, Atlassian Suite What’s on Offer: Hybrid working and flexible schedules (4xFlex) Ongoing training and career development Exciting projects ...

development lifecycle from requirements to deployment Tech Stack Includes: Java, Python, Linux, Git, JUnit, GitLab CI/CD, Oracle, MongoDB, JavaScript/TypeScript, React, Apache NiFi, Elasticsearch, Kibana, AWS, Hibernate, Atlassian Suite PLEASE NOTE: eDV clearance is required to start. The process can take 6 - 18 months. For more ...

Required Data Integration & Ingestion Data Manipulation & Processing GitHub, GitHub Actions, Azure DevOps Azure Data Factory Databricks SQL Database Azure Synapse Stream Analytics AWS Glue Apache Airflow AWS Kinesis Amazon Redshift SonarQube PyTest Optional/Nice to Have Experience managing projects or running Scrum teams Experience with BPC/Planning ...

Experience with AWS and cloud-native data engineering patterns Clear communicator who can work effectively with both technical colleagues and business stakeholders Exposure to Apache Airflow, Databricks Workflows, or Informatica Cloud is a bonus — as are Databricks or AWS certifications Why Join Us? You'll be part ...

building a modern Lakehouse architecture. Designing and implementing AWS-native ETL pipelines using S3, Glue, Athena, Step Functions. Building scalable, ACID-compliant datasets using Apache Iceberg. Running cost-efficiency initiatives across Redshift and broader AWS services. Consolidating fragmented environments into a secure, multi-tenant data platform. Implementing automated data ...