1 to 25 of 29 Contract Apache Jobs in England

driving innovation in data engineering. Desirable Criteria Experience delivering data pipelines on Hortonworks/Cloudera on-prem and leading cloud migration initiatives. Familiarity with: Apache Airflow Data modelling and metadata management Experience influencing enterprise data strategy and contributing to architectural governance. To apply for this position please submit your ...

practice routes Required Skills & Experience Active SC Clearance - mandatory and non-negotiable Strong hands-on experience with Databricks in production environments Expert knowledge of Apache Spark , including PySpark and Spark SQL Proficiency with Python for data engineering Experience delivering solutions on cloud data platforms ( AWS preferred , Azure acceptable) Understanding ...

platforms (AWS) and containerisation (such as Docker, Podman, Kubernetes) Experience working in secure or regulated environments Exposure to big data technologies (Spark, Hadoop) and Apache tools Familiarity with Agile and DevOps practices Industry certifications (e.g., TensorFlow Developer, AWS Machine Learning Specialty) Knowledge of NLP, computer vision, and deep learning ...

explain technical concepts to varied audiences. Nice to Have Cloud experience: AWS/Azure/GCP . Containerisation: Docker, Kubernetes . Distributed processing: Apache Spark/Flink . Please apply within for further details - Matthew Holmes, Harvey Nash To From Record Yes No Always use these settings ...

statistical techniques, including validation. Understanding of data analytics and data visualisation techniques. Ability to process large datasets via batch or stream processing using Apache Spark or similar tools. Exposure to techniques used for acquiring and fusing data. Experience with cloud platforms (preferably AWS) or implementing cloud-based data science ...

Required Data Integration & Ingestion Data Manipulation & Processing GitHub, GitHub Actions, Azure DevOps Azure Data Factory Databricks SQL Database Azure Synapse Stream Analytics AWS Glue Apache Airflow AWS Kinesis Amazon Redshift SonarQube PyTest Optional/Nice to Have Experience managing projects or running Scrum teams Experience with BPC/Planning ...

Cloudera Data Platform (CDP) on AWS or recent Hadoop administration on similar platforms. AWS administration and platform management experience. Strong experience in Spark, Airflow, Apache Ranger, Impala (AWS CDK is a plus). Agile experience with Scrum, and tools including Jira, Slack. Familiarity with PowerBI, CI/ ...

7+ years as a Data Analyst with at least 2 years in a Lead capacity Strong hands-on experience with AWS , Databricks , dbt and Apache Airflow Advanced SQL + Python Expert in visualisation tools (Tableau/Power BI) Experience working in a regulated banking environment Ability to manage stakeholders ...

cloud data platforms Required Technical Expertise - Data Migration & Data Synchronisation Architecture - SQL/Python/Scala - Data Engineering & Data Pipelines - Relational & NoSQL Databases - Apache Spark - Databricks - Data Warehousing/Data Lakes - Cloud & On-Prem Data Integration Additional Requirements - Freelance contractor only - Must be eligible for security clearance - Availability ...

+ implementation of a cloud based Data Analytics platform to provide data workflow, data visualisation + dashboard solutions. Key Skills: Tableau, Power BI + Apache Superset dashboard + data visualisation tools. Python and R-style workflow development environments. SQL querying + data transformation skills. AWS/Cloud Native Infrastructure ...

+ implementation of a cloud based Data Analytics platform to provide data workflow, data visualisation + dashboard solutions. Key Skills: Tableau, Power BI + Apache Superset dashboard + data visualisation tools. AWS/Cloud Native Infrastructure environments. Python/R-style workflow development environments, SQL querying + data transformation ...

Experience 8+ years total experience with at least 3 years in a Lead/Principal Data Engineer role Expert-level AWS , Databricks , dbt and Apache Airflow Proven experience leading teams in a regulated financial services environment Strong stakeholder management and ability to translate business needs into technical solutions Deep ...

Automation: GitLab CI, Terraform, Ansible, Helm Charts Scripting & APIs: Python, PowerShell, REST APIs Containerisation & Platforms: Kubernetes cluster build and application delivery Application Technologies: Apache NiFi, Elastic ECK, Artifactory Secrets Management: Hashicorp Vault Operating Systems: RedHat Linux and Windows Experience & Background Experience across the full software development lifecycle Strong understanding ...

general security protocols within a UNIX environment to ensure compliant and hardened architectures. Performance Optimization: Implement and tune high-performance web stacks using Apache, Varnish for caching, and HAProxy for load balancing. Team Leadership: Manage and technically govern a team of 5+ infrastructure engineers, providing guidance on root-cause ...

technical delivery of data platforms and pipelines built in AWS-with a focus on AWS Glue, Managed Workflows for Apache Airflow (MWAA), and Python-and collaborate closely with Directors, Senior Architects, and Program Leadership to deliver business outcomes at scale. This is a player-coach role: you will design … environment. Advanced hands-on expertise with: Python (including PySpark & data engineering patterns) AWS Glue (Jobs, Crawlers, Glue Studio, Glue Catalog, PySpark, Job bookmarks) MWAA (Apache Airflow) (DAG design, scheduling, sensors, retries, XComs, task isolation, best practices) Strong across broader AWS services: S3, Lambda, Step Functions, IAM, CloudWatch, KMS, Secrets ...

design. Understanding of various communication protocols, including RS-232, I2C, CAN, SPI, USB, TCP, and UDP over IP. Familiarity with databases, web servers (e.g. Apache), and UI/UX design. Interested? Apply today via the link provided ...

with EKS) Proficiency in Git-based development workflows Experience working independently and communicating effectively in distributed teams Desirable : Familiarity with (or happy to learn): Apache Spark (EMR) and Delta Lake PostgreSQL (Aurora) CI/CD (Github Actions) and IaC (Helm, CloudFormation) Monitoring (Sentry) Knowledge/interest in research ...

would be keen to hear from you. Please submit your CV to discuss this opportunity in confidence with one of our specialist consultants. Apache Associates is acting in its capacity as an Employment Business. Due to the number of applications, we can only respond to those that meet these ...

architecture to support data consumption for reporting systems, operational applications, and analytics platforms. Implement automation, orchestration, and scalable pipeline frameworks using tools such as Apache Airflow. Collaborate with business stakeholders and technical teams to align the data platform with enterprise data strategy. Support hospitality analytics use cases, including guest … predictive analytics, recommendation engines, and customer behaviour analytics. Ability to design AI-ready data platforms for future analytics use cases. Preferred Skills Experience with Apache Airflow for pipeline orchestration. Knowledge of CI/CD pipelines, DevOps, and Git-based development workflows. Experience with data governance, metadata management, and enterprise ...

architecture to support data consumption for reporting systems, operational applications, and analytics platforms. Implement automation, orchestration, and scalable pipeline frameworks using tools such as Apache Airflow. Collaborate with business stakeholders and technical teams to align the data platform with enterprise data strategy. Support hospitality analytics use cases, including guest … predictive analytics, recommendation engines, and customer behaviour analytics. Ability to design AI-ready data platforms for future analytics use cases. Preferred Skills Experience with Apache Airflow for pipeline orchestration. Knowledge of CI/CD pipelines, DevOps, and Git-based development workflows. Experience with data governance, metadata management, and enterprise ...

code and sharing knowledge across the team Supporting production systems when needed The platform uses a mix of modern data tooling including AWS and Apache Spark, so there's plenty of opportunity to work with big data technologies. What they're hoping you'll bring You don't need … complex data problems An interest in improving pipelines, tooling and processes A collaborative approach and willingness to share ideas Exposure to tools like Apache Spark, modern data platforms, or AI tools for development productivity would be a bonus but isn't essential. The setup The team works ...

Production Hands-On Experience with Deep Learning Frameworks (TensorFlow, PyTorch, XGBoost) Deep Knowledge of Data Warehousing, ETL/ELT Architectures & Heavy Analytic Environments (Apache Beam, Hadoop, Spark, Hive) Responsibilities: Leading Customer-Facing AI Deployments across Europe, from the Initial Consulting Phase right through to the Live Implementation of Production … Systems Architecting & Optimising Scalable Data Pipelines, ETL/ELT Solutions & Distributed ML Environments (using Hadoop, Spark & Apache Beam). Deploying Recommendation Engines & Deep Learning Models (TensorFlow, PyTorch) to solve specific Client Problems. Running Technical Design Sessions, Tailoring ML Ops Architectures using Vertex AI & Gen AI. Writing Automation-Focused Code ...

that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data ingestion, transformation … such as databases, APIs, and cloud platforms. About You: As an experienced Data Platform Engineer, your skills and experience may include; • Strong experience of Apache NiFi • Experience designing and optimizing data flows for batch, real-time streaming, and event-driven architectures. • Ability to identify and resolve flow issues, optimize ...

data sets can be effectively combined and analysed. They can also utilise programming languages such as Python, Java or SQL and tools such as Apache Spark or in this instance LakeFS, for data processing and management. Useful - R, Apache Spark Very useful - Python, SQL, JSON, LakeFS. ...

estate (AWS + Airflow + Databricks). Key Responsibilities Design, build and maintain Infrastructure as Code using CloudFormation and AWS services Manage and scale Apache Airflow (MWAA) environments Develop and maintain CI/CD pipelines (Git + Jenkins/GitHub Actions) Build serverless components with Lambda and other … call rotation and incident resolution Essential Skills & Experience 5+ years as a DevOps/Platform Engineer Strong AWS experience + CloudFormation Production experience with Apache Airflow (MWAA) Lambda , Linux + Bash scripting CI/CD expertise (Git, Jenkins, GitHub Actions) IaC and GitOps practices Nice to Have Terraform Databricks ...