your cloud/platform engineering capabilities Experience working with Big Data Experience of data storage technologies: Delta Lake, Iceberg, Hudi Knowledge and understanding of Apache Spark, Databricks or Hadoop Ability to take business requirements and translate these into tech specifications Competence in evaluating and selecting development tools and technologies More ❯
advantage in database technologies used for analytics: SQL Server, Snowflake, Azure Synapse, Oracle, and Teradata Experienced in ELT orchestration tools: Azure Data Factory, SSIS, Apache Airflow, Informatica, and Talend (nice-to-have) Native-level or Proficient-level English speaker. YOU WANT TO Be part of a team of data More ❯
bath, south west england, United Kingdom Hybrid / WFH Options
Futures
data in support of operational decision-making and intelligence development. Key Tech Stack: Microsoft SQL Server Stack: SQL Server, SSIS, C#, T-SQL Python, Apache Airflow Elastic/OpenSearch (interchangeable) Experience Required: Proven ability to design, build and maintain data pipelines Experience in system integration , ETL , and managing structured More ❯
for purpose Experience that will put you ahead of the curve Experience using Python on Google Cloud Platform for Big Data projects, BigQuery, DataFlow (Apache Beam), Cloud Run Functions, Cloud Run, Cloud Workflows, Cloud Composure SQL development skills Experience using Dataform or dbt Demonstrated strength in data modelling, ETL More ❯
Tools: GitLab CI, Terraform, Ansible, Helm Charts, Python, PowerShell, REST APIs. Kubernetes: Experience building and managing Kubernetes clusters and application delivery. Applications: Familiarity with Apache NiFi, Elastic ECK, Artifactory. Secret Management: Expertise in using HashiCorp Vault. Operating Systems: Solid experience with Red Hat and Windows environments. Apply today via More ❯
years of hands-on experience with big data tools and frameworks. Technical Skills: Proficiency in SQL, Python, and data pipeline tools such as Apache Kafka, Apache Spark, or AWS Glue. Problem-Solving: Strong analytical skills with the ability to troubleshoot and resolve data issues. Communication: Excellent communication skills More ❯
bath, south west england, united kingdom Hybrid / WFH Options
GMA Consulting
async · An expert working with databases and database architecture, SQL and Stored Procedures · Proven experience with Data integration technologies such as Azure Data Factory, Apache airflow, Databricks AutoLoader · Ability to build CI/CD pipelines and infrastructure as code · Experience with event driven data flows and message aggregators (Event … Hub, Apache Kafka) · Good understanding of current and emerging technologies and their potential to deliver business benefits · Hands on experience working with data matching processes would be highly desirable · Ability to translate business strategy into technical solutions and business requirements into technical design As a precondition of employment for More ❯
to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with … Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with Apache NiFi for building and managing complex data flows and integration processes. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with More ❯
