and conduct unit testing. Required qualifications to be successful in this role Proficient in Java, preferably Kotlin, with experience on Java 11, Gradle and Apache Spark. Experience in GCP, preferably Big Query and Cloud Composer. Experience with CI/CD, preferably GitHub and GitHub action. Experience with Agile is More ❯
Richmond, North Yorkshire, Yorkshire, United Kingdom
Datix Limited
knowledge of programming languages, specifically Python and SQL. Expertise in data management, data architecture, and data visualization techniques. Experience with data processing frameworks like Apache Spark, Hadoop, or Flink. Strong understanding of database systems (SQL and NoSQL) and data warehousing technologies. Familiarity with cloud computing platforms (AWS, Azure) and More ❯
tuning and optimisation Solid understanding of data warehousing principles, data modelling practice, Excellent knowledge of creation and maintenance of data pipelines - ETL Tools (e.g. Apache Airflow) and Streaming processing tools (e.g. Kinesis) Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related issues More ❯
Greater London, England, United Kingdom Hybrid / WFH Options
Datatech Analytics
tuning and optimisation Solid understanding of data warehousing principles, data modelling practice, Excellent knowledge of creation and maintenance of data pipelines - ETL Tools (e.g. Apache Airflow) and Streaming processing tools (e.g. Kinesis) Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related issues More ❯
Middlesex, Greater London, United Kingdom Hybrid / WFH Options
Datatech
tuning and optimisation ·Solid understanding of data warehousing principles, data modelling practice, ·Excellent knowledge of creation and maintenance of data pipelines - ETL Tools (e.g. Apache Airflow) and Streaming processing tools (e.g. Kinesis) ·Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related issues More ❯
london, south east england, United Kingdom Hybrid / WFH Options
Datatech Analytics
tuning and optimisation Solid understanding of data warehousing principles, data modelling practice, Excellent knowledge of creation and maintenance of data pipelines - ETL Tools (e.g. Apache Airflow) and Streaming processing tools (e.g. Kinesis) Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related issues More ❯
and ML scientists to plan the architecture for end-to-end machine learning workflows. Implement scalable training and deployment pipelines using tools such as Apache Airflow and Kubernetes. Perform comprehensive testing to ensure reliability and accuracy of deployed models. Develop instrumentation and automated alerts to manage system health and More ❯
Stroud, England, United Kingdom Hybrid / WFH Options
Data Engineer
excellence and be a person that actively looks for continual improvement opportunities. Knowledge and skills Experience as a Data Engineer or Analyst Databricks/Apache Spark SQL/Python BitBucket/GitHub. Advantageous dbt AWS Azure Devops Terraform Atlassian (Jira, Confluence) About Us What's in it for you... More ❯
Stroud, south east england, united kingdom Hybrid / WFH Options
Data Engineer
excellence and be a person that actively looks for continual improvement opportunities. Knowledge and skills Experience as a Data Engineer or Analyst Databricks/Apache Spark SQL/Python BitBucket/GitHub. Advantageous dbt AWS Azure Devops Terraform Atlassian (Jira, Confluence) About Us What's in it for you... More ❯
experience deploying ML models into production environments, including both batch and real-time/streaming contexts Proficiency working with distributed computing frameworks such as Apache Spark , Dask, or similar Experience with cloud-native ML deployment , particularly on AWS , using services like ECS, EKS, Fargate, Lambda, S3, and more Familiarity More ❯
Spark, Kafka). • Familiarity with cloud-based data platforms and services (e.g., AWS, Azure, Google Cloud). • Expertise in ETL tools and processes (e.g., Apache NiFi, Talend, Informatica). • Proficiency in data integration tools and technologies. • Familiarity with data visualization and reporting tools (e.g., Tableau, Power BI) is a More ❯
experience in a technical position. - Strong understanding of networking protocols: DNS, HTTP, SSL, SFTP, TCP and UDP. - Experience with web-based services and applications, Apache, Tomcat etc. Knowledge of client/server and distributed systems architectures. - Strong Unix/Linux or Windows system administration skills. - Knowledge of filesystem, block More ❯
Frameworks: JSON YAML Python (advanced proficiency, Pydantic bonus) SQL PySpark Delta Lake Bash Git Markdown Scala (bonus) Azure SQL Server (bonus) Technologies: Azure Databricks Apache Spark Delta Tables Data processing with Python PowerBI (Data ingestion and integration) JIRA Additional Notes: Candidates with current or past high-level security clearance More ❯
PySpark Delta Lake Bash (both CLI usage and scripting) Git Markdown Scala DESIRABLE Azure SQL Server as a HIVE Metastore DESIRABLE TECHNOLOGIES Azure Databricks Apache Spark Delta Tables Data processing with Python PowerBI (Integration/Data Ingestion) JIRA If you meet the above requirements, please apply for the vacancy More ❯
Romsey, Hampshire, South East, United Kingdom Hybrid / WFH Options
Robert Half
C, or PHP Cloud: Hands-on experience with AWS or similar cloud platforms Containers: Strong understanding of Docker & Kubernetes LAMP Stack: Experience managing Linux, Apache, MySQL, PHP environments Security & Monitoring: Deep knowledge of server security best practices APPLY NOW! Don't miss this chance to join an innovative SaaS More ❯
Lake - Bash (both CLI usage and scripting) - Git - Markdown - Scala (bonus, not compulsory) - Azure SQL Server as a HIVE Metastore (bonus) Technologies - Azure Databricks - Apache Spark - Delta Tables - Data processing with Python - PowerBI (Integration/Data Ingestion) - JIRA Due to the nature and urgency of this post, candidates holding More ❯
Messaging and Streaming services such as Kinesis Data Streams, Simple Queue Service (SQS), Simple Notification Service (SNS), Amazon MQ, and Amazon Managed service for Apache Flink (MSF). We are looking for a technical expert who brings a mix of operations and networking expertise and shares our passion to More ❯
On, Password Management, and Passwordless Authentication (FIDO2) solutions. Exposure to supporting Web Access Management solutions, such as Ping Access or CA SiteMinder. Experience with Apache and IIS solutions. Understanding of the OSI model. Knowledge of the Software Development Life Cycle. Familiarity and understanding of high-availability environments. Skills: Analytical More ❯
Data Engineering Lead. This role is fully remote and is paying up to £85,000 on the base plus bonus and benefits. Experience Required: Apache Spark, Kafka, and Airflow for data ingestion and orchestration. Designing and deploying solutions on Azure Kubernetes Service (AKS). Knowledge of the Medallion Architecture More ❯
s in Computer Science, or a related field and expertise with SQL and NoSQL databases (e.g. MySQL, MongoDB, PostgreSQL, Dynamo DB), web servers (e.g. Apache, Apache Tomcat). - Expertise in Python/R and experience with DevOps tools like Docker, Kubernetes with application deployment using CI/CD. More ❯
Azure or AWS Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice to haves: Azure/AWS Data Engineering certifications Databricks certifications What's More ❯
london, south east england, United Kingdom Hybrid / WFH Options
Peaple Talent
Azure or AWS Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice to haves: Azure/AWS Data Engineering certifications Databricks certifications What's More ❯
modelling- experience delivering physical, logical or conceptual data models Data design- experience developing data warehouses, lakehouses or data lakes Use of tools such as Apache Atlas, Hive Metastore, AWS Glue/Datazone Data standards- experience driving data standards If you are interested in working for a government client on More ❯
manchester, north west england, United Kingdom Hybrid / WFH Options
Applause IT Recruitment
role will focus on: Machine Learning & Big Data applications Performance-oriented software development Working with a tech stack that includes Java, Spring, AWS, Linux, Apache, Wildfly, and Vue.js Implementing statistical models, including Bayes Theorem Skills & Experience ✅ Strong Java development experience ✅ Familiarity with Spring Framework ✅ Knowledge of AWS and cloud More ❯