clouds. The successful Lead Data Engineer will have: Experience leading a Data Engineering team. Extensive working experience with GCP, SQL and DBT. Proficient in: Kafka, Dataform, Airflow, Tableau, PowerBI, Redshift, Snowflake, Terraform and BigQuery. What's in it for the successful Lead Data Engineer: Hybrid working for a better more »
testing and releasing data or storage systems End-to-end distributed systems experience (When we say distributed systems, we mean near-real-time like Kafka or Redpanda, not microservices Proficiency in writing and reading Python or Go programs, in addition to excellent shell scripting skills Experience with Terraform or more »
and ETL frameworks Proficiency in working with relational databases (e.g., Oracle, PostgreSQL), Parquet/Delta files and big data technologies (e.g. Synapse, Hadoop, Spark, Kafka) Knowledge of Microsoft Azure and associated data services is a good to have. Strong analytical and data interpretation skills, with the ability to communicate more »
intricacies of Postgres with ease. 🌐 Distributed Systems: Navigate failure modes and mitigations with finesse. 🔄 Message and Event Streaming Systems: Dive into the world of Kafka and distributed streaming. ☁️ Cloud-Native Technologies: Explore observability tools and manage SLOs/SLAs effortlessly. 🔒 Cybersecurity Best Practices: Embrace secure-by-design principles for more »
team and organisation. Requirements Demonstrable experience as a software or data engineer, demonstrating a good understanding of data architecture and engineering principles. Proficiency with Kafka, AWS, and Redshift Strong coding skills with either Python or SQL, showcasing the ability to manipulate and analyse data. Proven expertise in implementing testing more »
being an added advantage. Microservices Architecture: Experience in designing, developing, and deploying applications based on microservices. Event-Driven Systems: Hands-on experience with ApacheKafka or similar distributed messaging systems. Monitoring and Observability: Familiarity with monitoring tools like Prometheus, Grafana, or Victoria Metrics. Database Technologies: Experience working with various more »
skilled in Python Development, with Big Data skills. This is a fully remote position (in the UK). Skills/Technologies Python Django PostgreSQL Kafka RabbitMQ more »
Management, Incident Response, and Capacity Planning for a number of their core services. Some of their key technologies are: AWS Cloud, Dynatrace, Terraform, Biztalk, Kafka Key Responsibilities: Part of the Platform Operations team with a heavy focus on platform and system operations in Production. Collaborate with Client Services, Application more »
Stoke-On-Trent, England, United Kingdom Hybrid / WFH Options
bet365
also ensuring that our processes and technology are efficient and effective. The team works with a number of core technologies including Python, Golang, JavaScript, Kafka, New Relic, Splunk, Influx, Grafana and Ansible. This role is eligible for inclusion in the Company’s hybrid working from home policy. Preferred Skills more »
AIX Power series hardware and AIX OS is a plus Familiarity with disk systems like SSA and SAN technologies, HACMP, HMC, CSM, NIM, VI, Kafka architecture, and Zabbix monitoring platform. Performance Tuning: Skilled in performance monitoring and tuning of operating systems and hardware. Networking: Solid understanding of networking (TCP more »
City Of London, England, United Kingdom Hybrid / WFH Options
Cititec Talent
London office Experience Required: - Commodities industry experience Weather forecasting Airflow (or equivalent data orchestration platforms) Data Modeling (Star Schema) Data Warehousing Data Pipeline Orchestration (Kafka) On-Prem SQL more »
Chicago, Illinois, United States Hybrid / WFH Options
Request Technology - Robyn Honquest
services like AWS's VPCs, Security groups, EC2, RDS, S3 ACLs, KMS, AWS CLI and IAM etc. (required) Experience with distributed message brokers using Kafka (required) Experience with high speed distributed computing frameworks such as AWS EMR, Hadoop, HDFS, S3, MapReduce, Apache Spark, Apache Hive, Kafka Streams, Apachemore »
will include building microservices, using Docker and Kubernetes and 3rd party API integrations. You will also be working with big data technologies like Hadoop, Kafka and Cassandra.This Senior Java Engineer (Multithreading) role will be a strong fit if you:Have extensive Core Java, multihreading, low-latency, concurrency experienceEnjoy working … with big data technologies like Hadoop (or if you are keen to learn!)Have messaging experience with Kafka, RabbitMQ or MongoDBAs the Senior Java Engineer, you will be a strong advocate for modern development ways of working including pair programming, Agile and BDD/TDD. This company (during normal more »
Burgess Hill, England, United Kingdom Hybrid / WFH Options
Tata Consultancy Services
Role: Backend Senior Engineer Job Type: Permanent Location: Burgess Hill, UK (Hybrid) Are you a highly skilled Java engineer who is comfortable with back-end programming? Are you passionate about all aspects of software development, including design, implementation, and deployment more »
Manchester, Greater Manchester, United Kingdom Hybrid / WFH Options
AutoTrader UK
full delivery chain, from data to productsYou will have an understanding of data modelling and experience with data engineering tools and platforms such as, Kafka, Spark, and HadoopComfortable presenting technical ideas to non-technical colleaguesExperience mentoring and coaching and sharing technical expertiseStrong team work ethic … communication and collaboration skillsSupport with our recruitment process by evaluating candidates at all stages.Although not essential, helpful experience includes:Messaging systems such as ApacheKafka or Google Pub/SubDocker/Container OrchestrationWorking experience with Google CloudEvery candidate brings a unique mix of skills and qualities to the table. more »
City of London, London, United Kingdom Hybrid / WFH Options
Oliver Bernard Ltd
strategies and engineering practices. They specialise in providing cutting-edge data solutions to various clients across the globe. Their tech stack includes Kotlin, React, Kafka, Kubernetes, and AWS, and they are on a mission to make data work smarter for businesses across various industries. £110,000 depending on experience. … a JVM language, Kotlin, Java, Scala, Clojure Knowledge of Typescript and React is beneficial Exposure to data pipelines using technologies such as Spark and Kafka Experience with cloud services (ideally AWS) Hybrid working 1-2 days per week in Central London. £110,000 depending on experience. Please apply and more »
As a Machine Learning Engineer: Apply Machine Learning Engineering project You will build the Machine Learning Infrastructures interacting with CI/CD pipelines, MLFlow, Kafka, and Kubernetes. You will be developing and Deploying Advanced Analytical algorithms/scalable solutions using Cloud. You will be working with a team of … of Machine Learning and clustering techniques with commercial experience as a Data Scientist. DevOps experience in CI/CD. Experience using Tensorflow, Kubernetes, MLFlow, Kafka, and Airflow. Experience using Python is a must (tools like AWS and Spark are beneficial) Excellent communication skills and team and colleague engagement. A more »
London, England, United Kingdom Hybrid / WFH Options
Harnham
As a Machine Learning Engineer: Apply Machine Learning Engineering project You will build the Machine Learning Infrastructures interacting with CI/CD pipelines, MLFlow, Kafka, and Kubernetes. You will be developing and Deploying Advanced Analytical algorithms/scalable solutions using Cloud. You will be working with a team of … of Machine Learning and clustering techniques with commercial experience as a Data Scientist. DevOps experience in CI/CD. Experience using Tensorflow, Kubernetes, MLFlow, Kafka, and Airflow. Experience using Python is a must (tools like AWS and Spark are beneficial) Excellent communication skills and team and colleague engagement. A more »
As a Machine Learning Engineer: Apply Machine Learning Engineering project You will build the Machine Learning Infrastructures interacting with CI/CD pipelines, MLFlow, Kafka, and Kubernetes. Lead a Team of ML Engineers. You will be developing and Deploying Advanced Analytical algorithms/scalable solutions using Cloud. You will … of Machine Learning and clustering techniques with commercial experience as a Data Scientist. DevOps experience in CI/CD. Experience using Tensorflow, Kubernetes, MLFlow, Kafka, and Airflow. Experience using Python is a must (tools like AWS and Spark are beneficial) Excellent communication skills and team and colleague engagement. A more »
London, England, United Kingdom Hybrid / WFH Options
Harnham
As a Machine Learning Engineer: Apply Machine Learning Engineering project You will build the Machine Learning Infrastructures interacting with CI/CD pipelines, MLFlow, Kafka, and Kubernetes. Lead a Team of ML Engineers. You will be developing and Deploying Advanced Analytical algorithms/scalable solutions using Cloud. You will … of Machine Learning and clustering techniques with commercial experience as a Data Scientist. DevOps experience in CI/CD. Experience using Tensorflow, Kubernetes, MLFlow, Kafka, and Airflow. Experience using Python is a must (tools like AWS and Spark are beneficial) Excellent communication skills and team and colleague engagement. A more »
Woking, Surrey, South East, United Kingdom Hybrid / WFH Options
CBSbutler Holdings Limited
Python, and node.js to streamline deployment processes. Manage and optimize relational databases (e.g., PostgreSQL), NoSQL databases (e.g., MongoDB), and implement data streaming solutions (e.g., Kafka) for efficient data handling. Work with big data technologies such as Hadoop to manage and analyse large datasets. Implement security best practices and ensure … such as Java, Python, and node.js. Familiarity with SQL and database management systems, including relational and NoSQL databases. Knowledge of data streaming technologies (e.g., Kafka) and big data platforms (e.g., Hadoop). Understanding of cybersecurity principles and best practices. Familiarity with architectural styles and experience in implementing DevSecOps practices. more »
Java Data DeveloperTech: Core Java, JDBC, Kafka, HDFS, Docker, SQL, MultithreadingChallenge: Greenfield Big Data Analysis Platform Development in FSFirm: Well-known Financial Data fintech50 business, City of London, 10 man flat Dev TeamPay: 85k, Options, training budget, Pension, Life/Health, Some Work from HomeNO FINANCE EXPERIENCE NEEDEDCore Java … sharp end of technology and the possibility of making serious money doing something you are passionate about.My client is based in LondonCore Java, JDBC, Kafka, HDFS, Docker, SQL, Multithreading more »
Sheffield, South Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Experis
Role Title: Solution Architect Duration: 12 Months Location: Sheffield/Hybrid (3-4 days on site) Rate: £535/d - Umbrella only Would you like to join a global leader in consulting, technology services and digital transformation? Our client is more »
Cork, Cork County, Republic of Ireland Hybrid / WFH Options
Reperio Human Capital
Lead Software Engineer - Java Fully Remote - Ireland My client, a market-leading product company, is looking for a seasoned Lead Software Engineer with expertise in Java, Spring, AWS, and DevOps environments. You will be responsible for the development of their more »