production. Exposure to some of the following technologies (or equivalent): Apache Spark, AWS Redshift, AWS S3, Cassandra (and other NoSQL systems), AWS Athena, ApacheKafka, Apache Flink, AWS, and service-oriented architecture. What you'll get: Full responsibility for projects from day one, a collaborative team, and a dynamic More ❯
data normalisation is required for the role. Equally, proficiency in Python and SQL is essential, ideally with experience using data processing frameworks such as Kafka, NoSQL, Airflow, TensorFlow, or Spark. Finally, experience with cloud platforms like AWS or Azure, including data services such as Apache Airflow, Athena, or SageMaker More ❯
patterns and their application in hybrid and cloud-native environments. You have experience with message brokers and event-driven systems using tools like ApacheKafka, RabbitMQ, or Azure Service Bus. Expertise in designing and managing RESTful APIs, GraphQL, or gRPC as well as API management tools like Boomi API More ❯
scripting languages (e.g. Python) Knowledge of infrastructure as code and container technologies (e.g. Puppet, Docker) Knowledge of COTS integration technologies (e.g. Apache Camel, ApacheKafka) Experience of Atlassian tools (e.g. Jira, Confluence) Experience with public cloud platforms (e.g. AWS) Experience of the complete system life cycle from problem definition More ❯
ELT pipelines using Python and pandas within a financial environment. Strong knowledge of relational databases and SQL. Familiarity with various technologies such as S3, Kafka, Airflow, Iceberg. Proficiency working with large financial datasets from various vendors. A commitment to engineering excellence and pragmatic technology solutions. A desire to work More ❯
Liverpool, England, United Kingdom Hybrid / WFH Options
Protein Works
solutions. Expertise in SQL and NoSQL databases (e.g., MySQL, MSSQL, Big Query, or similar) for effective data management. Familiarity with message queues (RabbitMQ, ApacheKafka, AWS SQS) for asynchronous communication. Knowledge of API security and authentication protocols (OAuth, JWT). Experience working in environments with CI/CD pipelines More ❯
non-technical stakeholders alike. The Head of BI will work within a modern, cloud-based BI ecosystem, including: Data Integration: Fivetran, HVR, Databricks, ApacheKafka, Google BigQuery, Google Analytics 4 Data Lake & Storage: Databricks Delta Lake, Amazon S3 Data Transformation: dbt Cloud Data Warehouse: Snowflake Analytics & Reporting: Power BI More ❯
functional product like Security Posture Management. A natural sense of curiosity and a can-do attitude. Nice-to-Have Skills Experience with PostgreSQL, ApacheKafka, Python, Go, and Unix systems will be highly regarded. You do not need to have experience with any of these technologies! The ability to More ❯
Skilled in Python, Java, or Scala for data pipeline development Experienced with BigQuery, Dataflow, Dataproc, Cloud Storage, Pub/Sub Exposure to Hadoop, Spark, Kafka Data Engineer - GCP & Python Location: London, UK Type: Hybrid (3 days onsite, 2 remote) Employment: Full-time, Permanent/Fixed Term We're looking More ❯
CI/CD pipeline to deliver high-velocity, production-ready systems This Role Requires: Strong Java skills Experience with live-streaming technologies such as Kafka, Flink or Kinesis Solid understanding of event-driven architecture Experience with CI/CD practices and tools Familiarity with microservices and modern cloud-based More ❯
Oxford, Oxfordshire, United Kingdom Hybrid / WFH Options
Corriculo Ltd
working with data at scale/data pipelines, with any experience of bioinformatics/genome data advantageous. Experience of data processing platforms such as Kafka and Spark would also be useful Strong experience with Python, with any additional skills with R and/or C++ of benefit Experience of More ❯
greatest challenges. Preferred skills and experience Commercial experience within web clients or server-side development. Experience working with front and backend technology. Knowledge of Kafka, SQL, .Net, Golang, Java, Python, Node, C++, Typescript or React, though expertise in similar or alternative technologies is welcome. Ability to clearly communicate technical More ❯
Oxford, Oxfordshire, South East, United Kingdom Hybrid / WFH Options
Corriculo Ltd
working with data at scale/data pipelines, with any experience of bioinformatics/genome data advantageous. Experience of data processing platforms such as Kafka and Spark would also be useful Strong experience with Python, with any additional skills with R and/or C++ of benefit Experience of More ❯
Manchester, North West, United Kingdom Hybrid / WFH Options
InterQuest Group (UK) Limited
to shape the overall approach to software engineering and mentor less experienced team members. Skills: TypeScript (Node & React) Rest APIs Event driven systems AWS Kafka TDD The money is good too - up to £80k plus benefits including 10% annual bonus and hybrid working (2 days per week in Manchester More ❯
continuous improvements Extensive experience with C#, .Net, SQL Server and MongoDB (or other NoSQL databases) Experience working with message brokers i.e. RabbitMQ, ServiceBus or Kafka Good understanding of pipelines such as Jenkins Good understanding of database operations and clustering Prior experience with the likes of WinForms, WCP or WPF More ❯
from unstructured or alternative sources) Strong coding ability in Python; familiarity with cloud environments and scalable data platforms Experience with data pipeline tools (e.g. Kafka, SQL, DevOps, microservices) Prior publications, patents or research contributions What you’ll get in return: A salary of between £70,000 - £100,000 per More ❯
from unstructured or alternative sources) Strong coding ability in Python; familiarity with cloud environments and scalable data platforms Experience with data pipeline tools (e.g. Kafka, SQL, DevOps, microservices) Prior publications, patents or research contributions What you’ll get in return: A salary of between £70,000 - £100,000 per More ❯
including DeltaLake, Unity Catalogue, ML Flow etc. Experience building data pipelines and ETL processes Experience with any of the following is highly desirable: Snowflake, Kafka, Azure Data Factory, Azure Synapse, Microsoft Fabric Desire to be client-facing with brilliant communication skills Benefits: Salary up to £60,000 depending on More ❯
including DeltaLake, Unity Catalogue, ML Flow etc. Experience building data pipelines and ETL processes Experience with any of the following is highly desirable: Snowflake, Kafka, Azure Data Factory, Azure Synapse, Microsoft Fabric Desire to be client-facing with brilliant communication skills Benefits: Salary up to £60,000 depending on More ❯
including DeltaLake, Unity Catalogue, ML Flow etc. Experience building data pipelines and ETL processes Experience with any of the following is highly desirable: Snowflake, Kafka, Azure Data Factory, Azure Synapse, Microsoft Fabric Desire to be client-facing with brilliant communication skills Benefits: Salary up to £60,000 depending on More ❯
Staatliche Hochschule für Musik und Darstellende Kunst Mannheim
Customer Experience. You pride yourself on consistent high levels of test coverage, strong technical documentation and effective monitoring. Preferably exposure to technologies such as Kafka, PostgreSQL, Redis. Have a basic understanding of reactive systems using CQRS and event sourcing. A bonus would be experience using Akka. A passion for More ❯
expertise with Databricks and modern data platforms in the cloud (Azure, AWS, or GCP). Strong technical background in big data frameworks (e.g., Spark, Kafka), distributed systems, and scalable data architectures. Excellent understanding of data governance, security, and privacy, with practical knowledge of GDPR compliance. Track record of building More ❯
london, south east england, united kingdom Hybrid / WFH Options
Merlin Entertainments
expertise with Databricks and modern data platforms in the cloud (Azure, AWS, or GCP). Strong technical background in big data frameworks (e.g., Spark, Kafka), distributed systems, and scalable data architectures. Excellent understanding of data governance, security, and privacy, with practical knowledge of GDPR compliance. Track record of building More ❯
applied experience in Cloud Computing, Microservices, Data Mesh Architectures, Architecture Frameworks and Stakeholder Management Review and improve modern cloud solution architectures (public cloud, microservices, kafka, no-sql, cockroachdb, datamesh) Develop an understanding of a portfolio of applications and technical capabilities and capture this knowledge in a standard notation/ More ❯
Newcastle-under-Lyme, Staffordshire, UK Hybrid / WFH Options
GivEnergy
you had some competence in the following: Atlassian suite (Jira, Confluence) Responsive/mobile first design IoT Rust Redis MongoDB Meilisearch Developing Alexa Skills Kafka Firebase Cloud Messaging (FCM) Home Assistant Automation & CI/CD pipelines OAuth2 Benefits Include: Opportunity for two bonuses per year (individual & profit share) Flexible More ❯