in mentoring junior team members Experience in Oracle/Relational Databases and/or Mongo Experience in GitLab CI/CD Pipelines Knowledge of Apache NiFi Experience in JavaScript/TypeScript & React Experience of Elasticsearch and Kibana Knowledge of Hibernate Proficiency in the use of Atlassian Suite - Bitbucket, Jira More ❯
mocking frameworks, and Git version control. Experienced in Agile (SCRUM) development, relational (Oracle) and NoSQL (Mongo) databases. Familiar with GitLab CI/CD Pipelines, Apache NiFi, and Atlassian Suite (Bitbucket, Jira, Confluence). Knowledge of JavaScript/TypeScript, React, Elasticsearch, Kibana, Hibernate, JSF (PrimeFaces), and AWS cloud services. Skilled More ❯
mocking frameworks, and Git version control. Experienced in Agile (SCRUM) development, relational (Oracle) and NoSQL (Mongo) databases. Familiar with GitLab CI/CD Pipelines, Apache NiFi, and Atlassian Suite (Bitbucket, Jira, Confluence). Knowledge of JavaScript/TypeScript, React, Elasticsearch, Kibana, Hibernate, JSF (PrimeFaces), and AWS cloud services. Skilled More ❯
Infra tooling using Terraform, Ansible and Jenkins whilst automating everything with Python Tech (experience in any listed is advantageous) Python Cloud: AWS Lake house: Apache Spark or AWS Glue Cloud Native storage: Iceberg, RDS, RedShift, Kafka IaC: Terraform, Ansible CI/CD: Jenkins, Gitlab Other platforms such as Databricks More ❯
Agile (Scrum) methodologies Database experience with Oracle and/or MongoDB Experience using the Atlassian suite : Bitbucket, Jira, and Confluence Desirable Skills Knowledge of Apache NiFi Front-end development with React (JavaScript/TypeScript) Working knowledge of Elasticsearch and Kibana Experience developing for cloud environments, particularly AWS (EC2, EKS More ❯
Java development with strong Spring Boot expertise. Solid background in building cloud-native applications , particularly using AWS services such as S3, SQS, Kinesis, or Apache Flink. Strong knowledge of stream processing , low-latency systems, and microservice architectures. Demonstrated leadership experience, including mentoring and guiding junior developers. Proficient in designing More ❯
e.g., Refinitiv, Bloomberg). Data Platforms: Warehouses: Snowflake, Google BigQuery, or Amazon Redshift. Analytics: Tableau, Power BI, or Looker for client reporting. Big Data: Apache Spark or Hadoop for large-scale processing. AI/ML: TensorFlow or Databricks for predictive analytics. Integration Technologies: API Management: Apigee, AWS API Gateway More ❯
london, south east england, united kingdom Hybrid / WFH Options
Aventis Solutions
services experience is desired but not essential. API development (FastAPI, Flask) Tech stack : Azure, Python, Databricks, Azure DevOps, ChatGPT, Groq, Cursor AI, JavaScript, SQL, Apache Spark, Kafka, Airflow, Azure ML, Docker, Kubernetes and many more. Role Overview: We are looking for someone who is as comfortable developing AI/ More ❯
Saffron Walden, Essex, South East, United Kingdom Hybrid / WFH Options
EMBL-EBI
Experience in developing web infrastructure (Solr, kubernetes) Experience in git and basic Unix Commands You may also have Experience with large data processing technologies (Apache Spark) Other helpful information: The team work in a hybrid working pattern and spends 2 days per week in office Apply now! Benefits and More ❯
/CD process to ensure standards and processes are uniformly upheld Java (ideally version 8+), database, C#, .Net Multi-threading Junit Maven Logging frameworks Apache libraries GOF Patterns MS SQL Server/SQL & PL Experience in Kafka is a plus Experience in Monitoring solutions - Azure Insights/Grafana etc. More ❯
and storage. Strong programming skills in Python, Java, or Scala . Proficiency in SQL, NoSQL, and time-series databases . Knowledge of orchestration tools (Apache Airflow, Kubernetes). If you are a passionate and experienced Senior Data Engineer seeking a Lead role, or a Lead Data Engineer aiming to More ❯
london, south east england, united kingdom Hybrid / WFH Options
Opus Recruitment Solutions
ll Bring: Strong experience in AWS cloud platform architecture and solving complex business issues. Proficiency in Java programming and Linux, with desirable knowledge of Apache NiFi, Node.js, JSON/XML, Jenkins, Maven, BitBucket, or JIRA. Hands-on experience with scripting (Shell, Bash, Python) and a solid understanding of Linux More ❯
london, south east england, united kingdom Hybrid / WFH Options
Noir
robust data pipelines. Work with Python and SQL for data processing, transformation, and analysis. Leverage a wide range of GCP services including: Cloud Composer (Apache Airflow) BigQuery Cloud Storage Dataflow Pub/Sub Cloud Functions IAM Design and implement data models and ETL processes. Apply infrastructure-as-code practices More ❯
automation, ETL processes, and AI-driven data architecture design. Technical Skills Proficiency in Python and SQL, with experience in data processing frameworks such as Apache Spark or Hadoop. Strong understanding of relational and NoSQL databases, as well as cloud-based data storage solutions (e.g., AWS S3, Google Cloud Storage More ❯
related field. 5+ years of experience in data engineering and data quality. Strong proficiency in Python/Java, SQL, and data processing frameworks including Apache Spark. Knowledge of machine learning and its data requirements. Attention to detail and a strong commitment to data integrity. Excellent problem-solving skills and More ❯
Design and Maintenance, Apps, Hive Metastore Management, Network Management, Delta Sharing, Dashboards, and Alerts. Proven experience working with big data technologies, i.e., Databricks and Apache Spark. Proven experience working with Azure data platform services, including Storage, ADLS Gen2, Azure Functions, Kubernetes. Background in cloud platforms and data architectures, such More ❯
field. Proficiency in programming languages such as Python, Spark, SQL. Strong experience with SQL databases. Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF). Experience with cloud platforms (Azure preferred) and related data services. There’s no place quite like BFS and we’re proud More ❯
field. Proficiency in programming languages such as Python, Spark, SQL. Strong experience with SQL databases. Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF). Experience with cloud platforms (Azure preferred) and related data services. There's no place quite like BFS and we're proud More ❯
extracting value from large datasets Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS Experience with Apache Spark/Elastic Map Reduce Experience with continuous delivery, infrastructure as code More ❯
london, south east england, united kingdom Hybrid / WFH Options
DATAHEAD
ensure high availability and accessibility. Experience & Skills : Strong experience in data engineering. At least some commercial hands-on experience with Azure data services (e.g., Apache Spark, Azure Data Factory, Synapse Analytics). Proven experience in leading and managing a team of data engineers. Proficiency in programming languages such as More ❯
london, south east england, United Kingdom Hybrid / WFH Options
Careerwise
BigQuery, Redshift, Data Lakes). Expertise in SQL for querying large datasets and optimizing performance. Experience working with big data technologies such as Hadoop, Apache Spark, and other distributed computing frameworks. Solid understanding of machine learning algorithms, data preprocessing, model tuning, and evaluation. Experience in working with LLM (Large More ❯
hoc analytics, data visualisation, and BI tools (Superset, Redash, Metabase) Experience with workflow orchestration tools (Airflow, Prefect) Experience writing data processing pipelines & ETL (Python, Apache Spark) Excellent communication skills and ability to work collaboratively in a team environment Experience with web scraping Perks & Benefits Competitive salary package (including equity More ❯
tuning and optimisation Solid understanding of data warehousing principles, data modelling practice, Excellent knowledge of creation and maintenance of data pipelines - ETL Tools (e.g. Apache Airflow) and Streaming processing tools (e.g. Kinesis) Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related issues More ❯
Middlesex, Greater London, United Kingdom Hybrid / WFH Options
Datatech
tuning and optimisation ·Solid understanding of data warehousing principles, data modelling practice, ·Excellent knowledge of creation and maintenance of data pipelines - ETL Tools (e.g. Apache Airflow) and Streaming processing tools (e.g. Kinesis) ·Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related issues More ❯
london, south east england, United Kingdom Hybrid / WFH Options
Datatech Analytics
tuning and optimisation Solid understanding of data warehousing principles, data modelling practice, Excellent knowledge of creation and maintenance of data pipelines - ETL Tools (e.g. Apache Airflow) and Streaming processing tools (e.g. Kinesis) Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related issues More ❯