/CD process to ensure standards and processes are uniformly upheld Java (ideally version 8+), database, C#, .Net Multi-threading Junit Maven Logging frameworks Apache libraries GOF Patterns MS SQL Server/SQL & PL Experience in Kafka is a plus Experience in Monitoring solutions - Azure Insights/Grafana etc. More ❯
and storage. Strong programming skills in Python, Java, or Scala . Proficiency in SQL, NoSQL, and time-series databases . Knowledge of orchestration tools (Apache Airflow, Kubernetes). If you are a passionate and experienced Senior Data Engineer seeking a Lead role, or a Lead Data Engineer aiming to More ❯
Trafford Park, Trafford, Greater Manchester, United Kingdom Hybrid / WFH Options
ISR RECRUITMENT LIMITED
cloud solutions Handling real-time data processing and ETL jobs Applying AI and data analytics to large datasets Working with big data tools like Apache Spark and AWS technologies such as Elastic MapReduce, Athena and Lambda Please contact Edward Laing here at ISR Recruitment to learn more about our More ❯
Employment Type: Permanent
Salary: £75000 - £85000/annum (plus excellent company benefits)
that meet the evolving needs of the business. Utilise your strong background in data engineering, combined with your existing experience using SQL, Python and Apache Spark in production environments. The role will entail strong problem-solving skills, attention to detail, and the ability to work independently while collaborating closely More ❯
Manchester Area, United Kingdom Hybrid / WFH Options
Opus Recruitment Solutions
ll Bring: Strong experience in AWS cloud platform architecture and solving complex business issues. Proficiency in Java programming and Linux, with desirable knowledge of Apache NiFi, Node.js, JSON/XML, Jenkins, Maven, BitBucket, or JIRA. Hands-on experience with scripting (Shell, Bash, Python) and a solid understanding of Linux More ❯
london, south east england, united kingdom Hybrid / WFH Options
Opus Recruitment Solutions
ll Bring: Strong experience in AWS cloud platform architecture and solving complex business issues. Proficiency in Java programming and Linux, with desirable knowledge of Apache NiFi, Node.js, JSON/XML, Jenkins, Maven, BitBucket, or JIRA. Hands-on experience with scripting (Shell, Bash, Python) and a solid understanding of Linux More ❯
london, south east england, united kingdom Hybrid / WFH Options
Noir
robust data pipelines. Work with Python and SQL for data processing, transformation, and analysis. Leverage a wide range of GCP services including: Cloud Composer (Apache Airflow) BigQuery Cloud Storage Dataflow Pub/Sub Cloud Functions IAM Design and implement data models and ETL processes. Apply infrastructure-as-code practices More ❯
automation, ETL processes, and AI-driven data architecture design. Technical Skills Proficiency in Python and SQL, with experience in data processing frameworks such as Apache Spark or Hadoop. Strong understanding of relational and NoSQL databases, as well as cloud-based data storage solutions (e.g., AWS S3, Google Cloud Storage More ❯
related field. 5+ years of experience in data engineering and data quality. Strong proficiency in Python/Java, SQL, and data processing frameworks including Apache Spark. Knowledge of machine learning and its data requirements. Attention to detail and a strong commitment to data integrity. Excellent problem-solving skills and More ❯
React Typescript, React Native, Angular framework, Html5, JavaScript and CSS with Responsive grid framework Experience in Java, JSP, Struts 2 Basic knowledge of Tomcat, Apache, NGINX Some other highly valued skills include: Jira, Confluence, Git, Jenkins, Problem solving skills Jquery, Lodash Understanding of Agile development cycle You may be More ❯
Design and Maintenance, Apps, Hive Metastore Management, Network Management, Delta Sharing, Dashboards, and Alerts. Proven experience working with big data technologies, i.e., Databricks and Apache Spark. Proven experience working with Azure data platform services, including Storage, ADLS Gen2, Azure Functions, Kubernetes. Background in cloud platforms and data architectures, such More ❯
Nottingham, Nottinghamshire, United Kingdom Hybrid / WFH Options
Experian Group
Significant experience of programming using Scala and Python Experience of using Terraform to provision and deploy cloud services and components Experience of developing on Apache Spark Experience of developing with AWS cloud services including (but not limited to) AWS Glue, S3, Step Functions, Lambdas, EventBridge and SQS BDD/ More ❯
field. Proficiency in programming languages such as Python, Spark, SQL. Strong experience with SQL databases. Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF). Experience with cloud platforms (Azure preferred) and related data services. There’s no place quite like BFS and we’re proud More ❯
field. Proficiency in programming languages such as Python, Spark, SQL. Strong experience with SQL databases. Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF). Experience with cloud platforms (Azure preferred) and related data services. There's no place quite like BFS and we're proud More ❯
X.509 certificate infrastructure. Extensive experience supporting and implementing TLS/SSL certificate management systems Proficient with Token-based authentication services, Perfect Forward Security (PFS), Apache, Nginx, HAProxy Solid knowledge of Linux security and system operations. Benefits Roku is committed to offering a diverse range of benefits as part of More ❯
Newcastle upon Tyne, Tyne & Wear Hybrid / WFH Options
Client Server
scientific discipline, backed by minimum A A B grades at A-level You have commercial Data Engineering experience working with technologies such as SQL, Apache Spark and Python including PySpark and Pandas You have a good understanding of modern data engineering best practices Ideally you will also have experience More ❯
extracting value from large datasets Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS Experience with Apache Spark/Elastic Map Reduce Experience with continuous delivery, infrastructure as code More ❯
month contract with strong potential for extension, offering a unique opportunity to shape secure software delivery from end to end. Strong Kubernetes and Apache NiFi expertise. Responsibilities: Collaborate with engineering teams to design, develop, and release secure, scalable software. Implement quality assurance processes to ensure outputs meet stringent security More ❯
Malvern, Worcestershire, West Midlands, United Kingdom
CBSbutler Holdings Limited
month contract with strong potential for extension, offering a unique opportunity to shape secure software delivery from end to end. Strong Kubernetes and Apache NiFi expertise. Responsibilities: Collaborate with engineering teams to design, develop, and release secure, scalable software. Implement quality assurance processes to ensure outputs meet stringent security More ❯
london, south east england, united kingdom Hybrid / WFH Options
DATAHEAD
ensure high availability and accessibility. Experience & Skills : Strong experience in data engineering. At least some commercial hands-on experience with Azure data services (e.g., Apache Spark, Azure Data Factory, Synapse Analytics). Proven experience in leading and managing a team of data engineers. Proficiency in programming languages such as More ❯
with toolkits such as BioPython AI Protein Dynamics Integrative structural modelling Experience with data curation and processing from heterogeneous sources; familiarity with tools like Apache Spark or Hadoop. Proficiency with cloud platforms (AWS, GCP, Azure). Familiarity with major machine learning frameworks (e.g., scikit-learn, TensorFlow, PyTorch). *NGS More ❯
with toolkits such as BioPython AI Protein Dynamics Integrative structural modelling Experience with data curation and processing from heterogeneous sources; familiarity with tools like Apache Spark or Hadoop. Proficiency with cloud platforms (AWS, GCP, Azure). Familiarity with major machine learning frameworks (e.g., scikit-learn, TensorFlow, PyTorch). *NGS More ❯
motivated to learn new technologies and teach programming languages to team members. Ability to collaborate across different stakeholder groups and levels. Working knowledge of Apache, Tomcat, and TomEE. About the Team J.P. Morgan is a global leader in financial services, providing strategic advice and products to a diverse client More ❯
Richmond, North Yorkshire, Yorkshire, United Kingdom
Datix Limited
knowledge of programming languages, specifically Python and SQL. Expertise in data management, data architecture, and data visualization techniques. Experience with data processing frameworks like Apache Spark, Hadoop, or Flink. Strong understanding of database systems (SQL and NoSQL) and data warehousing technologies. Familiarity with cloud computing platforms (AWS, Azure) and More ❯