Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, BigData, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead … Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are … seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge technologies, architecting bigdata solutions and developing More ❯
innovative solutions, and migrate existing solutions to our platform. We provide the "how" of the move to the platform. Our customers are global enterprises and necessitate high standards and big ideas! We adopt modern architectures, consulting and project methodologies embracing a multi-disciplinary team setup. Large-scale transformation, mass migrations, complex application architectures, Artificial Intelligence, Data Science and … BigData are our trade. We are seeking an experienced Data Architect to focus on Supply Chain engagements for Energy & Utilities customers. The ideal candidate will bridge the gap between traditional supply chain systems and modern cloud architecture, creating scalable solutions that enhance our energy supply chain visibility, efficiency, and intelligence. This role will be part of … AWS Energy ProServe team and requires a deep understanding of AWS technologies, data architectures, AI/ML, and the broader technology ecosystem, as well as how those technologies can be leveraged to optimize the end-to-end supply chain. You will engage directly with CDOs, CDAOs, CTOs, and CIOs to drive strategic data and generative AI initiatives, ensuring More ❯
Sheffield, South Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Sparta Global Limited
Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, BigData and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯
Data Engineer (Databricks) - Leeds (Data Engineer, Python, PySpark, SQL, BigData, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. … They are looking for Data Engineers with significant Databricks experience to join an exceptional Agile engineering team. We are seeking a Data Engineer with strong Python, PySpark and SQL experience, possess a clear understanding of databricks, as well as a passion for Data Science (R, Machine Learning and AI). Database experience with SQL and No-SQL … exposure along with SOLID principles. Continuous Integration tools, Infrastructure as code and strong Cloud Platform knowledge, ideally with AWS is also key. We are keen to hear from talented Data Engineer candidates from all backgrounds. This is a truly amazing opportunity to work for a prestigious brand that will do wonders for your career. They invest heavily in training More ❯
Head of Engineering. You will oversee all aspects of the engineering lifecycle, from technology design and architecture through to implementation and optimisation. You'll work closely with cloud architects, data scientists, and risk officers to deliver a robust, scalable, and compliant platform that meets the bank's risk and regulatory needs. The role will shape the Lab vision, set … direction, and demonstrate technical leadership across the lifecycle from idea to value realisation. About us Like the modern Britain we serve, we're evolving. Investing billions in our people, data and tech to transform how we meet the changing needs of our 26 million customers. We're growing with purpose. Join us on our journey and you will too … What you'll do Lead the engineering team responsible for end-to-end infrastructure and technology transformation, including legacy decommissioning and GCP-based data infrastructure. Provide technical direction and mentorship, fostering collaboration, innovation, and continuous improvement. Design scalable, high-performance cloud infrastructure on GCP, ensuring availability, resilience, security, and compliance. Implement Infrastructure-as-Code (IaC) using tools like Terraform More ❯
Head of Engineering. You will oversee all aspects of the engineering lifecycle, from technology design and architecture through to implementation and optimisation. You'll work closely with cloud architects, data scientists, and risk officers to deliver a robust, scalable, and compliant platform that meets the bank's risk and regulatory needs. The role will shape the Lab vision, set … direction, and demonstrate technical leadership across the lifecycle from idea to value realisation. About us Like the modern Britain we serve, we're evolving. Investing billions in our people, data and tech to transform how we meet the changing needs of our 26 million customers. We're growing with purpose. Join us on our journey and you will too … What you'll do Lead the engineering team responsible for end-to-end infrastructure and technology transformation, including legacy decommissioning and GCP-based data infrastructure. Provide technical direction and mentorship, fostering collaboration, innovation, and continuous improvement. Design scalable, high-performance cloud infrastructure on GCP, ensuring availability, resilience, security, and compliance. Implement Infrastructure-as-Code (IaC) using tools like Terraform More ❯
a team that treats each other with respect and challenges you to be better. What you know how to do: Can write Spring 4 beans and Hibernate or JPA data objects. Knows Spring bean scopes and when to use them. Able to identify and fix defective, poor performing or non-scalable code. Knows how to develop and debug AOP … injected code. Understands software security practices including user authentication and authorization, data validation and an understanding of common DOS and SQL injection techniques. Is familiar with profiling, code coverage, logging, common IDE's and other development tools. Demonstrates good judgment, creativity, and ingenuity in proposed technical solutions. Coordinates work across teams to build seamless features. What you also have … Qualifications Does this describe you? Java REST Spring The Ideal Candidate Must have good communication skills. Must have experience working on web applications supporting 1M+ end users or large data sets with 10M+ database records. This is a very BigData platform. Experience building REST services (orchestration layer) on CRUD data services based on Cloudera Hadoop More ❯
troubleshooting and problem resolution Experience in System Integration Knowledge of the following: Hadoop, Flume, Sqoop, Map Reduce, Hive/Impala, Hbase, Kafka, Spark Streaming Experience of ETL tools incorporating BigData Shell Scripting, Python Beneficial Skills: Understanding of: LAN, WAN, VPN and SD Networks Hardware and Cabling set-up experience Experience of implementing and supporting BigDataMore ❯
attention to detail. • Knowledge of Spring MVC, Hibernate and Spring frameworks. • Understanding of Html 5, CSS3, Java Script, AJAX based programming and jQuery/Hibernate. • Experience in Hadoop, Cassandra, Bigdata technologies is a plus. SKILLS AND CERTIFICATIONS java REST spring hibernate Additional Information All your information will be kept confidential according to EEO guidelines. Direct Staffing Inc More ❯