5 of 5 Big Data Engineer Jobs in the UK excluding London

month ago Be among the first 25 applicants As part of the Big Data Team, you will be using cutting-edge technologies to work on collating data across different sources within GiG. Sources are all in real-time, and you will support an event-driven microservice Lambda architecture. Your focus is to work with the current agile … team, contribute to the platform's objectives, and enable other data technology stakeholders such as Business Intelligence, Data Science, and Quality Assurance teams. You will be challenged to maintain and add new features to a platform that ingests up to 5000 messages per second across multiple products like Lottery, Sports, and Casino. Reporting to the Lead Big Data Engineer and supported by the Big Data Architect, you will follow best practices and deliver world-class product increments supporting our Tier 1 Platform. You're really awesome at: Object-oriented programming (Java) Data modeling using various database technologies ETL processes (transferring data in-memory, moving away from traditional ETLs) and experience More ❯

month ago Be among the first 25 applicants As part of the Big Data Team, you will be using cutting edge technologies to work on collating data across different sources within GiG. Sources are all in real time, and you will be supporting an event driven micro service lambda architecture. Your focus is to work with the … current agile team and contribute to the platform's objectives and continue being an enabler to many other data technology stakeholders such as the Business Intelligence, Data Science and Quality Assurance teams. You will be up for a challenge, to continue maintaining and adding new features to a platform that ingests up to 5000 messages per second across … multiple products such as Lottery, Sports and Casino. Reporting to the Lead Big Data Engineer and supported by the Big Data Architect to follow best practices, you'll be guided into delivering world class product increments that support our Tier 1 Platform. You're really awesome at: Object oriented programming (Java) Data modelling using More ❯

Join to apply for the Senior/Lead Big Data Engineer (Scala/Spark) role at Grid Dynamics . Responsibilities Development of Spark jobs for data synchronization between different storage systems. Development of big data pipelines and infrastructure. Planning and deploying data schemas for data warehousing. Designing, developing, and maintaining RESTful services … and microservices. Managing real-time data streams using Kafka. Writing efficient backend code in Java/Scala. Optimizing Postgres databases and handling complex queries. Creating automated build processes using Gradle. Requirements Strong expertise in Spark and Scala. Hands-on experience with Hadoop. Proficiency with data processing frameworks like Kafka and Spark. Experience with database engines such as Oracle … PostgreSQL, Teradata, Cassandra. Understanding of distributed computing technologies, approaches, and patterns. Nice to have Experience with Data Lakes, Data Warehousing, or analytics systems. We offer Opportunity to work on cutting-edge projects. Collaboration with a motivated and dedicated team. Flexible schedule. Opportunities for professional development. About Us Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting More ❯

Data Engineer Hybrid working (2-3 days per week in Gloucester) £450-£550 per day (inside IR35) We are seeking a skilled, Security Cleared, Data Engineer to join our team. The ideal candidate will have a strong background in data architecture and engineering, specifically within the AWS ecosystem. You will be responsible for designing and … implementing data pipelines that support large-scale data processing and analytics. Key Responsibilities: - Develop, construct, test, and maintain data architectures and data processing systems. - Collaborate with data scientists and analysts to understand data requirements and ensure data availability. - Design and optimise data models to support business intelligence and reporting needs. - Monitor and … troubleshoot data systems to ensure high availability and performance. - Implement best practises for data management, security, and compliance. Required Skills: - Active Security Clearance - Proficiency in AWS services related to data processing and storage, such as Amazon S3, Redshift, and EMR. - Strong experience with big data technologies and frameworks. - Solid understanding of data modelling, ETL More ❯

international security across land, sea and air. They are leaders in highly sensitive international protection and continually seek to lead the way for innovation in their domain. About this Big Data Engineer Role As a Big Data Engineer, you will play a crucial role in creating and maintaining systems to support our client’s … data science, AI and machine learning workloads. You will be required to work in a collaborative nature with different departments and ensure effective data integration. Why Work as a Big Data Engineer with Our Client? Competitive salary up to £115,000 Flexible working hours Private healthcare Holiday buy and sell Career development Performance bonus What … is Expected of you as a Big Data Engineer with Our Client? You will need to hold current eDV or UKIC security vetting A minimum of 5 years of experience of working with Big Data as a Data Engineer Excellent communication skills and the ability to work in a collaborative nature with the More ❯