676 to 700 of 776 Senior Data Engineer Jobs

Join to apply for the Senior/Lead Big Data Engineer (Scala/Spark) role at Grid Dynamics . Responsibilities Development of Spark jobs for data synchronization between different storage systems. Development of big data pipelines and infrastructure. Planning and deploying data schemas for data warehousing. Designing, developing, and maintaining RESTful services and … microservices. Managing real-time data streams using Kafka. Writing efficient backend code in Java/Scala. Optimizing Postgres databases and handling complex queries. Creating automated build processes using Gradle. Requirements Strong expertise in Spark and Scala. Hands-on experience with Hadoop. Proficiency with data processing frameworks like Kafka and Spark. Experience with database engines such as Oracle, PostgreSQL … Teradata, Cassandra. Understanding of distributed computing technologies, approaches, and patterns. Nice to have Experience with Data Lakes, Data Warehousing, or analytics systems. We offer Opportunity to work on cutting-edge projects. Collaboration with a motivated and dedicated team. Flexible schedule. Opportunities for professional development. About Us Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform More ❯

Senior Data/Consulting Engineer (Palantir Foundry) – London – Salary Up To £60,000 per annum Are you a seasoned engineer ready to lead in the AI era? A true Palantir expert? Then Morela has the opportunity for you. Morela are proud to be working with one of the UK’s leading Palantir partners, who are experiencing … rapid growth and now looking to bring on a Senior Data/Consulting Engineer to help drive complex, high impact projects forward. This role is about more than just technical proficiency it’s about leadership, strategy, and joining a team of exceptional individuals who are shaping transformative journeys on the Palantir Foundry platform. You’ll be joining … collaborative ethos and deep technical acumen allow them to consistently deliver solutions that offer real-world impact and long term value. Core Responsibilities Client Strategy & Leadership: Work closely with senior stakeholders to understand critical challenges, shaping long-term data strategies and scalable solutions using Palantir Foundry. Solution Design & Architecture: Take ownership of the design and architecture of complex More ❯

Job Description Your new company Working for a globally renowned bank. Your new role Seeking an experienced Data Engineer to design, build, and optimise this bank's complex data pipelines and big data infrastructure. You will have deep experience working as a data engineer and architecting scalable data solutions/optimising data … This role requires both technical excellence and the ability to influence architectural decisions that align with business objectives. What you'll need to succeed Deep experience working as a data engineer (within big consultancies or financial services). Great expertise in designing/building/implementing complex data pipelines. Vast experience with Databricks. Strong knowledge of distributed … computing frameworks e.g Spark, Hadoop ecosystem. Highly experienced with cloud-based data platform AWS. Solid programming skills with Python, Spark. Demonstrated ability to engineer/architect solutions for Big Data. Experienced with defining target architecture. Financial product knowledge e.g. assets, bonds, swaps would be desirable. What you'll get in return Flexible working options available. What you need More ❯

Senior Data Platform Engineer Location: Hybrid (London) Salary: £90,000 + Benefits We are supporting a growing business who are currently building out a brand-new data platform as part of their long-term data strategy. This is a fantastic opportunity to take real ownership of a modern AWS/Snowflake-based platform, work directly … alongside specialist data consultants, and shape the infrastructure, deployment and best practices from the ground up. As the consultants move towards the handover phase, they are now looking to hire a Data Platform Engineer to take full ownership of the platform. You'll have the opportunity to work closely with the consultants during handover, giving you the … chance to fully understand the environment, architecture, and tools being implemented. The Role: Take ownership of the AWS & Snowflake data platform and infrastructure. Build and maintain CI/CD pipelines to support code deployments, infrastructure changes and data pipeline releases. Drive infrastructure, deployment, and code management best practices across the data platform. Work closely with internal software More ❯

I’m currently representing a financial institution that is looking to bridge the gap between cybersecurity and data to fight financial crime and fraud. They are looking for data/software engineers with strong experience in engineering integrating databases and generating insights to fight financial crimes. Location: Greater Manchester or Knutsford (Hybrid – 2 days on-site per week … What’s the Role? I'm looking for a Software and Data Engineer to join my client's global fraud team. This role is a mix of 80% engineering and 20% financial crime & service marketing, ideal for someone passionate about building scalable solutions in a fast-paced, high-impact environment. What Makes You a Great Fit? Experience with … large data sets and data engineering pipelines Cloud expertise is a huge plus (AWS, Snowflake, Databricks) Thrives in an agile/start-up-like environment with minimal red tape Strong stakeholder management skills – this role operates across Barclays’ sub-divisions Databases: Structured & unstructured data Not required! My client is happy to upskill candidates in fraud prevention and More ❯

Social network you want to login/join with: Remote: Remote Type: Temporary Job #25040 We are looking for a Senior Big Data Engineer to produce innovative solutions driven by exploratory data analysis from complex and high-dimensional datasets. You will be working on a team that detects fraudulent activity within payments for ads, so experience … renowned for their advancements in online technologies that have changed the world. An ambitious, fast-paced, forward-thinking company with a creative culture. They are looking for an experienced Data Scientist to join their team on a fully remote basis. Location: Must be based in the UK Type: Remote Duration: 6 – 12 months Visa sponsorship: No Job Reference: BBBH25040 … Job Responsibilities: Apply knowledge of statistics, machine learning, programming, data modelling, simulation, and advanced mathematics to recognize patterns, identify opportunities, pose business questions, and make valuable discoveries leading to prototype development and product improvement. Use a flexible, analytical approach to design, develop, and evaluate predictive models and advanced algorithms that lead to optimal value extraction from the data. Generate More ❯

The Data Engineer provides data engineering expertise in support of JBSA-Lackland Department of the Air Force, Counter Insider Threat (DAF C In T) program. Per PWS 1.3.8.2, Enterprise Engineering Support, specific responsibilities include, but are not limited to: • Design, develop and maintain data processing systems, ensuring data security, and creating data visualization tools. … Develop extract, transform, load (ETL) processes to ingest and process large volumes of data. • Implement data quality checks and validate processes to ensure accuracy and integrity of data. • Design and implement data storage solutions. • Create data APIs and web services for data access and integration. • Build real-time data processing systems for streaming data sources. • Develop data security protocols and access controls to protect sensitive information. • Design and implement data visualization tools and dashboards for data analysis and reporting. • Collaborate with data scientists and analysts to understand analytic requirements and create data solutions to meet those needs. • Ensure compliance with data governance and privacy regulations. • Provide technical More ❯

Social network you want to login/join with: Remote: Remote Type: Temporary Job #25301 We are looking for Senior Data Engineer to produce innovative solutions driven by exploratory data analysis from complex and high-dimensional datasets.You will be working on a team that detects fraudulent activity within payments for ads so experience in this space … their continuing advancements in online technologies that have changed the world. An ambitious, fast-paced forward-thinking company with a very creative culture. They are looking for an experienced Data Scientist to join their team on a fully remote basis. Location: Must be based in the UK Type : Remote Duration: 6 – 12 months Visa sponsorship : No Job Reference : BBBH25040 … Job Responsibilities: Apply knowledge of statistics, machine learning, programming, data modelling, simulation, and advanced mathematics to recognize patterns, identify opportunities, pose business questions, and make valuable discoveries leading to prototype development and product improvement. Use a flexible, analytical approach to design, develop, and evaluate predictive models and advanced algorithms that lead to optimal value extraction from the data. Generate More ❯

Join to apply for the Senior Data Engineer role at Opply Join to apply for the Senior Data Engineer role at Opply Currently, 25 million consumer goods brands worldwide with $4 Trillion of revenue do not have knowledge or power to create effective supply chains. Opply is revolutionising the way these brands find, communicate … building the world's first personalised end-to-end supply platform for them. We focus on the most innovative brands and suppliers, aiming to become the leading platform and data authority in consumer goods innovation. Opply is backed by some of the best-known venture capitalists in the world and is one of the fastest-growing startups in the … the Automation Team which is responsible for building features that automate workflows for our users (internal and external). The roadmap for the Automation Team requires cross-functional skills: Data Engineer (this position) Product Engineer (hired recently) Data Scientist (well-established in the company, deep knowledge of the domain) As a Senior Data Engineer More ❯

Join to apply for the Senior Data Engineer role at Graphics Unlimited (Vic) Pty Ltd . Pay up to £73,517 , plus 28.97% employer pension contributions, hybrid working, flexible hours, and great work-life balance. Our DWP Data Engineers work in a high-performing team with engineers, architects, designers, and more. We offer guidance and support … develop data-centric solutions that positively impact millions of DWP users, helping them find and use essential DWP services. DWP. Digital with Purpose. We are looking for a Senior Data Engineer to join our community of tech experts in DWP Digital. We're using fresh ideas and leading-edge tech to build and maintain digital solutions … purpose is unique. We'd love you to join us. You and your role This role involves leading from within, helping shape how DWP's Business Audit team approaches data engineering, without a formal leadership title. You'll translate technical requirements into workable solutions, especially during platform migrations and system upgrades. You'll work closely with data engineers More ❯

Job Description AWS Stack, data being landed in S3, Lambda triggers, Data Quality, data written back out to AWS S3(Parquet Formats), Snowflake for dimensional model. Design and build the data pipelines, work with someone around understanding data transformation, this is supported by BA's, building out the data pipelines, moving into layers in … the data architecture (Medallion architecture). Requirements 5 plus year's experience with AWS 5-8 years overall exposure to Data Technical Lead experience Proficient in Snowflake, S3, Lambda Triggers Hybrid London 1-2 days a week £(Apply online only) (Outside IR35) The reason they're hiring now, they have a client that is all on a legacy More ❯

Social network you want to login/join with: Senior Data Engineer (Reasoning ML), Oxford col-narrow-left Client: Location: Oxford, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Reference: f83cb6f3b590 Job Views: 13 Posted: 17.06.2025 Expiry Date: 01.08.2025 col-wide Job Description: Your Role As our Senior Data Engineer (Reasoning ML), you will be responsible for creating and curating the datasets for training and evaluating our ML planner components. You will build effective data analysis tools and work across ML model development and evaluation to achieve desired AV driving behaviours. You will also actively participate in operational support for your team, ensuring the root causes … and resolved, and drive improvements to product quality, customer experience, and maintainability. You will: Take a leading role within your team to develop and deploy state of the art data pipelines for our machine learning models. Design and implement metrics for model validation and continuous monitoring in production. Leverage the Oxa Metadriver platform to generate synthetic data, and More ❯

Data Engineer Up to £75k Derby (3 Days a Week) SC Clearable Infrastructure Projects Are you a technically sharp, consultative data engineer ready to embed yourself in one of the UK s most important infrastructure programmes? We re working with a global engineering consultancy at the forefront of the energy transition. They re building out their … data & analytics capability and this role is your chance to be the first data specialist on the project. The end client? One of the UK s most recognisable engineering organisations. You ll be the bridge between technical and business teams, delivering insights where spreadsheets currently dominate, and helping to modernise how critical infrastructure decisions are made. What you … ll be doing: Designing and building scalable, efficient datasets using SQL Extracting, transforming, and consolidating segmented BIM data sources Creating intuitive Power BI dashboards to support decision-making Collaborating with engineers, BIM leads and project teams to define requirements and use cases Acting as the go-to data expert in a hands-on, consultative capacity Building trust on More ❯

a different format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 3 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for … you as a GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and … innovation and thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key More ❯

a different format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 3 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for … you as a GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and … innovation and thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key More ❯

million raised in the last Series C funding round in January 2023. Your Team You will join a growing team of computer science and robotics experts leveraging machine learning, data and cloud infrastructure to build and deploy powerful on-vehicle reasoning capabilities. Your work will enable Oxa Driver to plan and execute sophisticated driving behaviours scalably across all of … our customer domains using data-driven approaches. Your Role As our Senior Data Engineer (Reasoning ML), you will be responsible for creating and curating the datasets for training and evaluating our ML planner components. You will build effective data analysis tools and work across ML model development and evaluation to achieve desired AV driving behaviours. … and resolved, and drive improvements to product quality, customer experience, and maintainability. You will: Take a leading role within your team to develop and deploy state of the art data pipelines for our machine learning models. Design and implement metrics for model validation and continuous monitoring in production. Leverage the Oxa Metadriver platform to generate synthetic data, and More ❯

million raised in the last Series C funding round in January 2023. Your Team You will join a growing team of computer science and robotics experts leveraging machine learning, data and cloud infrastructure to build and deploy powerful on-vehicle reasoning capabilities. Your work will enable Oxa Driver to plan and execute sophisticated driving behaviours scalably across all of … our customer domains using data-driven approaches. Your Role As our Senior Data Engineer (Reasoning ML), you will be responsible for creating and curating the datasets for training and evaluating our ML planner components. You will build effective data analysis tools and work across ML model development and evaluation to achieve desired AV driving behaviours. … and resolved, and drive improvements to product quality, customer experience, and maintainability. You will: Take a leading role within your team to develop and deploy state of the art data pipelines for our machine learning models. Design and implement metrics for model validation and continuous monitoring in production. Leverage the Oxa Metadriver platform to generate synthetic data, and More ❯

companies, industry, the public sector and, ultimately, society as a whole. Job Description Our mission is to create a framework for a self-healing network. By integrating real-time data, highly automated and modular processes and proactive anomaly detection and resolution, we enable an environment in which changes are safely introduced and undesirable conditions are avoided or corrected as … quickly as possible. In this way, we are driving the transformation towards more efficient and resilient network management. As a Data Scientist on this project, you will design, implement, and review robust code solutions, orchestrate and optimize ETL pipelines, and work directly with large-scale datasets utilizing technologies such as Python, Spark, Cloudera, and Hadoop. Your responsibilities will include … identifying meaningful patterns and generating actionable insights from complex data, translating these findings into strategic recommendations. You will collaborate closely with your Kanban team and actively contribute to regular agile ceremonies, with your workflow supported by Jira. Qualifications Skill requirements: • At least 3 years of programming with Python, including extensive experience with Pandas for data manipulation and analysis More ❯

the Best Place to Work in Greater Washington, D.C., our client offers an exceptional work environment with unparalleled benefits and opportunities for professional growth. If you're passionate about data engineering and looking to make a significant impact, this is the place for you! Compensation Range: $142k - 174k(DOE) Position Title: Senior Data Engineer with Active … Top Secret/SCI Eligibility Clearance Location: Huntsville, AL Role Overview: We are seeking a Senior Data Engineer to support an advanced visual analytic application. This role involves developing data analytics for desktop and web-based visual analytic software, facilitating bulk analysis of relational information using advanced graphics, visualization, and high-performance computing, and utilizing specified … open source, COTS, and GOTS technologies. The Senior Data Engineer will establish applications that produce actionable intelligence from streams of structured and semi-structured data, design strategies for enterprise database systems, set standards for operations, programming, and security, construct large relational databases, and integrate new systems with existing warehouse structures to refine system performance and functionality. More ❯

Joining one of the best-known retail brands in the UK as a Senior Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the wider data teams. The Opportunity … For this role as Senior Data Engineer, they are looking for this person to have extensive experience with data pipelines, data warehousing and to play a key role in driving high standards across the data function. You will build and maintain reliable and high-quality data solutions. You will support the team in … building pipelines to deliver insights enabling the company to be more data-driven with their decision-making. Skills and Experience Strong experience in Python Strong experience working with Azure Experience using Spark Experience working with wider data teams to ensure delivery What’s in it for you? Please send your CV in for initial screening. #J-18808-Ljbffr More ❯

Joining one of the best-known retail brands in the UK as a Senior Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the wider data teams. The Opportunity … For this role as Senior Data Engineer, they are looking for this person to have extensive experience with data pipelines, data warehousing and to play a key role in driving high standards across the data function. You will build and maintain reliable and high-quality data solutions. You will support the team in … building pipelines to deliver insights enabling the company to be more data-driven with their decision-making. Skills and Experience Strong experience in Python Strong experience working with Azure Experience using Spark Experience working with wider data teams to ensure delivery What’s in it for you? Please send your CV in for initial screening. #J-18808-Ljbffr More ❯

We are looking for a hands-on senior data engineer to work in an early-stage startup providing services to a range of multinational firms. Technical competencies (covering some if not all of these areas ): - Data Engineering - Data Warehousing - Cloud Computing - Systems Engineering & DevOps expertise - Machine Learning and AI development - Full Stack software development Behavioural More ❯

London-based trading firm seeks a Senior Data Engineer Contractor for a Grafana resiliency project. The ideal candidate will have solid experience with the Grafana analytics and visualization platform to deliver solutions and create comprehensive documentation of the end-to-end process. Responsibilities include: Translating architectural and data flow diagrams into actionable plans to extract key … metrics, transform and normalize data, and surface insights into Grafana dashboards for end users. Building robust data pipelines to extract telemetry data from source systems, collaborating with data architects to ensure the use of appropriate patterns, technologies, and processes. Leveraging expertise in Grafana and OpenTelemetry to deliver monitoring, debugging, and system performance reporting solutions. Requirements: Strong … experience in Python, SQL, and data wrangling. Expertise in Grafana analytics and visualization platform. Experience with OpenTelemetry for monitoring and system performance reporting. This is a 6-month contract paying £700 per day, inside IR35, via umbrella company. The role requires 3 days per week in their London offices. More ❯

Data Engineer | up to £85,000 | Hybrid - 1 day at the Toddington office Dynamic and fast-paced, Moto is ideal for individuals seeking a career with maximum opportunities. If you have energy, passion for quality, and a desire to deliver exceptional results, you will do well here. We're Moto, the future of motorway rest stops, and we … and loved ones Inclusive benefits: Enhanced maternity, paternity, pension, sick pay & life assurance Responsibilities: Manage the engineering team Collaborate with the Technical Architect to build new integrations and analytical data sources Design and implement new integration processes to replace Moto's end-of-life back-office platform Support other project activities Manage BAU support functions maintaining existing integrations Build … reliable, efficient data applications, systems, services, and platforms Deploy, schedule, and monitor components pragmatically within workflows Handle complex queries against relational and non-relational data stores As our Senior Data Engineer, you will have experience of: Designing, building, and maintaining robust and scalable data pipelines using various tools and technologies Advanced knowledge of Python More ❯

Work on a greenfield data project for one of the world’s leading energy organisations, leveraging data points across energy sources to enable their trading team to make decisions & drive success. We’re looking for a Senior Data Engineer to join a brand-new team in a leading Energy Trading Company, to take forward their … migration from legacy data systems to create a future-proof data ingestion & storage solution focused on scalability. This is a top-paying industry, and anyone joining at this stage would be positioning themselves for high remuneration in future. This role is perfect for: – Senior Data Engineers that want to work in one of the world’s … removed from hedge funds and can be a difficult space to break into. This is an opportunity to do so and maximise your earning potential in the long run. – Senior Data Engineers that want to work on a greenfield data project which will have a major impact within a top organisation in their field. – Senior Data More ❯