51 to 75 of 629 Big Data Jobs

Data Engineer (Hybrid) Position location: San Antonio, TX, United States Additional details: We are seeking a talented Lead Data Engineer to support the ingestion of mission-critical and mission-support data sets into a big data environment. The ideal candidate will have a background in supporting cyber and/or network-related missions within military … professional culture where everyone can thrive. We welcome anyone who is willing to contribute positively to the success of our clients and their missions. Essential Job Responsibilities • Work with big data systems and complex structured and unstructured data sets. • Support government data acquisition, analysis, and sharing efforts. • Focus on software infrastructure for big data scaled ingestion, including understanding and ingesting new data sources, modifying existing data sources, implementing testing, establishing monitoring, and troubleshooting. • Lead the department in achieving strategic goals, ensuring data integrity, and fostering a collaborative and innovative work environment. Minimum Qualifications • Security Clearance-Current active TS/SCI • At least 10 years of experience in one of the More ❯

career progression, sustainability, or volunteering, you'll find like-minded people driving change at Howden. Role: Quality Assurance Engineer Objective: Ensure the quality, reliability, and governance of the Group Data Platform , covering data engineering, platform engineering, and data governance processes . Summary of the Role Howden Group Services is expanding its Group Data Platform and seeks … a Quality Assurance Engineer to test, validate, and improve data pipelines, infrastructure, and governance processes. The ideal candidate will have experience in data testing, automation frameworks, and cloud-based data platforms , ensuring high-quality standards for data pipelines, storage, and platform components . This role requires a detail-oriented professional with a strong technical background in … data assurance and test automation . You will work alongside data engineers, platform engineers, and governance teams to ensure data accuracy, reliability, and compliance . Responsibilities Support the execution of the quality assurance strategy for the Group Data Platform , ensuring the reliability of data pipelines, infrastructure, and governance processes . Develop and execute test cases More ❯

Want to help solve the world's toughest problems with big data and AI? This is what we do every day at Databricks. As a Named Enterprise Account Executive, you will come with an informed and compelling point of view on the Big Data, Advanced Analytics, and AI space which will guide your successful strategy and … that accelerates existing customer success, identifies and acquires new customers and enables you to exceed quarterly/annual usage and booking goals You will motivate a diverse team of big data and AI professionals to implement your business plan You will lead your team, customers, and partners to identify impactful big data and AI use cases … whilst proving their value on the Databricks Data Intelligence Platform You will support the broader big data and AI transformation goals of your customers through a combination of strategic partnerships, well-scoped professional services, training, and targeted Executive engagement You will build exceptional value with all engagements to guide successful negotiations to close What we look for More ❯

to Content Link Select how often (in days) to receive an alert: Create Alert Competitive salary UK/Glasgow: hybrid working model (2-3 days on site) At NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees are key factors in our company's growth, market … our clients stay a step ahead of the competition. By hiring the best people and helping them grow both professionally and personally, we ensure a bright future for NTT DATA and for the people who work here. NTT DATA is currently looking for a Data Engineer for our growing team in the UK. Overview: NTT DATA is seeking a highly skilled Data Engineer with over 4+ years of experience to join our team to help a strategic banking client in various data transformation activities. Key Responsibilities: Collaborating with cross-functional teams to understand data requirements, and design efficient, scalable, and reliable ETL processes using Python and Databricks Developing and deploying ETL jobs More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions … scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders to identify opportunities for leveraging data as a More ❯

Job Description Job Title: Data Architect Level: Manager (CL7) Locations: London, Bristol or Manchester Salary: Competitive salary and package (Depending on level of experience) Please Note: Any offer of employment is subject to satisfactory BPSS and SC security clearance which requires 5 years continuous UK address history (typically including no periods of 30 consecutive days or more spent outside … Qualification Key responsibilities of the role are summarised below: Define the architecture for high profile, public facing, government, and private sector projects, including providing architectural and technical leadership Define data strategy, data migration approach, data integration approach, data models and data design for any given client Investigate and thoroughly understand the current live applications and … and guidelines to direct the build and deployment of systems Ensure that agreed upon architectural principles and standards are applied to the finished system or product Define a strategic Data Model across the enterprise and products Propose technical solutions for storing data in distributed systems Create a model that works for small micro-services as well as big More ❯

Senior ML & AI Backend Engineer - Big Data, LLMs & MLOps About the Role We're an ambitious, fast-moving tech company developing next-generation solutions at the intersection of advanced Machine Learning, Big Data, and Large Language Models (LLMs). We're looking for a hands-on Senior ML & AI Backend Engineer to design and build the … systems powering ML models and LLMs in production. Design, build, and maintain end-to-end ML pipelines, championing MLOps best practices for deployment, monitoring, and iteration. Develop solutions for big data storage and processing, ensuring data quality, security, and efficiency. Integrate and optimize both classical ML models and LLMs for real-world use cases. Research and experiment … with state-of-the-art algorithms, tools, and frameworks - bringing fresh ideas from prototype to production. Collaborate closely with a cross-functional team of data scientists, engineers, and product stakeholders. Write clean, maintainable, well-tested code and help set engineering best practices. Diagnose and resolve complex technical challenges in big data and ML systems. About You You More ❯

This post is an exciting opportunity for a Data Scientist or Informatician to work with electronic healthcare databases, and to engage in big data techniques. The post will be based within King's Centre for Military Health Research, the leading UK centre of excellence for military health research and the project is funded by the Economic and … Social Research Council (ESRC) for a Secondary Data Analysis Initiative (Phase 2). The post holder will be required to manage and process multiple large databases, utilising skills in programming and data linkage. Primary responsibilities will be to: i) conduct data linkages and develop databases, ii) extract data from the healthcare records databases, iii) ensure data quality and validity and iv) ensure appropriated data management procedures. The post holder will link electronic healthcare records to a large UK military cohort study and extract health data from these complex databases. This post will also offer the opportunity to contribute to health research which should directly inform policy, and to work with the Department of More ❯

Metyis is growing! We are looking for a Data Engineering Associate with 3-4 years of experience to join our Data and Analytics team in London. Who we are Metyis is a global and forward-thinking firm operating across a wide range of industries, developing and delivering Big Data, Digital Commerce, Marketing & Design solutions and Advisory … the best version of yourself. We are Metyis. Partners for Impact. What we offer Interact with senior stakeholders at our clients regularly to drive impactful business change. Work with Data Scientists to manage data throughout its lifecycle - acquisition, exploration, cleaning, integration, analysis, interpretation, and visualization. Become part of a fast-growing, international, and diverse team. What you will … technical solutions to solve concrete business challenges across various domains. Gather functional and non-functional requirements, considering technical environments, business constraints, and organizational needs. Support clients in executing their Big Data strategies by designing and building operational data platforms: ETL pipelines, data anonymization pipelines, data lakes, near real-time streaming data hubs, web services More ❯

Senior ML & AI Backend Developer You'll lead the design and deployment of scalable backend systems powering ML, big data, and LLM-driven applications. From MLOps pipelines and big data engineering to productionizing classical ML and LLMs, you'll be at the core of AI infrastructure. Key Requirements: Expert in Python, ML/AI frameworks (PyTorch … TensorFlow, Hugging Face) Proven MLOps, big data, and backend/API development experience Deep understanding of NLP and LLMs Proficient with cloud platforms (AWS/GCP/Azure), Airflow, DBT, Docker/Kubernetes Strong collaboration, problem-solving, and coding best practices Nice to have: LLM fine-tuning, streaming data, big data warehousing, open-source contributions. More ❯

Senior ML & AI Backend Developer You'll lead the design and deployment of scalable backend systems powering ML, big data, and LLM-driven applications. From MLOps pipelines and big data engineering to productionizing classical ML and LLMs, you'll be at the core of AI infrastructure. Key Requirements: Expert in Python, ML/AI frameworks (PyTorch … TensorFlow, Hugging Face) Proven MLOps, big data, and backend/API development experience Deep understanding of NLP and LLMs Proficient with cloud platforms (AWS/GCP/Azure), Airflow, DBT, Docker/Kubernetes Strong collaboration, problem-solving, and coding best practices Nice to have: LLM fine-tuning, streaming data, big data warehousing, open-source contributions. More ❯

sets thefoundation for delivering our full suite of capabilities. Job Description Employment Type: Full-Time Location: UK Job Overview We are looking for a skilled Database Designer/Senior Data Engineer to join our data engineering team. This role involves the development and maintenance of data solutions in the cloud environment. The ideal candidate will have a … strong background in data processing and a solid understanding of cloud data services. Requirements Key Responsibilities Design and implement modern data platforms in cloud such as AWS or Azure. Develop data pipelines and data streaming processes. Ensure data solutions are scalable, reliable, and efficient. Collaborate with data analysts and other stakeholders to meet … data requirements. Optimize data storage and processing for performance and cost. Maintain data security and compliance standards. Minimum Qualifications Bachelor's degree in Computer Science , Information Technology, Engineering, or a related field. Minimum 3 years of experience as a Database Designer & Senior Data Engineer, with hands-on experience in cloud based data services. Proficiency in More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. Additionally … you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: ·Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components More ❯

a passion to make an impact. Harnessing our innovative technologies and strong partnerships, we aim to make travel easy and rewarding for everyone. Get to Know Our Team The Data department, based in Bangkok, oversees all of Agoda's data-related requirements. Our ultimate goal is to enable and increase the use of data in the company … through creative approaches and the implementation of powerful resources such as operational and analytical databases, queue systems, BI tools, and data science technology. We hire the brightest minds from around the world to take on this challenge and equip them with the knowledge and tools that contribute to their personal growth and success while supporting our company's culture … of diversity and experimentation. The role the Data team plays at Agoda is critical as business users, product managers, engineers, and many others rely on us to empower their decision making. We are equally dedicated to our customers by improving their search experience with faster results and protecting them from any fraudulent activities. Data is interesting only when More ❯

agency still grounded in our founding principle that people are at the centre of all we do. Each day, we apply this belief to harness the transformative power of data and technology to inspire and move people and business forward. With more than 7,000 employees in over 100 offices around the world, we are the flagship Publicis Media … incredibly high demand. If you are passionate about shaping the future of AI and thrive on complex, high-impact challenges, we encourage you to apply. Responsibilities As a Senior Data Engineer for AI/ML, you will be the architect and builder of the data infrastructure that feeds our intelligent systems. Your responsibilities will include: Design and Build … Scalable Data Pipelines: Architect, implement, and optimize robust, high-performance real-time and batch ETL pipelines to ingest, process, and transform massive datasets for LLMs and foundational AI models. Cloud-Native Innovation: Leverage your deep expertise across AWS, Azure, and/or GCP to build cloud-native data solutions, ensuring efficiency, scalability, and cost-effectiveness. Power Generative AI More ❯

high-growth Google Cloud consultancy. At Qodea, you'll be part of a team energised by innovation and passionate about delivering exceptional results. We craft cutting-edge solutions in data and analytics, AI, cloud infrastructure and security, driving digital transformation that empowers our customers to scale, modernise and lead in their industries. We're driven by ideas and powered … by our people. We are looking for a Data Engineer with skills in cloud platforms (GCP/AWS/Azure), SQL and a programming language (python ideally). We really value in-person collaboration, so we're looking for you to spend at least 60% of your time on-site. This means being at our company offices or at … a client's site. How You'll Shape Our Success The purpose of this role is to design, build, and maintain scalable data pipelines and infrastructure that enable the efficient processing and analysis of large, complex data sets. What You'll Do Develop and maintain automated data processing pipelines using Google Cloud: Design, build, and maintain data More ❯

high-growth Google Cloud consultancy. At Qodea, you'll be part of a team energised by innovation and passionate about delivering exceptional results. We craft cutting-edge solutions in data and analytics, AI, cloud infrastructure and security, driving digital transformation that empowers our customers to scale, modernise and lead in their industries. We're driven by ideas and powered … by our people. We are looking for a Senior Data Engineer to deliver solutions that surpass our customers expectations, by utilising cutting-edge tools and technologies. We really value in-person collaboration, so we're looking for you to spend at least 60% of your time on-site. This means being at our company offices or at a client … s site. How You'll Shape Our Success The purpose of this role is to design, build, and maintain scalable data pipelines and infrastructure that enable the efficient processing and analysis of large, complex data sets. What You'll Do Develop and maintain automated data processing pipelines using Google Cloud: Design, build, and maintain data pipelines More ❯

Decision Intelligence in making their decisions. This leads to better business decisions with improved accuracy, reduced errors, and better outcomes across various aspects of the business. Team Description: The Data Ingestion and Pipelines (DIP) team is responsible for designing, building, and optimizing scalable data systems that integrate and process data from a variety of sources. We develop … efficient data pipelines that ensure seamless data flow into our data lake and transform it to support business intelligence and machine learning applications. Our work spans the entire data lifecycle; from ingesting data from clients, to developing complex ETL processes, to building systems for scraping external datasets (e.g., traffic, weather, points of interest, etc.). … The team is dedicated to delivering high-performance, reliable infrastructure that enables data-driven decision-making across the organization. Job Summary: The Data Ingestion and Pipelines (DIP) team is seeking a highly skilled Software Engineer. The ideal candidate will have a strong background in software development with a focus on building and optimizing data pipelines, ensuring data More ❯

qualifications: Bachelor's degree or equivalent practical experience. 6 years of experience with cloud native architecture in a customer-facing technical or support role, with demonstrated success. Experience with Big Data concepts. Experience leading technical proof-of-concept engagements and providing technical support for bid responses and request for information/request for proposal (RFI/RFP) processes. … concepts and applications. Preferred qualifications: Experience with architecture design, implementing, tuning, schema design, design technical architectures, customer requirements and query optimization of scalable and distributed systems. Experience with developing data warehousing, data lakes, batch/real-time event processing, streaming, data processing (ETL/ELT), data migrations, data visualization tools and data governance on … cloud native architectures. Experience with aspects of cloud computing (infrastructure, storage, platforms and data), technical business, data analytics, or Big Data and the cloud market, competitive dynamics and customer buying behavior. Ability to design and optimize solutions using leading data warehousing (e.g., BigQuery), data lake (e.g., Dataplex), and real-time analytics technologies. About the More ❯

Location: Reston, VA Clearance Requirement: TS w/SCI Eligibility Job Description and Responsibilities: Come join the future of data-driven decision making! At Data Machines we leverage data analytics, DevSecOps, machine intelligence, and data science to engineer solutions for our Federal government, defense, and commercial sponsors to solve real-world, critical mission problems. Data Machines is looking for a motivated and detail-oriented Junior Data Engineer to join our growing Data Engineering team. This is an exciting opportunity for someone early in their career to gain hands-on experience with modern data technologies, contribute to the development of data pipelines, and help drive data-driven decision-making across … the organization. This position is full-time on site in Reston, VA. Key Responsibilities: Assist in the design, development, and maintenance of scalable data pipelines and ETL processes Work with structured and unstructured data from various sources to ingest, clean, transform, and store in appropriate formats Support the creation and optimization of data models in data More ❯

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed to 100% renewable energy and sustainability, focusing on delivering exceptional customer experiences. It is initially … one day a week being based in their Nottingham office, this is negotiable. It is a full-time role, 37 hours per week. Accountabilities: * Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change. * Build and manage an enterprise data model within Databricks. * Integrate new data sources into the platform … using batch and streaming processes, adhering to SLAs. * Create and maintain documentation for data pipelines and associated systems, following security and monitoring protocols. * Ensure data quality and reliability processes are effective, maintaining trust in the data. * Be comfortable with taking ownership of complex data engineering projects and develop appropriate solutions in accordance with business requirements. * Able to More ❯

Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (Within the M25) Home working allowance of £581 per annum Job Ref: J12964 A technically proficient Azure Data Engineer is required to join an enterprise data platform team. The role will see the successful individual designing, building, testing, and maintaining robust, scalable, and secure data pipelines and services on the Microsoft Azure platform. You'll play a key role in enabling data accessibility for business stakeholders and end users, ensuring that solutions meet functional … non-functional, and compliance requirements. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components and products. Design, write and iterate code from prototype to production More ❯

Data Engineer - Manager x5 There are data teams and then there are data teams! Our customer puts enterprise at a new scale, not only with the size of their client engagements, but also with their own size as one of the big 4 and one of the first ever Microsoft Global Alliance Partners ( all data technologies will be delivered (GCP/AWS/Big data) although Microsoft Azure is at the forefront of some roles). As a result of insane customer wins, they are now looking to expand the teams by 5 experienced Data Engineering Managers who can be at the level to lead and assist them in their varied … Cloud Data transformation projects. This internationally renowned global consulting leader has a proven track record of delivering leading edge enterprise data engineering projects/programmes for a variety of Private and Public sector organisations including banking, pharma and government; and not only will you get fantastic project diversity, you will also get the opportunity to work with the More ❯

Join Ten10 as a Software Development Engineer in Test (Data Automation Focus) Job Type: Permanent Location: London (Hybrid working with occasional client travel) Passionate about data and automation? At Ten10, were at the forefront of helping organisations harness the power of data through quality engineering and innovative test solutions. Were looking for a Software Development Engineer in … Test (SDET) with a strong focus on data automation to join our dynamic team. If you're driven by complex data challenges and thrive in high-performance environments where ETL testing has become second nature, this is the role for you. ?? Important: All applicants must be eligible for SC clearance Why Ten10? At Ten10, were one of the … UKs leading independent Quality Engineering, Software Testing, and DevOps consultancies. We empower top-tier organisations to accelerate software delivery while maintaining confidence in qualityespecially in data-driven environments. Heres why youll love working with us: Data-Driven Projects: Collaborate on exciting and complex data pipelines, platforms, and automation solutions across industries including finance, retail, and government. Cutting More ❯

Analytics Engineer (9-month contract) Share on: Locations Billund, Denmark London, United Kingdom Job ID Category Data & Analytics Job Description Do you want to help us build a data-driven culture for digital product development? We have an amazing job opportunity for you! We are looking for an Analytics Engineer in our Data, Analytics & Business Improvement team. … robust behavioral analytics platform for our portfolio of consumer-facing LEGO websites, apps, and other owned experiences. Core Responsibilities Partner with multiple digital product teams to define & implement our data model, ensuring we have a scalable way of turning raw data from a range of sources into structured tables and data feeds that are aligned with the … and create a semantic & reporting layer for our suite of digital products, including the build and maintenance of DBT models for our behavioral analytics platform. Partner with the LEGO Data Office to develop standards and ways of working for data producers and data consumers across Digital Consumer Engagement and embed these across digital product teams (data More ❯