26 to 50 of 3,161 Big Data Jobs

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of … our cutting-edge Azure Databricks platform for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires … a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources More ❯

Data Architect Baltimore, MD - 100% onsite FTF interview Responsibilities: Data Architecture Design: Develop and maintain a robust data architecture strategy for the AWS Cloud-based Lake House, encompassing data modeling, data storage, data processing, and data integration across various AWS services, such as … S3, Glue, Athena, and Redshift. Cloud Data Governance: Define and enforce data governance principles, standards, and best practices to ensure data quality, security, and compliance with relevant regulations. Data Integration: Design and implement efficient data integration processes, enabling seamless data flow between diverse data sources and the data lake infrastructure. Performance Optimization: Collaborate with data engineers and technical teams to optimize the performance and scalability of the data lake architecture, ensuring high availability and low latency for data access and processing. Metadata Management: Implement metadata management solutions to enhance More ❯

LEAD BIG DATA ENGINEER - DV CLEARED BRAND NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A GLOBALLY LEADING NATIONAL SECURITY COMPANY FOR A LEAD BIG DATA ENGINEER WITH DV CLEARANCE Permanent job opportunity for a Lead Big Data Engineer Globally leading defence/cyber security company … Salary up to £90,000 plus clearance bonus London based organisation in an easily accessible location WHO WE ARE? We are recruiting a lead Big Data Engineer to work with a multi-national, industry leading national security company in central London. WHAT WILL THE LEAD BIG DATA … be able to deploy applications in a controlled and repeatable way as well as being able to develop technical specialisms. WE NEED THE LEAD BIG DATA ENGINEER TO HAVE... Current DV clearance (Enhanced) Must have experience with big data tools such as Hadoop, Cloudera or Elasticsearch More ❯

CONTRACT DATA ENGINEER – eDV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY COMPANY FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Data Engineer National Security client Palantir Foundry Outside IR35 Central London based organisation in an easily accessible location … To apply please call 07704 152 640/0203 854 0120 or email dominic.barbet@searchability.com WHO WE ARE? We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE … NEED THE DATA ENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Experience With Palantir Foundry Experience working in an Agile Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration More ❯

Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal extraction … transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. Work with stakeholders … including the Executive, Product, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs. Keep our data separated and secure across national boundaries through multiple data centers and AWS regions. Create data tools for analytics and data More ❯

begin or progress your career in the commodities sector. Join us, make a difference and help shape the future of energy. Job Description: The Data Management team is part of the Data Team which works very closely with the Front Office and is the centre of master data management, data quality and control with direct responsibility over the development and maintenance of EDF Trading’s data assets. Position purpose The Data Management team is looking for a Data Governance Lead to manage a team of analysts and work with the product team for … defining requirements for Data Governance products and processes (i.e. Data Quality tool, Data Catalogue, APIs, Access Controls and policy documents.) as well as coordinating and overseeing the work done by the departments involved. The Data Governance Lead is expected to have leadership and project management skills More ❯

Eviden, part of the Atos Group, with an annual revenue of circa € 5 billion is a global leader in data-driven, trusted and sustainable digital transformation. As a next generation digital business with worldwide leading positions in digital, cloud, data, advanced computing and security, it brings deep expertise … countries. By uniting unique high-end technologies across the full digital continuum with 47,000 world-class talents, Eviden expands the possibilities of data and technology, now and for generations to come. We require an experienced Lead Data Architect (over 7 years’ experience in the data arena … to support the delivery of Enterprise and Big Data Architectures with a focus on Analytics and Data Management applications. As a Lead Data Architect, you will be responsible for leading and developing numerous data strategies which ensure data-driven decision-making. You will work More ❯

Technologies: Enterprise Data Architect, Data Engineer, Financial Services, Insurance Our client, one of the world's largest commercial insurance companies with operations in 54 countries and territories, has a need for a skilled Data Architect/Data Engineer to join its London-based team. The role … is 3 days onsite and 2 days remote. The role: Do you have data engineering or architecture experience within the financial services industry? If you are interested in growing your skills and career within one of the largest commercial insurers in the world, then we would love to hear … from you! The Data Architect will be responsible for the design of the enterprise-wide data architecture and supporting the development of the organisation's functional data strategy and roadmaps. The successful candidate will first determine and classify which data assets should be treated as enterprise More ❯

s unique experiences, and embrace the flexibility to do your best work. Creating a career you love? It's Possible. Team and Responsibilities: The Big Data & Analytics team at Pinterest is responsible for end-to-end big data infrastructure, data warehousing, AB testing framework, and … business intelligence solutions that power the rest of the business. The team owns critical data infrastructure, including log ingestion, batch and stream processing, big data query and workflow systems, AB testing experimentation framework, and data processing & ETL pipelines for data warehousing and BI. What you … ll do: Build infrastructure platforms or data processing pipelines that support Pinterest's critical business needs. Utilize cutting-edge big data technologies such as Hadoop, Spark, Flink, Kafka, Airflow, and Presto. What we're looking for: 5+ years of experience in big data infrastructure, data More ❯

week ago Be among the first 25 applicants As a Lead (Senior) Data Scientist at Lumilinks, you will take a leadership role in shaping our data science initiatives and driving impactful solutions that align with our strategic objectives. In this position, you will leverage your extensive experience and … advanced analytical skills to guide the development of complex models, lead cross-functional projects, and mentor a team of data scientists. You will play a crucial role in transforming raw data into actionable insights that support key business decisions and enhance our product offerings. You will collaborate closely … with stakeholders across various departments, including engineering, product development, and business strategy, to identify opportunities for leveraging data to drive innovation and growth. Your expertise in machine learning, statistical analysis, and data visualisation will enable you to design and implement robust analytical frameworks that enhance our understanding of More ❯

Join to apply for the Big Data Solutions Architect role at Databricks 6 days ago Be among the first 25 applicants Join to apply for the Big Data Solutions Architect role at Databricks Get AI-powered advice on this job and more exclusive features. CSQ226R109 As … a Big Data Solutions Architect (Resident Solutions Architect) in our Professional Services team you will work with clients on short to medium-term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology … cases Work with engagement managers to scope variety of professional services work with input from the customer Guide strategic customers as they implement transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications More ❯

Role: Senior Data Engineer (Maximo) Location: United Kingdom (Remote, with office access) Arcadis is the world's leading company delivering sustainable design, engineering, and consultancy solutions for natural and built assets. We are more than 36,000 people, in over 70 countries, dedicated to improving quality of life. Everyone … complex challenges and deliver more impact together. Role description: This role is a unique chance to work within Arcadis Intelligence’s Solution Architecting, Systems & Data group, providing services including Data Migration and Integration, Data Warehousing, Master Data Management, Big Data and Analytics, Software, API … solution delivery engagements across a variety of industry sectors. Projects are varied, some involve working with Arcadis’s software product instances to securely migrate data from multiple data sources and integrate with customer’s other business systems such as SAP, Microsoft Dynamics, various Oracle products and others. Other More ❯

finance, healthcare, hospitality, telecom and other industries, helping our clients to implement technology and business transformations. Currently, N-iX seeks a dynamic VP of Data Consulting to join our CTO Office. This pivotal role combines technical consulting with team leadership, ensuring our team's capability to handle diverse data projects for Fortune 500 clients. Key Responsibilities: Develop and execute the Data Consulting GTM strategy, focusing on data services and data consulting offering (data platforms, data lakes, data warehouses, data governance, data strategy, data reporting and analytics, etc) Scale and … manage a high-performing team of data architects, business analysts and engineers to deliver advanced data solutions to various clients Drive team activities, including marketing lead generation, technical pre-sales, project estimation, and short- and long-term technical consulting and implementation projects Collaborate with Solutions & Cloud Team, AI More ❯

finance, healthcare, hospitality, telecom and other industries, helping our clients to implement technology and business transformations. Currently, N-iX seeks a dynamic VP of Data Consulting to join our CTO Office. This pivotal role combines technical consulting with team leadership, ensuring our team's capability to handle diverse data projects for Fortune 500 clients. Key Responsibilities: Develop and execute the Data Consulting GTM strategy, focusing on data services and data consulting offering (data platforms, data lakes, data warehouses, data governance, data strategy, data reporting and analytics, etc) Scale and … manage a high-performing team of data architects, business analysts and engineers to deliver advanced data solutions to various clients Drive team activities, including marketing lead generation, technical pre-sales, project estimation, and short- and long-term technical consulting and implementation projects Collaborate with Solutions & Cloud Team, AI More ❯

Data Scientist - skills in statistics, physics, mathematics, Computer Science, Engineering, Data Mining, Big Data (Hadoop, Hive, MapReduce) This is an exceptional opportunity to work as a Data Scientist within a global analytics team, utilizing various big data technologies to develop complex behavioral models … advanced quantitative and statistical techniques. Designing, building, and utilizing consumer behavioral forecasting models across different business sectors to maximize opportunities. Leading initiatives to enhance data accuracy, availability, granularity, and coverage. Developing analytics strategies to improve customer and product strategies. Designing better data analysis processes for future use. Proactively … patterns to optimize product performance and customer experience. Building complex behavior forecasting models to identify links between behavior and new opportunities. Manipulating high-level data and presenting findings clearly to senior stakeholders. Supporting the development of analytics strategies to enhance product plans and customer engagement. Ideal candidates are talented More ❯

Data Engineer Application Deadline: 27 June 2025 Department: [SBSS] Enterprise Data Management Employment Type: Permanent - Full Time Location: Newcastle Reporting To: Mike Jolley Compensation: £55,000 - £68,500/year Description We're building something special — and we need a talented Data Engineer to help bring our … Azure data platform to life. This is your chance to work on a greenfield Enterprise Data Warehouse programme in the insurance sector, shaping data pipelines and platforms that power smarter decisions, better pricing, and sharper customer insights. The Data Engineer will design, build, and optimise scalable … data pipelines within Azure Databricks, ensuring high-quality, reliable data is available to support pricing, underwriting, claims, and operational decision-making. This role is critical in modernising SBG’s cloud-based data infrastructure, ensuring compliance with FCA/PRA regulations, and enabling AI-driven analytics and automation. More ❯

Principal Data Engineer for Data Asset & Provisioning Technology Join to apply for the Principal Data Engineer for Data Asset & Provisioning Technology role at HSBC Principal Data Engineer for Data Asset & Provisioning Technology Join to apply for the Principal Data Engineer for Data … banking services for our customers around the world. We are looking for an exceptional Principal Engineer to serve as the technical anchor for the Data Asset and Provisioning Technology domain, covering platforms and capabilities including Enterprise Data Assets (EDA), Reference Data, Big Data & Movement, and … Data Decisioning engineering. This role will drive technical strategy, architecture, and engineering excellence across distributed data platforms that are foundational to data democratization, AI enablement, customer insight, and regulatory compliance. The Principal Engineer will provide hands-on leadership in modern data and digital engineering practices, hybrid More ❯

to support operational needs for our clients and deliver a seamless experience to customers in the moments that matter. We are looking for a Data Engineer to join our team and support with designing, implementing, and maintaining the data systems that support our Gen AI-driven applications and … data-driven decision-making processes. Job Summary We are looking for an experienced Senior Data Engineer to join our AI team. You will be responsible for designing and optimizing complex data storage solutions, developing and maintaining efficient data pipelines, and ensuring data quality and integrity. … Working closely with data analysts, machine learning engineers, and software engineers, you will deliver relevant datasets or data APIs for downstream applications. This role requires strong proficiency in data modelling, database management, and programming skills in Python and SQL. You should have experience with big data More ❯

Join to apply for the Senior Data Engineer role at Centrica Join to apply for the Senior Data Engineer role at Centrica Join us, be part of more. We’re so much more than an energy company. We’re a family of brands revolutionising how we power the … make it, store it, move it, sell it, and mend it. An opportunity to play your part – We are seeking a highly skilled Senior Data Engineer to join our dynamic DTS team at Centrica. In this role, you will collaborate closely with our platform and architecture teams to design … develop, implement, and support an operational framework that facilitates the productionisation of large-scale data transformation jobs and pipelines within a big data environment. Your responsibilities will include designing, building, documenting, deploying, and managing data structures, data transformation pipelines, and data transformation jobs. Additionally More ❯

Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 15 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines … or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. Senior Data Engineer (Azure/Databricks Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to our … collective success? The Data & Analytics department transforms raw data into actionable insights to drive informed decision-making and optimize business operations. The Senior Azure Data Engineer will support these goals by designing, implementing, and managing scalable data solutions on the Azure platform, ensuring efficient data More ❯

About Exsolvæ: Exsolvæ is a Brussels-based consultancy at the forefront of Data and Artificial Intelligence innovation. We specialize in providing expert Consultancy, Audit, and Solution Development services to empower our partners in overcoming unique challenges. Our holistic approach fosters collaboration across diverse domains, including Data Engineering, Advanced … professionals equipped with cutting-edge tools, a culture of continuous learning, and an unwavering commitment to delivering high-impact solutions. We are seeking a Data Engineering Specialist with expertise in Azure technologies to join our expert team. Your Role: As a Data Engineering Specialist with a focus on … Azure, you will design and implement cloud-native data solutions that enable clients to unlock the full potential of their data assets. You will collaborate with multidisciplinary teams, utilizing advanced Azure technologies to build scalable, efficient data pipelines, data models, and analytics workflows. What We're More ❯

Duration: 12 + Months - Contract to Hire PR: $80/hr - $90/hr on W2 Top 3 Skills - Databricks certified technical lead, Python, Data Domain experience This is a contract-to-hire position, and candidates must be prepared to transition to a full-time employee role. Job Summary … Engineering team. This role is pivotal in enhancing the experience of over 420,000 associates by leading the design, build, and optimization of our data platform, services, APIs, and cloud migrations. As a product-centric role within an agile delivery framework, you will ensure our data solutions align … an organization recognized as one of the best places to work in IT for seven consecutive years. Required Qualifications: • 10+ years of experience in data engineering, big data, or API development, with at least 3+ years in a leadership role. • Proven experience leading product-centric data More ❯

Job Title: AI Research & Data Scientist The WOW Adventure Ltd, acclaimed as the UK's best SEO company , is expanding its horizons and actively seeking skilled AI Research & Data Scientists to join our esteemed team. If you are passionate about Artificial Intelligence, Data Science, and want to … work alongside the UK's best SEO experts, this is your opportunity to contribute to ground-breaking projects and shape the future of data-driven innovation. AI Research & Data Scientists Key Responsibilities: Leverage your expertise in Artificial Intelligence, Machine Learning, and Big Data to conduct advanced … data analysis and generate actionable insights. Develop and implement innovative data structures, data engineering, and data modeling solutions. Utilize neural networks and deep learning techniques for predictive analytics and business intelligence. Drive data governance and ensure data security across various projects. Lead data More ❯

Big Data & Cloud Consultant - London, UK Join to apply for the Big Data & Cloud Consultant - London, UK role at Infosys Big Data & Cloud Consultant - London, UK Join to apply for the Big Data & Cloud Consultant - London, UK role at Infosys Job Description … Role - Lead Consultant Technology – Big Data & Cloud -Hadoop, Hive, Spark, Cloud, Python, SQL with Banking domain Location – United Kingdom Compensation – Competitive (including bonus) Job Description Today, the corporate landscape is dynamic and the world ahead is full of possibilities! None of the amazing things we do at Infosys … will have the opportunity to shape value-adding consulting solutions that enable our clients to meet the changing needs of the global landscape. Required Big Data & Cloud -Hadoop, Hive, Spark Strong experience in Python, SQL with Banking domain, such as in financial managing risk and strengthening controls supporting More ❯

make it, store it, move it, sell it, and mend it. An opportunity to play your part – We are seeking a highly skilled Senior Data Engineer to join our dynamic DTS team at Centrica. In this role, you will collaborate closely with our platform and architecture teams to design … develop, implement, and support an operational framework that facilitates the productionisation of large-scale data transformation jobs and pipelines within a big data environment. Your responsibilities will include designing, building, documenting, deploying, and managing data structures, data transformation pipelines, and data transformation jobs. Additionally … to us about flexible working) The day to day: Design, develop, own, and improve the framework and toolset used to implement, operate, and document data transformation jobs in our big data environment. Establish, implement, and support automation frameworks that enable continuous integration, deployment, and monitoring of our More ❯