Big Data Jobs in the South East

1 to 25 of 351 Big Data Jobs in the South East

Enterprise Data & Analytics Platforms Director

Slough, Berkshire, United Kingdom
Mars, Incorporated and its Affiliates
Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions … scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders to identify opportunities for leveraging data as a More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Management Architect

Farnborough, England, United Kingdom
Infor
Infor Farnborough, England, United Kingdom Join or sign in to find your next job Join to apply for the Data Management Architect role at Infor Infor Farnborough, England, United Kingdom 3 days ago Be among the first 25 applicants Join to apply for the Data Management Architect role at Infor The role supports our business plan by enabling … can handle more projects without overburdening the team, maintain high-quality delivery, and effectively manage risks, all of which are critical to our long-term success. Position Summary A Data Services Solution Architect is a technical leader responsible for designing and implementing solutions that manage, analyze, and utilize data effectively. Their role bridges business needs with technical execution … ensuring that data systems are scalable, reliable, and aligned with the project's goals. Essential Duties of a Data Services Solution Architect 1. Data Solution Design and Integration a. Architect scalable solutions for data conversions, migrations, and integrations across systems. b. Ensure smooth data flow between legacy and modern platforms during transitions. 2. Data More ❯
Posted:

Data Architect (Enterprise Data Foundations)

Slough, England, United Kingdom
Mars
Social network you want to login/join with: Data Architect (Enterprise Data Foundations), Slough col-narrow-left Client: Mars Location: Slough, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Reference: 5770903661a6 Job Views: 4 Posted: 02.06.2025 Expiry Date: 17.07.2025 col-wide Job Description: JOB DESCRIPTION Job Description: Come become a part … of a vibrant CDO team serving Mars Snacking Enterprise. Our team helps build the Data Platforms, Model & Engineer data products, craft Analytical products and Integrations to be a truly data driven growth engine. As we continue to expand and transform digitally, we’re actively seeking an experienced and skilled Data Architect to help model, build and … own our Enterprise Data Foundations. This is a pivotal role that involves conceptualizing, designing and overseeing the implementation, and optimizing global data models to deliver value throughout the organisation. You’ll be designing and driving delivery of data products with a major focus on marketing, DCOM and overall Demand functions that will be the foundational pillars for More ❯
Posted:

Senior AI Technical Consultant

Reading, England, United Kingdom
HSO
about our people, customers and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Overview: As a Senior Technical Consultant - Data and AI, you will be responsible for designing, implementing, and optimizing data and AI solutions for our clients. You will work closely with clients to understand their business … needs and translate them into technical solutions that leverage the latest technologies in data and AI. This role requires a deep understanding of data architecture, machine learning, and AI technologies, as well as strong problem-solving and communication skills. Key Responsibilities: Design and implement data and AI solutions that meet client requirements. Collaborate with clients to understand … their business needs and translate them into technical solutions. Develop and maintain data pipelines, data warehouses, and data lakes using tools such as Azure Data Factory, Azure Synapse Analytics, and Azure Databricks. Implement machine learning models and AI algorithms using frameworks like Azure Machine Learning, Microsoft Cognitive Services, and Databricks. Provide technical leadership and mentorship to More ❯
Posted:

Senior Data Engineer

london, south east england, united kingdom
Levy Professionals
As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation. The Senior Data Engineer will work closely with the data, Architecture, Business Analyst, Data Stewards to integrate and … align requirements, specifications and constraints of each element of the requirement. They will also need to help identify gaps in resources, technology, or capabilities required, and work with the data engineering team to identify and implement solutions where appropriate. Work type: Contract Length: initial 6 months Work structure: hybrid 2 days a week in London. Primary Responsibilities: Integrate data from multiple on prem and cloud sources and systems. Handle data ingestion, transformation, and consolidation to create a unified and reliable data foundation for analysis and reporting. Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare More ❯
Posted:

Senior Data Engineer

slough, south east england, united kingdom
Levy Professionals
As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation. The Senior Data Engineer will work closely with the data, Architecture, Business Analyst, Data Stewards to integrate and … align requirements, specifications and constraints of each element of the requirement. They will also need to help identify gaps in resources, technology, or capabilities required, and work with the data engineering team to identify and implement solutions where appropriate. Work type: Contract Length: initial 6 months Work structure: hybrid 2 days a week in London. Primary Responsibilities: Integrate data from multiple on prem and cloud sources and systems. Handle data ingestion, transformation, and consolidation to create a unified and reliable data foundation for analysis and reporting. Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare More ❯
Posted:

Senior Data Engineer

South East London, England, United Kingdom
Levy Professionals
As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation. The Senior Data Engineer will work closely with the data, Architecture, Business Analyst, Data Stewards to integrate and … align requirements, specifications and constraints of each element of the requirement. They will also need to help identify gaps in resources, technology, or capabilities required, and work with the data engineering team to identify and implement solutions where appropriate. Work type: Contract Length: initial 6 months Work structure: hybrid 2 days a week in London. Primary Responsibilities: Integrate data from multiple on prem and cloud sources and systems. Handle data ingestion, transformation, and consolidation to create a unified and reliable data foundation for analysis and reporting. Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare More ❯
Posted:

Senior Data Engineer

london (city of london), south east england, united kingdom
Levy Professionals
As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation. The Senior Data Engineer will work closely with the data, Architecture, Business Analyst, Data Stewards to integrate and … align requirements, specifications and constraints of each element of the requirement. They will also need to help identify gaps in resources, technology, or capabilities required, and work with the data engineering team to identify and implement solutions where appropriate. Work type: Contract Length: initial 6 months Work structure: hybrid 2 days a week in London. Primary Responsibilities: Integrate data from multiple on prem and cloud sources and systems. Handle data ingestion, transformation, and consolidation to create a unified and reliable data foundation for analysis and reporting. Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare More ❯
Posted:

Cloud Data Engineer

Bracknell, Berkshire, United Kingdom
Icloudxcel
CloudXcel is a technology-driven company dedicated to providing innovative cloud solutions to businesses worldwide. Our mission is to empower organizations to harness the full potential of their data in the cloud, unlocking insights and driving transformation. With a commitment to cutting-edge technologies and a dynamic, inclusive work environment, we foster growth, creativity, and innovation. Overview: CloudXcel is … seeking a talented and highly motivated Cloud Data Engineer with expertise in Python to join our team. In this role, you will work closely with cross-functional teams to design, develop, and optimize cloud-based data pipelines and infrastructure. The ideal candidate is passionate about data engineering, proficient in Python, and eager to solve complex challenges in … a fast-paced, collaborative environment. Key Responsibilities: Design, develop, and maintain scalable cloud-based data pipelines to collect, process, and analyze large datasets. Build and optimize ETL workflows to ensure efficient data integration and processing. Collaborate with data scientists, analysts, and engineers to support data modeling, analytics, and reporting needs. Leverage Python to implement robust data More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Generative AI Architect (Open AI) Professional Services

South East London, England, United Kingdom
HCLTech
and highly skilled Generative AI Architect to lead the design and implementation of advanced AI solutions tailored for professional services. This role requires expertise in AI-driven decision automation , data-driven insights , and scalable architecture to enhance business processes and client outcomes. As a key member of our team, you will architect solutions that learn, reason, and make intelligent … optimize AI algorithms for predictive analytics, recommendation engines, and automation in professional services. Apply machine learning (ML) and deep learning (DL) techniques to enhance decision-making and business intelligence. Data Engineering & Integration Architect robust data pipelines to support AI model training and inference. Implement automated data collection, integration, cleansing, and transformation techniques to ensure high-quality data inputs. Collaborate with data engineering teams to align AI solutions with real-world business applications. AI Model Training, Evaluation & Performance Optimization Train AI models using supervised, unsupervised, and reinforcement learning techniques , refining them based on business insights . Define model performance metrics to ensure AI solutions deliver tangible value. Real-Time AI Applications & System Integration Work alongside software More ❯
Posted:

Generative AI Architect (Open AI) Professional Services

london, south east england, united kingdom
HCLTech
and highly skilled Generative AI Architect to lead the design and implementation of advanced AI solutions tailored for professional services. This role requires expertise in AI-driven decision automation , data-driven insights , and scalable architecture to enhance business processes and client outcomes. As a key member of our team, you will architect solutions that learn, reason, and make intelligent … optimize AI algorithms for predictive analytics, recommendation engines, and automation in professional services. Apply machine learning (ML) and deep learning (DL) techniques to enhance decision-making and business intelligence. Data Engineering & Integration Architect robust data pipelines to support AI model training and inference. Implement automated data collection, integration, cleansing, and transformation techniques to ensure high-quality data inputs. Collaborate with data engineering teams to align AI solutions with real-world business applications. AI Model Training, Evaluation & Performance Optimization Train AI models using supervised, unsupervised, and reinforcement learning techniques , refining them based on business insights . Define model performance metrics to ensure AI solutions deliver tangible value. Real-Time AI Applications & System Integration Work alongside software More ❯
Posted:

Generative AI Architect (Open AI) Professional Services

slough, south east england, united kingdom
HCLTech
and highly skilled Generative AI Architect to lead the design and implementation of advanced AI solutions tailored for professional services. This role requires expertise in AI-driven decision automation , data-driven insights , and scalable architecture to enhance business processes and client outcomes. As a key member of our team, you will architect solutions that learn, reason, and make intelligent … optimize AI algorithms for predictive analytics, recommendation engines, and automation in professional services. Apply machine learning (ML) and deep learning (DL) techniques to enhance decision-making and business intelligence. Data Engineering & Integration Architect robust data pipelines to support AI model training and inference. Implement automated data collection, integration, cleansing, and transformation techniques to ensure high-quality data inputs. Collaborate with data engineering teams to align AI solutions with real-world business applications. AI Model Training, Evaluation & Performance Optimization Train AI models using supervised, unsupervised, and reinforcement learning techniques , refining them based on business insights . Define model performance metrics to ensure AI solutions deliver tangible value. Real-Time AI Applications & System Integration Work alongside software More ❯
Posted:

Generative AI Architect (Open AI) Professional Services

london (city of london), south east england, united kingdom
HCLTech
and highly skilled Generative AI Architect to lead the design and implementation of advanced AI solutions tailored for professional services. This role requires expertise in AI-driven decision automation , data-driven insights , and scalable architecture to enhance business processes and client outcomes. As a key member of our team, you will architect solutions that learn, reason, and make intelligent … optimize AI algorithms for predictive analytics, recommendation engines, and automation in professional services. Apply machine learning (ML) and deep learning (DL) techniques to enhance decision-making and business intelligence. Data Engineering & Integration Architect robust data pipelines to support AI model training and inference. Implement automated data collection, integration, cleansing, and transformation techniques to ensure high-quality data inputs. Collaborate with data engineering teams to align AI solutions with real-world business applications. AI Model Training, Evaluation & Performance Optimization Train AI models using supervised, unsupervised, and reinforcement learning techniques , refining them based on business insights . Define model performance metrics to ensure AI solutions deliver tangible value. Real-Time AI Applications & System Integration Work alongside software More ❯
Posted:

Senior Data Engineer (Remote)

South East, United Kingdom
Hybrid / WFH Options
Circana
Company description: At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity, equity, and inclusion as we believe in the undeniable … Place To Work. This prestigious award is based entirely on what current employees say about their experience working at Circana. Job description: We are seeking a skilled and motivated Data Engineer to join a growing global team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines and infrastructure on the Azure cloud … platform. You will leverage your expertise in PySpark, Apache Spark, and Apache Airflow to process and orchestrate large-scale data workloads, ensuring data quality, efficiency, and scalability. If you have a passion for data engineering and a desire to make a significant impact, we encourage you to apply! Job Responsibilities ETL/ELT Pipeline Development: Design, develop More ❯
Employment Type: Permanent
Posted:

Lead Data Scientist (Equity Only) - 1%

Crawley, England, United Kingdom
JR United Kingdom
Lead Data Scientist (Equity Only) - 1% About Luupli Luupli is a social media app 'in development' that aims to provide opportunities for diverse creators from marginalized communities. The platform will highlight their work and offer access to social media opportunities. Job Description As a Lead Data Scientist at Luupli, you will leverage AWS analytics services to analyze data and extract insights. Collaborating with cross-functional teams, you will develop data-driven solutions and shape our data strategy to support business growth. Responsibilities Work with teams to understand objectives, data needs, and analytics goals. Develop strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design data pipelines and ETL processes for diverse … data sources. Apply statistical and machine learning techniques for analysis and pattern recognition. Create KPIs and dashboards to facilitate decision-making. Perform exploratory data analysis to identify trends and insights. Collaborate on data architecture, quality, and governance improvements. Requirements Bachelor’s or Master’s in Computer Science, Statistics, Mathematics, or related fields. Experience as a Data More ❯
Posted:

Lead Data Scientist (Equity Only) - 1%

Dartford, England, United Kingdom
JR United Kingdom
Lead Data Scientist (Equity Only) - 1% Job Details Location: Dartford, United Kingdom Job Category: Other EU Work Permit Required: Yes Job Description Luupli is a social media app 'in development' that aims to provide opportunities for diverse creators from marginalized communities. The platform will highlight their work and offer access to social media opportunities. Role Overview: As a Lead … Data Scientist, you will leverage AWS analytics services to analyze data, collaborate with cross-functional teams, and develop data-driven solutions to support business growth. Responsibilities Understand business objectives and define analytics goals with teams. Develop data analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design data pipelines and ETL processes … for diverse data sources. Apply statistical and machine learning techniques for predictive and pattern analyses. Create dashboards and KPIs using Amazon QuickSight for decision-making. Perform exploratory data analysis to identify trends and insights. Work with data engineers to optimize data architecture, quality, and governance in AWS. Requirements Bachelor's or master's degree in Computer More ❯
Posted:

Lead Data Scientist (Equity Only) - 1%

Brighton, England, United Kingdom
JR United Kingdom
Lead Data Scientist (Equity Only) - Brighton Location: Brighton, United Kingdom Job Category: Other EU work permit required: Yes Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 Job Description Lead Data Scientist - Equity-Only role (1%) About Luupli Luupli is a social media app 'in development' that aims to provide opportunities for diverse creators from marginalized communities. The platform … will highlight their work and open access to social media opportunities. Responsibilities Collaborate with teams to understand business goals, data needs, and analytics objectives. Develop data analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design and build data pipelines and ETL processes for diverse data sources into AWS. Apply statistical and machine … learning techniques for predictive, prescriptive analyses, clustering, segmentation, and pattern recognition. Identify key metrics, develop KPIs, and create dashboards and visualizations with Amazon QuickSight. Perform exploratory data analysis to uncover trends and insights for product and engagement improvements. Work with data engineers to optimize data architecture, quality, and governance in AWS. Requirements Bachelor's or master's More ❯
Posted:

Lead Data Scientist (Equity Only) - 1%

Basingstoke, England, United Kingdom
JR United Kingdom
Lead Data Scientist (Equity Only) - Basingstoke Company: Luupli, a social media app in development aimed at supporting diverse creators from marginalized communities, highlighting their work and providing access to opportunities in the social media space. Job Details: Position: Lead Data Scientist (Equity Only, 1%) Location: Basingstoke Job Category: Other EU Work Permit Required: Yes Job Views: 4 Posted … Date: 16.06.2025 Expiry Date: 31.07.2025 Job Description: As a Lead Data Scientist at Luupli, you will leverage AWS analytics services to analyze data and extract insights. Collaborate with cross-functional teams to develop data-driven solutions and influence our data strategy to support business growth. Responsibilities: Understand business objectives, data requirements, and analytics goals with … cross-functional teams. Develop data analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design and build data pipelines and ETL processes for data extraction, transformation, and loading. Apply statistical and machine learning techniques for predictive and segmentation analyses. Develop KPIs and dashboards to facilitate data-driven decision-making. Perform exploratory data More ❯
Posted:

Lead Data Scientist (Equity Only) - 1%

Slough, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: Lead Data Scientist (Equity Only) - 1%, Slough Location: Slough, United Kingdom Job Category: Other EU work permit required: Yes Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 Job Description: Lead Data Scientist - Equity-Only role (1%) About Luupli Luupli is a social media app 'in development' that aims to … communities. The platform will highlight their work and offer access to social media opportunities. Responsibilities: Collaborate with cross-functional teams to understand business goals and define analytics objectives. Develop data analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design and build data pipelines and ETL processes for data extraction, transformation, and loading. Apply … statistical and machine learning techniques for predictive and segmentation analyses. Identify key metrics, develop KPIs, and create dashboards using Amazon QuickSight. Perform exploratory data analysis to uncover trends and insights for product and engagement improvements. Work with data engineers to optimize data architecture, quality, and governance in AWS. Requirements: Bachelor's or master's degree in Computer More ❯
Posted:

Lead Data Scientist (Equity Only) - 1%

Oxford, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: Lead Data Scientist (Equity Only) - 1%, Oxford district col-narrow-left Client: Location: Oxford district, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: Lead Data Scientist - Equity-Only role 1% About Luupli … in development', aiming to provide opportunities for diverse creators from marginalized communities. It will highlight their work and offer access to social media opportunities. Job Description: As a Lead Data Scientist at Luupli, you will leverage AWS analytics services to analyze data and extract insights. You will work with cross-functional teams to develop data-driven solutions … and recommendations, shaping our data strategy and supporting business growth. Responsibilities: Work with teams to understand objectives, data needs, and analytics goals. Develop data analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design data pipelines and ETL processes for diverse data sources. Apply statistical and machine learning techniques for analysis, clustering More ❯
Posted:

Lead Data Scientist (Equity Only) - 1%

Guildford, England, United Kingdom
JR United Kingdom
Lead Data Scientist (Equity Only) - 1% Job Details Location: Guildford, United Kingdom Job Category: Other EU Work Permit Required: Yes Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 Job Description: About Luupli Luupli is a social media app currently in development that aims to provide opportunities for diverse creators from marginalized communities. The platform will highlight their work and … facilitate access to social media opportunities. Role Overview: As a Lead Data Scientist at Luupli, you will leverage AWS analytics services to analyze data, develop insights, and support strategic decisions. Collaboration with cross-functional teams will be essential to develop data-driven solutions that foster business growth. Responsibilities: Work with teams to understand objectives, data needs … and analytics goals. Develop data analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design and implement data pipelines and ETL processes for diverse data sources. Apply statistical and machine learning techniques for predictive and segmentation analyses. Identify key metrics, develop KPIs, and create dashboards using Amazon QuickSight. Perform exploratory data analysis to More ❯
Posted:

Lead Data Scientist (Equity Only) - 1%

High Wycombe, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: Lead Data Scientist (Equity Only) - 1%, High Wycombe Client: Location: High Wycombe, United Kingdom Job Category: Other EU work permit required: Yes Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 Job Description: Lead Data Scientist - Equity-Only Role About Luupli Luupli is a social media app 'in development' that … aims to provide opportunities for diverse creators from marginalized communities. It will highlight their work and offer access to social media opportunities. Job Description: As a Lead Data Scientist at Luupli, you will leverage AWS analytics services to analyze data and extract insights. You will work with data engineers, product managers, and stakeholders to develop data-driven solutions and provide actionable recommendations. Your expertise will shape our data strategy and support business growth. Responsibilities: Collaborate with teams to understand objectives, data requirements, and analytics goals. Develop data analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design and build data pipelines and ETL processes for data extraction More ❯
Posted:

Lead Data Scientist (Equity Only) - 1%

Portsmouth, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: Lead Data Scientist (Equity Only) - 1%, Portsmouth, Hampshire col-narrow-left Client: Location: Portsmouth, Hampshire, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: Lead Data Scientist - Equity-Only role 1% About Luupli … for diverse creators from marginalized communities. Luupli will highlight the work of diverse creators and provide access to opportunities in the social media space. Job Description: As a Lead Data Scientist at Luupli, you will leverage AWS analytics services to analyze data and extract insights. You will work with cross-functional teams to develop data-driven solutions … and deliver actionable recommendations, shaping our data strategy and driving growth. Responsibilities: Collaborate with teams to understand objectives, identify data needs, and define analytics goals. Develop data analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design data pipelines and ETL processes for data extraction, transformation, and loading into AWS. Apply statistical More ❯
Posted:

Senior Data Engineer

Slough, Berkshire, UK
Mastek
Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary: We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working … with large datasets. Key Responsibilities: Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules More ❯
Employment Type: Full-time
Posted:

Senior Data Engineer

london, south east england, united kingdom
Mastek
Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working … with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules More ❯
Posted:
Big Data
the South East
10th Percentile
£45,000
25th Percentile
£48,750
Median
£65,000
75th Percentile
£68,750
90th Percentile
£83,750