51 to 75 of 332 Permanent Big Data Jobs

Senior Solution Architect (Big Data) – Outside IR35 I’m supporting a major UK government programme looking for an experienced Senior Solution Architect with a strong big data and cloud background. You’ll provide the technical leadership needed to ensure data solutions are secure, scalable and aligned with strategic goals - influencing design, governance and delivery across … a complex portfolio of digital services. Key Responsibilities: • Define and own the technical vision and roadmap for data-driven solutions across multiple workstreams. • Design, review, and assure data architectures ensuring they meet performance, governance and security standards. • Act as the technical bridge between engineering teams and business stakeholders, translating complex requirements into clear architectural direction. • Provide mentorship and … guidance to technical teams, promoting best practice and consistency across projects. • Oversee data management and modelling standards, working closely with engineers to enable efficient automation and integration. Details: Outside IR35 £600–£625 per day SC Cleared Remote , with occasional travel if required 6-month initial contract (start within 2 weeks) If you’re an experienced architect who enjoys shaping More ❯

start-up. Develop yourself and with us the software solutions of tomorrow! Learn more here: ADMIRAL Technologies - A clear victory for your future! Aufgaben Administrate, monitor and optimize our Big Data environments based on Apache Hadoop (AWS Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates … and upgrades Advise our Data Engineers and Data Scientists on the selection of Hadoop services for business use cases 3rd level support through troubleshooting and error analysis Support workload optimization (eg. query optimization) Evaluation and implementation of Cloud Native Services Profil Technical education (computer science studies, etc.) Experience in system administration of Linux systems (RedHat) Expertise in building … and operating Big Data environments based on Apache Hadoop clusters Interest in continuously learning and improving one's skillset Wir bieten State-of-the-Art Technologies We understand the usage of State-of-the-Art-Technologies as part of our mission. Modern Company That means for you: flat hierarchies, interdisciplinary teams and wide-ranging opportunities for self-realisation. More ❯

We are seeking a skilled Subject Matter Expert (SME) & Data Engineer with a strong focus on data modelling, mapping, and transformation to join our Big Data Services team within the Hybrid Cloud & Data service line. This role will involve collaborating with cross-functional teams to define, implement, and validate data integration and transformation requirements … across a range of structured and semi-structured data sources. Key Responsibilities Analyse source and target data formats and structures (e.g., databases, XML, JSON, CSV, EDI) to define and document accurate and effective data mappings. Develop and maintain data mapping specifications, transformation logic, and integration rules based on business and technical requirements. Work closely with data architects, domain experts, and business analysts to ensure semantic alignment and consistency between systems. Validate mapping outputs and troubleshoot discrepancies or issues in data transformations. Create and maintain documentation to support data traceability, governance, and reusability. Ensure all data processing activities comply with relevant data quality, security, and privacy standards. Required Skills & Experience UK National More ❯

Do you enjoy working with data? Are you a problem solver? About our Team: LexisNexis is a data and analytics company with 10,500 colleagues serving customers in more than 150 countries. We're one of the largest information and analytics companies on the planet. We design solutions that help our customers increase productivity, improve decision-making and … outcomes, and be more successful. About the Role: As a Data Analyst III you will consult with internal stakeholders to understand problems, collect and analyze data to support data driven business decisions. This role uses data tools to collate, model, interpret, develop visualizations/information products, and communicate to the business. Specifically, individuals in this role … for analysis and metrics to drive insights and recommendations Understanding who the customers are and what is happening in the market with necessary commercial awareness Creating visual displays of data through selected tools and analytical packages Effectively lead and manage small/operational analytics projects Requirements: Bachelors or Master Degree in Data Analytics/Math or equivalent work More ❯

The Role The Data Practice is the team made up of experts dedicated to Data centric offers (Data platform, Data Analytics, IoT, Big Data, Data compliance) who support our customers in their IT and Data transformations. We help customers choose the right tools and services, build highly scalable secure environments, and help More ❯

Qualifications Bachelor's or Master's degree in Computer Science, Mathematics or similar field (PhDs will be given preference) 7+ years of experience working with massive data Strong knowledge of public cloud (AWS) Experience with data acquisition (API calls/FTP downloads), ETL, transformation/normalization Proficiency in ETL process is mandatory Experienced building components for enterprise central … data platforms (data warehouses, Operational Data Stores, Access layers with APIs, file extracts, user queries) Hands-on experience with SQL, Python, Spark, Kafka Excellent communication skills, including a good working proficiency in verbal and written English About this Job Scopeworker Business Intelligence real time processes enterprise customer data. We develop and maintain robust and reliable data pipelines to support 24x7 business operations and enable systems, tools, dashboards and data analysts to surface business insights and opportunities. This actionable business intelligence is provided in real time to our Fortune 100 users from data engineers, to analysts and C-Level stakeholders. As a Data Architect, you'll innovate, design, build and automate, scalable solutions More ❯

achieve enduring results. Working with clients in consumer and manufacturing, defence and security, energy and utilities, financial services, government and public services, health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the … following technologies to ensure scalable, high-performance applications: AWS is a significant growth area for the business with a diverse and growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics … Essential requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data using More ❯

achieve enduring results. Working with clients in consumer and manufacturing, defence and security, energy and utilities, financial services, government and public services, health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the … following technologies to ensure scalable, high-performance applications: AWS is a significant growth area for the business with a diverse and growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics … Essential requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data using More ❯

achieve enduring results. Working with clients in consumer and manufacturing, defence and security, energy and utilities, financial services, government and public services, health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the … following technologies to ensure scalable, high-performance applications: AWS is a significant growth area for the business with a diverse and growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics … Essential requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data using More ❯

Data QA Engineer – Remote-first - £55-65,000 Overview: As a Data QA Engineer, you will ensure the reliability, accuracy and performance of our client’s data solutions. Operating remotely, you will work closely with Data Engineers, Architects and Analysts to design and execute automated testing strategies that validate data pipelines, integrations and transformations across … cloud platforms. Your work will underpin data quality and ensure that insights are built on trusted, consistent data. Key Responsibilities: Design and implement automated tests for data pipelines, ETL processes and APIs across AWS and Azure environments. Develop and maintain test frameworks that validate data quality, completeness and integrity. Collaborate with engineering teams to identify data defects, root causes and performance issues. Support continuous integration and deployment by embedding automated testing into CI/CD pipelines. Validate source-to-target data mapping, transformations and business logic. Produce clear test documentation and communicate test results to technical and non-technical stakeholders. Monitor data test coverage and define quality metrics for ongoing improvement. Contribute to More ❯

Exp: 10 + yrs Job Summary The Senior Test Specialist/Architect in Cloud Automation Testing focuses on automating testing processes in ETL (Extract, Transform, Load) and Data Warehousing environments to ensure the quality and reliability of data pipelines. The role involves designing, developing, and implementing automation scripts for testing data transformations, data loading processes, and … data quality verification. Key Responsibilities 1. Develop and execute automated test scripts for etl processes and data pipelines. 2. Collaborate with cross functional teams to design and implement automated testing frameworks. 3. Create test plans and test cases for etl and data warehouse testing. 4. Identify and troubleshoot issues in data transformations and data loading … processes. 5. Conduct performance testing and ensure scalability of data pipelines. 6. Implement best practices for data quality assurance in etl environments. Skill Requirements 1. Proficiency in cloud-based automation testing tools like selenium, appium, or similar. 2. Experience in automation testing of etl (extract, transform, load) processes and data warehousing. 3. Strong understanding of sql for More ❯

Exp: 10 + yrs Job Summary The Senior Test Specialist/Architect in Cloud Automation Testing focuses on automating testing processes in ETL (Extract, Transform, Load) and Data Warehousing environments to ensure the quality and reliability of data pipelines. The role involves designing, developing, and implementing automation scripts for testing data transformations, data loading processes, and … data quality verification. Key Responsibilities 1. Develop and execute automated test scripts for etl processes and data pipelines. 2. Collaborate with cross functional teams to design and implement automated testing frameworks. 3. Create test plans and test cases for etl and data warehouse testing. 4. Identify and troubleshoot issues in data transformations and data loading … processes. 5. Conduct performance testing and ensure scalability of data pipelines. 6. Implement best practices for data quality assurance in etl environments. Skill Requirements 1. Proficiency in cloud-based automation testing tools like selenium, appium, or similar. 2. Experience in automation testing of etl (extract, transform, load) processes and data warehousing. 3. Strong understanding of sql for More ❯

Exp: 10 + yrs Job Summary The Senior Test Specialist/Architect in Cloud Automation Testing focuses on automating testing processes in ETL (Extract, Transform, Load) and Data Warehousing environments to ensure the quality and reliability of data pipelines. The role involves designing, developing, and implementing automation scripts for testing data transformations, data loading processes, and … data quality verification. Key Responsibilities 1. Develop and execute automated test scripts for etl processes and data pipelines. 2. Collaborate with cross functional teams to design and implement automated testing frameworks. 3. Create test plans and test cases for etl and data warehouse testing. 4. Identify and troubleshoot issues in data transformations and data loading … processes. 5. Conduct performance testing and ensure scalability of data pipelines. 6. Implement best practices for data quality assurance in etl environments. Skill Requirements 1. Proficiency in cloud-based automation testing tools like selenium, appium, or similar. 2. Experience in automation testing of etl (extract, transform, load) processes and data warehousing. 3. Strong understanding of sql for More ❯

Exp: 10 + yrs Job Summary The Senior Test Specialist/Architect in Cloud Automation Testing focuses on automating testing processes in ETL (Extract, Transform, Load) and Data Warehousing environments to ensure the quality and reliability of data pipelines. The role involves designing, developing, and implementing automation scripts for testing data transformations, data loading processes, and … data quality verification. Key Responsibilities 1. Develop and execute automated test scripts for etl processes and data pipelines. 2. Collaborate with cross functional teams to design and implement automated testing frameworks. 3. Create test plans and test cases for etl and data warehouse testing. 4. Identify and troubleshoot issues in data transformations and data loading … processes. 5. Conduct performance testing and ensure scalability of data pipelines. 6. Implement best practices for data quality assurance in etl environments. Skill Requirements 1. Proficiency in cloud-based automation testing tools like selenium, appium, or similar. 2. Experience in automation testing of etl (extract, transform, load) processes and data warehousing. 3. Strong understanding of sql for More ❯

Exp: 10 + yrs Job Summary The Senior Test Specialist/Architect in Cloud Automation Testing focuses on automating testing processes in ETL (Extract, Transform, Load) and Data Warehousing environments to ensure the quality and reliability of data pipelines. The role involves designing, developing, and implementing automation scripts for testing data transformations, data loading processes, and … data quality verification. Key Responsibilities 1. Develop and execute automated test scripts for etl processes and data pipelines. 2. Collaborate with cross functional teams to design and implement automated testing frameworks. 3. Create test plans and test cases for etl and data warehouse testing. 4. Identify and troubleshoot issues in data transformations and data loading … processes. 5. Conduct performance testing and ensure scalability of data pipelines. 6. Implement best practices for data quality assurance in etl environments. Skill Requirements 1. Proficiency in cloud-based automation testing tools like selenium, appium, or similar. 2. Experience in automation testing of etl (extract, transform, load) processes and data warehousing. 3. Strong understanding of sql for More ❯

/Alpharetta, GA (Locals or near by only who can do in person with client) Duration: 12 Months Required Skills:Programming Languages: Strong proficiency in Python, Java, and SQL. Big Data Frameworks: Deep understanding of Hadoop ecosystem (HDFS, MapReduce, Hive, Spark Cloud Data Warehousing: Expertise in Snowflake architecture, data manipulation, and query optimization. Data Engineering … Concepts: Knowledge of data ingestion, transformation, data quality checks, and data security practices. Data Modeling: Ability to design efficient data models for data warehousing environments. More ❯

Senior Data Engineer - Cardiff/Hybrid - 65,000 - 75,000 + benefits Yolk Recruitment are proud to be supporting a leading global business investing heavily in its data and analytics capabilities. They're looking for a Senior Data Engineer to help shape the next generation of their data platform - leading technical design, mentoring others, and driving … best practice. This is a great opportunity for an experienced data professional who enjoys solving complex challenges, optimising large-scale systems, and influencing strategy within a collaborative, forward-thinking team. What you'll be doing: Lead the design and implementation of scalable, high-performance data architectures and pipelines. Define and enforce best practices for data engineering, including … coding standards, testing, and documentation. Mentor and guide engineers, fostering collaboration and technical excellence. Translate complex business requirements into reliable, well-structured data solutions. Optimise data workflows for performance, reliability, and cost efficiency. Drive adoption of modern data tools and technologies across the organisation. Ensure robust data governance, security, and compliance. Troubleshoot and resolve complex data More ❯

Senior Data Engineer - Cardiff/Hybrid - £65,000 - £75,000 + benefits Yolk Recruitment are proud to be supporting a leading global business investing heavily in its data and analytics capabilities. They're looking for a Senior Data Engineer to help shape the next generation of their data platform - leading technical design, mentoring others, and driving … best practice. This is a great opportunity for an experienced data professional who enjoys solving complex challenges, optimising large-scale systems, and influencing strategy within a collaborative, forward-thinking team. What you'll be doing: Lead the design and implementation of scalable, high-performance data architectures and pipelines. Define and enforce best practices for data engineering, including … coding standards, testing, and documentation. Mentor and guide engineers, fostering collaboration and technical excellence. Translate complex business requirements into reliable, well-structured data solutions. Optimise data workflows for performance, reliability, and cost efficiency. Drive adoption of modern data tools and technologies across the organisation. Ensure robust data governance, security, and compliance. Troubleshoot and resolve complex data More ❯

Salary: .000 € per year Requirements: What you will need to succeed: PhD or MS in Computer Science, Data Science, Statistics or a related quantitative field with scientific background and with 5+ years of relevant experience Strong expertise in data science, Bayesian modeling, probabilistic programming, and uncertainty quantification Hands-on experience with neural network analysis, deep learning frameworks (e.g. … TensorFlow, PyTorch), and model evaluation Proficiency in Python, R, SQL, and data engineering tools such as Spark or Apache Beam and experience in designing, executing, and analyzing A/B tests Ability to develop and optimize ETL pipelines for large-scale data processing Solid understanding of causal inference, time series forecasting, and statistical modeling Hands-on experience with … cloud computing platforms (e.g., AWS, GCP, Azure) and big data tools Knowledge in natural language processing (NLP), reinforcement learning, and graph analytics is preferable Responsibilities: Position Description As a Senior Data Scientist at Cinemo, you will drive data-driven decision-making through cross-functional collaboration on several topics. This role requires a deep understanding of statistics More ❯

Data Engineer Hybrid (West Midlands) Permanent Competitive Salary + Benefits Are you passionate about building scalable data solutions and working with cutting-edge technologies like Microsoft Fabric, Azure, and Power BI? TXP is looking for a talented Data Engineer to join our growing team and help shape the future of data-driven decision-making. We are … power of technology and people, and we help everyone here to succeed. At TXP, you can multiply your potential. What You’ll Be Doing Designing, developing, and maintaining robust data pipelines. Building and optimising infrastructure for scalable data solutions. Integrating data from diverse sources across the business. Ensuring data integrity, security, and compliance with best practices. … Collaborating with cross-functional teams including analysts, developers, and business stakeholders. Leveraging Microsoft Fabric (Lakehouse, Data Pipelines) to modernise our data architecture. Supporting CI/CD and DevOps practices for data workflows. What We’re Looking For Proven experience as a Data Engineer or in a similar role. Strong coding skills in SQL , Python , and PySpark More ❯

Data Engineer Hybrid (West Midlands) Permanent Competitive Salary + Benefits Are you passionate about building scalable data solutions and working with cutting-edge technologies like Microsoft Fabric, Azure, and Power BI? TXP is looking for a talented Data Engineer to join our growing team and help shape the future of data-driven decision-making. We are … power of technology and people, and we help everyone here to succeed. At TXP, you can multiply your potential. What You'll Be Doing Designing, developing, and maintaining robust data pipelines. Building and optimising infrastructure for scalable data solutions. Integrating data from diverse sources across the business. Ensuring data integrity, security, and compliance with best practices. … Collaborating with cross-functional teams including analysts, developers, and business stakeholders. Leveraging Microsoft Fabric (Lakehouse, Data Pipelines) to modernise our data architecture. Supporting CI/CD and DevOps practices for data workflows. What We're Looking For Proven experience as a Data Engineer or in a similar role. Strong coding skills in SQL , Python , and PySpark More ❯

succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Data Analytics & AI - Data Science & AI - Senior Consultant EY exists to build a better working world. We empower our people by offering the culture, tech, teams, scale, challenges, learning … tax and transactions. EY teams ask better questions to find new answers for the complex issues facing our world today. The Team and the opportunity As part of our Data Analytics and AI team, the Data Scientist & AI role is pivotal in enabling our clients to derive significant value from their information assets. Through collaboration and domain expertise … our team embeds innovative data analytics solutions into existing business areas, transforming data into strategic assets. We are looking for a Data Scientist who is passionate about leveraging data to solve complex problems and drive business outcomes. You will play a key role in driving growth by developing new and existing client relationships and delivering first More ❯

GCP Data Engineer | London | £50,000 - £70,000 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. With a diverse portfolio of clients and cutting-edge projects, our client is a trusted name in the data consulting space. Due to exciting growth plans … we are now looking for a Data Engineer , specialising in Google Cloud Platform (GCP) and BigQuery . We are looking for: Demonstrable data engineering/BI skills, with a focus on having delivered solutions in Google Cloud Platform (GCP) Strong experience designing and delivering data solutions using BigQuery Proficient in SQL and Python Experience working with Big Data technologies such as Apache Spark or PySpark Excellent communication skills, with the ability to engage effectively with senior stakeholders Nice to haves: GCP Data Engineering certifications BigQuery or other GCP tool certifications What’s in it for you: 📍 Location: London (Hybrid) 💻 Remote working: Occasional office visits each month 💰 Salary: £50,000–£70,000 DOE 🤝 Collaborative culture More ❯

GCP Data Engineer | London | £50,000 - £70,000 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. With a diverse portfolio of clients and cutting-edge projects, our client is a trusted name in the data consulting space. Due to exciting growth plans … we are now looking for a Data Engineer , specialising in Google Cloud Platform (GCP) and BigQuery . We are looking for: Demonstrable data engineering/BI skills, with a focus on having delivered solutions in Google Cloud Platform (GCP) Strong experience designing and delivering data solutions using BigQuery Proficient in SQL and Python Experience working with Big Data technologies such as Apache Spark or PySpark Excellent communication skills, with the ability to engage effectively with senior stakeholders Nice to haves: GCP Data Engineering certifications BigQuery or other GCP tool certifications What’s in it for you: 📍 Location: London (Hybrid) 💻 Remote working: Occasional office visits each month 💰 Salary: £50,000–£70,000 DOE 🤝 Collaborative culture More ❯

GCP Data Engineer | London | £50,000 - £70,000 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. With a diverse portfolio of clients and cutting-edge projects, our client is a trusted name in the data consulting space. Due to exciting growth plans … we are now looking for a Data Engineer , specialising in Google Cloud Platform (GCP) and BigQuery . We are looking for: Demonstrable data engineering/BI skills, with a focus on having delivered solutions in Google Cloud Platform (GCP) Strong experience designing and delivering data solutions using BigQuery Proficient in SQL and Python Experience working with Big Data technologies such as Apache Spark or PySpark Excellent communication skills, with the ability to engage effectively with senior stakeholders Nice to haves: GCP Data Engineering certifications BigQuery or other GCP tool certifications What’s in it for you: 📍 Location: London (Hybrid) 💻 Remote working: Occasional office visits each month 💰 Salary: £50,000–£70,000 DOE 🤝 Collaborative culture More ❯