1 to 25 of 37 Big Data Jobs in the Thames Valley

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working … with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules More ❯

For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer requirements Previous experience with the preparation of high-quality engaging … the offer solution team, solution definition, effort and cost estimation, Past experience in dealing with partners, tools vendors, etc. Business Domain Knowledge More than 5 years of experience in Big Data implementation projects Experience in the definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure and GCP), Cloudera, No-sql databases (Cassandra … Mongo DB), ELK, Kafka, Snowflake, etc. Past experience in Data Engineering and data quality tools (Informatica, Talend, etc.) Previous involvement in working in a Multilanguage and multicultural environment Proactive, tech passionate and highly motivated Desirable requirements: Experience in Data analysis and visualization solutions: Microstrategy, Qlik, PowerBI, Tableau, Looker,... Background in Data Governance and Data More ❯

format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you … thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development: Design More ❯

Arthur Financial are supporting a leading global reinsurer to appoint a Chief Data Officer, for a newly created role. The Chief Data Officer will lead the design and implementation of the companies data strategy and roadmap. This will include hiring and developing a team, data governance and adoption of big data and AI tooling. … Responsibilities Ownership of the following areas; Data Model, Data Strategy, Data Governance & Quality, Analytics and Insights, Big Data and AI. Hiring and leading a team of data professional as well as managing outsource providers Requirements Experience of working in a Chief Data Officer, Head of Data or data leadership role within … the Specialty Insurance market Previous, working knowledge of the global reinsurance market Proven track record in designing data functions and bringing business users on a journey of adoption Track record in delivering data driven transformation More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, we re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector we are always in search of the best talent … benefits, you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and onpremises platforms. … You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, we’re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector – we are always in search of the best talent … benefits, you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and onpremises platforms. … You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, we’re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector – we are always in search of the best talent … benefits, you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on-premises … platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure More ❯

Contract Opportunity: Data Engineer - 6-Month Inside IR35 Location: Milton Keynes (Hybrid - 3 Days in Office per Week) Duration: 6 Months IR35 Status: Inside IR35 Rate: Flexible, Depending on Experience We're looking for an experienced Data Engineer to join a project-focused team working on the development and implementation of a robust data model for banking … The engagement is inside IR35 , and rates are flexible based on experience. Role Purpose: You'll collaborate with a small technical team and liaise with IT to ensure the data model is effectively productionised. The ideal candidate will have strong technical data analysis skills, experience with big data technologies, and the ability to communicate complex insights … clearly to stakeholders. Key Responsibilities: Collaborate with a small team to build and refine a banking-focused data model. Liaise with IT teams to transition data models into production environments. Conduct data mining and exploratory data analysis to support model development. Apply strong SQL, Hadoop, and cloud-based data processing skills to manage and analyse More ❯

Data Engineer (Hybrid – London, UK) Overview An opportunity for a skilled and motivated Data Engineer to join a growing data engineering team within a fast-paced and innovative environment. This position is ideal for someone who enjoys designing robust, scalable data infrastructure using modern open-source technologies. The role offers exposure to diverse datasets, complex data challenges, and opportunities to influence technical direction and best practices. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools. Build and optimise ETL/ELT processes for small to large-scale data processing requirements. Develop data models and schemas to support analytics, business intelligence, and product needs. Monitor, troubleshoot, and … optimise data pipeline performance and reliability . Collaborate with analysts, engineers, and product teams to gather and translate data requirements. Implement data validation and quality checks to ensure data integrity. Participate in architecture discussions and contribute to technical roadmap planning . Skills and Attributes Strong analytical mindset with exceptional attention to detail. Excellent problem-solving and More ❯

Do you enjoy working with data? Are you a problem solver? About our Team: LexisNexis is a data and analytics company with 10,500 colleagues serving customers in more than 150 countries. We’re one of the largest information and analytics companies on the planet. We design solutions that help our customers increase productivity, improve decision-making and … outcomes, and be more successful. About the Role: As a Data Analyst III you will consult with internal stakeholders to understand problems, collect and analyze data to support data driven business decisions. This role uses data tools to collate, model, interpret, develop visualizations/information products, and communicate to the business. Specifically, individuals in this role … for analysis and metrics to drive insights and recommendations Understanding who the customers are and what is happening in the market with necessary commercial awareness Creating visual displays of data through selected tools and analytical packages Effectively lead and manage small/operational analytics projects Requirements: Bachelors or Master Degree in Data Analytics/Math or equivalent work More ❯

Job Description – Data Architect Role Overview We are seeking an experienced Data Architect to collaborate with stakeholders and design innovative, scalable, and high-performance data solutions. The role involves shaping enterprise-wide data architectures, developing strategies and governance frameworks, and ensuring solutions align with business objectives and technology strategies. You will play a key role in … communicating data findings, building integrations, and delivering real-world value through modern data capabilities. Key Responsibilities Partner with stakeholders to understand requirements, conduct discoveries, and design data-driven solutions that are scalable, performant, and resilient. Clearly and concisely communicate data architecture, strategies, and findings to both technical and non-technical audiences. Apply data architecture principles … to solve complex challenges, including the design and implementation of enterprise-wide data architectures aligned with business and IT strategies. Define and implement data strategies, governance frameworks, and operating models (spanning technology, people, and processes). Design and maintain data models (conceptual, logical, and physical) across databases, data lakes, and warehouses. Enable data integration with More ❯

Principal Data Architect Salary : Up to £100,000 (Based on candidate experience) Employee Package: Outstanding employee benefits Hybrid Model : Once a week (London) Job Type: Permanent Job Summary Our client, a leading IT services and consulting firm, is seeking an experienced Principal Data Architect to spearhead the development of enterprise-wide data architecture initiatives. This pivotal role … will drive the strategic implementation of scalable data solutions that support organizational transformation, foster innovation, and enable advanced analytics capabilities across multiple business units. Understanding of public sector compliance, regulations, and cross-departmental data sharing challenges Key Responsibilities: Drive data governance and stewardship transformation across the organization Build scalable data ecosystems using APIs and open standards … Work with teams and leadership to align data strategy with business goals Set up data governance, quality controls, and compliance frameworks Make data AI-ready and optimize for analytics and machine learning Embed security, privacy, and ethics into all data architecture decisions Lead the overall data architecture vision across different business areas Qualifications and Requirements More ❯

Exp: 10 + yrs Job Summary The Senior Test Specialist/Architect in Cloud Automation Testing focuses on automating testing processes in ETL (Extract, Transform, Load) and Data Warehousing environments to ensure the quality and reliability of data pipelines. The role involves designing, developing, and implementing automation scripts for testing data transformations, data loading processes, and … data quality verification. Key Responsibilities 1. Develop and execute automated test scripts for etl processes and data pipelines. 2. Collaborate with cross functional teams to design and implement automated testing frameworks. 3. Create test plans and test cases for etl and data warehouse testing. 4. Identify and troubleshoot issues in data transformations and data loading … processes. 5. Conduct performance testing and ensure scalability of data pipelines. 6. Implement best practices for data quality assurance in etl environments. Skill Requirements 1. Proficiency in cloud-based automation testing tools like selenium, appium, or similar. 2. Experience in automation testing of etl (extract, transform, load) processes and data warehousing. 3. Strong understanding of sql for More ❯

Databricks Data Engineer | London | £50,000 - £70,000 🧱 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. As a trusted Microsoft Partner, my client are leaders in the industry, with a diverse portfolio of clients and projects. Due to exciting growth plans we are … now looking for a Data Engineer, specialising in Databricks. We are looking for: Demonstratable data engineering/BI skills, with a focus on having delivered in Microsoft Azure Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication … skills, effectively participating with Senior Stakeholders Nice to haves: Azure Data Engineering certifications Databricks certifications What's in it for you: 📍Location: London (Hybrid) 💻Remote working: Occasional office visits each month 💰Salary: £50,000-£70,000 DOE 🤝Collaborative culture and great team support 📈Vast L&D opportunities both internally and externally More ❯

Databricks Data Architect – London, UK Permanent | Analytics We’re looking for an experienced Databricks Data Architect to join a growing analytics practice. This is a strategic role where you’ll combine deep technical expertise with client-facing leadership, shaping and delivering modern data solutions for leading organisations. What you’ll be doing: Leading technical teams to design … and deliver large-scale, end-to-end data solutions Architecting modern data platforms (data lakes, lakehouses, warehouses) with Databricks and related tools (Snowflake, Synapse, Azure Fabric) Applying data governance and master data management practices to ensure quality and compliance Advising clients on strategy, future-state architectures, and cloud migrations Driving collaboration, innovation, and best practices … across projects and teams What we’re looking for: 10+ years in BI/Data Warehousing, including 4+ years in solution/technical architecture Strong hands-on expertise in Databricks and cloud platforms (Azure, AWS, GCP) Experience with ETL/ELT tooling (Databricks, ADF, Informatica, SSIS, IBM DataStage) Proficiency in enterprise data modelling (ERwin, ER/Studio, Power More ❯

Energy Domain is a must. Under 7 years of experience only. Permanent. Key Responsibilities Design, develop, and maintain data ingestion pipelines using open-source frameworks and tools Build and optimise ETL/ELT processes to handle small to large-scale data processing requirements Develop data models and schemas that support analytics, business intelligence and product needs Monitor … troubleshoot, and optimise data pipeline performance and reliability Collaborate with stakeholders, analysts and product team to understand data requirements Implement data quality checks and validation processes to ensure data integrity Participate in architecture decisions and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills with … experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow) Knowledge of distributed computing concepts and big data technologies Experience with version control systems More ❯

s enduring challenges. Position We are seeking to recruit a Senior Full Stack Software Engineer to help design, build, and maintain user-facing components of our scalable, high-performance data platform supporting our bioinformaticians and science teams. This role blends hands-on engineering (70-80%) with people leadership and a focus on engineering excellence, raising the bar on standards … security, reliability, observability, and quality. Responsibilities Design, develop, and support web applications deployed to support the data platform. Own full stack development for tools supporting data management across the full lifecycle, including ingest monitoring, curation, release management, data quality monitoring, and user access control. Build and support components to manage ingest from and monitor distributed next-generation … devices, including device telemetry (Kafka, MQTT streaming from Oxford Nanopore NGS devices). Design, develop, and maintain platform tools to help bioinformaticians and science teams discover, understand, and access data (e.g., pathogen data catalogue, quality dashboards, management information reporting). Support innovation efforts by exploring new technologies such as vector databases to enable search and AI use cases. More ❯

En:ACT (short for Enable Accurate Compliance in Transaction reporting), is a market-leading solution for regulatory transaction reporting and reconciliation across global regimes. En:ACT automates reporting, reconciles data across systems, and maps errors directly to regulatory rules, helping firms remediate quickly, reduce risk, and meet regulatory obligations with confidence. Already trusted by more than 30 firms worldwide … and designed for both business and technical users. Alongside our SaaS offering, our unique model delivers consulting services across Risk & Compliance (including Transaction Reporting and Operational Resilience), ESG, Strategy, Data, and Operations. Unlike larger consultancies, we embed ourselves within client teams to deliver both insight and execution, taking ownership of outcomes and driving measurable impact. Since our launch in … creating space for our people to grow with the business. Backed by North American private equity investment, and partnerships with the London Stock Exchange Group and Snowflake’s global data platform, we are shaping the future of regulatory compliance through innovation in both advisory and technology. Our growth plans do not stop here; we are on the lookout for More ❯

About Us: Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed. Company Highlights: Quantiphi, a Services … AI Platforms company, has seen 2.5x growth YoY since its inception in 2013 Headquartered in Boston, with 3300+ data science professionals across 11 global offices Winner of 3X NVIDIA AI Partner of the year award Winner of the 17X Google Cloud Partner of the Year award including "Machine Learning, Breakthrough and Social Impact partner Winner of 3X AWS AI … Recognized Leaders by Gartner, Forrester, IDC, ISG, Everest Group and other leading analyst and independent research firms. Recognized in the Fast Company 2021 World Changing Ideas- AI and Data category Winner of 2021 AWS Canada Rising Star of the Year Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation. Your next More ❯

We're the world's leading data, insights, and consulting company; we shape the brands of tomorrow by better understanding people everywhere. Kantar's Profiles division is home to the world's largest audience network. With access to 170m+ people in over 100 global markets, we offer unrivalled global reach with local relevancy. Validated by industry leading anti-fraud … technology, Kantar's Profiles Audience Network delivers the most meaningful data with consistency, accuracy, and accountability – all at speed and scale. Job Details Location: Reading or London, UK Please note: You must have the right to work in the UK. We are unable to offer visa sponsorship for this role. At Kantar, we help the world's leading brands … make better decisions through data. We're now looking for an experienced Lead Data Engineer to join our team and help us elevate the quality and integrity of our global consumer panels. These panels—more than 50 worldwide—are the foundation of our data-driven insights. Your mission? To build and evolve the data ecosystem, pipelines and More ❯

and documenting: Conducting and facilitating design thinking workshops User research & user testing when required Define and develop user flows, journey maps Define and develop service design blueprints Information and data flows that interact with users Work with UX, UI and technical development teams to develop the experience Experience with working with data platforms and data marketplaces is … for users. You will oversee the Service Design and research aspects of the program, working with stakeholders to understand, define and design the journey’s for users across the data products. As an experienced UX & Service Designer, you will plan, run and lead workshops, and discovery sessions. Participate in persona creation, user journeys, flows and blueprints and assist client … teams to establish a consistent approach to user experience across data products and marketplaces. You will work closely with product owners and the business to gain in-depth understanding of user needs, identifying common touchpoints, removing pain-points and reducing friction. Focuses on developing a coherent service that accommodates all personas across a user spectrum. Eliminating complexities and crafting More ❯

Role: Senior AI/ML Scientist – Personalization & GenAI (Dubai based) Join a high-performing Data Science team whose mission is to drive competitive value through scalable AI solutions. The team builds models that enhance user experiences, enable better decision-making, improve operational efficiency, and shape the regional AI ecosystem. As a senior technical leader, you’ll help define the … Lead end-to-end AI transformation focused on personalization in a consumer-facing application. Define and execute a long-term vision for customer acquisition and engagement strategies powered by data and AI. Conduct exploratory analysis to understand user behavior, discover optimization opportunities, and develop behavior models to inform product enhancements. Design and deploy data/ML instrumentation to … extract insights and optimize the product experience. Provide strategic product guidance through data-driven recommendations, experimentation insights, and root cause analyses. Build and scale machine learning algorithms and pipelines to production using big data technologies. Develop and deploy retrieval-augmented generation (RAG) systems and LLM-based applications. Design and evaluate A/B tests and communicate results More ❯

and present to various internal stakeholder audiences (e.g., business unit leaders, regional marketing leaders) Synthesize information across a wide variety of insight sources including primary market research, third-party data, customer analytics (big data), marketing/media performance Identify the most relevant sources of data/information needed to address the key issues on a project … in running & end-to-end management of research projects – from brief and questionnaire design to analysing & reporting. Proven experience with insight synthesis, marrying research learning with analysis of other data types (e.g., secondary, behavioural, transactional, etc.) Strong analytical and numerical skills alongside an ability to distil large, complex and sometimes disparate datasets into concise, relevant and actionable insights Experience … working on multi-country projects or across different markets Ability to “roll-up your sleeves” and work directly with raw data (when needed) Demonstrated successful track record in collaborating with high performing, highly technical and analytical teams Excellent communication skills, written, verbal and presentation Fluency in any additional language would be a plus *This role is open for a More ❯

and engineering problems Experience with MLOps tools and practices, including Airflow, MLflow, and containerization (e.g., Docker) A passion for gaining insight into real-world datasets and clearly communicating through data visualization techniques Interest in material discovery, computer vision, handling big data and optimisation techniques Highly effective communicator who encourages innovation through collaboration Natural problem-solver with a More ❯

and engineering problems Experience with MLOps tools and practices, including Airflow, MLflow, and containerization (e.g., Docker) A passion for gaining insight into real-world datasets and clearly communicating through data visualization techniques Interest in material discovery, computer vision, handling big data and optimisation techniques Highly effective communicator who encourages innovation through collaboration Natural problem-solver with a More ❯