251 to 275 of 674 Big Data Jobs in the UK

Senior Integrator Eng London - Hybrid (2 days/week, usually Tues & Fri) 12-month contract Day rate: £800 (umbrella) About the Role Join a critical data remediation programme within the Surveillance Team/Lab, part of the Markets Platform area of a major financial services business. You will lead design and delivery of stable, scalable, and performant data solutions within a complex GCP architecture, driving simplification and improving pipeline automation to enable timely, secure data delivery to surveillance systems. Key Responsibilities Engineer stable, scalable, performant, accessible, testable, and secure data products aligned with endorsed technologies and best practices Lead the design, build, and optimisation of GCP-based data pipelines for critical surveillance and remediation … development of technical and Agile skills Collaborate closely with architecture, security, and compliance teams to ensure solutions meet regulatory requirements Manage and enhance CI/CD automated pipelines supporting data engineering workflows Support potential transition planning to vendor surveillance products Core Skills & Experience Proven hands-on experience with Google Cloud Platform (GCP) and components such as Dataflow, Pub/ More ❯

and operational capacity for years to come. You’ll join at a particularly transformative time, as the business builds a next-generation forecasting platform — utilising the latest advancements in data science, cloud computing, machine learning, AI, Monte Carlo simulation, and big data analytics to create more accurate and insightful forecasts than ever before. Key Responsibilities: Lead delivery … of short, medium, and long-term passenger forecasts, leveraging deep sector knowledge, economic modelling, and cutting-edge data science techniques. Drive continuous improvement of forecasting methodologies, processes, and data inputs to ensure high levels of accuracy and commercial value. Partner with internal senior stakeholders, investors, commercial teams, airline partners, and external consultants to validate forecasts and support business … mentor a team of analysts, fostering the development of best-in-class capability within the forecasting function. Collaborate cross-functionally and externally to bring in leading-edge thinking, new data sources, and innovative modelling techniques. Candidate Profile: Educated to degree level in a quantitative discipline (e.g. Mathematics, Economics, Engineering) with additional training in forecasting, econometrics, or statistics an advantage. More ❯

What is Human Native? At Human Native, we're building an AI data marketplace that ensures creators and rights holders are fairly compensated for their work while providing AI developers with high-quality, responsibly licensed training data. We believe in building AI the right way - ensuring transparency, fairness, and accessibility. This is a hard problem, and we need brilliant … minds to help us solve it. The Opportunity As an ML Engineer, you'll help us index, benchmark, and evaluate training datasets at scale. Your expertise with data, AI and ML training methodologies and evaluation techniques will advance the state of the art for developing AI. You will work across: Designing and developing benchmarks that allow our customers to … understand their value of data for training ML (quantifying dataset quality and biases). Deploy these benchmarks by implementing end-to-end data evaluation pipelines to be run on different datasets and ML models. Tools to visualise, analyze, and understand the attributes of datasets based on the evaluations. Develop ML models to transform, clean and understand data. Collaborating More ❯

activities - reformulating operating models, optimizing processes and installing automation. As a Senior Process Mining Consultant, you play a key role in shaping our clients' strategic goals by transforming raw data into actionable insights. You collaborate closely with the project team to deliver impactful, data-driven solutions that maximize value for clients. Leveraging cutting-edge process mining tools like … skills to engage with stakeholders at all levels. Passionate about understanding and interpreting business processes. Known for your analytical mindset, organizational skills, and ability to learn quickly. Excited about Big Data, Data Mining, Business Intelligence, and Process Mining, with a desire to continuously expand your expertise. Preferred Qualifications: Experience with setting up data pipelines (configuring source … connections, using flat files, SQL for data transformation, and defining data models). Motivated and forward-thinking, ready to contribute to the evolution of Process Mining technology. Eager to tackle challenges and embrace a steep learning curve to grow and expand your knowledge. Reasons to join: Permanent contract collaboration. You will be working fully remote in a stable More ❯

Responsibilities and Impact: You will enable S&P ratings business to provide best in class end-to-end analytical, commercial and customer experience by building feature rich solutions including big data engineering, analytics, business intelligence and workflow capabilities. Complete SDLC: architecture, design, development and support of tech solutions Active participation in all scrum ceremonies, follow AGILE best practices … years of software engineering experience as individual contributor and as people leader Familiarity with well architected frameworks in modern era, and experience in migration monolithic applications on on-premises data centers to cloud Long standing hands-on experience in building web applications, APIs, etc. using java and/or .net technology stack Experience in wide range of technologies to … develop software products end-to-end involving UI, APIs, Databases, etc. Experience in building DevOps pipelines for applications and infrastructure Experience in data engineering, SQL/NOSQL databases, Big Data, and Analytics Lead SAFe by example Gathers and refines requirements by engaging with stakeholders, product manager, and QA manager DevOps/SRE improvements and ensures continuous progress More ❯

this role, and you will stay up-to-date with emerging technologies, tools, and industry trends. Responsibilities : The candidate will be responsible for designing and building solutions for Compliance Data Archival & Reporting application. Core Java, Spring and Hibernate will be the primary technologies used supplemented by strong technical knowledge of Oracle databases Knowledge of Spark, Big Data … test framework like junit and mockito. Experience in any cloud technologies like Openshift/PCF/AWS/GCP. Experience with building distributed systems, using solutions such as Spark, Big Data Technologies would be preferred but not mandatory. Knowledge of Big Data querying tools (Cloudera stack or similar) e.g. Hive or Impala would be preferred but More ❯

with new experiences and development opportunities right here in Belfast's iconic Titanic Quarter. Compliance Technology is building a sophisticated next generation surveillance solution on top of a distributed data platform. The Belfast team is the global centre for the creation of feature-based surveillance algorithms using cutting edge technologies and techniques.The volume and variety of data involved … in these surveillances and the complexity of the algorithms results in one of most challenging and appropriate use cases for big data technologies This role is an individual contributor role within a fast paced technology delivery organization supporting regulatory compliance. This position is part of a Trade surveillance development team and will work closely with project managers, architecture … requirements for the solutions being built. Understand engineering needs including those required to build, maintain, and operate the system through all phases of its life. Proficient in information modeling, data structures and algorithms. Understand maintenance characteristics, runtime properties and dependencies that exist in support of your system's software. These dependencies will include but not limited to: hardware, platform More ❯

a unified, trusted and sustainable value chain that enables the most efficient production and logistics outcomes, while lowering the impact on the environment. We deliver actionable digital solutions and data insights that connect global supply chains, improving the safety, quality and sustainability of food and consumer goods, all in a way that's traceable and clear to the end … right price, creating more sustainable production and consumption outcomes. As part of our Food, Beverage and Consumer Goods team, you'll help our customers connect business processes and leverage data-driven technology for better visibility, agility and responsiveness. The purpose of this role is to complete technical tasks as required in the delivery of client implementations of Trade Promotion … using SQL Server stack 2012 or above, Knowledge of SQL Server Suite, V12. • Experience working with Developer tools such as Azure DevOps, Visual Studio Team Server • Kimball methodologies for Data Warehousing • Strong experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, • An analytical mindset, excellent communication and interpersonal skills More ❯

capability. The focus is on backend Python systems that underpin the UK’s transition to sustainable, low-carbon energy. From secure APIs and cloud deployments to DevOps pipelines and data management, you’ll be responsible for ensuring high standards, modern engineering practices, and long-term scalability. What you’ll be doing: Driving technical direction across backend Python services (Django … deployment pipelines Must be a sole UK national – SC clearance required Desirable extras: Experience with high-assurance or safety-critical software Exposure to GDS digital service standards Familiarity with big data, ETL, or ML/AI pipelines Background in energy, defence, embedded or industrial software a bonus Why this role? You’ll have real influence on how key More ❯

infrastructure teams to create automated testing solutions that accelerate delivery, improve confidence, and reduce risk. This is a high-impact opportunity for someone who thrives in a fast-moving, data-driven environment and is ready to take ownership of our testing vision. Who You Are: A passionate and pragmatic quality engineer who understands the value of automation but knows … testing frameworks (e.g., k6, JMeter) Familiarity with cloud-based test environments and infrastructure (AWS preferred) Working knowledge of observability and test reporting tools (e.g., Datadog, Grafana) Experience improving test data strategies and test isolation techniques Contributions to internal tooling or open-source testing frameworks Background in building out quality initiatives at the org level EverQuote Can Offer You: The … opportunity to join a world leading team of experts striving to redefine an industry with data and technology at its heart. An inclusive environment designed to develop your interests and passions while learning and achieving your goals. Very competitive salary Performance based bonus plan Online learning platforms Flexible work environment 30 days annual leave plus 6 stats. Pension plan More ❯

Company Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group, Akkodis combines the expertise of AKKA and Modis, with over 50,000 engineers and digital specialists across 30 countries in North America, EMEA … and APAC. Our teams bring extensive cross-sector knowledge in critical technology areas such as mobility, software services, robotics, simulations, cybersecurity, AI, and data analytics, enabling clients to tackle complex challenges in today’s rapidly evolving markets. With a comprehensive solution portfolio across four service lines—Consulting, Solutions, Talents, and Academy—Akkodis supports clients from concept through to full … both public and private sector clients. By leveraging cutting-edge technology, strategic partnerships, and innovative SaaS-based solutions, the CoE will enhance digital capabilities, future-proof workforces, and enable data-driven decision-making. Joining our CoE presents a unique opportunity to be at the forefront of major national initiatives, working within a high-impact, collaborative environment. Our diverse roles More ❯

Company Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group, Akkodis combines the expertise of AKKA and Modis, with over 50,000 engineers and digital specialists across 30 countries in North America, EMEA … and APAC. Our teams bring extensive cross-sector knowledge in critical technology areas such as mobility, software services, robotics, simulations, cybersecurity, AI, and data analytics, enabling clients to tackle complex challenges in today’s rapidly evolving markets. With a comprehensive solution portfolio across four service lines—Consulting, Solutions, Talents, and Academy—Akkodis supports clients from concept through to full … both public and private sector clients. By leveraging cutting-edge technology, strategic partnerships, and innovative SaaS-based solutions, the CoE will enhance digital capabilities, future-proof workforces, and enable data-driven decision-making. Joining our CoE presents a unique opportunity to be at the forefront of major national initiatives, working within a high-impact, collaborative environment. Our diverse roles More ❯

products are always evolving and under experimentation. We accomplish this by having an amazing degree of automation, CI/CD systems, and use a modularized approach. As we are data driven and measure our results, we continually innovate and improve our work. We are looking for the next great talent who strives to learn and grow and has a … agile, analytics, A/B testing and/or feature flags, Continuous Delivery, Trunk-based Development Excellent HTML/CSS skills - you understand not only how to build the data, but how to make it look great too Excellent understanding of object-oriented JavaScript, TypeScript You love new technologies and approaches and want to use the best tools available. … Web, and API services Have worked on an app or internet company that is at scale with large numbers of users and transactions per second Have experience in a data driven company with experience analyzing and working with Big Data Lead teams and greenfield projects solving large system problems Worked on global projects serving world markets with More ❯

unique blend of strengths, to take our business to the next level. You'll be a Research Scientist based within our Oxford R & D Lab using your expertise in data science and collaborating with business partners, technical partners and academic partners, developing new AI solution for insurance industry and contributing to solve societal problems over the world. If you … further, faster join us and enjoy every opportunity. CHALLENGED NOW AND-EXPERT NEXT. Responsibilities Conduct feasibility assessments and validate the suitability of cutting-edge technologies, such as machine learning, big data analytics, generative AI, multi-agent systems, and quantum computing, within the insurance and risk consulting domain. Collaborate with cross-functional teams to identify social and business challenges … in the industry and develop innovative solutions that leverage the identified technologies. Analyse complex data sets and provide insights to support strategic decision-making processes for clients in the insurance sector. Design and implement proof-of-concept projects to demonstrate the potential value and practical implementation of the identified technologies. Stay up-to-date with the latest advancements and More ❯

a real difference. Our exchange handles over 500 billion requests every day (for comparison Google serves an estimated 9 billion searches a day), all running in our own global data centers. Every member of our technology team has an enormous amount of autonomy in building and managing our systems to support and enable our growing level of scale. Through … of our worldwide 24x7 on-premises and cloud environments. As the first line of defense this team has ownership of operations engineering. Collaborating closely with IT, SRE, Network, and Data engineering teams, and key stakeholders across business, product, and software engineering teams. We play a crucial role in maintaining systems health, responding to incidents, and optimizing the performance, efficiency … cloud infrastructure: Bare-metal, vSphere, KVM, Kubernetes. Experience with tools like Ansible, Terraform, Docker, Kafka, Nexus Experience with observability platforms: InfluxDB, Prometheus, ELK, Jaeger, Grafana, Nagios, Zabbix Familiarity with Big Data tools: Hadoop, HDFS, Spark, HBase Ability to write code in Go, Python, Bash, or Perl for automation. Work Experience 5-7+ years of proven experience in More ❯

a Plus: Start-up/scale-up experience in AI, computer vision, or enterprise software space PhD in Computer Science, Math, or related fields Experience with vision, AI, or big data applications Experience with Terraform and IaC Familiarity with BIM or construction scheduling tools (Autodesk, Primavera, etc.) Hybrid Role: with 2 days/week in our London Shoreditch More ❯

skills Proficiency in programming languages such as Python, Java, or Scala, and experience with ML frameworks like TensorFlow, PyTorch, or scikit-learn Experience with large-scale distributed systems and big data technologies (e.g., Spark, Hadoop, Kafka) Accommodation requests If you need assistance with any part of the application or recruiting process due to a disability, or other physical More ❯

Job Description Are you interested in applying your strong quantitative analysis and big data skills to world-changing problems? Are you interested in driving the development of methods, models and systems for capacity planning, transportation and fulfillment network? If so, then this is the job for you. Our team is responsible for creating core analytics tech capabilities, platforms … development and data engineering. We develop scalable analytics applications and research modeling to optimize operation processes. We standardize and optimize data sources and visualization efforts across geographies, builds up and maintains the online BI services and data mart. You will work with professional software development managers, data engineers, scientists, business intelligence engineers and product managers using … rigorous quantitative approaches to ensure high quality data tech products for our customers around the world, including India, Australia, Brazil, Mexico, Singapore and Middle East. Amazon is growing rapidly and because we are driven by faster delivery to customers, a more efficient supply chain network, and lower cost of operations, our main focus is in the development of strategic More ❯

Data Scientist ?" Manchester Our Client an international organisation is looking to recruit a Data Scientist with 7 to 10 years expertise as a Data Scientist. You will have Natural Language Processing (NLP) knowledge and experience and understand and analyse large data sets to discover new insights. Working in a multi-disciplinary team within a highly technical … and complex environment. Well versed in scalable data mining and machine learning techniques (using computers to improve as well as develop algorithms)Kernel Methods, Deep Learning, Statistical Relational Learning, Ensemble Methods Model using advanced statistical/mathematical models, predict and segment data to hypothesize/evolve uses cases to monetize data and generate other business value. Translate … business needs to technical requirements and implementation. Experience of Big Data technologies/Big Data Analytics. C++, Java, Python, Shell Script R, Matlab, SAS Enterprise Miner Elastic search and understanding of Hadoop ecosystem Experience working with large data sets, experience working with distributed computing tools like Map/Reduce, Hadoop, Hive, Pig etc. Advanced use More ❯

This is an exceptional job opportunity to work for a leading client in the heart of the City as a Jnr Data Scientist. You will be part of a global analytics team using a number of big data technologies to produce complex behavioural models, customer uptake product analysis and new product innovation. Provide data driven analysis … to solve problems to enhance existing and develop new analytics related products and services. My clients are especially interested in hearing from gifted scientists who not only have exceptional data analysis and problem solving abilities but also have what it takes to discern the hidden patterns and signals within the markets. Company: OPUS (Rec.) Qualifications: Useful skills to possess … Commercial data science experience Machine learning SQL Msc or PhD preferred in either of the following areas, statistics, physics, mathematics, Computer Science or Engineering Creating customer segmentation models knowledge of SAS Data Mining R/Python Proficient user MS Office This is a superb career opportunity in the Data Science space .This Company invest a tremendous amount More ❯

Data Engineer Warrington - Hybrid £50,000 - £60,000 - Depending on experience Focus 5 Recruitment are working with an exciting software business to help recruit a Data Engineer. The company have just been awarded 2 large contracts with international Mobile Network Operators. Appointed to help them source a Data Engineer, we’re looking for an experienced Data Engineer to design and optimize our client’s data pipelines and storage solutions. This is an amazing opportunity to work with a growing and ambitious software business who have contracts with some of the world’s leading mobile network companies. They are looking for candidates who can come in at a key point in their growth and develop … their career as they grow. Key responsibilities for the Data Engineer – Design and build high-performance, low-latency data pipelines capable of processing large volumes of data at high speed. Develop and enhance real-time and batch data processing architectures. Manage both structured and unstructured data, ensuring efficient ingestion, transformation, and storage. Deploy scalable data More ❯

Data Engineer Warrington - Hybrid £50,000 - £60,000 - Depending on experience Focus 5 Recruitment are working with an exciting software business to help recruit a Data Engineer. The company have just been awarded 2 large contracts with international Mobile Network Operators. Appointed to help them source a Data Engineer, we’re looking for an experienced Data Engineer to design and optimize our client’s data pipelines and storage solutions. This is an amazing opportunity to work with a growing and ambitious software business who have contracts with some of the world’s leading mobile network companies. They are looking for candidates who can come in at a key point in their growth and develop … their career as they grow. Key responsibilities for the Data Engineer – Design and build high-performance, low-latency data pipelines capable of processing large volumes of data at high speed. Develop and enhance real-time and batch data processing architectures. Manage both structured and unstructured data, ensuring efficient ingestion, transformation, and storage. Deploy scalable data More ❯

Data Engineer Warrington - Hybrid £50,000 - £60,000 - Depending on experience Focus 5 Recruitment are working with an exciting software business to help recruit a Data Engineer. The company have just been awarded 2 large contracts with international Mobile Network Operators. Appointed to help them source a Data Engineer, we’re looking for an experienced Data Engineer to design and optimize our client’s data pipelines and storage solutions. This is an amazing opportunity to work with a growing and ambitious software business who have contracts with some of the world’s leading mobile network companies. They are looking for candidates who can come in at a key point in their growth and develop … their career as they grow. Key responsibilities for the Data Engineer – Design and build high-performance, low-latency data pipelines capable of processing large volumes of data at high speed. Develop and enhance real-time and batch data processing architectures. Manage both structured and unstructured data, ensuring efficient ingestion, transformation, and storage. Deploy scalable data More ❯

Data Engineer Warrington - Hybrid £50,000 - £60,000 - Depending on experience Focus 5 Recruitment are working with an exciting software business to help recruit a Data Engineer. The company have just been awarded 2 large contracts with international Mobile Network Operators. Appointed to help them source a Data Engineer, were looking for an experienced Data Engineerto … design and optimize our clients data pipelines and storage solutions. This is an amazing opportunity to work with a growing and ambitious software business who have contracts with some of the worlds leading mobile network companies. They are looking for candidates who can come in at a key point in their growth and develop their career as they grow. … Key responsibilities for the Data Engineer Design and build high-performance, low-latency data pipelines capable of processing large volumes of data at high speed. Develop and enhance real-time and batch data processing architectures. Manage both structured and unstructured data, ensuring efficient ingestion, transformation, and storage. Deploy scalable data storage solutions across bare More ❯

Principal Data Engineer – Consulting | £90K–£105K | London/Leeds/Bristol Our client, a global leader in digital transformation consulting, is hiring a Principal Data Engineer to lead the design and delivery of advanced cloud-native data solutions. Based in London, Leeds, or Bristol , this is an opportunity to work on greenfield projects that solve complex data … Location: London, Leeds, or Bristol Hybrid (2 days per week in office) ️ Must be eligible for SC (Security Check) clearance The Role As a Principal Data Engineer , you’ll propose and implement solutions using a range of AWS infrastructure. Working within a multidisciplinary consulting team, you’ll collaborate directly with clients to shape strategy, drive delivery, and guide internal … engineering standards. Your responsibilities: Build and maintain large-scale data lakes and ETL pipelines using AWS S3, Redshift, Glue, Lambda, DynamoDB, and Matillion Translate client requirements into scalable and secure data architectures Drive infrastructure-as-code and CI/CD deployment practices Process structured and semi-structured data (JSON, XML, Parquet, CSV) Maintain metadata, build data More ❯