26 to 50 of 133 Big Data Jobs in the UK excluding London

Forensic Technology Management Level Associate Job Description & Summary Forensic Technology - Forensic Investigative Analytics Our Forensic Technology team helps clients manage vast amounts of electronic data and navigate the legal and business processes that are mandated by critical events Prevention is even better; knowing where vulnerabilities are and managing the … the following team: Forensic Investigative Analytics In an increasingly digitised world, instances of fraud and electronic crime are becoming more and more common. Forensic Data Analytics involves the analysis of data in order to discover meaningful patterns, measure historic events or predict the likelihood of future ones. Much … of our work requires us to analyse vast quantities of electronic data, using cutting edge technology and advanced statistical techniques to extract meaningful insights for our worldwide clients. As we operate in an environment where speed of response is often critical to our clients, we are constantly innovating and more »

Data Engineer - SQL, Spotfire, Dataiku Data Engineer - SQL, Spotfire, Dataiku The location of the role is remote (main site in Cheltenham, candidates must be based in UK). The duration of the contract is 12 months . The pay rate on offer is £50 per hour via Umbrella. … role Review and manage surge capacity to facilitate the seamless transition to Redshift and effectively manage heightened demand for digital tools. Conduct validation of data ingested from the source database, ensuring data accuracy and reliability. Utilise Dataiku and SQL coding for data preparation, and optimise efficiency in … the processing of data. Manage the transition of projects and data between cloud-based data warehouses. Ensure continuity and effective data management. Lead the migration of System services datasets from Greenplum to AWS Redshift, supporting the development of UK business metrics dashboards using Spotfire, and creating published more »

The Role - This growing manufacturing company are increasing their IT function capability in the area of Data Analytics, having a need to improve visibility of data to help with business decisions, interpret results, identify trends and opportunities to ensure the business is achieving the most value from the … BI/Reporting assets and data they have, whilst proposing improvements where possible. Responsibilities - Drive the business intelligence, reporting and data analytics strategy forward. Ensure there is appropriate reporting consumption methods for the different data paths. Drive the BI strategy using the Microsoft data lake and … Power BI data sets as the primary data source. Maintain the Power BI first approach. Build and lead a new data approach which can ensure data is accurate, usable and accessible for the business. Drive the business to make the best use of the BI and more »

languages such as Java, Python, and node.js to streamline deployment processes. Manage and optimize relational databases (e.g., PostgreSQL), NoSQL databases (e.g., MongoDB), and implement data streaming solutions (e.g., Kafka) for efficient data handling. Work with big data technologies such as Hadoop to manage and analyse large … Proficiency in programming languages such as Java, Python, and node.js. Familiarity with SQL and database management systems, including relational and NoSQL databases. Knowledge of data streaming technologies (e.g., Kafka) and big data platforms (e.g., Hadoop). Understanding of cybersecurity principles and best practices. Familiarity with architectural styles more »

languages such as Java, Python, and node.js to streamline deployment processes. Manage and optimize relational databases (e.g., PostgreSQL), NoSQL databases (e.g., MongoDB), and implement data streaming solutions (e.g., Kafka) for efficient data handling. Work with big data technologies such as Hadoop to manage and analyse large … Proficiency in programming languages such as Java, Python, and node.js. Familiarity with SQL and database management systems, including relational and NoSQL databases. Knowledge of data streaming technologies (e.g., Kafka) and big data platforms (e.g., Hadoop). Understanding of cybersecurity principles and best practices. Familiarity with architectural styles more »

Here at Creditsafe, we are looking for a Data Engineer, to join the Data engineering team. WHO ARE WE? Our success over the last 25 years and our ongoing growth can be attributed to our people and our strong culture. Culture and engagement really are part of our … that support a good work-life balance, including a hybrid approach to work, which enables you the flexibility needed to thrive. THE TEAM The Data Engineering department at Creditsafe Group comprises four delivery teams covering over 1000 data pipelines, scorecard processing, and also data services to facilitate … access to the data via API. Reporting to the Director of Data Engineering, we are a friendly and supportive team working across Creditsafe's data universe, building out and managing our centralised data warehouse, and delivering processed "business ready" data to the downstream products and more »

REF: JD53244 Job Title: Commercial Finance Data & MI Analyst Industry: PE Backed European Group Employment Type: Permanent Location: Essex/Hybrid Salary Guide: £60,000 - £65,000 + Bonus + Benefits Our client is a market leading Private Equity backed business with revenues in excess of £300m generated in … significant value by moving to a subscription-based model. Description This new role has been created to support the Commercial Finance Director by providing data, reporting, analysis and insights that will influence and guide the Commercial, Operational and Finance teams. The successful candidate will need to understand the complex … working with stakeholders to determine optimal solutions to support the growth of the Group. This position will be key to providing the business with data and analysis to drive improvements and recommendations. Core responsibilities are to provide robust and timely data and MI to support pricing decisions across more »

Data Engineer - Belfast - £55 - 60k + Bonus Want to help drive the Data function with one of the most reputable employers in Belfast? This company is known for it’s innovation, delivery, and culture. Their Belfast hub is at the centre of the tech community, promoting learning and … diversity at all levels. They have a new opportunity for a Data Engineer to join their Digital function. AWS is a huge growth area for this company, so it's a great opportunity to really develop your cloud skills. The person Experienced in designing and deploying production data pipelines within a big data architecture Strong technical skills in Python, SQL and AWS (though they’re very open to any cloud experience) Experience processing large volumes of structured and unstructured data Knowledge of data cleaning, wrangling, visualization and reporting Knowledge of data mining more »

Edinburgh, UK. The ideal candidate will be an expert in developing scalable web applications and services using NodeJS, React, and MongoDB. A passion for big data and experience in working with large-scale datasets will be highly regarded. This role is pivotal in driving our product development forward … other engineers to write high quality code that’s easy to understand and maintain. Review code pull requests and provide constructive feedback. Work with big data, developing strategies for data acquisition, storage, processing, and analysis. Integrate data and design APIs for various back-end services and … databases using REST. Implementing monitoring and alerting mechanisms via DataDog & logging tools. Building for security and user data privacy. We aspire for full PCI Compliance. Preferred Skills and qualifications A minimum of 3 years of professional experience in web development with an emphasis on core JavaScript Node & React skills more »

Merkle is a leading data-driven customer experience management (CXM) company that specialises in the delivery of unique, personalised customer experiences across platforms and devices. With a thirty year heritage as a leading data and analytics consultancy, In 2016, Merkle became part of Dentsu, one of the world … five 5 media companies agency networks with 60,000+ employees across 146 countries. Dentsu leads the region in digital media trading. We generate more data, drive more audience engagement and track everything. We specialise in applications of technology that drive unmatched ROI for our clients. As a result, we … take a laser focused view on the implementation and integration of technology across our digital business. Job Description We are looking for a Senior Data Engineer to join our growing Data Engineering team at Merkle. You will understand modern data platform architecture, have experience with software development more »

and troubleshooting of the SOC's technology stack (hardware and software). The engineer will also assist with the continued development and maintenance of data pipelines and signature updates and the professional development of the system engineering team. Tasks: Perform system administration on specific cyber defence applications and systems … defence network tools in response to new or observed threats within the network environment or enclave. Manage the compilation, cataloguing, distribution, and retrieval of data from a range of enterprise networks and data sources. Implement data management standards, requirements, and specifications. Develop data standards, policies, and … procedures. Analyse data sources to provide actionable recommendations and facilitate data-gathering methods. To share knowledge, skills and experience, create and improve documentation, and train new members of the data engineering team. Knowledge: Knowledge of big data technologies and ecosystems (eg, NiFi). Knowledge of more »

and troubleshooting of the SOC's technology stack (hardware and software). The engineer will also assist with the continued development and maintenance of data pipelines and signature updates and the professional development of the system engineering team. Tasks: * Perform system administration on specific cyber defence applications and systems … defence network tools in response to new or observed threats within the network environment or enclave. * Manage the compilation, cataloguing, distribution, and retrieval of data from a range of enterprise networks and data sources. * Implement data management standards, requirements, and specifications. * Develop data standards, policies, and … procedures. * Analyse data sources to provide actionable recommendations and facilitate data-gathering methods. * To share knowledge, skills and experience, create and improve documentation, and train new members of the data engineering team. Knowledge: * Knowledge of big data technologies and ecosystems (e.g., NiFi). * Knowledge of more »

Lead Data Engineer - £70k plus benefits - hybrid 2 days in Manchester An exciting opportunity has arisen to join this leading household name, based in Manchester city centre (hybrid). The role will be critical in delivering and ensuring data quality, consistency, and reliability working closely with other data … in the team as well as the analytics team, architecture team and stakeholders. You will be responsible for the development, operation and maintenance of data pipelines to extract, load and transform data sources from both internal and external/third-party providers whilst leading a small team of … on. The ideal candidate will have led a team or projects and used to working in an Azure environment with a focus on Azure Data Lake, Databricks, Azure Data Factory and Power BI architectures. Working with Python, SQL, Spark and Databricks, you will build, rebuild and maintain data more »

Lead Data Engineer - £70k plus benefits - hybrid 2 days in Manchester An exciting opportunity has arisen to join this leading household name, based in Manchester city centre (hybrid). The role will be critical in delivering and ensuring data quality, consistency, and reliability working closely with other data … in the team as well as the analytics team, architecture team and stakeholders. You will be responsible for the development, operation and maintenance of data pipelines to extract, load and transform data sources from both internal and external/third-party providers whilst leading a small team of … on. The ideal candidate will have led a team or projects and used to working in an Azure environment with a focus on Azure Data Lake, Databricks, Azure Data Factory and Power BI architectures. Working with Python, SQL, Spark and Databricks, you will build, rebuild and maintain data more »

Data Engineer - Glasgow Bright Purple are working in close partnership with a successful Glasgow based organisation who specialise in cutting-edge surveillance technology. They are undergoing an exciting data transformation strategy that will see new and emerging technologies leveraged to overhaul how they store, manage and harness their … data. We are looking to recruit a Data Engineer to work closely with their Senior Analyst and Head of Transformation and play a central role in this project. You will enjoy the benefits of their Glasgow office three days (3) a week, a place where they collaborate closely, working … wish, and moving forward after getting up and running in the business, you will benefit from flexible hours. For an ambitious, up and coming Data Engineer, this role offers an amazing platform to turbo-charge your career. Your day to day work will focus on: . ETL processes and more »

We are currently recruiting for one of our trusted clients who are look for a Data Engineer. Join our client, a leading player in the pet health services and insurance industry, as they aim to secure the coveted position of the UK's #1 Pet Insurer. Our client is … You Can Expect Type – Permanent Location – Borehamwood (Hybrid model – once a week in the office) Industry – Insurance Salary - £80,000 Main Responsibilities as a Data Engineer Establish and oversee the creation of new data storage systems, managing both unstructured and semi-structured data. Monitor and enforce the use … of our Azure platform to ensure that users adhere to agreed-upon processes and practices for code, data, and model governance. Deploy policies and quotas to optimize the usage and spending on the Azure platform and its instances. Maintain and provide support for our Azure platform for Machine Learning more »

Job Title: Senior Data Engineer (Machine Learning Start-up) Company: Our client are reshaping the e-commerce and retail industry with innovative data-driven solutions. Location: Flexible/Remote About Us: We're a passionate team dedicated to pushing the boundaries of machine learning to drive transformative change. … Role Overview: Seeking a Senior Data Engineer to design and implement scalable data infrastructure for their machine learning initiatives. Key Responsibilities: Design, develop, and maintain data pipelines. Collaborate with data scientists to support model development. Optimize data processing workflows and algorithms. Stay updated on emerging … data engineering and ML trends. Qualifications: Bachelor's degree in Computer Science or related field. Strong programming skills in Python, Java, or Scala. Experience with big data technologies like Spark and Hadoop. Familiarity with ML frameworks such as TensorFlow or PyTorch. Why Join Our Client: Be part more »

our clients fresh and new team. In this role, you will play a pivotal role in designing, developing, and implementing solutions to support our big data, AI, and analytics projects on cloud platforms. You will be responsible for automating infrastructure provisioning, managing containerized applications, establishing CI/CD … to contribute to the development of our ongoing strategies and lead the growth of a new team. Responsibilities: Design, develop, and implement solutions for big data, AI, and analytics projects on cloud platforms (Azure) Leverage infrastructure as code tools like Terraform to automate infrastructure provisioning and management. Expertise … Azure (Highly Desirable but not essential) Apply your knowledge of NLP models/modelling or AI to enhance processes and automation. Work collaboratively with data scientists, engineers, product managers and more to understand project requirements and translate them into actionable strategies. Lead and manage projects, ensuring timely delivery and more »

Java Cryptography Architecture. Operating-system-level server virtualization e.g. Docker. Enterprise attribute based access control e.g Axiomatics. Identity Management e.g. NetIQ. RESTful Web services. Big Data and Cloud. Skills in additional languages e.g. C, C++ Python, or Perl. Development of embedded C and C++ for embedded Linux using … Java Cryptography Architecture. Operating-system-level server virtualization e.g. Docker. Enterprise attribute based access control e.g. Axiomatics. Identity Management e.g. NetIQ. RESTful Web services. Big Data and Cloud. Experience with recent versions of MS Visual Studio. Skills in additional languages e.g. C, C#, Python, or Perl. Desirable skills more »

models ( Python or TensorFlow ) Familiarity with natural language processing or AI technologies ( e.g LLMs such as ChatGPT or BARD , Embeddings , Prompt Engineering ) Experience with data pipelines and preferably processing of document s ( e.g using Google Cloud Fusion/Azure Data Factory ) Strong background in either Python/Typescript … methodologies (Service Orientated Architecture, API-Centric Design, Twelve-Factor App, FAIR, etc.). Experience supporting digital platforms, including Integrations, Release Management, Regression Testing, Integrations, Data Obfuscation, etc. Knowledge of Azure Data Factory/GCP Cloud Data Fusion , Microsoft Azure Machine Learning or GCP Cloud ML Engine , Azure … Data Lake , Azure Databricks or GCP Cloud Dataproc . Familiarity with big data technologies and distributed computing frameworks, such as Hadoop, Spark, or Apache Flink. Experience scaling an “API-Ecosystem ”, designing, and implementing “API-First” integration patterns. Experience working with authentication and authorisation protocols/patterns. Other more »

Lead Data Engineer Want to help drive the Data function with one of the most reputable employers in Belfast? This company is known for it’s innovation, delivery, and culture. Their Belfast hub is at the centre of the tech community, promoting learning and diversity at all levels. … They have a new opportunity for a Lead Data Engineer – this function is still relatively young in this region, and they’re looking for a thought leader in the industry to come in to this blank page and help write a new story. The person Experienced in designing and … deploying production data pipelines within a big data architecture Strong technical skills in Python, SQL and AWS (though they’re very open to any cloud experience) Experience processing large volumes of structured and unstructured data Experience of leading teams, mentoring junior team members and promoting learning more »

Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? Big Data Architect - Remote UK First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and … few. What will you do? You will be responsible for the ownership of key projects across the SDLC developing and implementing an overall organizational data strategy that is in line with business processes. This strategy must include data model designs, database development standards, implementation and management of data warehouses and data analytics systems. What experience will you need? Apache Spark Azure Databricks ETL Snowflake Big Query What's in it for you? You will embark upon a career with life-long learning at its core, facilitating rapid professional and personal development and the opportunity to more »

exciting possibility of extension. As a PySpark/Python Lead Software Engineer/Developer, you will play a crucial role in developing and maintaining data processing applications using PySpark and Python within our leading financial institution. This is a unique opportunity to contribute to a long-term project, where … the future of the development process. If you are interested in the role, please email me on daniel.bennett@hamilton-barnes.com Responsibilities: Develop and maintain data processing applications using PySpark and Python. Collaborate with cross-functional teams to gather requirements and implement solutions. Optimize and tune PySpark jobs for performance … and scalability. Ensure data quality, reliability, and integrity throughout the data processing pipelines. Troubleshoot and resolve issues related to data processing and analysis. Skills: Hands-on experience with PySpark and Python is essential. Proven experience developing and maintaining data processing applications. Strong understanding of distributed computing more »

Ripjar is a UK based software company that uses data and machine learning technologies to help companies and governments prevent financial crimes and terrorism. This includes continuing to help many financial institutions and corporations comply with the recent addition of sanctions on Russian entities. Ripjar originally span out from … with (for ethical or environmental reasons). Labyrinth Intelligence empowers organisation to perform deep investigations into varied datasets to find interesting patterns and relationships. Data infuses everything Ripjar does. We work with a wide variety of datasets of all scales, including an always-growing archive of 8 billion news … articles in (nearly!) every language in the world going back over 30 years, sanctions and watchlist data provided by governments, plus 250 million organisations and ownership data from global corporate registries. This is a great time to join a growing group of highly talented technologists and data more »

Senior Data Optimisation Engineer Location: Coventry (3 Days a Week) Salary: up to £80,000 + Benefits Investigo are working with a leading global technology business based in the Midlands in search of a Senior Data Optimisation Engineer to come and join their new team. They offer systems … used by some of the largest house hold brands in the Automotive sector. We are looking to assist them in growing out a new data focused team to ultimate service the pipeline of clients in need of their support and expertise. This responsibilities will include: Manage and execute data … optimisation opportunities. Provide expertise in AWS monitoring and optimisation, optimising databases and ETL pipelines. Utilise programming languages such as Python and PySpark to transform big data into manageable datasets. Contribute to the development of interactive dashboards and provide expert analysis across program lifecycles. Transform technical data into more »