76 to 100 of 300 Big Data Jobs in the UK

Senior Data Engineer- Fast growing SaaS Scale up 🚀 West Midlands- hybrid working Up to £86K base with bonus and benefits The client SaaS Software business platform which is revolutionising financial management for their customers. Responsibility: Working to ensure a high-quality data platform. Design, develop, test, and deploy … data pipelines and integrations using IPaaS technology Collaborate on engineering platform ingestion, orchestration, data warehouse/data lake and API strategies for the data management ecosystem Willingness and an enthusiastic attitude to work within existing processes/methodologies. Collaborate with the DevOps team to provide high … availability data solutions that scale geographically. Big data processing - Expertise in processing enterprise-scale volumes of data, ideally with proficiency in Snowflake. Experience Data Stores - Technical excellence in SQL, NoSQL, Blob,Delta Lake, and other enterprise scale data stores. Data Orchestration - Enterprise scale more »

Solutions Architect - Data Product UK Remote (very ad-hoc travel) Market Day Rate - Outside IR35 Initial 6 months (high scope for extensions) Fruition Consulting are looking for an experienced Solutions Architect with extensive experience working across data platforms to join a well-recognised, highly regulated software focused business. … Solutions Architect, you will take responsibility for the platform design and architecture ahead of a migration from legacy to a brand new AWS cloud data platform. Requirements: Experience with AWS cloud data platforms Strong understanding of the role of architecture in enterprise data projects Proven commercial experience … migrating on prem solutions to the cloud, including re-architecting Prior experience working on data focused projects e.g. data warehousing, big data, data streaming Proficiency with Apache Kafka, Apache Spark, Apache Flink etc. We are an equal opportunities employer and welcome applications from all suitably more »

Exciting Opportunity: Python/Spark Big Data Software Engineer - Financial Services Sector Location: Glasgow Contract: 6 Months (Inside IR35) Rate: Up to £600 per Day Are you ready to take your software engineering career to the next level? We invite you to join a leading team in the … financial services industry where innovation meets top-tier excellence. We are on the lookout for a seasoned Python/Spark Big Data Software Engineer to play a key role in our agile team. What You Will Do: Devise and implement cutting-edge software solutions, venturing beyond traditional methods … to tackle complex challenges. Develop robust architecture and design artefacts that adhere to strict design requirements. Detect patterns and underlying issues in data to refine system architecture and coding practices. Enhance our team culture by promoting diversity, equity, inclusion, and respect. Participate in software engineering communities, staying up-to more »

Job DescriptionBig Data Architect - Hybrid - £120KMy client is a leading trading platform that is looking to add a talented Big Data Architect. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives.You'll be responsible … and implementation to improve operational management, scalability, and extensibility.The following skills/experience is essential:-Proven experience as an Architect and excellent knowledge of Big Data-Excellence experience across Azure-Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc-Excellent experience of ETL … data warehousing and handling a variety of data types-Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes and Business Intelligence (BI)-Experience implementing data visualisation and reporting tools-Excellent communication and business-facing skillsBig Data Architect - Hybrid - £120K more »

business. About the Role: As the Lead AI Consultant, you will report directly to the CTO and be responsible for driving AI adoption, developing "big data" solutions, and defining API strategies. You will collaborate with senior product, technical, and operational managers to enhance the product suite with cutting … edge AI technologies. Key Responsibilities: Develop and execute the technical integration strategy. Create comprehensive "big data" solutions across products. Define internal and external API strategies. Enhance existing products through AI technologies. Design, develop, and implement AI solutions. Integrate AI with client data, APIs, and production systems. Conduct … data analysis and build machine learning models. Utilize modern ML and AI libraries and frameworks. Deliver reliable solutions collaboratively. Desired Experience: Significant experience as an AI Consultant, Machine Learning Engineer, or similar role. Proven track record in start-up or dynamic environments. Hands-on experience with cloud-based AI more »

business. About the Role: As the Lead AI Consultant, you will report directly to the CTO and be responsible for driving AI adoption, developing 'big data' solutions, and defining API strategies. You will collaborate with senior product, technical, and operational managers to enhance the product suite with cutting … edge AI technologies. Key Responsibilities: Develop and execute the technical integration strategy. Create comprehensive 'big data' solutions across products. Define internal and external API strategies. Enhance existing products through AI technologies. Design, develop, and implement AI solutions. Integrate AI with client data, APIs, and production systems. Conduct … data analysis and build machine learning models. Utilize modern ML and AI libraries and frameworks. Deliver reliable solutions collaboratively. Desired Experience: Significant experience as an AI Consultant, Machine Learning Engineer, or similar role. Proven track record in start-up or dynamic environments. Hands-on experience with cloud-based AI more »

Exciting Opportunity: Python/Spark Big Data Software Engineer – Financial Services Sector 📍 Location: Glasgow 💼 Contract: 6 Months PAYE 💷 Rate: Up to £500 per Day Are you ready to take your software engineering career to the next level? We invite you to join a leading team in the financial … services industry where innovation meets top-tier excellence. We are on the lookout for a seasoned Python/Spark Big Data Software Engineer to play a key role in our agile team. What You Will Do: Devise and implement cutting-edge software solutions, venturing beyond traditional methods to … tackle complex challenges. Develop robust architecture and design artefacts that adhere to strict design requirements. Detect patterns and underlying issues in data to refine system architecture and coding practices. Enhance our team culture by promoting diversity, equity, inclusion, and respect. Participate in software engineering communities, staying up-to-date more »

DV Cleared Data Science Consultant Location : Bristol (with potential for client site work in Gloucester) Type : Permanent - Hybrid Salary : £50,000 - £60,000 + 10% bonus + 11% pension **Must have Active DV Clearance** Job Description: We are seeking a Data Scientist with Active DV Clearance to join … work on some of the largest and most ambitious projects within Defence and Security arena. In this role, you will leverage your expertise in data science, mathematical modelling, and machine learning to help digitise Defence and Security whilst upholding traditonal values. Responsibilities: • Conduct analysis for evidence-based decision-making … developing models and analysis to support data-centric decision-making processes. • Work closely with clients to understand their requirements and translate them into actionable solutions. • Lead and deliver solutions across the full modelling lifecycle, including problem formulation, exploratory data analysis, model design, build, testing, and handover. • Utilize common more »

We are a team of passionate engineers committed to building the best-in-class petabyte-scale data infrastructure optimization platform that combines hardware acceleration with performance metering to enable real-time actionable insights for reducing data center costs. So far, we have raised a total of $3.5M in … and maintain the solution up to date and compatible with a variety of supported runtimes. Your contributions to our core solution will directly impact data infrastructure processing 10s of petabytes every day where Xonai is being deployed. What you will do: Implement shims and backport changes required to maintain … and diligently write, test and deploy production code driven by modern software engineering practices. Work with the internals of leading open-source software for Big Data analytics as part of our core product for the cloud. What you will bring: 3+ years of experience working with large applications more »

We are a team of passionate engineers committed to building the best-in-class petabyte-scale data infrastructure optimization platform that combines hardware acceleration with performance metering to enable real-time actionable insights for reducing data center costs. So far, we have raised a total of $3.5M in … CPU Compiler Engineer, you will collaborate with the founding team to improve and expand the core engine that we are building that massively accelerates Big Data pipelines. Your contributions to our core solution will directly impact data infrastructure processing 10s of petabytes every day where Xonai is … being deployed. Join us in building a cutting edge solution for the cloud to realize cost-effective data infrastructure at scale and with unparalleled flexibility. What you will do: Optimize code generation for executing JIT-compiled code on CPUs (Arm and x86 architectures). Diversify compiler optimizations based on more »

Job DescriptionBig Data Architect - Hybrid - £110KMy client is a global telecommunications company that are looking to add a talented Big Data Architect. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives.You'll be responsible … and implementation to improve operational management, scalability, and extensibility.The following skills/experience is essential:-Proven experience as an Architect and excellent knowledge of Big Data-Great understanding of Cloud e.g. Azure and or AWS-Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark … etc-Excellent experience of ETL, data warehousing and handling a variety of data types-Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes and Business Intelligence (BI)-Experience implementing data visualisation and reporting tools-Excellent communication and business-facing skills more »

Job Description Data Scientist - Manchester Our Client an international organisation is looking to recruit a Data Scientist with 7 to 10 years expertise as a Data Scientist. You will have Natural Language Processing (NLP) knowledge and experience and understand and analyse large data sets to discover … new insights. Working in a multi-disciplinary team within a highly technical and complex environment. Well versed in scalable data mining and machine learning techniques (using computers to improve as well as develop algorithms)Kernel Methods, Deep Learning, Statistical Relational Learning, Ensemble Methods Model using advanced statistical/mathematical … models, predict and segment data to hypothesize/evolve uses cases to monetize data and generate other business value. Translate business needs to technical requirements and implementation. Experience of Big Data technologies/Big Data Analytics. C++, Java, Python, Shell Script R, Matlab, SAS more »

new client is looking for a ServiceNow consultant who will be accountable for enriching, managing, and ensuring the quality of organisational and product usage data, with a focus on efficient query writing. They will enforce data governance policies and best practices, as well as develop documentation on data assets. Role includes: Instrument data collection on the ServiceNow platform Writing complex queries Maintain an in-depth understanding of data flow within the business Partner across multiple data teams Identify data integrity issues and conduct root cause analyses Develop workflows, processes, SLAs, and documentation for … product usage data governance Must have experience: 2 - 3 years Writing complex queries 2 - 3 years Experience with Glide Skills: big data analytics, database management, or an equivalent analyst position 2 - 3 years + developing on the ServiceNow platform 2 - 3 years Glide experience Proficiency in PL more »

Data Analyst - up to £40k DOE - Hybrid 3 days on-site NO VISA SPONSORSHIP AVAILABLE About the Company My client is an independent digital agency creating captivating brand experiences. They blend data, creativity and technology to drive growth for clients. Their culture fosters work-life balance and continuous … learning. The Role Join the Data & Insights team as a Data Analyst. You'll collect, analyze and visualize datasets to derive actionable insights. Focus areas include data collection, analytics, visualization, data governance, and collaborating cross-functionally to enable data-driven decision-making. Key Responsibilities - Champion … data-driven decision-making agency-wide - Analyze large datasets to extract valuable insights - Develop predictive models for forecasting - Implement attribution tracking and modeling - Utilize big data tools like Google BigQuery - Create compelling data visualizations - Communicate insights to stakeholders - Develop data collection systems and processes - Ensure more »

Head of Data - Manchester - £120,000 The Company: Lorien Global are working in partnership with a company based in Manchester to hire a Head of Data into their leadership team. As the business travel into a transition phase, we need someone who has a confident technical knowledge and … leadership skills to guide the team through this time. The Role: The transition phase consists of various priorities to ensure the business can use data and develop its global solutions. Firstly to ensure the unification of couple teams ensuring they collaborate and work effectively, second we need to structure … the future data strategy and how it aligns with the global ambition. Leading the Data Team we're looking for a candidate who has the knowledge of traditional data platforms and a passion and drive to push modernisation, utilising Big Data, Machine Learning, Cloud Services more »

microservices architecture. Looking for a resource who has worked on sophisticated SAAS platforms or microservices products. Experience working with global teams would be a big plus. Should be able to own workstreams within the platform and be responsible for it end to end to deliver outstanding outcomes. Our clients … to meet their expectations. The Role We are looking for an enthusiastic hands-on technologist to join an exciting opportunity for building a sophisticated data/analytics/reporting platform. As the director of data engineering/analytics/reporting, you will build and evolve the next gen … data platform to process and report huge datasets across our client ecosystem. You will own end to end projects to plan, design, and execute critical features of this platform. Role Responsibilities Architect & implement a highly scalable analytics and reporting platform. and resilient EAI architecture using off the shelf middleware more »

minded subject matter experts, solving interesting problems, and building the products of tomorrow, this opportunity is for you. On our mission to revolutionize the Data Strategy & Management space, we are seeking a dynamic and seasoned Solution Architect with a stellar track record in Data Products. As our client … navigates the complexities of a legacy IT landscape, we need someone who can not only conceptualize, design and build robust data platforms but also provide strategic guidance and stakeholder management expertise. Leveraging your software engineering expertise, you'll play a pivotal role in ensuring the integrity, efficiency, and compliance … of the data architecture while spearheading the migration from legacy systems to modern solutions. What you'll bring to us: At least 5 years of experience in a similar role, with 10 years in software engineering and solution architecture. Extensive knowledge of database structure systems, data mining, data more »

The Role - This growing manufacturing company are increasing their IT function capability in the area of Data Analytics, having a need to improve visibility of data to help with business decisions, interpret results, identify trends and opportunities to ensure the business is achieving the most value from the … BI/Reporting assets and data they have, whilst proposing improvements where possible. Responsibilities - Drive the business intelligence, reporting and data analytics strategy forward. Ensure there is appropriate reporting consumption methods for the different data paths. Drive the BI strategy using the Microsoft data lake and … Power BI data sets as the primary data source. Maintain the Power BI first approach. Build and lead a new data approach which can ensure data is accurate, usable and accessible for the business. Drive the business to make the best use of the BI and more »

Azure Data Engineer - £60,000 + Benefits, London, weekly on-site You must have full right to work authorisation. No sponsorship available. Azure data platform technologies, including Data Lake Gen 2, Synapse, Analysis Services, and Power BI. Working in a leading UK and global business you will … be a key part of the team and take the lead in supporting the Strategic Data Manager to enrich, implement and maintain a highly effective Business Intelligence technical service, at the forefront of the technical development of cloud data platforms, offering near real-time process reporting solutions. Your … Profile : Extensive experience with Azure data platform technologies, ideally including Data Lake Gen 2, Synapse, Analysis Services, and Power BI. Proven skills with Azure Data Factory & Databricks/Apache/Sparx, along with extensive SQL knowledge (Microsoft SQL Server 2005+) and SSIS experience. Proficiency in Microsoft DevOps more »

Data Engineer with Azure & Power BI Permanent £65-70k + Great Bens Hybrid Flexible Working - London area Talented and experienced Data Engineer/Power BI Developer, strong in both interpersonal communication skills, as well as key technical experience including; strong SQL, Azure Synapse Analytics and Power BI … DAX & PowerQuery). This is a key technical role to join a small dynamic and friendly team, responsible for the data that enables our client to deliver premium entertainment to a Global network of over a billion airline passengers. You will play a crucial part in the continued development … and maintenance of the existing data warehouse solution, including data analysis, integration pipeline creation, SQL JSON querying and reporting using Power BI. The cloud based systems leverage data to support operational activities and inform business decisions. The combination of creativity and technology is at the heart of more »

working alongside our team on a wide variety of projects with a special focus on innovation. You could be working with all types of data (both structured and unstructured) using a variety of software - so we're open to seeing engineers with different technology backgrounds! THE MACHINE LEARNING ENGINEER … SHOULD HAVE…. SC or DV Security Clearance to work on secure projects Demonstratable technical background in Machine Learning/Data Science Experience with programming languages such as Python and R Demonstratable experience developing & delivering Machine Learning strategies Experience with big data ecosystems, cloud infrastructure and analytic … frameworks Techniques and toolkits for data cleansing, data processing and data preparation Any experience with techniques and toolkits for combining data or analysing data streams would be desirable TO BE CONSIDERED…. Please either apply by clicking online or emailing me directly to For further more »

Eames Consulting are looking for Data Engineering Manager to join our dynamic team at a prestigious asset management firm. As a Data Engineering Manager, you will play a crucial role in shaping and overseeing the data infrastructure that supports our business operations. Key Responsibilities: Lead and mentor … a team of talented data engineers, fostering a culture of collaboration and continuous improvement. Develop and execute the data engineering strategy aligned with the organization's business objectives. Collaborate with key stakeholders to understand business requirements and translate them into data solutions. Oversee the design, development, and … maintenance of robust data pipelines to ensure the timely and accurate delivery of data to various stakeholders. Manage and optimize data storage, ensuring scalability and security in compliance with industry standards. Communicate complex technical concepts to non-technical stakeholders, fostering a culture of data-driven decision more »

Job Description Collibra Ranger Data Project Manager - Docklands London We are keen to recruit a Collibra Ranger Certified data Project Manager with at least 1 to 2 years experience of Collibra Ranger. Overall you must have a background in data and data management especially in line … would be a major plus. This is a permanent position based In the Docklands London. This is an exciting and challenging new position working data, Big Data and Collibra. Salary will be in the range £60K - £70K. Please send your CV to us in Word format along more »

Leading ecommerce client are now searching for a Senior Data Engineer to contribute towards the delivery of their data strategy. This engineer will shape our client’s data function, delivering end to end solutions for an array of customer data projects. The role: Designing data pipelines, managing data warehouses, and implementing complex ETL processes. Work closely with data scientists, analysts, and stakeholders to optimise our client’s infrastructure. Optimise data driven products, personalisation, reporting and overall business success. Manage the whole data lifecycle (End to End). Ensure the reliability … and quality of data. Key Requirements: Strong experience designing data pipelines/warehouses using AWS and Snowflake. Exposure to big data technologies such as Kafka, Spark, or Hadoop. Solid experience with Snowflake, including performance optimisation and cost management. Strong experience with SQL and Data modelling. Excellent more »

and design a comprehensive plan for implementation.Responsibilities: Collaborate with stakeholders to understand business requirements and translate them into effective solution designs for our party data model data platform.Architect and implement cloud-based solutions that leverage popular data platforms to enable efficient storage, processing, and analysis of large … scale data.Design scalable and resilient architectures that ensure high availability, fault tolerance, and disaster recovery for our data platform.Assess and select appropriate data platforms and technologies based on functional and non-functional requirements, considering factors such as performance, scalability, security, and cost-effectiveness.Provide guidance and technical leadership to … ensure the accurate implementation of the solution design.Required Skills: Proven experience as a Solution Architect, designing and implementing cloud-based solutions.Strong knowledge of popular data platforms such as Amazon Web Services (AWS) (e.g., S3, RDS, Redshift, Athena), Microsoft Azure (e.g., Blob Storage, SQL Database, Data Lake Analytics), or more »