26 to 50 of 125 Big Data Jobs in the UK excluding London

Job Description for Data Engineer - Coding skills: Pyspark or Scala(level to troubleshoot issues) and SQL. Must have good pyspark knowledge to build data transformation. Hands on Azure data platforms i.e; Azure Datafactory, Databricks, Synapse, SQL, Data lake storage. Experience building and optimizing ‘big data’ data pipelines, architectures and data sets. Must have experience on production environment specific to data processing and activities like Monitoring, Troubleshoot, Deployments. Good understanding on Data Cleansing, Ingestion ,Transformation and Visualization(PowerBI) flow. Good Data analytics skill and able to communicate with customers/ more »

business. About the Role: As the Lead AI Consultant, you will report directly to the CTO and be responsible for driving AI adoption, developing 'big data' solutions, and defining API strategies. You will collaborate with senior product, technical, and operational managers to enhance the product suite with cutting … edge AI technologies. Key Responsibilities: Develop and execute the technical integration strategy. Create comprehensive 'big data' solutions across products. Define internal and external API strategies. Enhance existing products through AI technologies. Design, develop, and implement AI solutions. Integrate AI with client data, APIs, and production systems. Conduct … data analysis and build machine learning models. Utilize modern ML and AI libraries and frameworks. Deliver reliable solutions collaboratively. Desired Experience: Significant experience as an AI Consultant, Machine Learning Engineer, or similar role. Proven track record in start-up or dynamic environments. Hands-on experience with cloud-based AI more »

Exciting Opportunity: Python/Spark Big Data Software Engineer – Financial Services Sector 📍 Location: Glasgow 💼 Contract: 6 Months PAYE 💷 Rate: Up to £500 per Day Are you ready to take your software engineering career to the next level? We invite you to join a leading team in the financial … services industry where innovation meets top-tier excellence. We are on the lookout for a seasoned Python/Spark Big Data Software Engineer to play a key role in our agile team. What You Will Do: Devise and implement cutting-edge software solutions, venturing beyond traditional methods to … tackle complex challenges. Develop robust architecture and design artefacts that adhere to strict design requirements. Detect patterns and underlying issues in data to refine system architecture and coding practices. Enhance our team culture by promoting diversity, equity, inclusion, and respect. Participate in software engineering communities, staying up-to-date more »

Solutions Architect - AWS Data Platform UK Remote (very ad-hoc travel) Market Day Rate - Outside IR35 Initial 6 months (high scope for extensions) Fruition IT are looking for an experienced Solutions Architect with extensive experience working across data platforms to join a well-recognised, highly regulated software focused … Solutions Architect, you will take responsibility for the platform design and architecture ahead of a migration from legacy to a brand new AWS cloud data platform. Requirements: Experience with AWS cloud data platforms Strong understanding of the role of architecture in enterprise data projects Proven commercial experience … migrating on prem solutions to the cloud, including re-architecting Prior experience working on data focused projects e.g. data warehousing, big data, data streaming Proficiency with Apache Kafka, Apache Spark, Apache Flink etc. We are an equal opportunities employer and welcome applications from all suitably more »

Job Description Data Scientist - Manchester Our Client an international organisation is looking to recruit a Data Scientist with 7 to 10 years expertise as a Data Scientist. You will have Natural Language Processing (NLP) knowledge and experience and understand and analyse large data sets to discover … new insights. Working in a multi-disciplinary team within a highly technical and complex environment. Well versed in scalable data mining and machine learning techniques (using computers to improve as well as develop algorithms)Kernel Methods, Deep Learning, Statistical Relational Learning, Ensemble Methods Model using advanced statistical/mathematical … models, predict and segment data to hypothesize/evolve uses cases to monetize data and generate other business value. Translate business needs to technical requirements and implementation. Experience of Big Data technologies/Big Data Analytics. C++, Java, Python, Shell Script R, Matlab, SAS more »

About the Role: I am looking for a talented Data Engineer to join our clients dynamic team on a 6-month contract basis. This is an exciting opportunity for a mid-level professional with 3-5 years of experience to make a significant impact on our data infrastructure … remote/hybrid working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions. Optimize and troubleshoot data workflows to ensure efficiency and reliability. Implement data quality and validation checks to ensure data integrity. Contribute to the development and maintenance of our data lake and data warehouse solutions on AWS. more »

Head of Data - Manchester - £120,000 The Company: Lorien Global are working in partnership with a company based in Manchester to hire a Head of Data into their leadership team. As the business travel into a transition phase, we need someone who has a confident technical knowledge and … leadership skills to guide the team through this time. The Role: The transition phase consists of various priorities to ensure the business can use data and develop its global solutions. Firstly to ensure the unification of couple teams ensuring they collaborate and work effectively, second we need to structure … the future data strategy and how it aligns with the global ambition. Leading the Data Team we're looking for a candidate who has the knowledge of traditional data platforms and a passion and drive to push modernisation, utilising Big Data, Machine Learning, Cloud Services more »

Data Engineer (M/F/X) About: Our partners are renowned for designing and developing cutting-edge racing cars for Formula One, they are entering a new era of relentless innovation and sustainable performance to grow their data initiatives. Are you a skilled Data Engineer looking … to join a great analytics team? This team is vital in all data-related activities and in driving value through unique strategies. Key Responsibilities: Design, construct, and maintain scalable data pipelines (ETL processes). Understand and implement data solutions. Optimize data processing Migrating data to … cloud-based solutions About You: Bachelor’s degree in Computer Science or related field. 4+ Years as a practical Data Engineer Proficiency in Python, Java, or Scala programming. Familiarity with big data frameworks (Spark, Hadoop, etc..) Nice to have: Cloud migration experience with AWS, AZURE or GCP more »

join our client's UK-based team. The successful candidate will: -have previous experience of mentoring a team of developers - be adept at managing data pipelines, working with data exports in Business Central - possess a solid understanding of financial reporting. Key Responsibilities : Design, develop, and maintain advanced PowerBI … dashboards and reports to drive business decisions. Expertly craft DAX formulas for complex calculations and data analysis within PowerBI. Utilise SQL queries to manipulate and retrieve data efficiently from various databases. Implement and manage data pipelines to ensure seamless data flow and integration. Work with data exports from Business Central to optimise data usage in PowerBI. Leverage Synapse Analytics to handle large volumes of data and perform big data analytics. Provide insights into financial reports including General Ledger (GL), Profit & Loss (P&L), and Balance Sheets. Collaborate with finance teams to more »

Data Scientist – 6 Months - £22p/hour (Inside IR35) Parity Network are recruiting on behalf of a public sector organisation, who are looking to recruit Data Scientists for an initial 6 months. This role will be hybrid working , 2 days per week in one of their offices in … DOE) and operating via an Umbrella Co. Overview You will work at the heart of the transformation of statistics, using your skills as a data scientist to harness insight from a diverse range of data sources. Most of their roles focus on the development of reproducible analytical pipelines … languages (notably Python, PySpark and R) across a range of cloud based and local platforms. The roles also provide an opportunity for cutting edge data science analysis with the aim of producing timelier and more granular statistics. Job Responsibilities Write code and functions in a way that is reusable more »

Senior Data Scientist Salary £55,000 to £65,000 Permanent FT 35 hours per week **Hybrid with occasional visits into the London Office Closing date 9 th June 2024 Here at Saga, we are embarking on a data transformation journey across all our established business units, Cruise, Insurance … Travel, Financial Services and Saga Magazine. We are now ready to build a high performing Data Science team around our newly appointed Head of Data Science. Working as one of our Senior Data Scientist at Saga, you will play a pivotal role in shaping our data strategy and driving the development of advanced analytics solutions. Your primary responsibility will be to harness the power of data to extract meaningful insights, inform strategic decisions, and contribute to the overall success of the organisation using machine learning and statistical techniques. You will have access to the more »

Job summary Artificial Intelligence, Machine Learning and other technologies are enhancing big data analytics like never before, generating real insights and opportunities for improvement. In the NHS and in an NHS Integrated Care Board (ICB) organisation, the data asset available to facilitate this is substantial. While we … we need people to help us unlock it. In response to this changing and evolving environment, an excellent opportunity has arisen to join our Data Services Team at NHS Gloucestershire. We are looking for candidates who can support the delivery of key projects and programmes and drive forward our … exceptional, insightful Business Intelligence service to the organisation and the wider health and care system in Gloucestershire. For further enquiries please email Lee Tarbuck (Data Services Manager) l.tarbuck@nhs.net Main duties of the job Our expectation of you: You will have an enquiring mind and will be able to more »

REF: JD53244 Job Title: Commercial Finance Data & MI Analyst Industry: PE Backed European Group Employment Type: Permanent Location: Essex/Hybrid Salary Guide: £60,000 - £65,000 + Bonus + Benefits Our client is a market leading Private Equity backed business with revenues in excess of £300m generated in … significant value by moving to a subscription-based model. Description This new role has been created to support the Commercial Finance Director by providing data, reporting, analysis and insights that will influence and guide the Commercial, Operational and Finance teams. The successful candidate will need to understand the complex … working with stakeholders to determine optimal solutions to support the growth of the Group. This position will be key to providing the business with data and analysis to drive improvements and recommendations. Core responsibilities are to provide robust and timely data and MI to support pricing decisions across more »

Data Engineer Birmingham - AWS Hybrid working 1 day every 3 weeks out of their Birmingham City Centre offices. Salary 55-65k plus 10% bonus, 28 days holidays Childcare vouchers, Life Assurance, pension. We are a looking for an experienced Data Engineer to play a pivotal role in … constructing and maintaining data pipelines within a dynamic, Agile environment. This opportunity is based in Birmingham, West Midlands, with a hybrid work model. As a key member of their Data team, you'll be instrumental in translating technical requirements into actionable pipelines, developing solutions to drive data-centric decision-making, and upholding data quality and organisation standards. Strong skills in Python, SQL, AWS, Glue, ETL and DataOps principles is essential. Core skills for this Data Engineer role: Strong coding skills in Python & SQL Excellent experience in the AWS Cloud platform, including AWS Glue, Amazon more »

Data Scientist Salary: Up to £35,000 An exciting opportunity has arisen in our high-profile data science team for a creative and innovative individual who can apply the best computer science, engineering, statistics and machine learning techniques to our market leading big-data assets to … through cutting-edge analytics. The insurance industry is evolving in an age of rapid technological development, and as an organisation Aviva are investing in data science, machine learning and advanced analytics as a distinctive capability. The UK team is recognised as a centre of excellence in our Global Data Science Practice – providing new data-driven insights that improve decision making across the Aviva Group. A bit about the job: This role will be within Commercial Analytics, and as such will have a broad range of focus points. As well as contributing to our Award-winning projects across more »

digital and platforms. Role purpose/summary Collaborate with stakeholders to understand business requirements and translate them into effective solution designs for our party data model data platform. Architect and implement cloud-based solutions that leverage popular data platforms to enable efficient storage, processing, and analysis of … large-scale data. Design scalable and resilient architectures that ensure high availability, fault tolerance, and disaster recovery for our data platform. Assess and select appropriate data platforms and technologies based on functional and non-functional requirements, considering factors such as performance, scalability, security, and cost-effectiveness. Provide guidance … of the solution design. Key Skills/requirements Proven experience as a Solution Architect, designing and implementing cloud-based solutions. Strong knowledge of popular data platforms such as Amazon Web Services (AWS) (e.g., S3, RDS, Redshift, Athena), Microsoft Azure (e.g., Blob Storage, SQL Database, Data Lake Analytics), or more »

Data Analyst Salary £25,000 - £35,000 Northamptonshire based. Monday to Friday Are you passionate about data analysis? We're looking for someone to contribute to innovative techniques and tools for analysing 1D, 2D, and 3D data collected from multi-sensor instruments. This is your chance to … experience under your belt. Be part of a small, dedicated team with a strong international presence, and engage in cutting-edge projects and innovative data analysis techniques. Key Responsibilities: Acquire, organise, preprocess, and manipulate 1D, 2D, and 3D datasets. Apply statistical and mathematical techniques to analyse data, identifying … patterns, trends, and anomalies. Collaborate with the Senior Data Analyst, R&D, and software teams to develop and implement new tools and workflows. Implement quality control measures to ensure data accuracy and participate in validation processes. Support in developing innovative workflows and technologies to deliver insightful results to more »

Lead Data Scientist | £85-95k | Gambling | Hybrid Leeds or Newcastle If you're a Lead Data Scientist who wants to work for one of THE best and fastest growing Data functions in this sector then you'll want to check this out... About the business 🚀 G.Digital … players safe, grown from 10 to over 400 employees and expanded into a handful of countries and now they're looking to building a data science capacity to deliver high-impact work around the UK and Europe! Why did we choose to work with them? ✅ Investing heavily in their … Tech and Product teams ✅ Remote first and great work life balance ✅ Brand new Data Science practice ✅ Working on a number of new Greenfield projects ✅ Big on L&D About the role 👩‍💻 The Head of Data has been building appetite and use cases for Data Science and more »

Data Engineer - Belfast - £55 - 60k + Bonus Want to help drive the Data function with one of the most reputable employers in Belfast? This company is known for it’s innovation, delivery, and culture. Their Belfast hub is at the centre of the tech community, promoting learning and … diversity at all levels. They have a new opportunity for a Data Engineer to join their Digital function. AWS is a huge growth area for this company, so it's a great opportunity to really develop your cloud skills. The person Experienced in designing and deploying production data pipelines within a big data architecture Strong technical skills in Python, SQL and AWS (though they’re very open to any cloud experience) Experience processing large volumes of structured and unstructured data Knowledge of data cleaning, wrangling, visualization and reporting Knowledge of data mining more »

Data Engineer Birmingham - AWS Hybrid working 1 day every 3 weeks out of their Birmingham City Centre offices. Salary 55-65k plus 10% bonus, 28 days holidays Childcare vouchers, Life Assurance, pension. We are a looking for an experienced Data Engineer to play a pivotal role in … constructing and maintaining data pipelines within a dynamic, Agile environment. This opportunity is based in Birmingham, West Midlands, with a hybrid work model. As a key member of their Data team, you'll be instrumental in translating technical requirements into actionable pipelines, developing solutions to drive data-centric decision-making, and upholding data quality and organisation standards. Strong skills in Python, SQL, AWS, Glue, ETL and DataOps principles is essential. Core skills: Strong coding skills in Python & SQL Excellent experience in the AWS Cloud platform, including AWS Glue, Amazon DynamoDB for NoSQL database management, Amazon more »

We are currently seeking a Data Engineer to join our client, a unique scale-up business who have received significant investment, that is entering a phase of large scale growth. This role will be a pivotal role in shaping the organisation’s data operations, as the company grows … and matures. As a Data Engineer you will design and build data pipelines that will fuel our client’s groundbreaking product lines. You'll collaborate across multiple disciplines to ensure seamless data flow, and go beyond pipelines to champion data quality, governance, integration, and transformation. About … overview of what the successful candidate will require (don’t worry if you don’t tick all the boxes!): Python for building and automating data pipelines. A solid understanding of ETL processes for data extraction, transformation, and loading. Experience with relational databases ( SQL ) and database design principles and more »

Mid-Level and Senior Data Scientist Roles - Hybrid/Bristol Location: Hybrid/Bristol - 2 days in office per week min. About Our Client: Our client is a leading organisation in the risk industry, specialising in cyber risk assessment and management. They are at the forefront of innovation, using … test. With unique perks like dog-friendly offices, team meals and enrichment days, their team thrives on a cooperative and inventive spirit. Mid-Level Data Scientist: Location: Hybrid/Bristol Salary: £50,000 - £60,000 per annum Contract Type: Permanent Key Responsibilities: Seeking an Engineer with a curious mindset … and an understanding of bespoke data transformation, without the need for the crutch of Cloud Platforms at all times… Develop, enhance, and manage intricate data ingestion pipelines. Integrate advanced machine learning elements into data pipelines. Implement data quality metrics and dashboards for monitoring. Collaborate with data more »

Data Engineering Technical Lead Salary - £60,000 - £65,000 This is a great job for someone who has worked as a senior data engineer in data lake/lake house architecture platform and has hands on experience of developing data pipelines using Pyspark and SQL. The … successful individual will have working experience of AWS data eco system and toolsets, with passion to learn and explore new technology stack. A bit about the job: The Data Engineering Technical Lead will provide technical expertise and delivery capability across the development & IT Change community. The role will … keep a clear overview of all aspects of this area. Skills and experience we’re looking for: Strong technical consultancy experience across ETL/Data Warehouse/Big Data but comfortable with hands on delivery. Working experience of Cloud Technologies and data eco system, AWS is more »

Are you an experienced Data Engineer ? Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ? Its a Hybrid working role and you will be based from either their London, Leeds, Manchester or Edinburgh office, typically 3 days a week from … home and 2 day in office/on client site. Responsibilities: Developing and optimizing data pipelines Building and maintaining data architectures Leading projects and teams Ensuring data quality and integrity Preferred skills: Proficiency in AWS Glue, AWS Redshift, and Python Experience with ETL processes, data integration … and data warehousing. Strong SQL skills Experience with Big Data technologies such as Hadoop, Spark, and Kafka Familiarity with cloud platforms (AWS, Azure, Google Cloud) Working knowledge of data visualisation tools (PowerBI, Tableau, Qlik Sense) Additional skills: Client-facing and communication skills Leadership and mentoring capabilities more »

Group Head of Data Engineering & Governance Are you an accomplished Head of Data Engineering & Governance looking for the next move in your career? InX are currently working on a retained Search basis with a Financial Services organisation to place a Group Head of Data in the CIO … s senior management team. The Role As the Group Head of Data Engineering & Governance, you will be responsible for leading the data engineering team in designing, implementing, and maintaining scalable data pipelines and infrastructure. You will collaborate closely with cross-functional teams to ensure the integrity, availability … and security of the organisation's data, while also driving innovation in data engineering practices. You will work closely with the Data Science and Analytics team (which sits outside of the remit of this position) but will be responsible for the growth and capability of your own more »