1 to 25 of 91 Permanent Big Data Jobs in the UK excluding London

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

Exciting Opportunity: Python/Spark Big Data Software Engineer – Financial Services Sector 📍 Location: Glasgow 💼 Contract: 6 Months PAYE 💷 Rate: Up to £500 per Day Are you ready to take your software engineering career to the next level? We invite you to join a leading team in the financial … services industry where innovation meets top-tier excellence. We are on the lookout for a seasoned Python/Spark Big Data Software Engineer to play a key role in our agile team. What You Will Do: Devise and implement cutting-edge software solutions, venturing beyond traditional methods to … tackle complex challenges. Develop robust architecture and design artefacts that adhere to strict design requirements. Detect patterns and underlying issues in data to refine system architecture and coding practices. Enhance our team culture by promoting diversity, equity, inclusion, and respect. Participate in software engineering communities, staying up-to-date more »

Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business … Analysts and Data Architects with discovery and best practices. Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure. Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark. Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis. Strong analytic skills related to working with unstructured datasets. Build processes supporting data transformation, data structures, metadata, dependency more »

Solutions Architect - Data Product UK Remote (very ad-hoc travel) Market Day Rate - Outside IR35 Initial 6 months (high scope for extensions) Fruition Consulting are looking for an experienced Solutions Architect with extensive experience working across data platforms to join a well-recognised, highly regulated software focused business. … Solutions Architect, you will take responsibility for the platform design and architecture ahead of a migration from legacy to a brand new AWS cloud data platform. Requirements: Experience with AWS cloud data platforms Strong understanding of the role of architecture in enterprise data projects Proven commercial experience … migrating on prem solutions to the cloud, including re-architecting Prior experience working on data focused projects e.g. data warehousing, big data, data streaming Proficiency with Apache Kafka, Apache Spark, Apache Flink etc. We are an equal opportunities employer and welcome applications from all suitably more »

Data Engineer Grade: Consultant Analyst/Consultant Location: Belfast – BT6 8DN In-Office: 2 days per week Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks a highly ambitious and technically astute AWS Data Engineer to help design, build and deploy cloud-based data solutions - transforming raw data into actionable insights that inspire ingenuity. The Company: The Organisation consists of 4000 high-performing Digital Strategists and Engineering Technologists - united in delivering human-centred innovation and making a meaningful impact on global society. Boasting a vast network of FTSE 100 and Fortune … manufacturing, Defence and security, Energy and utilities, Financial Services, Government and Public Services, Healthcare, Life Sciences, and Transport. Essential Skills & Experience: Design and deploy data pipelines in big data architecture using Java, Python, Scala, Spark, and SQL. Execute tasks involving scripting, API data extraction, and SQL more »

DV Cleared Data Science Consultant Location : Bristol (with potential for client site work in Gloucester) Type : Permanent - Hybrid Salary : £50,000 - £60,000 + 10% bonus + 11% pension **Must have Active DV Clearance** Job Description: We are seeking a Data Scientist with Active DV Clearance to join … work on some of the largest and most ambitious projects within Defence and Security arena. In this role, you will leverage your expertise in data science, mathematical modelling, and machine learning to help digitise Defence and Security whilst upholding traditonal values. Responsibilities: • Conduct analysis for evidence-based decision-making … developing models and analysis to support data-centric decision-making processes. • Work closely with clients to understand their requirements and translate them into actionable solutions. • Lead and deliver solutions across the full modelling lifecycle, including problem formulation, exploratory data analysis, model design, build, testing, and handover. • Utilize common more »

Data Scientist | Maritime Tech | £60K Join a scaling Maritime tech business as a Data Scientist. You will play a crucial role in leveraging data analytics to enhance our products and services, optimize operations, and drive strategic decision-making. If you are passionate about applying advanced analytical techniques … to solve complex problems in the maritime industry, we want to hear from you. Responsibilities Analyze raw data: assessing quality, cleansing, structuring for downstream processing Design accurate and scalable prediction algorithms Collaborate with engineering team to bring analytical prototypes to production Generate actionable insights for business improvements Qualifications Bachelor … classification techniques, and algorithms Fluency in a programming language, ideally Python but can also be Java or C/c++ SQL expeirence Familiarity with Big Data frameworks and visualization tools (Cassandra, Hadoop, Spark, Tableau) Get in touch with Ella Alcott - Ella@engagewithus.com more »

magic ✨ Cloud: Azure is our main offering, but experience with AWS/GCP is a strong plus! Containerization: Docker and/or Kubernetes Bonus: Big Data processing (BI systems, Data lakes) Excited to learn more? 🤔 Feel free to reach out, and I'll happily share all the more »

together to develop truly human centric innovation? Are you someone who is interested in creating innovations to build trusted, sustainable societies using insights from big data, digital twins and computational social science? If this is your world, here is an opportunity to shape it for the better. At … technologies to transform our customers’ businesses. The Social Digital Twin project develops solutions to social issues. We create integrated technologies that combine large scale data with knowledge from a variety of fields, including data science, the humanities and social sciences. We are developing systems that use real-world … real-time data to create digital twins that mirror the behavior of complex systems –cities, transport, power – and enable their management. We are looking for a Senior Researcher who can create technologies for the Social Digital Twin and integrate research outputs into to functional end to end systems. The more »

apply. Python App Developer Requirements: Proficiency with Python or PySpark. Exposure to cloud technologies such as Airflow, Astronomer, Kubernetes, AWS, Spark, Kafka. Experience with Big Data solutions or Relational DB. Demonstrated knowledge of software applications and technical processes within a cloud or microservice architecture. Hands On practical experience more »

ML frameworks (TensorFlow, PyTorch etc.) MLOps experience Nice to have: Familiarity with Git or other Version Control Systems Computer Vision Library exposure Understanding of Big Data Technologies (Hadoop, Spark etc) Experience with Cloud platforms (AWS, GCP or Azure) This is a fully remote role, but may require very more »

successful search intelligence platform. You’ll join a fantastic team, driving forward a product used by high-profile global brands. As a large-scale, big data application, we think our mission is more exciting than a typical PHP project. You’ll work alongside experienced engineers within a small … team where you’ll have genuine influence from day one. You’ll join our Platform team, connecting to external services and providing data processing capabilities to support the work of our Product Development team. You’ll get exposure to a variety of AWS Services all joined together by a … tools you’ll be using to optimise your code ro help us scale ever higher. Day to day: Optimising and scaling up the cloud data processing code that powers our platform. Expanding platform services with new functionality to support our product development roadmap Maintaining the high standards of our more »

Principal Data Engineer Grade: Principal Consultant Location: Belfast – BT6 8DN In-office: 2 days per week Clearance: Must be SC Clearable Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks an influential Principal Data Engineer to help lead across the design, build and deployment of … cloud-based data solutions - transforming raw data into actionable insights that inspire ingenuity. The Company: The Organisation consists of 4000 high-performing Digital Strategists and Engineering Technologists - united in delivering human-centred innovation and making a meaningful impact on global society. Boasting a vast network of FTSE … Goods and Manufacturing, Defence and Security, Energy and Utilities, Financial Services, Government and Public Services, Healthcare, Life Sciences, and Transport. Essential Skills & Experience: Lead Data Engineering teams in designing, building, and maintaining large-scale data solutions using AWS data and analytics services. Recognised as a trusted expert more »

models ( Python or TensorFlow ) Familiarity with natural language processing or AI technologies ( e.g LLMs such as ChatGPT or BARD , Embeddings , Prompt Engineering ) Experience with data pipelines and preferably processing of document s ( e.g using Google Cloud Fusion/Azure Data Factory ) Strong background in either Python/Typescript … methodologies (Service Orientated Architecture, API-Centric Design, Twelve-Factor App, FAIR, etc.). Experience supporting digital platforms, including Integrations, Release Management, Regression Testing, Integrations, Data Obfuscation, etc. Knowledge of Azure Data Factory/GCP Cloud Data Fusion , Microsoft Azure Machine Learning or GCP Cloud ML Engine , Azure … Data Lake , Azure Databricks or GCP Cloud Dataproc . Familiarity with big data technologies and distributed computing frameworks, such as Hadoop, Spark, or Apache Flink. Experience scaling an “API-Ecosystem ”, designing, and implementing “API-First” integration patterns. Experience working with authentication and authorisation protocols/patterns. Other more »

/s, Tester/s, Technical Architects as well as subject matter experts from wider Tech Central teams. The Role Lead in developing strategic data science engagements with key clients and lines of business to form & execute the next development of pipeline opportunities Lead and be accountable for the … delivery of core data science assets (such as our SaaS platforms) in client facing settings Be a role model while managing junior staff on project and product teams Support PwC’s growth accelerator pipelines Skills and Experience Practical experience from industry and professional services in delivering significant and valuable … advanced analytics projects and/or assets Engagement of technical and senior stakeholders Ability to manage and coach a team of data scientists Delivery of projects on time and in budget for high profile clients Understanding of requirements for software engineering and data governance in data science more »

and test software components of varying size and complexity. Design and execute unit, link and integration test plans and document test results. Create test data and environments as necessary to support the required level of testing. Work closely with the quality assurance team and assist with integration testing, system … software development experience within an industry setting. Ability to work in both Windows and UNIX/Linux operating systems. Good understanding of software/data design methods and data structures. Experience of API (REST) development, Docker, and Kubernetes. Familiarity with IntelliJ, Subversion and Maven. Exposure to one or … work within a hybrid Agile methodology. Understand the design and development approaches required to build a scalable infrastructure/platform for large amounts of data ingestion, aggregation, integration and advanced analytics. Knowledge of general database concepts, plus experience of one of the following platforms: MySQL or Cassandra. Experience of more »

the last Series C funding round in January 2023. Your team You will be the Senior Product Manager for a group of cross-functional Data Platforms teams within Oxa, incorporating the following key teams: Data Engineering; MLOps; Replay/Simulation as a Service; and Telemetry & Metrics. These teams … are located in both our Oxford, UK HQ & Toronto, CA offices and support the broader organisation and our external customers. Members within Data Platforms are a dynamic and engaged group of people from diverse cultural and professional backgrounds working together towards our goal of Universal Autonomy. They have an … obsessive customer focus, deep technical understanding of data, and how the cloud can achieve greater insights. Solutions/services must be designed to be scalable, secure, performant, reliable, operationally effective and cost optimal, in line with architectural best practice guidelines. Product Managers collaborate with business unit leaders, cross-functional more »

This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. Client Details Global Pharmaceutical Services … provider Description This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. You will work … on designing and developing their company data acquisition strategy allowing for near real time process reporting and full support of contractual reporting to customers. Key Responsibilities: Monitor and maintain ETL processes to ensure the continuation of an accurate data reporting platform for the business. Explore solutions for optimising more »

Data Engineer Birmingham - AWS Hybrid working 1 day every 3 weeks out of their Birmingham City Centre offices. Salary 55-65k plus 10% bonus, 28 days holidays Childcare vouchers, Life Assurance, pension. We are a looking for an experienced Data Engineer to play a pivotal role in … constructing and maintaining data pipelines within a dynamic, Agile environment. This opportunity is based in Birmingham, West Midlands, with a hybrid work model. As a key member of their Data team, you'll be instrumental in translating technical requirements into actionable pipelines, developing solutions to drive data-centric decision-making, and upholding data quality and organisation standards. Strong skills in Python, SQL, AWS, Glue, ETL and DataOps principles is essential. Core skills for this Data Engineer role: Strong coding skills in Python & SQL Excellent experience in the AWS Cloud platform, including AWS Glue, Amazon more »

deliver approximately 85000 jobs per year and the service contract value for all clients exceeds 1.8 million. This role involves the analysis of system data, providing efficiency to scheduling and re-scheduling works as required which will provide sales and margin improvement for the business. Always Scheduling at least … ahead. Reconciling/re-scheduling of the previous days work as required. Managing capacity to deliver the workload, liaising with Contract Teams. Analysing workload data to ensure best scheduling practice is used (i.e. Geography/Skill set/existing works scheduled). Develop and promote best practice for processes … detail. Excellent communication skills for internal/external Stakeholders. Positive attitude. Focused. Ambitious. Experience required: 2yrs experience with administering user-based systems, reporting and data manipulation within Access and Excel. Dealing with big data sets Benefits: 20 days leave increasing by 1 day for each full year more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

with the sharpest possible prices and with locally available inventory. We develop scalable systems and services, and utilizing cutting edge technology (e.g., machine leaning, big data, etc.), to enable world-class global logistics solutions. We are currently looking for a Sr. Product Manager to join our growing organization. … be defining the vision for how Sellers and Amazon manage fulfilment globally. You will own developing and executing against a multi-year roadmap, leveraging data and insights from our Sellers and inventing new technology to deliver innovations which help Sellers grow and expand their business on Amazon. You will … are open to hiring candidates to work out of one of the following locations: London, GBR PREFERRED QUALIFICATIONS Experience in influencing senior leadership through data driven insights Experience working across functional teams and senior stakeholders Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce more »

Job summary Are you an experienced Data Scientist, Statistician or in a similar role, looking to make a difference in the public health sector? We are looking for a motivated individual to join our award-winning team as a Data Science and Advanced Analytics Lead. You will play … an integral role in leading the delivery of high value projects, as well as developing the capability of the Data Science and Advanced Analytics team and wider analytical community. The NHSBSA create a wealth of valuable data and insight from the services we deliver and the £43 billion … of activity we are part of. Our team delivers actionable insights from this data to help drive policy and strategic decisions as well as supporting efficiencies across the NHSBSA and wider health and social care. We make a difference to the lives of people not only in the NHS more »

with a creative mindset. Great attention to detail and quality focused. Keen to build operational knowledge in 21st century IT (Cloud, Social, Mobility, IoT, Big Data, etc). Appetite to learn and apply architecture best practices and patterns. Understanding of other programming languages and the software development lifecycle more »

Responsibilities: As a pivotal member of our rapidly expanding business, your role involves: Designing and Maintaining Data Architectures and Pipelines: Create and optimize robust data architectures and pipelines. Assemble intricate data sets that align with both functional and non-functional business requirements. Identify opportunities to acquire new … data from various systems. Enhancing Processes: Develop and refine data set processes for effective data modeling, mining, and production. Build the necessary infrastructure for seamless data extraction, transformation, and loading from diverse data sources. Data Reliability and Efficiency: Recommend and implement strategies to enhance … data reliability, efficiency, and quality. Collaborate with Data Scientists and Machine Learning Engineers to construct analytics tools that leverage the data pipeline. These tools provide actionable insights related to asset management, operational efficiency, and other critical business metrics. Cross-Functional Collaboration: Work closely with stakeholders, including Product more »