1 to 25 of 27 Big Data Jobs in the East Midlands

Join to apply for the Azure data Engineer role at IBM Continue with Google Continue with Google Join to apply for the Azure data Engineer role at IBM Introduction In this role, you’ll work in one of our IBM Consulting Client Innovation Centres (Delivery Centres), where we deliver deep technical and industry expertise to a wide range … Assistance Program, a group personal pension plan of an additional 5% of your base salary paid by us monthly to save for your future. Your Role And Responsibilities A data engineer with expertise in Azure toolset advises on, develops, and maintains data engineering solutions on the Azure Cloud ecosystem. They design, build, and operate batch and real-time … data pipelines using Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub. This role also involves designing, building, and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. The data engineer is proficient in Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics More ❯

Join to apply for the Senior Data Engineer role at IBM Introduction In this role, you’ll work in one of our IBM Consulting Client Innovation Centres (Delivery Centres), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centres offer our clients locally based skills … and maternity return schemes Standard benefits like holiday allowance, discounts, Employee Assistance Program, and a pension plan with employer contributions Your Role and Responsibilities We are seeking a Senior Data Engineer to join our team, focusing on public sector accounts. Your role involves designing, developing, and managing scalable data pipelines, integrating diverse systems, and implementing data models. … You will work with cross-functional teams to ensure data integrity, security, and compliance with public sector regulations. Preferred Education Bachelor's Degree in a relevant field Responsibilities Design, build, and maintain scalable data pipelines and ETL processes Collaborate with data scientists and engineers on data integration Ensure data quality, accuracy, and reliability through testing More ❯

engagement.” SecurityScorecard is proud to be funded by world-class investors including Silver Lake Waterman, Moody’s, Sequoia Capital, GV and Riverwood Capital. About the Team: At SecurityScorecard, the Data Science organization builds AI and ML products that empower our customers to manage cybersecurity risk. We leverage massive datasets sourced by our internal Threat Intelligence teams to create the … build LLM-powered systems for automating and accelerating cybersecurity risk assessment workflows. About the Role: As an ML Engineer, you will design and optimize machine learning algorithms, build scalable data pipelines, and deploy reliable models into production environments. You'll collaborate with cross-functional teams to integrate ML solutions into products, conduct research to stay ahead of emerging technologies … while working in a dynamic, collaborative environment. Responsibilities: Technical Leadership: Establish best practices and share expertise through mentorship. Model Development: Design, train, and optimize machine learning models and algorithms. Data Pipeline Creation: Build and maintain scalable data pipelines to preprocess, clean, and transform raw data for analysis and model training. Model Deployment: Implement and manage models in More ❯

Job Description This is a fantastic opportunity to join our eCommerce Data team as a Trainee Data Engineer! Based at NEXT Head Office in Enderby, Leicestershire with a competitive starting salary of £30,238 and great benefits! The eCommerce Data Team provides the department and the business the means to see what is working and what is … not by drawing data and analysing patterns of shopping on our site and in general. About the role: A Trainee Data Engineer will sit within the Engineering team, to support our Data Engineers to better our architecture and website platform offering. This is done through researching and trialling new technologies, keeping up to date with the industry … You will gain knowledge of transferring data to and from Google, Meta, other Social media platforms and third parties. You will support the Data Engineers with processing BigData on largedatasets with billions of rows. You will be learning how to improving efficiencies and quality of data provided, creating dashboards and handling errors through alerts You will be More ❯

Social network you want to login/join with: Are you an experienced Data Engineer with a passion for coaching and mentoring others? Join our client’s growing team as a Data Engineering Coach , where you'll coach, guide & mentor junior/apprentice Data Engineer’s throughout their apprenticeship journey - from day one to completion. This is … a highly flexible, remote-working role, ideal for Data Engineering professionals seeking meaningful work, and one that could still fit around other commitments. Key Responsibilities: Deliver 1:1 and small group coaching sessions to support Data Engineer apprentices across a variety of industries Provide technical mentoring in core Data Engineering tools, techniques, and methodologies — including Python, SQL … ETL pipelines, data warehousing, cloud platforms, and version control Offer pastoral support, helping learners stay on track and fully motivated throughout their programme Support learners in building confidence and developing practical, job-ready data engineering skills Collaborate with employers to ensure learner progress and success in real-world projects Adapt coaching styles to meet diverse learner needs and More ❯

Social network you want to login/join with: Are you an experienced Data Engineer with a passion for coaching and mentoring others? Join our client’s growing team as a Data Engineering Coach , where you'll coach, guide & mentor junior/apprentice Data Engineer’s throughout their apprenticeship journey - from day one to completion. This is … a highly flexible, remote-working role, ideal for Data Engineering professionals seeking meaningful work, and one that could still fit around other commitments. Key Responsibilities: Deliver 1:1 and small group coaching sessions to support Data Engineer apprentices across a variety of industries Provide technical mentoring in core Data Engineering tools, techniques, and methodologies — including Python, SQL … ETL pipelines, data warehousing, cloud platforms, and version control Offer pastoral support, helping learners stay on track and fully motivated throughout their programme Support learners in building confidence and developing practical, job-ready data engineering skills Collaborate with employers to ensure learner progress and success in real-world projects Adapt coaching styles to meet diverse learner needs and More ❯

Social network you want to login/join with: Are you an experienced Data Engineer with a passion for coaching and mentoring others? Join our client’s growing team as a Data Engineering Coach , where you'll coach, guide & mentor junior/apprentice Data Engineer’s throughout their apprenticeship journey - from day one to completion. This is … a highly flexible, remote-working role, ideal for Data Engineering professionals seeking meaningful work, and one that could still fit around other commitments. Key Responsibilities: Deliver 1:1 and small group coaching sessions to support Data Engineer apprentices across a variety of industries Provide technical mentoring in core Data Engineering tools, techniques, and methodologies — including Python, SQL … ETL pipelines, data warehousing, cloud platforms, and version control Offer pastoral support, helping learners stay on track and fully motivated throughout their programme Support learners in building confidence and developing practical, job-ready data engineering skills Collaborate with employers to ensure learner progress and success in real-world projects Adapt coaching styles to meet diverse learner needs and More ❯

Social network you want to login/join with: Are you an experienced Data Engineer with a passion for coaching and mentoring others? Join our client’s growing team as a Data Engineering Coach , where you'll coach, guide & mentor junior/apprentice Data Engineer’s throughout their apprenticeship journey - from day one to completion. This is … a highly flexible, remote-working role, ideal for Data Engineering professionals seeking meaningful work, and one that could still fit around other commitments. Key Responsibilities: Deliver 1:1 and small group coaching sessions to support Data Engineer apprentices across a variety of industries Provide technical mentoring in core Data Engineering tools, techniques, and methodologies — including Python, SQL … ETL pipelines, data warehousing, cloud platforms, and version control Offer pastoral support, helping learners stay on track and fully motivated throughout their programme Support learners in building confidence and developing practical, job-ready data engineering skills Collaborate with employers to ensure learner progress and success in real-world projects Adapt coaching styles to meet diverse learner needs and More ❯

Social network you want to login/join with: Are you an experienced Data Engineer with a passion for coaching and mentoring others? Join our client’s growing team as a Data Engineering Coach , where you'll coach, guide & mentor junior/apprentice Data Engineer’s throughout their apprenticeship journey - from day one to completion. This is … a highly flexible, remote-working role, ideal for Data Engineering professionals seeking meaningful work, and one that could still fit around other commitments. Key Responsibilities: Deliver 1:1 and small group coaching sessions to support Data Engineer apprentices across a variety of industries Provide technical mentoring in core Data Engineering tools, techniques, and methodologies — including Python, SQL … ETL pipelines, data warehousing, cloud platforms, and version control Offer pastoral support, helping learners stay on track and fully motivated throughout their programme Support learners in building confidence and developing practical, job-ready data engineering skills Collaborate with employers to ensure learner progress and success in real-world projects Adapt coaching styles to meet diverse learner needs and More ❯

Job Description Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting talented data engineers. As a major UK energy provider, our client is committed to 100% renewable energy and sustainability, focusing on delivering exceptional customer experiences. It is … is hybrid, with one day a week based in their Nottingham office, negotiable. It is a full-time role, 37 hours per week. Accountabilities: Develop and maintain scalable, efficient data pipelines within Databricks, evolving them as requirements and technologies change. Build and manage an enterprise data model within Databricks. Integrate new data sources into the platform using … batch and streaming processes, adhering to SLAs. Create and maintain documentation for data pipelines and systems, following security and monitoring protocols. Ensure data quality and reliability processes are effective to maintain trust in the data. Take ownership of complex data engineering projects and develop solutions aligned with business needs. Work closely with stakeholders to manage requirements. Coach More ❯

Join to apply for the Senior Data Solution Designer role at Barclays Business Banking 2 days ago Be among the first 25 applicants Join to apply for the Senior Data Solution Designer role at Barclays Business Banking Join us as a Senior Data Solution Designer at Barclays, supporting the BUK Data Foundations Programme, where you will … help build designs/patterns for our different use-cases as we migrate from our On-premise warehouses to Cloud. In this role you will work alongside Data Product Owners, Platform Leads and Engineering Leads to help accelerate our journey to Data Products on Cloud. To be successful as a Senior Data Solution Designer you should have … Experience Designing and Maintaining Data warehouse in big data solutions on Cloud and on Premises. Experience and knowledge of cloud platforms such as Snowflake, AWS (S3, Glue, EC2, Athena), Databricks and DBT . This includes hands-on knowledge of cloud-based data storage, processing, and analytics solutions. Good understanding of business processes. Strong analytical skills and More ❯

capability. The focus is on backend Python systems that underpin the UK’s transition to sustainable, low-carbon energy. From secure APIs and cloud deployments to DevOps pipelines and data management, you’ll be responsible for ensuring high standards, modern engineering practices, and long-term scalability. What you’ll be doing: Driving technical direction across backend Python services (Django … deployment pipelines Must be a sole UK national – SC clearance required Desirable extras: Experience with high-assurance or safety-critical software Exposure to GDS digital service standards Familiarity with big data, ETL, or ML/AI pipelines Background in energy, defence, embedded or industrial software a bonus Why this role? You’ll have real influence on how key More ❯

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed to 100% renewable energy and sustainability, focusing on delivering exceptional customer experiences. It is initially … one day a week being based in their Nottingham office, this is negotiable. It is a full-time role, 37 hours per week. Accountabilities: * Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change. * Build and manage an enterprise data model within Databricks. * Integrate new data sources into the platform … using batch and streaming processes, adhering to SLAs. * Create and maintain documentation for data pipelines and associated systems, following security and monitoring protocols. * Ensure data quality and reliability processes are effective, maintaining trust in the data. * Be comfortable with taking ownership of complex data engineering projects and develop appropriate solutions in accordance with business requirements. * Able to More ❯

infrastructure; think power grid management, nuclear, and sustainability-focused tech. This isn’t a theory-heavy R&D role. It’s about secure, scalable, performant backend engineering that enables data to move reliably through critical systems. You’ll help shape the architecture, mentor junior devs, and influence DevOps practices across a growing team. Day to day: Architecting and building … and DevOps engineering culture Comfortable leading technical discussions and code reviews Bonus if you have: Knowledge of GDS delivery standards Exposure to embedded or real-time systems Experience with big data or machine learning backends Why this role is worth considering: You’ll shape the direction of digital systems that support national infrastructure You’ll be joining a More ❯

Join us as a Senior Data Solution Designer at Barclays, supporting the BUK Data Foundations Programme, where you will help build designs/patterns for our different use-cases as we migrate from our On-premise warehouses to Cloud. In this role you will work alongside Data Product Owners, Platform Leads and Engineering Leads to help accelerate … our journey to Data Products on Cloud. To be successful as a Senior Data Solution Designer you should have: Experience Designing and Maintaining Data warehouse in big data solutions on Cloud and on Premises. Experience and knowledge of cloud platforms such as Snowflake, AWS (S3, Glue, EC2, Athena), Databricks and DBT . This includes hands … on knowledge of cloud-based data storage, processing, and analytics solutions. Good understanding of business processes. Strong analytical skills and techniques. Expertise in Batch \Real Time ETL Solution skills along with performance enhancement knowledge. Strong knowledge of data and analytics, such as dimension modelling, ETL, Reporting tools, Data governance, Data warehousing, Structured and Unstructured data. Other More ❯

technological change to successfully deliver innovations that will help them gain a competitive advantage and improve the everyday lives of people around the globe. We are seeking a talented Data Engineer to join our team. As a Data Engineer, you will work with a variety of technologies including Python, Py-Spark, Pandas, SQL and Azure DevOps. You will … be responsible for modeling and implementing predictive maintenance solutions for our products, specifically focusing on jet engines. Responsibilities Collaborate with stakeholders to understand data migration requirements Work with diverse data formats and source/target databases Design, develop, test, and maintain data migration modules Analyse and address data quality issues at both the source and destination … and resolve issues reported in live systems to ensure minimal downtime Document migration processes and provide regular progress updates Essential skills Strong experience with Databricks Proficient in SQL for data querying and transformation Solid understanding of Azure Services including: Azure Data Factory Azure Storage Containers Lakehouse architecture Expertise in PySpark for big data processing In-depth More ❯

party documentation and designs for conformance with internal standards and expectations. Requirements Proven experience in designing and implementing a wide range of enterprise-scale technology solutions, including: Large-scale data processing and integration Systems dealing with both structured and unstructured data Highly distributed systems and architectures Strong expertise in Service-Oriented Architecture (SOA) and microservices design. Proficiency in … at least one major cloud platform (e.g., Azure, AWS, or Google Cloud Platform). Broad understanding of web, cloud, and data technologies, along with common architectural patterns. Ability to communicate architectural strategies and designs effectively to both technical teams and business leaders. Strong analytical and problem-solving skills; ability to decompose complex problems into actionable solutions. Familiarity with compliance … and regulatory standards such as GDPR. Experience contributing to and helping mature an enterprise architecture practice. Preferred Qualifications Experience in the market research, data analytics, or insights sectors. Hands-on experience with big data technologies and modern data platforms. Background in software engineering or development. Additional details include seniority level (Mid-Senior level), employment type (Full More ❯

processes and technologies to lead up the quality and interoperability of our segmentation and identity data. Find solution of problems related to the infrastructure. Control dataflow. Architect next-gen data distribution systems. Oversee main production systems to ensure system uptime and quality assurance. Troubleshoot data delivery issues. Collaborate with the Chief Engineer of Data Distributions to align … on strategic goals. About Experian Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist … Our corporate headquarters are in Dublin, Ireland. Learn more at Experience and Skills What you'll bring: 4+ years of production-level experience with Python. Proficiency in SQL for big data. Experience with big data sets. Excellent written and verbal English. Expertise in technical documentation and creating run books for new systems, feature, and config management. Skills More ❯

Good understanding of CI/CD pipelines, Git workflows and Agile delivery Strong attention to security, testing and performance Nice to have: Infrastructure as Code (Terraform) Exposure to microservices, big data or IoT Knowledge of GDS or UK Government digital standards Why join? The company is an institution in nuclear and energy sectors Big investment in digital More ❯

Help develop emerging services such as demand-side response, grid flexibility, and grid protection modes - Ensure platform capabilities align with evolving standards and regulations (e.g. PAS 1878, Mercury) - Drive data-led decisions and platform evolution using insights from users, analytics, and commercial teams Cross-Functional Delivery - Collaborate with firmware, cloud, and app teams to ensure end-to-end delivery … MQTT, or similar - Experience delivering connected products that combine hardware, firmware, and cloud software - Knowledge of the UK energy flexibility landscape, including grid services and dynamic tariffs - Experience with data science & leveraging big data sets to create compelling user features Qualifications: - Bachelor's degree or equivalent in a technical discipline (e.g. Mech/Electrical Engineering,Computer Science More ❯

Help develop emerging services such as demand-side response, grid flexibility, and grid protection modes Ensure platform capabilities align with evolving standards and regulations (e.g. PAS 1878, Mercury) Drive data-led decisions and platform evolution using insights from users, analytics, and commercial teams Cross-Functional Delivery Collaborate with firmware, cloud, and app teams to ensure end-to-end delivery … MQTT, or similar Experience delivering connected products that combine hardware, firmware, and cloud software Knowledge of the UK energy flexibility landscape, including grid services and dynamic tariffs Experience with data science & leveraging big data sets to create compelling user features Qualifications: Bachelor’s degree or equivalent in a technical discipline (e.g. Mech/Electrical Engineering, Computer Science More ❯

Social network you want to login/join with: Location: Lincoln, (hybrid but must live locally to Lincoln) Start: ASAP (once vetting completed) Key skills: Data Architecture experience including data architecture design and implementation, ETL, data visualisation, cloud-based tech storage and big data technologies, data query languages, and experience leading a data delivery team (Data Engineers, BI Devs, and Dashboard Designers) Our Client: UK Police Force. This is a great opportunity to undertake a key role with a high-profile organisation to drive data architecture performance, ultimately benefiting services at a local community level. The Role: (key duties include) SME leadership regarding Data Architecture Lead and manage Data Engineering Team Data architecture design — designing data models, data flows, integration, and data storage — ability to brainstorm ideas with stakeholders. Data solutions approach, able to present and articulate benefits to stakeholders Lead on Data Governance ** You will need to be able to demonstrate that you have lived and worked in the UK for More ❯

Integration Services, ou afins..); Experiencia na criação de Dashboards, com capacidade de coletar, organizar, analisar e disseminar grandes quantidades de informações com atenção aos detalhes e precisão; Conhecimento em BigData e tratamento de grandes volumes; Conhecimento em metodologias de Business Intelligence. Additional Information A Serasa Experian é muito mais do que você imagina. Com o propósito de criar um futuro More ❯

as scalability, performance, and security. Technical leadership experience with a consultative approach and the ability to influence and engage technical and non-technical stakeholders. Good knowledge of integration techniques, data architecture including Big Data, AI/ML, data warehousing, and analytics. A proven track record in guiding technology product selection and leading architecture decisions from discovery More ❯

as scalability, performance, and security. Technical leadership experience with a consultative approach and the ability to influence and engage technical and non-technical stakeholders. Good knowledge of integration techniques, data architecture including Big Data, AI/ML, data warehousing, and analytics. A proven track record in guiding technology product selection and leading architecture decisions from discovery More ❯