1 to 25 of 94 Big Data Jobs

Big Data Engineer - Fully Remote in Africa/EU As a Big Data Engineer you will have a strong understanding of big data technologies with an exceptional ability to code. You'll be providing technical leadership, working closely with the wider team and focusing … Code, TDD, BDD, continuous integration, continuous delivery, and DevOp s You will, among other tasks: Define, design, and develop services and solutions around large data ingestion, storage, and management such as withRDBMS, No SQL DBs, Log Files, Events. Define, design, and run robust data pipelines/batch jobs … Redis etc. Mocking (any of the following Mockito, ScalaTest Spock, Jasmine, Mocha). Build tools (One of SBT, Gradle, Maven). Knowledge of AWS Big Data/Analytics services - S3, EMR, Glue, Redshift, QuickSight, Kinesis. Desierables Skills Experience of big data environments (also advising best practices more »

Data Engineer Our client is a highly profitable and ambitious financial service business that has grown from scratch to c.£400m annual sales and over 600 head office staff, servicing over £30bn of assets under management and 20% of the UK financial adviser marker in approx. 17 years. Its … is on the next stage of its phenomenal journey and were now looking to help further strengthen the team, by appointing a first-rate Data Engineer. Reporting to the Head of Data, you will play a key team role in building a scalable, reliable and high impact solution … which helps the business become more data driven and deliver actionable insight. Using modern data engineering tools and technologies, y our key responsibilities as Data Engineer will include: Evaluating business needs and objectives - working with Data Analysts and other users to understand the needs for data more »

Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial businesses can unlock digital advantage in the most demanding environments. We are looking for experienced … Data Engineers to join our team following continuous growth and success. As a Data Engineer you will be involved in: Design, develop, test and support data collection, data integration and ETL applications to make information and data available to key client stakeholders and technical interfaces … Model data requirements, data sources and data flows to bring order and structure to programmes of work Defining how and where data is created, mastered and destroyed to ensure proper control over the lifecycle of corporate data assets Using categories of products that can be more »

Data Product Specialist Job Type: Full-time Location: Bristol Salary: £42,000 - £46,000 Work Pattern: Hybrid (2 days onsite) We are seeking a highly skilled Data Product Specialist for our Bristol-based client. This role involves supporting, maintaining, and enhancing their data platform to ensure it … aligns with industry best practices and meets the organisation's needs. The ideal candidate will have a robust understanding of big data and analytics, data engineering, and data design, along with experience in cloud integration and data security. Day to Day of the role: Optimise … and manage the data infrastructure, including DataBricks, Power Platform, Azure, and legacy data environments. Ensure efficient data processing and real-time analytics capabilities. Implement data ingestion frameworks, stream processing, and cloud-native data services. Maintain data security best practices, compliance requirements, and governance frameworks. more »

site Enhanced DV Clearance to start - must be active £685p/d inside ir35 Contact until March 2024 - high chance of extension Expertise in Data, Java/Python, Hadoop, ETL Who are we? We are recruiting a Data Scientist with Enhanced DV clearance to work with an industry … for the best talent to join us as we continue to bring the best to the table. We work alongside our customers using modern data engineering/science methods and the latest technologies. What will you be doing? Play a pivotal role in analysing complex data sets, developing … predictive models, and implementing data-driven solutions. Develop and implement predictive models and machine learning algorithms. Utilise Java or Python for data analysis, model development, and automation. Leverage Hadoop and other big data technologies to manage and process large data sets. Apply software engineering best more »

Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial businesses can unlock digital advantage in the most demanding environments. We are looking for experienced … Data Engineers to join our team following continuous growth and success in the UK Government sector. Our people are what differentiates us, they are resourceful, innovative and dedicated. We have a mix of generalists and specialists and recognise that this diversity contributes to our success. We recognise the benefits … diverse opportunities for our people to develop their careers in new areas of expertise and with new clients. Our projects are spread across the Data Science lifecycle from delivering Research and Proof of Concept models, to building and delivering operational solutions. Machine Learning (ML) Engineers are responsible for designing more »

MCS Group is delighted to be partnering with a local financial services organisation as they add a Data Architect to their team in a role that will see you have real impact. The position will see you working on the company wide digital transformation and change projects. You will … work with a dedicated team of data scientists and engineers to drive data strategy and have the opportunity to lead in an organisation that values growth and flexibility. The package: Salary £70,000 to £80,000 depending on experience Car allowance Health insurance 10% Company Pension contribution Market … days) Flexible, Hybrid working and training opportunities. About the role: This is an exciting time to join and be involved in shaping the data landscape within the organisation. You will have the opportunity to work on collaborative Greenfield Data Projects. You will contribute to the full data more »

Lead Data Engineer Chichester St, Belfast BT1, UK Full-time Company Description We believe in the power of ingenuity to build a positive human future. As strategies, technologies and innovation collide, we create opportunity from complexity. Our diverse teams of experts combine innovative thinking and breakthrough use of technologies … the team will look to you for support, guidance and help with decisions. You'll have: Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Perform tasks such as writing scripts … extracting data using APIs, writing SQL queries etc. Work closely with other engineering teams to integrate data engineering component into production systems. Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these more »

The Role: This role is pivotal in ensuring data solutions are scalable, sustainable, and aligned with both local and enterprise-wide architectural strategies, particularly in cloud migration. In this role, you will collaborate closely with Group Architects, the Head of Data & Analytics, and technology leads to craft a … data architecture roadmap that supports new technology platforms, advanced analytics, and AI initiatives. You will guide cross-functional teams, ensure data quality, and implement effective data management tools and practices. Additionally, you will communicate complex technical information to a broad range of stakeholders, establishing yourself as a … to integrate new technologies and policies effectively. This role is designed for a high-impact leader keen to play a key role in influencing data-driven strategies and enhancing technological capabilities. Key Responsibilities: Lead the design, development, and maintenance of data architecture solutions. Collaborate with key stakeholders to more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

Data Migration Architect (Holds Active SC) Contract Remote Outside IR35 The data management industry is evolving rapidly, driven by the increasing volume of data generated daily and the growing need for efficient data storage, processing, and analysis. With the rise of cloud technologies and big data analytics, businesses are seeking robust data architectures to streamline operations and gain strategic insights. Our client stands at the forefront of this transformation, leveraging the latest advancements in data warehousing, lake houses, and cloud platforms. We are seeking a highly skilled Data Migration Architect … to join our client’s dynamic team. The successful candidate will play a pivotal role in designing and implementing data migration strategies, ensuring seamless integration across various platforms and systems. You will be required to have Public Sector experience working and supporting multi-disciplinary Agile teams. Key Responsibilities: Design more »

Senior Data Engineer Senior Data Engineer (Full Time) - Salary - £54,664 - £64,310 (dependent on experience) - Hybrid working. Our growing Technology team plays a key role in ensuring OS is at the cutting edge of geospatial capability and is looking for people to join them. Its mission is … OS's vision: to be recognised as world leaders in geospatial services; creating location insight for positive impact. About the role As a Senior Data Engineer joining Ordnance Survey's Data Capture and Engineering team, you will provide leadership and expertise in developing new techniques, tools and pipelines. … You will transform and manipulate geospatial data into forms suitable for visualisation, analysis and further development with your Agile team. Providing insight and experience to advise data-driven decision making, your focus is on building, maintaining and solving data processing systems to meet business requirements, with an more »

of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis more »

of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis more »

Data Engineer: £35k - Glasgow (Hybrid/Remote) We're looking for a skilled Data Engineer to join our forward-thinking data team and contribute to our mission of delivering excellence through intelligent data solutions. As our Data Engineer, you will be the backbone of our … customers' data operations, and you will be responsible for building, maintaining, and optimising the pipelines that drive our customers' business analytics. Your mission is to ensure that our data flows smoothly and securely from source to destination, enabling us to extract valuable insights and inform strategic decisions. This … role will be a remote working position post the initial training period. Responsibilities: Architect and implement scalable data pipelines to support ongoing data processing requirements. Manage database operations, including performance tuning, security, and troubleshooting. Develop and maintain ETL processes and integrate data from various sources into a more »

Principal Data Engineer Location: London Hybrid (3 days a week) Salary: To £100,000 + Bonus + Benefits Job Description Investigo is partnered with an industry-leading technology logistical organisation, who are currently carrying out a huge data build out for their industry first application. This role would … having a true impact on the global supply chain and the ways some of the leading organisations move goods around the world. This Principal Data Engineer position would see you have critical involvement in implementing best-in-practice dataset and being 100% hands-on. They are looking for someone … who is comfortable with ambiguity and can really take ownership of the project, working in a small team of data engineers. You will be involved from inception to delivery of this project having a real say on all of the business's technology. You will be the Principal Data more »

this dynamic team. As a DevOps Engineer you will play a crucial role in enhancing the infrastructure, ensuring seamless deployment pipelines, and managing our big data operations. Key Responsibilities: Design, implement, and manage scalable, resilient, and secure AWS infrastructure. Develop and maintain infrastructure as code using Terraform. Collaborate … deployment and CI/CD pipelines. Monitor and optimise system performance, ensuring high availability and scalability. Manage and administer PostgreSQL databases. Implement and maintain big data solutions to handle large-scale data processing. Write and maintain scripts and automation tools using Python. Troubleshoot and resolve infrastructure and … a DevOps role or similar position. Proven expertise in AWS services and infrastructure management. Strong proficiency in Terraform for infrastructure as code. Experience with big data technologies and managing large datasets. Solid knowledge of PostgreSQL database administration. Proficient in Python scripting and automation. Excellent problem-solving skills and more »

Job summary Looking for a game-changing role in healthcare data? Dartford and Gravesham NHS Trust is on the hunt for a Data Warehouse Manager to help us revolutionize our business intelligence service. This isn't your run-of-the-mill data job. We're talking about … being part of a major transformation that'll support the Trust's strategic goals and lead us towards a data-rich future. You'll be the driving force behind our data warehousing services, developing our infrastructure and architecture for the digital age. Data and Business Intelligence transformation … is a key enabler at the heart of our 2030 strategic goals. We are dead set on becoming a truly data-driven organization, and that's where you come in. We need a forward-thinking data whiz with advanced SQL expertise, a knack for data architecture, and more »

Data Scientist Location: Darlington, Durham (Hybrid) Salary: £30k - £40k + Excellent Benefits Working Hours: 35 per week The Client: Our client is a renowned supplier of computerised systems for managing dangerous goods in sea transport, supporting global entities in shipping, distribution, warehouses, ports, and regulatory bodies. The Role: As … Data Scientist, you will analyse large, complex datasets to uncover patterns, trends, and correlations. Responsibilities: Apply statistical techniques to clean, preprocess, and transform raw data. Conduct exploratory data analysis to reveal insights and extract key features. Develop and deploy advanced machine learning algorithms and statistical models for business … Refine models to enhance accuracy, efficiency, and scalability. Collaborate with cross-functional teams to define and monitor key performance indicators (KPIs). Partner with data engineers, business analysts, and product managers to identify data needs and align on project goals. Requirements: Previously worked as a Data Scientist more »

Please Apply! Team Lead Lead Developer Golang GoLang Go Lang Rust Golang Nginx SQL (MySQL) Linux Version control Git Solr Docker Javascript JQuery Google Big Query Big data Google Big Data Java Developer Software Engineer Software developer Fully remote wfh more »

AWS Data Architect About the Job We have an excellent opportunity for an experienced AWS Data Architect to join our AWS services team and play a key role in supporting our continued growth plans. These plans aim to solidify our position as a leading global Services partner with … implementation engagements, as well as providing pre-sales qualification and design to consultancy engagements. What you can expect to be doing as an AWS Data Architect: Technically manage the assessment, design, and implementation of solutions Undertake individual consultancy assignments or work on a project as part of a larger … team analysing customer requirements, gathering and analysing data and recommending solutions. Design and implement scalable, secure, and high-performance data architectures on AWS. Prepare and deliver technical presentations and demonstrations to potential clients. Develop proof of concepts (POCs) to showcase the capabilities of proposed solutions. Develop data more »