26 to 50 of 97 Big Data Jobs with Hybrid or WFH Options

As a Java developer, you will be working in a small focused team using some of the latest technologies to create large sets of data, which can be efficiently processed to provide actionable intelligence. • Candidates will be working with Big Data, innovative security and threat detection systems more »

light, heat and mobility to millions of people, every day. We are one of the very few companies equipped to solve some of the big complex challenges that matter for the future. We have a real contribution to make to the world's ambition of a low carbon future. … sooner, and to help the world get to net zero. Critical to achieving bp’s digital ambitions is the delivery of our high value data and analytics initiatives, and the enablement of the technologies and platforms that will support those objectives. We are developing deep data capability to … transform the access, supply, control and quality to our vast and ever-growing reserves of data. We are looking for an outstanding Principal Data Engineer who will drive the development of our data modelling and data contextualisation capabilities. These use cases would drive significant operational efficiency, safety more »

Job Title - Data Engineer Entity - Aventum Reports to - Head of Data Location - London/Hybrid Who We Are At The Aventum Group, we’re not one for following the usual rules. We work hard at being different and that very much extends to how we look after our … people. Because for us, they’re not just people. They’re part of the family. A family that dreams big and always works together to make insurance better. For everyone. We offer our employees a unique benefits package that includes personal training sessions, well-being provisions, and an additional … employees to advance their careers at Aventum. Role Summary You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so that Aventum more »

light, heat and mobility to millions of people, every day. We are one of the very few companies equipped to solve some of the big complex challenges that matter for the future. We have a real contribution to make to the world's ambition of a low carbon future. … sooner, and to help the world get to net zero. Critical to achieving bp’s digital ambitions is the delivery of our high value data and analytics initiatives, and the enablement of the technologies and platforms that will support those objectives. We are developing deep data capability to … vast and ever-growing reserves of data. We are looking for an outstanding Principal Machine Learning Engineer who will drive the development of our data modelling and data contextualisation capabilities. These use cases would drive significant operational efficiency, safety and environmental aims that are key to the transformation more »

Find your magic with us Connecting people to their family stories is special. We’re proud to deliver these magic moments. Through technology, data and insights, we bring people closer to their past, to benefit their future. We’re a fast-growing team of smart people, on a mission … Enjoy the agility of a scale-up with the security of real financial backing, in a place where every story matters. Why join our Data Science and Insights team? We’re driven by the desire to create a fantastic customer experience We love nothing more than taking big data and extracting as much insight as possible We’re naturally collaborative and work closely with every other team within the company We’re neatly set up for flexible working and giving people the freedom to thrive. We’re a supportive bunch and actively attend conferences, have discussion more »

Job Description: Lead Data Engineer Location: Central London (Hybrid: 2 days per week onsite.) £600-£700 Outside Company Description: My Client is a leading financial organisation committed to leveraging cutting-edge technology and data-driven insights to empower stakeholders and drive innovation within the industry. As they continue … to expand their data capabilities, they are seeking a skilled Lead Data Engineer to spearhead the development and implementation of their data platform whilst also advising and consulting on legacy data migrations from on-prem to the cloud to increase carbon neutrality. Role Overview: As a … Lead Data Engineer, you will play a pivotal role in designing, building, and maintaining their data infrastructure while collaborating closely with senior stakeholders across the organisation. Your expertise in Azure, Databricks, Spark, Python, and data modelling will be critical in driving the success of their data more »

Senior Data Engineer- Fast growing SaaS Scale up 🚀 West Midlands- hybrid working Up to £86K base with bonus and benefits The client SaaS Software business platform which is revolutionising financial management for their customers. Responsibility: Working to ensure a high-quality data platform. Design, develop, test, and deploy … data pipelines and integrations using IPaaS technology Collaborate on engineering platform ingestion, orchestration, data warehouse/data lake and API strategies for the data management ecosystem Willingness and an enthusiastic attitude to work within existing processes/methodologies. Collaborate with the DevOps team to provide high … availability data solutions that scale geographically. Big data processing - Expertise in processing enterprise-scale volumes of data, ideally with proficiency in Snowflake. Experience Data Stores - Technical excellence in SQL, NoSQL, Blob,Delta Lake, and other enterprise scale data stores. Data Orchestration - Enterprise scale more »

design a comprehensive plan for implementation. Responsibilities: Collaborate with stakeholders to understand business requirements and translate them into effective solution designs for our party data model data platform. Architect and implement cloud-based solutions that leverage popular data platforms to enable efficient storage, processing, and analysis of … large-scale data. Design scalable and resilient architectures that ensure high availability, fault tolerance, and disaster recovery for our data platform. Assess and select appropriate data platforms and technologies based on functional and non-functional requirements, considering factors such as performance, scalability, security, and cost-effectiveness. Provide guidance … accurate implementation of the solution design. Required Skills: Proven experience as a Solution Architect, designing and implementing cloud-based solutions. Strong knowledge of popular data platforms such as Amazon Web Services (AWS) (e.g., S3, RDS, Redshift, Athena), Microsoft Azure (e.g., Blob Storage, SQL Database, Data Lake Analytics), or more »

Lead Data Scientist | £85-95k | Gambling | Hybrid Leeds or Newcastle If you're a Lead Data Scientist who wants to work for one of THE best and fastest growing Data functions in this sector then you'll want to check this out... About the business 🚀 G.Digital … players safe, grown from 10 to over 400 employees and expanded into a handful of countries and now they're looking to building a data science capacity to deliver high-impact work around the UK and Europe! Why did we choose to work with them? ✅ Investing heavily in their … Tech and Product teams ✅ Remote first and great work life balance ✅ Brand new Data Science practice ✅ Working on a number of new Greenfield projects ✅ Big on L&D About the role 👩‍💻 The Head of Data has been building appetite and use cases for Data Science and more »

.net with our leading edge technology stack to develop solutions for clients and core product functionality to incorporate into “Horizon” our fast growing customer data platform CDP product. Carry out problem solving assignments to work out how to solve problems with your technical knowledge. Key Responsibilities Key tasks will … supporting colleagues and co-workers Estimation of work You will deal with a broad stack of cutting edge technology and gain invaluable experience with “big-data”. Our technology stack includes Kafka/Kubernetes/Docker/Clickhouse/Git/Devops Languages we use include C#/… React/Javascript/Typescript/SQL Experience & Qualities The ideal candidate is broadly based and would want their work to include big and complex backend work, but might also have some experience with frontend too. Keen to learn new subjects and keen to keep up to date with more »

We are currently recruiting for one of our trusted clients who are look for a Data Engineer. Join our client, a leading player in the pet health services and insurance industry, as they aim to secure the coveted position of the UK's #1 Pet Insurer. Our client is … You Can Expect Type – Permanent Location – Borehamwood (Hybrid model – once a week in the office) Industry – Insurance Salary - £80,000 Main Responsibilities as a Data Engineer Establish and oversee the creation of new data storage systems, managing both unstructured and semi-structured data. Monitor and enforce the use … of our Azure platform to ensure that users adhere to agreed-upon processes and practices for code, data, and model governance. Deploy policies and quotas to optimize the usage and spending on the Azure platform and its instances. Maintain and provide support for our Azure platform for Machine Learning more »

Leading ecommerce client now requires a Data Engineer to join their innovative Machine Learning team. This role will focus on increasing overall data efficiency using Machine Leaning, streamlining data processes to increase overall profitability, and ensuring our clients operations and customer teams can increase overall value. They … with strong exposure to Machine learning principles/practices and technologies such as ML flow/Sage Maker. The role: Develop robust and scalable data pipelines. Collaborate with cross-functional teams to develop and deploy Machine Learning models and algorithms to solve business challenges and create opportunities. Contribute to … the development of our clients in-house Machine Learning operations framework. Support the data science and analytics team in deploying pipelines. Coach and mentor the team to improve development standards. Key requirements: Strong hands-on experience with Databricks, Spark, SQL or Scala. Proven experience designing and building data more »

Data Engineer • Location : Belfast based – Hybrid - flexible working • Salary : £32,5000 - £40,000 • Package: 10% bonus + 11% pension Overview One of the UK’s leading digital solution provider’s is searching for a Data Engineer to join their practice in Belfast and work on developing cutting-edge … start-ups wanting to scale at pace or some of the world’s biggest household names across the public and private sector. For the Data Engineer, this is an excellent opportunity to get experience working in a diverse role for one of the leading technology-orientated organisations with an … projects, learning resources, free cloud certifications and more. Role requirements • Experience with Python, Spark, or Py-Spark • Experience with SQL for databases • Experience developing Data/ETL pipelines • Knowledge of AWS cloud, Azure or GCP (Commercially or in free-time) • Big Data or Machine learning would be more »

Hawksworth are now searching for a Senior to Lead Data Scientist to join a large global insurance company that is investing heavily in its Data Science capabilities. As a result they're now looking to hire multiple Data Scientists to join them in their offices in Guildford. … They're looking for people that are comfortable with terms like; Statistical Models, Computer Vision, Predictive Analytics, Data Visualization, Large Language Models (LLM), NLP, AI, Machine Learning, MLOPs, Python, Pyspark, and Azure. Flexible Working : The role is 60% work from home Sponsorship : Sadly sponsorship isn't available for these … roles. About You: Bachelors Degree in Data Science, Mathematics, Economics or similar 4+ years working experience working in the world of Data Science You're more than capable with SQL & Python You have exposure to big data technologies such as Spark Ideally you will have experience more »

Senior Data Engineer • Location: Belfast based – Hybrid - flexible working • Salary : £50,000 - £60,000 • Package : 10% bonus + 11% pension Overview One of the UK’s leading digital solution provider’s is searching for a Senior Data Engineer to join their practice in Belfast and work on developing … ups wanting to scale at pace or some of the world’s biggest household names across the public and private sector. For the Senior Data Engineer, this is an excellent opportunity to get experience working in a diverse role for one of the leading technology-orientated organisations with an … and more. Role requirements • 5+ years Experience with Python, Spark, or Py-Spark • 5+ years experience Experience with SQL for databases • Extensive experience developing Data/ETL pipelines • Hands on commercial experience with AWS, Azure or GCP (preferably AWS) • Big Data or Machine learning would be nice. more »

we? We’re one of the UK’s largest media companies and we’re looking for a Senior Machine Learning Scientist to join our Data Science team who are working on modelling business problems including, our next generation of intelligent pricing, marketing, customer engagement tools. Building predictive and personalization … a strong statistical analysis/mathematical background with experience in applying solutions to real world problems. You’ll be able to identify opportunities in data, have experience reviewing code for junior colleagues, worked with Data Engineering, Machine Learning and non technical stakeholders. You’ll be comfortable assessing and … determining how to optimize processes. What skills should I have? As our Senior Data Scientist you will have: least 4 years experience in Statistics and Machine Learning with Python Machine Learning libraries (NumPy, Pandas, SKLearn etc) least 3 years Python programming experience applying models to Big Data more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

Who we are: At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in fair and equitable way. With over … about managing AWS accounts and infrastructure to host our systems for LLM-inference, including advanced RAG. To this end you will collaborate tightly with Data Scientists, Machine Learning, Big Data, and Software Engineers in a Scrum environment. You can support streamlining deployment and establish best practices in … of elevating processes and standards, we'd love to hear from you! Your skills and qualifications: 5+ years of experience in DevOps, Cloud Operations, Data Engineering, or a related field, with a strong team player mindset and a sense of ownership High proficiency in AWS administration, IaC (Terraform), CI more »

Azure Synapse Data Engineer - £75K - Remote (London) My client a market leading provider grants clients access to bespoke data insights and analytics specific to their needs, providing research, data and expertise to support clients and all lines of business (Advisory, Digital, Search). They are an innovation … a focus on delivering deep insights to clients, working collaboratively with our colleagues across the business. We are looking for an experienced Azure Synapse Data Engineer with exceptional technical, analytical, communication and project management skills to join our team of data and analytics experts, helping organize and leverage … arguably the richest, broadest data available on work and people, and support the build-out of a scalable, distributed data estate and supporting applications. The role will help us leverage critical data assets, set up data pipelines, transform data, and enable our data scientists more »

We are a team of passionate engineers committed to building the best-in-class petabyte-scale data infrastructure optimization platform that combines hardware acceleration with performance metering to enable real-time actionable insights for reducing data center costs. So far, we have raised a total of $3.5M in … CPU Compiler Engineer, you will collaborate with the founding team to improve and expand the core engine that we are building that massively accelerates Big Data pipelines. Your contributions to our core solution will directly impact data infrastructure processing 10s of petabytes every day where Xonai is … being deployed. Join us in building a cutting edge solution for the cloud to realize cost-effective data infrastructure at scale and with unparalleled flexibility. What you will do: Optimize code generation for executing JIT-compiled code on CPUs (Arm and x86 architectures). Diversify compiler optimizations based on more »

My client are looking for a talented and motivated Big Data Architect (Azure, Databricks, Spark) to be based in their London office. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives, as they provide increasing … skills/experience is essential: Strong implementation experience using Spark and Databricks Strong Cloud experience (ideally Azure) Previously heavily involved in an implementation programme Data Warehouse Strong stakeholder management experience Excellent IT background, ideally within Telco/Wireless service providers but not essential Salary: Excellent + bonus + package more »

The driving force behind Big Data at Mimecast: Dive into the forefront of innovation with our Data Platform engineering team, where we process massive volumes of data to delight our customers with insights they love! Our pioneering Data Platform pushes on the boundaries of what … s possible, leveraging the latest technologies and tooling in AWS. Why Join Our Team? “If you’re interested in solving customer data challenges at immense scale, the Data Platform team is for you. Our AWS services process billions of events from millions of users each day. With efficient … storage and querying capabilities, we’re able to serve requests in milliseconds when querying over huge volumes of data!” – Hiring Manager What You’ll Do: As a Senior Software Engineer in the Data Platform team, you will play a pivotal role in designing, developing, and maintaining scalable systems. more »