76 to 100 of 338 Big Data Jobs in London

We are seeking a specialist Kotlin Developer with experience working on Big Data projects in a high-performance environment. We're working with banks and other major financial institutions on projects where microseconds count. Essential functions You will build and maintain Kotlin applications in areas of banking and … trading that require working with large amounts of data (1TB), high concurrency, and distributed caching. Build and maintain testing and benchmarking code. Qualifications What we are looking for in a candidate: Proven track record in Big Data projects developing in Kotlin or any other JVM language. Experience … with any of the following: Oracle, Kubernetes/Openshift, Redis, Memcached. Experience with Big Data technologies like Hadoop, Cassandra, Hive. We offer Opportunity to work on cutting-edge projects. Work with a highly motivated and dedicated team. Competitive daily rate. Benefits package including medical insurance and sports activities. More ❯

Data Engineer (Python Spark ETL) London/WFH to £90k Are you a tech savvy Data Engineer keen to make an impact, delivering Greenfield systems? You could be progressing your career at a successful and growing Cyber Security Risk Management tech company that specialises in solutions for SME … s, working on complex and interesting systems at the cutting edge of technology. The company is scaling and enjoying great success. As a Data Engineer you'll be instrumental in building and scaling the data infrastructure to support advanced data aggregation, storage and analytics capabilities as the … company enters a phase of data maturity, holding data from hundreds of thousands of organisations since they were established seven years ago. You'll take ownership of building a new Data Lake from scratch using a range of modern tools and technologies, primarily Python and Spark in More ❯

hiring landscape and make a meaningful difference in people's lives. Together, we can solve the world's toughest hiring problems. Within ITA, the Data team delivers high-quality recruiting data, reusable tools, and analytics reporting to Amazon Talent Acquisition customers. The Data team is the engine … hiring decisions a million times over. Focused on building scalable long term solutions, the team empowers engineers and consumers to develop, access, and analyze data independently with a high degree of data privacy and integrity. As a member of the Data team, you will deliver robust data … drive fair and efficient hiring and rapidly evolve with the needs of the business. Key job responsibilities Develop and maintain end to end scalable data infrastructure and data pipelines. Work closely with business owners, developers, Business Intelligence Engineers to explore new data sources and deliver the data. More ❯

decisions so people can focus more on the positive aspects of life, rather than the stresses associated with managing money. Responsibilities As Head of Data , you will lead the development and implementation of the company’s data strategy. You’ll be responsible for ensuring stakeholders have access to … accurate and timely data, working closely with a Data Product Owner to align data initiatives with business objectives. Define and communicate the organization’s data strategy, ensuring alignment with key functions such as risk, finance, product, and customer service. Promote data literacy across the organization … by enabling self-service capabilities for non-technical teams. Lead the design and rollout of a scalable data warehouse to support analytics and reporting. Translate business requirements into technical solutions in partnership with the Data Product Owner. Influence the evolution of the loan management system to reflect data More ❯

AWS Data Engineer (Must hold current SC) The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all colleagues … delivery times. Our team consists of highly-skilled cross-functional consultants, analysts, and support staff. Overview: We are looking for a highly skilled AWS Data Engineer to join our team. The ideal candidate will have expertise in designing, building, and managing scalable data pipelines on AWS. You will … work closely with data scientists, analysts, and software engineers to implement efficient data solutions that support business intelligence and analytics needs. Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines using AWS services such as AWS Glue, Lambda, Step Functions, and Kinesis. Work with structured and unstructured More ❯

volunteering - you'll find like-minded people driving change at Howden. Quality Engineer Position Quality Engineer to ensure the quality, reliability, and robustness of data engineering and platform engineering pipelines within the Group Data Platform . Summary of the Role Howden Group Services is expanding its Group Data Platform team and is looking for a Quality Engineer to support data quality assurance, test automation, and validation frameworks across data engineering and platform engineering teams. The ideal candidate will have experience in testing data pipelines, automation frameworks, and CI/CD practices , with a focus … on ensuring data integrity, accuracy, and reliability . This role requires an analytical and detail-oriented individual who can work closely with engineers to embed quality-first principles , ensuring that data pipelines and platform components are thoroughly tested and meet business requirements . The successful candidate will help More ❯

A rapid growth gaming firm have created a new role for a Head of Data Engineering. The Head of Data Engineering will work in a Data Rich Testing environment, and be will be tasked with building their own team to help deploy cutting edge Machine Learning techniques … in a number of different areas of the company. Reporting into the Head of Data Science & working closely with the CTO and Software Engineering team, the Head of Data Engineering in the first 18 months will also be responsible for: Building the Companies Big Data Lake … Pushing out various cutting edge Data Science Models Infrastructure Management around the huge Volumes of Data being collected This role would suit an ambitious Data Engineer coming from a background of either working in a fast growth scale up company, or someone who has worked within a More ❯

investment bank with a long-standing reputation for excellence, innovation, and client service. With a strong presence in London, are looking to expanding there data engineering capabilities to support critical business functions, regulatory reporting, and data-driven decision-making. Role Overview They are seeking a highly skilled Senior … AWS Data Engineer to join the London-based data platform team. You will play a key role in building and optimizing scalable, secure, and high-performance data pipelines and infrastructure on AWS. This is a great opportunity to work in a fast-paced, high-impact environment where … technology drives the business. Key Responsibilities Design, build, and maintain robust data pipelines using AWS native services (Glue, Lambda, Step Functions, S3, etc.) Develop and optimize data lake and data warehouse solutions using Redshift, Athena, and related technologies Collaborate with data scientists, analysts, and business stakeholders More ❯

investment bank with a long-standing reputation for excellence, innovation, and client service. With a strong presence in London, are looking to expanding there data engineering capabilities to support critical business functions, regulatory reporting, and data-driven decision-making. Role Overview They are seeking a highly skilled Senior … AWS Data Engineer to join the London-based data platform team. You will play a key role in building and optimizing scalable, secure, and high-performance data pipelines and infrastructure on AWS. This is a great opportunity to work in a fast-paced, high-impact environment where … technology drives the business. Key Responsibilities Design, build, and maintain robust data pipelines using AWS native services (Glue, Lambda, Step Functions, S3, etc.) Develop and optimize data lake and data warehouse solutions using Redshift, Athena, and related technologies Collaborate with data scientists, analysts, and business stakeholders More ❯

Azure Data Engineer Opportunity - Leading Digital Transformation Project (Remote/Hybrid - UK Based) We are currently partnering with an innovative organisation undergoing a significant digital transformation. As part of this exciting journey, they are looking for a talented Azure Data Engineer to help modernise and streamline their data … playing a pivotal role in the migration to Azure and Microsoft platforms. This is an excellent opportunity for someone passionate about cloud technologies and data integration to join a forward-thinking team, working on high-impact projects with the latest Microsoft stack. Key Responsibilities Data Migration : Lead the … transition from legacy Big Data platforms and code-based ETL processes into Azure , Dataverse , and Dynamics 365 environments. Data Integration : Bring together data from a variety of sources including SaaS platforms and internal systems, ensuring smooth integration and high data quality. Azure Development : Design and More ❯

heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a … of creativity, experimentation, and continuous improvement. You will be an essential part of this mission, using your technical expertise to demonstrate how our Databricks Data Intelligence Platform can help customers solve their complex data challenges. You'll work with a collaborative, customer-focused team that values innovation and … solutions to help our customers achieve their goals and guide their businesses forward. Join us in our quest to change how people work with data and make a better world! Reporting to the Manager, Field Engineering. The impact you will have: Form successful relationships with clients throughout your assigned More ❯

/Performance Analyst to join our high-performing team, focusing on a strategic regional client account. This role will be pivotal in transforming complex data into actionable intelligence, driving performance optimization, and enhancing client value proposition. The ideal candidate will blend advanced analytical skills with business acumen to deliver … insights that shape strategic decisions and operational excellence. Key Responsibilities Advanced Data Analytics and Predictive Modeling Develop and implement sophisticated statistical models and machine learning algorithms to forecast trends, predict outcomes, and identify opportunities for performance enhancement. Utilize advanced analytics techniques such as regression analysis, time series forecasting, and … Develop and maintain a comprehensive performance measurement framework, aligning metrics with client's strategic objectives. Lead root cause analyses for complex performance issues, proposing data-driven solutions. Business Intelligence and Data Visualization Architect and implement end-to-end BI solutions, from data integration to front-end dashboards. More ❯

As a Data Engineer you will be working on building and maintaining complex data pipelines, assemble large and complex datasets to generate business insights and to enable data driven decision making and support the rapidly growing and dynamic business demand for data. You will have an opportunity … to collaborate and work with various teams of Business analysts, Managers, Software Dev Engineers, and Data Engineers to determine how best to design, implement and support solutions. You will be challenged and provided with tremendous growth opportunity in a customer facing, fast paced, agile environment. Key job responsibilities Design … implement and support an analytical data platform solutions for data driven decisions and insights Design data schema and operate internal data warehouses & SQL/NOSQL database systems Work on different data model designs, architecture, implementation, discussions and optimizations Interface with other teams to extract, transform More ❯

heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a … of creativity, experimentation, and continuous improvement. You will be an essential part of this mission, using your technical expertise to demonstrate how our Databricks Data Intelligence Platform can help customers solve their complex data challenges. You'll work with a collaborative, customer-focused team that values innovation and … solutions to help our customers achieve their goals and guide their businesses forward. Join us in our quest to change how people work with data and make a better world! Reporting to Manager, Field Engineering. The impact you will have: Form successful relationships with clients throughout your assigned territory More ❯

cutting-edge ideas, best-in-class products and solutions, and unparalleled access to capital and liquidity. What We do/The Team The FX Data Analytics & AI Technology team, within Citi's FX Technology organization, seeks a highly motivated Full Stack Data Scientist/Data Engineer. The … FX Data Analytics & Gen AI Technology team provides data, analytics, and tools to Citi FX sales and trading globally and is responsible for defining and executing the overall data strategy for FX. The successful candidate will be responsible for developing and implementing data-driven models, and … engineering robust data and analytics pipelines, to unlock actionable insights from our vast amount of global FX data. The role will be instrumental in executing the overall data strategy for FX and will benefit from close interaction with a wide range of stakeholders across sales, trading, and technology. More ❯

We are hiring: Data Scientist Are you an experienced data scientist or modeller, who enjoys problem solving and your idea of a good day is receiving huge amounts of data? This position could be for you . At GEOLYTIX we seek new and innovative ways to make … bespoke solutions. We are always looking to do things better. We have fun and value every member of our team. Are you our next Data Scientist? About You You're already an experienced data scientist or modeller - your idea of a good day is receiving huge amounts of … data and working out how customers are going to behave. You enjoy problem solving, and will be building gravity or machine learning models, for a variety of clients across wide ranging sectors. You want to be original - you don't want to do the same old, same old. You More ❯

Treasure Data: At Treasure Data, we're on a mission to radically simplify how companies use data to create connected customer experiences. Our sophisticated cloud-based customer data platform drives operational efficiency across the enterprise to deliver powerful business outcomes in a way that's safe … flexible, and secure. We are thrilled that Gartner Magic Quadrant has recognized Treasure Data as a Leader in Customer Data Platforms for 2024! It's an honor to be acknowledged for our efforts in advancing the CDP industry with cutting-edge AI and real-time capabilities. View the … report here. Furthermore, Treasure Data employees are enthusiastic, data-driven, and customer-obsessed. We are a team of drivers-self-starters who take initiative, anticipate needs, and proactively jump in to solve problems. Our actions reflect our values of honesty, reliability, openness, and humility. About the Team: Our More ❯

We are hiring: Data Scientist Are you an experienced data scientist or modeller, who enjoys problem solving and your idea of a good day is receiving huge amount of data? This position could be for you . At GEOLYTIX we seek new and innovative ways to make … bespoke solutions. We are always looking to do things better. We have fun and value every member of our team. Are you our next Data Scientist? About You You're already an experienced data scientist or modeller - your idea of a good day is receiving huge amounts of … data and working out how customers are going to behave. You enjoy problem solving, and will be building gravity or machine learning models, for a variety of clients across wide ranging sectors. You want to be original - you don't want to do the same old, same old. You More ❯

person) Contract : 12 months + Start : ASAP Status : Inside IR35 Key Skills: Azure Event Hubs | Kafka | Databricks | Spark | ETL/ELT | CI/CD | Data Governance | Terraform | Key Responsibilities: Evaluate the Cyber Analytics Platform architecture and design the data lake structure. Identify data sources for ingestion and … define a prioritized backlog of processing requirements. Design scalable data pipelines and document ingestion patterns. Provide technical leadership and mentorship to the engineering team. Implement data governance, access controls, and security models. Work with DevOps engineers to ensure CI/CD processes for data workflows. Build cloud … based solutions focusing on high-performance analytics and distributed data processing. Optimize data workflows and pipelines for large-scale data processing (terabytes/billions of events). Design cost-efficient, scalable solutions in the cloud. Ensure data quality, security, and compliance in all pipelines. Perform ongoing More ❯

Data Engineer - Contract £450-£500 per day | Outside IR35 6-Month Initial Contract Predominantly Remote | Occasional Office Visits Required We are working with a fast-growing SaaS organization that plays a key role in providing data-driven solutions across the financial services sector. As part of their mission … to scale impactful products, they are looking to expand their data capabilities and optimize the quality and availability of insights across their platform. This role is crucial for enhancing their current architecture, integrating diverse data sources, and enabling predictive and prescriptive analytics that will directly influence business strategy … and maintain Python-based web crawlers using tools such as Scrapy, BeautifulSoup, or Selenium Implement scalable and reliable web scraping frameworks for high-volume data extraction across websites and social media platforms Perform data cleaning, standardization, and normalization to ensure consistency and quality across all datasets Build and More ❯

My consulting client is looking to bring in a data engineering lead to their expanding AI and Data practice Data Engineering Lead Job Summary The Offering Leader is a senior expert responsible for driving strategic initiatives, providing domain-specific thought leadership, As our Data Engineering Offering … Lead you will play a pivotal role in driving data-driven transformation initiatives for enterprise clients. You will be responsible for leading consulting engagements, architecting scalable data solutions, managing teams, and developing client relationships to accelerate business growth. The ideal candidate will possess deep technical expertise in data engineering, strong business acumen, and a proven track record of delivering enterprise data solutions. Key Responsibilities Business Development & Commercial Leadership: Identify and develop new business opportunities, expanding client relationships and driving revenue growth. Lead sales efforts, proposal development, RFP responses, and contract negotiations. Shape go-to-market strategies More ❯

We are looking for a highly talented and driven Data Engineer who takes pride in their work, to expand our Engineering team in London. Successful candidates will join a cross functional team including product managers and designers working closely with the rest of our business to deliver working code … ensuring that their development aligns with the higher level AlphaSights Engineering strategy, while mentoring more junior Engineers. If you're passionate about solving complex data challenges with code, and enjoy collaborating with talented colleagues in a high-performance environment, this role is a perfect fit for you. What you … ll do: Design solutions: Design, develop, deploy and support data infrastructure, pipelines and architectures, contributing to an architectural vision that will scale up to be the world's leading research platform. Ship working code: Write clean, efficient, and maintainable code that powers data pipelines, workflows, and data More ❯

Title: VP Engineering, Activation WHO WE ARE Choreograph is WPP's global data products and technology company. We're on a mission to transform marketing by building the fastest, most connected data platform that bridges marketing strategy to scaled activation. We work with agencies and clients to transform … the value of data by bringing together technology, data and analytics capabilities. We deliver this through the Open Media Studio, an AI-enabled media and data platform for the next era of advertising. We're endlessly curious. Our team of thinkers, builders, creators and problem solvers are … for the successful technical delivery of many products within the Activation product area, entailing hands-on architecture and guidance for the implementation of our data platforms. Externally, the role is the engineering face of Activation, entailing senior stakeholder relationship management, product positioning and customer adoption. The role demands a More ❯

far-flung places, a job at British Airways is yours to make. We know great things can happen when you're inspired to think big and bring your ambition to work every day, which is why, at British Airways the sky is never the limit. We are looking for … talented Principal Data Engineers with deep technical data platform engineering skills including SQL, AWS, Snowflake, Airflow, Git, and Python. As a Principal Data Engineer, you'll serve as a technical lead overseeing Senior Data Engineers, driving industry best practices to build a world-class data engineering function and providing direction for engineering a modern data platform. You'll lead end-to-end data product development in an Agile environment, contributing to British Airways' renowned service and shaping the future of our business. Your responsibilities will include: Bringing an innovative and creative mindset More ❯

ll help to build and manage services that detect and automate the mitigation of cybersecurity threats across Amazon's infrastructure. You'll work with data scientists, software development engineers, and other security engineers across multiple teams to develop innovative security solutions. Our services protect the AWS cloud for all … role. The team has a mix of experience levels, and we're building an environment that celebrates knowledge sharing and mentorship. Our senior engineers, data scientists, and managers truly enjoy mentoring junior engineers, data scientists, and engineers from non-traditional backgrounds through one-on-one mentoring and thorough … in the context of large organisations. In-depth understanding of security threats, hands-on experience detecting and defending from cyber attacks, and experience using big data analytics and orchestration to address security challenges. Ability to develop code with at least one modern language such as Java, Go, TypeScript More ❯