101 to 125 of 195 Data Pipeline Jobs in London

Leading ecommerce client are now searching for a Senior Data Engineer to contribute towards the delivery of their data strategy. This engineer will shape our client’s data function, delivering end to end solutions for an array of customer data projects. The … role: Designing data pipelines, managing data warehouses, and implementing complex ETL processes. Work closely with data scientists, analysts, and stakeholders to optimise our client’s infrastructure. Optimise data driven products, personalisation, reporting and overall business success. Manage the whole data lifecycle (End to End). Ensure the reliability and quality of data. Key Requirements: Strong experience designing data pipelines/warehouses using AWS and Snowflake. Exposure to big data technologies such as Kafka, Spark, or Hadoop. Solid experience with Snowflake, including performance optimisation and more »

infrastructure investments. Be part of a dynamic team driving growth and maximizing value in the alternative asset management industry. Key Responsibilities: Support the Data Team Lead in system updates. Develop, modify, and maintain software components. Resolve data/software issues and suggest technical solutions. Collaborate with … peer reviews and offer technical guidance. Identify process improvements and adhere to IT policies. Essential Technical Skills: 2-3 years' experience in Azure data systems. Proficiency in Data Warehouse technologies and SQL. Familiarity with Azure services like Data Lake and Data Factory. … Essential Experience: Supporting traditional Data Warehouses. Building Azure data pipelines and data lakes. Agile development experience. Strong problem-solving skills. Awareness of industry trends and stakeholder interaction. Desired Experience: Familiarity with Business Objects Reporting and Power BI. more »

Are you an experienced Senior Data Engineer ? Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ? Its a Hybrid working role and you will be based from either their London, Leeds, Manchester or Edinburgh office, typically 3 days … site. Preferred skills: Experience with Azure and Databricks Proficiency in SQL and/or similar data technologies Familiarity with data pipeline tools and ETL processes Knowledge of cloud platforms and data architecture Experience working in the Retail Banking sector or financial services would more »

We are seeking a qualified Data Engineer to join our team, where your responsibilities will include: Designing, optimizing, and maintaining scalable data pipelines and ETL processes using Spark, ensuring streamlined data processing and integration. Collaborating cross-functionally to translate complex data requirements … into actionable technical solutions that drive business objectives. Leveraging Microsoft Azure and Databricks to architect robust data solutions, prioritizing performance optimization for enhanced operational efficiency. Conducting data modeling, profiling, and quality assessments to uphold the integrity and reliability of our data assets. Executing data governance, transformation, and integration initiatives to support advanced analytics and reporting requirements. Integrating machine learning models seamlessly into data pipelines to facilitate predictive and prescriptive analytics. Ensuring adherence to data security protocols and regulatory compliance standards, maintaining the highest levels of database integrity and more »

Amazon well architected frameworks, serverless solutions and improving existing platforms using AWS technologies with Agile delivery methods Demonstrable experience of Python 3, Python data management/… manipulation libraries and usage of Python with AWS components Demonstrable experience working in the Data domain, covering the full data pipeline from ingestion, mastering, management and consumption/distribution of large datasets Financial Services expertise preferred working with Equity and Fixed Income asset classes and … a working knowledge of Indices Experience with No-SQL and Relational databases and data analysis using SQL. Enter key behaviours and skills required to be successful in the role: Education & Work experience: 7+ years of AWS and Python development engineer experience within the Financial Services and Data more »

Job Title: Data Engineer Job Type: Permanent Location: London or Fully remote Salary: £50,000-£70,000 (Dependant on experience) + Bonus + Benefits Skills: Python, SQL, Posgress SQL, Snowflake, Powershell Roc Search`s client provides real-time decisions and active risk monitoring to enable their customers to … maximize profitability while managing risk. their solutions are continually adapting to changing market conditions. They 20+ years of retail data science expertise and experience. They work with a global base of leading commerce partners, representing a big proportion of all US omnichannel retail sales activity across hundreds of … to operations, finance, marketing, and loss prevention. Their performance-improvement solutions yield measurable results with significant return on investment. About the role The Data Engineer will be part of a team that follows DataOps best practices and owns the standardized data assets and the processes around more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Eames Consulting are delighted to be supporting an established Investment management company that are looking for a Data engineer. Responsibilities: Develop and maintain complex SQL queries, customize reports, and optimize data usage. Create tools to address business challenges and empower users with third-party tools. Design … and implement cloud-based data platforms, ETL pipelines, and data integration. Collaborate with colleagues to ensure data integrity, quality, and security standards are met. Experience required: 3 years experience working as a Data engineer or similar Strong proficiency in SQL or Data Bricks and database development, including complex query optimization and performance tuning. Comfortable using programming languages such as Python Strong Data Warehousing experience - building data pipelines from scratch Good understanding of open source, big data, and cloud data platforms (e.g. AWS more »

analytics to the global capital and commodity markets. As a Python Developer you will play a pivotal role in developing and maintaining advanced data processing and analysis solutions. You will collaborate closely with cross-functional teams to design, implement, and optimize Python-based applications, with a particular emphasis … on utilizing Airflow and also pandas for efficient data manipulation and analytics. This role offers an exciting opportunity to contribute to the transformation of their business through the application of innovative technologies. Responsibilities: Develop robust, scalable, and maintainable Python applications tailored to the needs of our insurance operations. … Collaborate with data engineers, data scientists, and business analysts to understand requirements and translate them into technical solutions. Working with Product team to integrate financial products of external clients, manage data flows, source market data and analyse financial algorithms. Utilize Pandas for more »

digital avatars and human clones. Role: MLOps Engineer Location: London Salary: Up to £100,000 Responsibilities: Develop ML Pipelines: Build and maintain scalable data processing systems. Ensure data quality and integrity. Automate ML Processes: Integrate machine learning solutions into existing systems and automate workflows. Deploy and … implementation practices. Ensure Security: Adhere to security and compliance standards in ML deployments. Requirements: Education: Bachelor’s or Master’s in Computer Science, Data Science, or related field. Experience: 2-3 years in ML, data engineering, or MLOps. Abilities: Strong analytical, problem-solving … and communication skills. Skills: Proficient in Python, ML frameworks like TensorFlow or PyTorch. Experienced with CI/CD, Docker, Kubernetes, and data pipeline tools like Airflow. more »

Data Engineer Location: London, UK Hybrid: 3x a week in office Salary: £63,000 About the Client Our client is a top-tier professional services firm known for its exceptional workplace culture and some of the most sought-after office spaces in London. Role Overview Our client is … in search of a skilled Data Engineer to manage and engineer the data warehouse. The opportunity will be amazing for a Data Engineer who is happy to work in a small team. Incredible opportunity to mentor/lead a small Data Engineering … team within a year! Main Responsibilities Build scalable data pipelines on a daily basis Code on a daily basis with Azure SQL and python Develop and maintain the logical and technical architecture to fulfil the client’s information, insights, and reporting needs. Stay informed on the latest developments more »

Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security … policies. Essential Technical Skills 2-3 years Azure data systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. … Building Azure data pipelines. Agile methodology experience. Problem-solving skills. Awareness of industry trends. Stakeholder engagement. Desired Experience Business Objects Reporting. Power BI familiarity. more »

Exciting Opportunity Alert! 🌟 Are you an experienced Data Engineer with a knack for driving innovation in healthcare? We have an incredible opportunity for you to join a leading pharmaceutical Data Management company as a Senior Data Engineer! Our client, a trailblazer in pharmaceutical data management, is seeking a talented Senior Data Engineer to join their dynamic team. In this role, you'll play a pivotal part in shaping the future of healthcare by leveraging cutting-edge technologies like Azure SQL Databases, Azure Data Factory, Power BI, GitLab, and … Alteryx, and collaborating with top-notch professionals. Key Responsibilities: Design, develop, and maintain scalable data pipelines using Azure Data Factory to process large volumes of pharmaceutical data. Implement data integration strategies leveraging Azure SQL Databases to ensure data quality and consistency across more »

Omni client solutions. These solutions are major differentiators that puts Omnicom ahead of the competition. Specific responsibilities of the team are listed below. Data Taxonomies design & maintenance Data Governance and QA Dashboard design, build and maintenance Data Pipelines design & delivery TW/Planit (& TrackIT … for maintaining and improving tables and business logic for a reporting platform. The Business Intelligence Manager will support an MI Director with all data operations and reporting workstreams for one of Omnicom’s largest global autotive clients and work closely with our engineering team; TSOC. This role will … ensure our AWS data infrastructure is supporting a best-in-class reporting platform for one our our largest accounts within Omnicom Media Group, and will be reporting into the Senior Marketing Intelligence and Reporting Director. Communication skills and the ability to prioritize tasks across projects to meet deadlines more »

Client: A global financial services company About the Role: We are seeking a talented Principal Data Engineer to join our team in London. As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring scalability, reliability … and efficiency. Key Responsibilities: Design, develop, and maintain scalable data pipelines using BigQuery, Python, and CloudRun. Collaborate with data scientists and analysts to understand business requirements and translate them into technical solutions. Implement best practices for data modeling, ETL processes, and data governance. Optimize and fine-tune data processes to improve performance and reliability. Stay up-to-date with the latest technologies and trends in data engineering and recommend innovative solutions to enhance our data infrastructure. Required Skills: Strong proficiency in BigQuery, Python, and more »

This innovative Multi-Strategy Hedge Fund, seek an experienced Software Engineer with expertise in Python to work within a dynamic Data Engineering Group building greenfield pipelines, frameworks, APIs and core Data store (Data warehouse and Data Lake) to enable the ingestion and … teams firmwide (X-Asset - Equities, Rates, Commodities, FX and Crypto). Key Skills required 3+ years of exp. as a Software Developer/Data Engineer with Python as your core language Extensive API and Microservices development experience 3+ years SQL Strong DB skills ideally in both SQL and more »

A new opportunity has risen for a Data and Insights Manager to join our D2C team. The Data and Insights team is a small but dynamic and experienced group of SMEs who work across Google Analytics, Bloomreach CDP and BI/data engineering. The … and segmented approach to every customer touchpoint to empower our customers to reach their financial goals. Plus, we know the best decisions are data-driven so we give our senior management team the best business intelligence data at their fingertips. Were looking for an experienced, driven … be responsible for managing the day-to-day work of the team, working with the team to triage incoming requests, gather requirements for data tasks (whether that be dashboards, new functionality, analysis pieces or tracking requests) and manage the teams backlog on JIRA. Youll take on running sprint more »

Job Overview: We are seeking a skilled Data Analyst to help drive business insights and strategy through analysis of large data sets. The Data Analyst will work cross-functionally to collect, structure, analyze, interpret, and clearly present data findings that inform business … decisions across the organization. Responsibilities: Consult with key business stakeholders to understand questions and problems Data can help solve Design and implement processes for collecting structured and unstructured data from a variety of internal systems and external sources Organize, cleanse, and validate raw data to prepare for analysis Perform exploratory analysis to uncover patterns, anomalies, and relationships in data using statistical modeling and data visualization tools Develop insightful reports, presentations, and dashboards to concisely summarize analysis and effectively communicate findings Make recommendations for business process optimizations supported by more »

As people increasingly move across channels and platforms, Kantar Media’s data and audience measurement, targeting, analytics and advertising intelligence services unlock insights to inform powerful decision-making. Working with panel and first-party data in over 80 countries, we have the world’s fastest growing … East, Asia Pacific, North America, and Africa to understand audiences and help the world’s leading organisations succeed and grow. Job Title: Senior Data Scientist Location: London, Grays Inn Road Salary: Competitive Full time/Permanent Kantar is the leader in providing audience and advertising measurement tools and … the forefront of technological developments in audience measurement in the media industry, working with broadcasters and advertisers, media agencies and industry committees. The data science team provides research and technical expertise, support, oversight, and methodological development to our global operating services and sits within the Global Product team. more »

Business Development Manager - Data Solutions Stride Recruitment is working with a leading data consultancy focused on delivering Data & Analytics Solutions for clients in markets such as; Financial Services, Retail, CPG, and Telco. They specialise in the delivery of Modern Data Solutions for … firms in their chosen target markets. Using innovative technologies, they deliver data pipelines, cloud data architectures, advanced analytical and AI/ML solutions. We are looking for ambitious and self-motivated sales professional with a passion for helping customers achieve more with Data, Analytics … Demonstrated ability in negotiating high-value contracts with a track record of successful deal closures. Analytical Mindset: Strong analytical skills to understand complex data environments and articulate the value proposition of our solutions effectively. Technological Proficiency: Familiarity with the latest trends in data analytics, machine learning more »

Data Engineering Manager London (1 day per week in office) £90,000 - £105,000 Salary + Benefits Xcede are excited to be partnered with a major publishing company in looking for a Data Engineering Manager. The succesful candidate will be required to lead a team of … on-shore and off-shore Data Engineers whilst remaining hands on. The tech stack is Azure/Databricks, however they are cloud agnostic so will consider candidates from any cloud background. Key skills/experience: Degree in a STEM subject or equivalent Prior experience as a Data Engineering Manager or Lead Data Engineer Excellent python coding skills Strong experience building ETL/ELT Data pipelines Experience working with cloud providers (Azure preferred but will consider AWS/GCP) Excellent strategical approach Excellent stakeholder management skills Excellent people management skills (prefereably with more »

A global company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team based in their London office – this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It’s a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having recently launched a brand-new Azure Data Platform and introduced the use of Databricks. The role is predominantly back-end Data Engineering focused, where you’ll develop … various solutions for data collection, integration, transformation and modelling, to support the ongoing development of their global data platform. This will include developing data pipelines, to automate data collection and integration across various sources, with the use of Azure Data more »

Graduate Data Engineer - Fast Growing FinTech A very fast scaling FinTech in London are looking for a talented Data Engineer to join their team. In this role as a Data Engineer you’ll work with extremely high calibre engineers and hit the ground running … with where you have the most experience and then gaining exposure to the rest of their services to build out your expertise. Graduate Data Engineer - About You On track for a First from a Top Russel Group University Self-starter who thrives in challenging environments A background in … a relevant field (Computer Science, Physics, Mathematics) with Software internships or projects Demonstrable experience in Python and SQL Data Engineer Desirable Qualities: Ability to communicate effectively to technical and non technical people Nice to haves includes: Kubernetes, Docker, BigQuery, Cloud, Databases Interest in FinTech Data Engineer more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI more »

EU. We are looking for a Sr. DSP Insights Manager who is ready to roll up their sleeves and help us develop actionable, data-driven insights, using various quantitative tools and core project management skills. Key job responsibilities Core responsibilities include : Managing our organizations AWS account, including a … data warehouse in Redshift. Manage permissions structure by eg administrating IAM settings. Owning reporting for strategic roadmaps by working with business leaders; driving expansion and optimization of new business units in our DSP program. Developing and maintaining performance dashboards with key metrics for review with senior leadership and … business teams; synthesizing large quantities of data to help create new, step-change initiatives for the organization. Onboarding data to our data warehouse by building automated data pipelines utilizing eg Python in Lambda or Sagemaker to invoke API calls. Using statistical techniques more »