201 to 225 of 376 Data Pipeline Jobs in the UK

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Amazon Redshift, Amazon EMR, Amazon Athena, Amazon Sagemaker and more. Help our customers to remove the constraints that prevent them from leveraging their data to develop business insights Create white papers, writing blogs, build demos and other reusable collateral that can be used by our customers. Work closely … with our Solution Architects, Data Scientists and Service Engineering teams Experience with design, development and operations that leverages deep knowledge in the use of services like Amazon Kinesis, Apache Kafka, Apache Spark, Amazon Sagemaker, Amazon EMR, NoSQL technologies and other 3rd parties Develop and define key business questions … needs of enterprises Basic understanding of machine learning fundamentals Ability to take Machine Learning models and implement them as part of data pipeline IT platform implementation experience Experience with one or more relevant tools ( Flink, Spark, Sqoop, Flume, Kafka, Amazon Kinesis) Experience developing software code in one more »

Eames Consulting are delighted to be supporting an established Investment management company that are looking for a Data engineer. Responsibilities: Develop and maintain complex SQL queries, customize reports, and optimize data usage. Create tools to address business challenges and empower users with third-party tools. Design … and implement cloud-based data platforms, ETL pipelines, and data integration. Collaborate with colleagues to ensure data integrity, quality, and security standards are met. Experience required: 3 years experience working as a Data engineer or similar Strong proficiency in SQL or Data Bricks and database development, including complex query optimization and performance tuning. Comfortable using programming languages such as Python Strong Data Warehousing experience - building data pipelines from scratch Good understanding of open source, big data, and cloud data platforms (e.g. AWS more »

Data Engineer Birmingham - AWS Hybrid working 1 day every 3 weeks out of their Birmingham City Centre offices. Salary 55-65k plus 10% bonus, 28 days holidays Childcare vouchers, Life Assurance, pension. We are a looking for an experienced Data Engineer to play a pivotal … role in constructing and maintaining data pipelines within a dynamic, Agile environment. This opportunity is based in Birmingham, West Midlands, with a hybrid work model. As a key member of their Data team, you'll be instrumental in translating technical requirements into actionable pipelines, developing solutions … contact us at 0161 438 1178 for more information. Key skills; AWS Data Engineer, AWS Cloud, Python, SQL, AWS, Glue, ETL Pipelines, Data Engineer, Birmingham, West Midlands Follow us on Twitter @erinassociates for updates on similar opportunities. Erin Associates Ltd is an equal opportunity employer. more »

Data Engineer – SAS/SQL/Power BI * Sponsorship is not available with this position * Role – Data Engineer Salary – Up to £75k DOE Location – Manchester or London (Hybrid) A well established and award-winning Data consultancy are looking to add a Senior Data Consultant to join their talented data team. You’ll be at the centre of everything they do as a business, supporting a range of top tier clients. The position is offering a basic salary up to £75,000 depending on experience as well as a discretionary … Flexible working environment Inclusive and friendly culture Private Medical Insurance Buy and Sell additional annual leave Funded Learning and development programmes The Successful Data Engineer will have: Experience in developing and designing data pipelines and ETL processes Previous experience of data warehousing Utilise SAS more »

digital avatars and human clones. Role: MLOps Engineer Location: London Salary: Up to £100,000 Responsibilities: Develop ML Pipelines: Build and maintain scalable data processing systems. Ensure data quality and integrity. Automate ML Processes: Integrate machine learning solutions into existing systems and automate workflows. Deploy and … implementation practices. Ensure Security: Adhere to security and compliance standards in ML deployments. Requirements: Education: Bachelor’s or Master’s in Computer Science, Data Science, or related field. Experience: 2-3 years in ML, data engineering, or MLOps. Abilities: Strong analytical, problem-solving … and communication skills. Skills: Proficient in Python, ML frameworks like TensorFlow or PyTorch. Experienced with CI/CD, Docker, Kubernetes, and data pipeline tools like Airflow. more »

Data Engineer Location: London, UK Hybrid: 3x a week in office Salary: £63,000 About the Client Our client is a top-tier professional services firm known for its exceptional workplace culture and some of the most sought-after office spaces in London. Role Overview Our client is … in search of a skilled Data Engineer to manage and engineer the data warehouse. The opportunity will be amazing for a Data Engineer who is happy to work in a small team. Incredible opportunity to mentor/lead a small Data Engineering … team within a year! Main Responsibilities Build scalable data pipelines on a daily basis Code on a daily basis with Azure SQL and python Develop and maintain the logical and technical architecture to fulfil the client’s information, insights, and reporting needs. Stay informed on the latest developments more »

Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security … policies. Essential Technical Skills 2-3 years Azure data systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. … Building Azure data pipelines. Agile methodology experience. Problem-solving skills. Awareness of industry trends. Stakeholder engagement. Desired Experience Business Objects Reporting. Power BI familiarity. more »

Omni client solutions. These solutions are major differentiators that puts Omnicom ahead of the competition. Specific responsibilities of the team are listed below. Data Taxonomies design & maintenance Data Governance and QA Dashboard design, build and maintenance Data Pipelines design & delivery TW/Planit (& TrackIT … for maintaining and improving tables and business logic for a reporting platform. The Business Intelligence Manager will support an MI Director with all data operations and reporting workstreams for one of Omnicom’s largest global autotive clients and work closely with our engineering team; TSOC. This role will … ensure our AWS data infrastructure is supporting a best-in-class reporting platform for one our our largest accounts within Omnicom Media Group, and will be reporting into the Senior Marketing Intelligence and Reporting Director. Communication skills and the ability to prioritize tasks across projects to meet deadlines more »

Our client, a leading innovation and transformation consulting firm based in London, is seeking a talented Senior Consultant - Data Engineer. This role is perfect for an experienced professional who thrives in dynamic environments and is eager to drive impactful data engineering projects. The firm specializes in … leveraging advanced technology to transform businesses, providing cutting-edge solutions to a diverse range of clients. As a Senior Consultant - Data Engineer, you will play a key role in designing, developing, and optimizing data pipelines and architectures. Your expertise will help clients harness the power of … their data, ensuring robust and scalable solutions that meet business needs. You will work with a talented team, utilizing your skills in ETL processes, AWS, and Python to deliver high-quality data engineering projects. Key Responsibilities: Design and develop ETL pipelines to support data more »

Managers as part of the Fixed Income Technology leadership team. The ideal candidate will be a collaborative leader, with experience of application development, data management and cloud-based architectures. They will be comfortable to empower the team members to be self-reliant in decision making, and ability to … levels, demands good hygiene of code, database design and APIs. You will need to be comfortable with databases, working with SQL to diagnose data issues, and digging into logs and documentation to truly understand what the systems are doing. The team is part of a wider Fixed Income … by Risk Analysts, Portfolio Managers, and Quants. This is a hands-on leadership role that provides an opportunity to tackle sophisticated business, logic, data, and technical challenges. Role summary and job responsibilities Manages a software engineering team to deliver business-focused outcomes. Work closely with Head of Fixed more »

Data Scientist/Quant Researcher Top-tier Hedge Fund London/Hong Kong Our client, an industry-leading hedge fund, is looking to add Data Scientists to its Equities division. We will be hiring in both London and Hong Kong. You will be an early/… mid-career Data Scientist (1-7 yrs' experience) currently working in a: Hedge Fund Asset Manager Market Data Provider Alternative Data Provider or adjacent industry with exposure to Capital Markets data You should ideally have an interest in a particular Equities sector … or group of sectors (e.g. Consumer data, Healthcare data, etc) and some proven expertise in applying this to Equities markets problems. Working with the firm's world class technologists and investment teams, you will be an individual contributor focused on the analysis of 3rd party data more »

Data Engineer - Contract (Outside IR35) Overview: An Exciting opportunity has arisen with one of the UK’s largest life insurance brokers to join as a Data Engineer. Reporting to the Data Platform Manager, you will be responsible for ensuring that all of the raw … data is prepared into clear and coherent presentations for the stakeholders. The successful candidate will be someone with at least 3-5 years’ experience in a similar environment, strong SQL and Python knowledge and with the ability to communicate effectively with senior stakeholders. Role & Responsibilities: Collaborating with stakeholders … to develop and maintain products Working cross-functionally across the business to understand the requirements of the products Designing and implementing performance related data ingestion pipelines from multiple sources using Apache Spark Integrating end-to-end data pipelines ensuring a high level of quality is maintained more »

LEAD DATA ENGINEER LONDON BASED £80,000-90,000 PER ANNUM This Real estate company is searching for a new Lead Data Engineer, to Revolutionise their expanding Data and Analytics team, and help build out brand new Data pipelines using Python and … SQL. You will also be responsible for building a new Data platform in GCP. THE COMPANY This growing company are searching for a new Lead Data Engineer, to own the technical direction of their expanding Data and Technology team. They have been investing heavily … in their data team over recent years, and are a very data-focused business. THE ROLE Joining this team as a Lead data engineer, you will be responsible for building the company's next-generation data platform using GCP. This role has more »

At AX, we are looking for a Data Engineering Lead to join our dynamic team. As the Data Engineering Lead you will have a strong background in data analysis, team management, and expertise in utilizing various Microsoft BI tools and cloud-based technologies including … SSRS, SSIS, SSAS, Azure Synapse, Azure Data Factory and lakes and curated business models. A little bit about us AX is an accident assistance and after care service provider who deliver replacement vehicles to customers who have been involved in non-fault accidents. We pride ourselves on keeping … and engaging with our colleagues is fundamental to ensure we provide an industry leading service to our partners and our customers. As our Data Engineering Lead, your responsibilities will include: Team Leadership Provide leadership, guidance and support to team members, ensuring the successful execution of projects and tasks. more »

contract basis to assist our client as they migrate over from legacy to AWS. The main focus will be to centralise the organisations data warehouses and consolidating/centralising a number of BI tools. Databricks Engineers should have extensive experience working with Databricks on recent projects and be … exposed to the latest features and toolsets of Databricks Role Responsibilities: Design and develop scalable data pipelines using Databricks. Implement data processing workflows in Python and SQL. Manage and optimise data storage solutions on AWS. Ensure data quality and integrity across all … stages of data processing. Develop and maintain documentation for data engineering processes. Utilise Databricks features, including Delta Live Tables (DLT) to simplify streaming and ensure data quality. Work with asset bundles in Databricks for streamlined data operations. Key Skills: Proven experience as more »

As people increasingly move across channels and platforms, Kantar Media’s data and audience measurement, targeting, analytics and advertising intelligence services unlock insights to inform powerful decision-making. Working with panel and first-party data in over 80 countries, we have the world’s fastest growing … East, Asia Pacific, North America, and Africa to understand audiences and help the world’s leading organisations succeed and grow. Job Title: Senior Data Scientist Location: London, Grays Inn Road Salary: Competitive Full time/Permanent Kantar is the leader in providing audience and advertising measurement tools and … the forefront of technological developments in audience measurement in the media industry, working with broadcasters and advertisers, media agencies and industry committees. The data science team provides research and technical expertise, support, oversight, and methodological development to our global operating services and sits within the Global Product team. more »

Data Engineer Birmingham - AWS Hybrid working 1 day every 3 weeks out of their Birmingham City Centre offices. Salary 55-65k plus 10% bonus, 28 days holidays Childcare vouchers, Life Assurance, pension. We are a looking for an experienced Data Engineer to play a pivotal … role in constructing and maintaining data pipelines within a dynamic, Agile environment. This opportunity is based in Birmingham, West Midlands, with a hybrid work model. As a key member of their Data team, you'll be instrumental in translating technical requirements into actionable pipelines, developing solutions … to drive data-centric decision-making, and upholding data quality and organisation standards. Strong skills in Python, SQL, AWS, Glue, ETL and DataOps principles is essential. Core skills: Strong coding skills in Python & SQL Excellent experience in the AWS Cloud platform, including AWS Glue, Amazon DynamoDB more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI more »

Business Development Manager - Data Solutions Stride Recruitment is working with a leading data consultancy focused on delivering Data & Analytics Solutions for clients in markets such as; Financial Services, Retail, CPG, and Telco. They specialise in the delivery of Modern Data Solutions for … firms in their chosen target markets. Using innovative technologies, they deliver data pipelines, cloud data architectures, advanced analytical and AI/ML solutions. We are looking for ambitious and self-motivated sales professional with a passion for helping customers achieve more with Data, Analytics … Demonstrated ability in negotiating high-value contracts with a track record of successful deal closures. Analytical Mindset: Strong analytical skills to understand complex data environments and articulate the value proposition of our solutions effectively. Technological Proficiency: Familiarity with the latest trends in data analytics, machine learning more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI more »

Are you a Data Engineer with a passion for engineering various data tools ? We would love to hear from you! Careers at TCS: It means more. TCS is a purpose-led transformation company, built on belief. We don’t just help businesses to transform through technology. … you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation. Be exposed to the future of data Work with some of the brightest global minds in the industry Lead definition and implementation of standards and best practices in Enterprise The Role … This role will support the design, management, checking, and engineering of a diverse range of data using a variety of tools to achieve consistent data sharing across the organization. Your Profile Key responsibilities: Design, create, test and maintain data pipelines to support Digital projects more »

A global company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team based in their London office – this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It’s a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having recently launched a brand-new Azure Data Platform and introduced the use of Databricks. The role is predominantly back-end Data Engineering focused, where you’ll develop … various solutions for data collection, integration, transformation and modelling, to support the ongoing development of their global data platform. This will include developing data pipelines, to automate data collection and integration across various sources, with the use of Azure Data more »

Graduate Data Engineer - Fast Growing FinTech A very fast scaling FinTech in London are looking for a talented Data Engineer to join their team. In this role as a Data Engineer you’ll work with extremely high calibre engineers and hit the ground running … with where you have the most experience and then gaining exposure to the rest of their services to build out your expertise. Graduate Data Engineer - About You On track for a First from a Top Russel Group University Self-starter who thrives in challenging environments A background in … a relevant field (Computer Science, Physics, Mathematics) with Software internships or projects Demonstrable experience in Python and SQL Data Engineer Desirable Qualities: Ability to communicate effectively to technical and non technical people Nice to haves includes: Kubernetes, Docker, BigQuery, Cloud, Databases Interest in FinTech Data Engineer more »

and annual plan for delivering this is available on our website. Our new team are embarking on a piece of work to monitor data to identify and respond to patterns indicative of potential fraud. This will support our current work that reduces the likelihood of fraud occurring. We … will bring in data science capabilities to be deployed in counter fraud activity and work closely with partners across health and government to further maximise the preventative impact of proactive counter fraud analysis. We will combine this with our range of counter fraud and domain expertise to maximise … our impact using your knowledge, experience, and passion for your chosen field. The Data Scientist role requires expertise in machine learning, statistical analysis, anomaly detection, and strong communication and collaboration skills. Key responsibilities include developing innovative models, designing, applying, and optimising models in a dynamic environment. The role more »