1 to 25 of 154 Permanent Data Pipeline Jobs in the UK with Remote Work Options

in TSQLT Unit Testing. Experience with PostgresSQL and NoSQL databases like MongoDB. Knowledge of Powershell. Linux experience is a plus. Familiarity with Azure data lake and data pipelines. Experience with Java or Kotlin (JVM 11+). Knowledge of the Spring Framework, including Spring Boot, Spring Cloud more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Leading ecommerce client now requires a Data Engineer to join their innovative Machine Learning team. This role will focus on increasing overall data efficiency using Machine Leaning, streamlining data processes to increase overall profitability, and ensuring our clients operations and customer teams can increase … strong exposure to Machine learning principles/practices and technologies such as ML flow/Sage Maker. The role: Develop robust and scalable data pipelines. Collaborate with cross-functional teams to develop and deploy Machine Learning models and algorithms to solve business challenges and create opportunities. Contribute to … the development of our clients in-house Machine Learning operations framework. Support the data science and analytics team in deploying pipelines. Coach and mentor the team to improve development standards. Key requirements: Strong hands-on experience with Databricks, Spark, SQL or Scala. Proven experience designing and building data more »

About the job Role: Data Engineer Location: London, UK (Hybrid) Harmonic is delighted to partner with a cutting-edge central London fast-growth media agency, in its search for a Data Engineer. They are looking for someone with proven experience in the development, maintenance, and testing … of data pipelines and most importantly passionate about all things data! To hit the ground running in this role, you will possess solid data warehousing experience, ideally with cloud-based data storage systems such as Google Cloud Platform (GCP), Azure, or AWS. … Imagine being at the forefront of a media revolution, where data is the key to unlocking unprecedented insights. This agency is experiencing explosive growth, and as it accumulates vast amounts of data from diverse sources, the role of Data Engineer becomes absolutely pivotal to more »

promotion that seen the Head of Engineering promoted into the CTO role there’s an opportunity to join the business as the Lead Data Engineer. Working hand in hand with the CTO you will play an instrumental part in shaping and leading the Data Engineering function … used on those days. This is a rare opportunity to work with a well liked and respected CTO and a great business. Lead Data Engineer £80k-£90k Hybrid working 2 days in Glasgow office a week Your New … Role: Platform Development: Build the foundations of the new data platform, leveraging extensive business data for both automation and analytics. Pipeline Design: Create and develop data processing pipelines to support the ingestion, enrichment, and quality control of client and partner data. Data more »

GOAT Interactive is looking for a Junior Data Engineer to join our Data Engineering team, this role will be responsible for the development, testing, and maintenance of data pipelines and data storage systems on Google Cloud Platform (GCP). You will be … working with technologies such as Apache Airflow, BigQuery, Python, and SQL to transform and load large data sets, ensuring high data quality and accessibility for business intelligence and analytics purposes. Our business is growing quickly and with that so the scale of our data, we are currently working on several initiatives to improve our data solution and you would become an integral part of this. Key Responsibilities Design, construct, install, test, and maintain data pipelines. Ensure systems meet business requirements and industry practices for data integrity more »

annum + package Tech: Python, FastAPI, Terraform, ETL, GCP Sector: E-Commerce Intelligence SwitchTT are currently partnered with a product focused business leveraging Data Science and AI, working within the E-Commerce intelligence field. Their mission is to drive advancements for online businesses to improve sales, ROI & forecasting … through offering data driven insights and analytics. You could be joining a business who have recently secured Series-A funding and are investing into their technology platforms and teams for their next phase of growth and now looking for a Senior Software Engineer. What will I be doing … Senior Software Engineer (Python) you’ll have a huge amount of autonomy owning backend API integrations with 3rd parties as well as owning Data pipelines to deliver information across the business and to clients. You’ll be responsible for delivering best in class processes and practices and for more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

SENIOR DATA ENGINEER (EU Remote Opportunity) Xcede are delighted to be working with a very exciting Web3/Blockchain organisation with a remote working culture. Their company makes life easier for organisations in the Web3 space by providing managed services across a range of operational tasks and responsibilities … in one space. As a Senior Data Engineer in the company, you will have several clear tasks that are essential to the smooth running of processes that make this Product so unique. Responsibilities Design and implement both batch & stream Data Pipelines around the data stores & data lake. Lead by example, always aiming to work towards software engineering best practice and disaster prevention (rather than recovery). Maintain and optimise the infrastructure across the company. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years more »

their way to becoming a billion dollar organisation. Key Responsibilities: Oversee the creation, implementation, and maintenance of scalable analytic solutions, working closely with data scientists, software engineers, and other team members. Provide strategic technical direction, support, and mentorship, fostering a culture of continuous learning and innovation. Lead the … improvement initiatives, and address any customer-related challenges. Desirable Technical Experience: Proficiency in Java, Kotlin, or Python. Experience with NLP, ML-Ops, and data pipelines. Familiarity with ML frameworks such as TensorFlow or PyTorch Strong understanding of ML algorithms, statistical techniques, and data analysis. Experience with more »

Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our … client's data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data streams to our client's Data Platforms. Shape data from various sources into a transactional ODS for detailed reporting and a Kimball-modelled Data Warehouse for analytics and dashboards. Define and embed data quality measures within data pipelines. more »

advanced financial market research to the world's largest hedge funds and asset managers. As we continue to expand, we seek a talented data engineer to join our dynamic quant analytics team. This team is at the forefront of developing our proprietary analytical platform, driving innovation and excellence … in financial data analysis. Why Join Us? At our firm, you will have the opportunity to: Collaborate with industry experts and thought leaders. Contribute to groundbreaking solutions that shape the financial industry. Grow your career in a supportive and innovative environment. Be part of a team that values … visualization tools. Requirements Proficient in Python development. Experience with libraries/frameworks such as Pandas, Numpy, Scipy, etc. Skilled in data pipeline orchestration management libraries (e.g., Airflow, Prefect). Nice-to-Haves Experience with cloud infrastructure (AWS, GCP, Azure). DevOps skills (CI/CD, containerization more »

business information accessible to all. Twenty-five years later, we’ve not only realised this dream, changed the market for the better, made data intelligence accessible to all businesses big and small but most importantly, opened new avenues of data intelligence for businesses with machine learning … AI and connected data. From risk management through to opportunity identification, our industry-leading solutions, power decisions for companies by turning their data into actionable insights that help them become stronger, grow faster and thrive. THE TEAM This opportunity is to join a team of highly technically skilled … engineers, who are redesigning Creditsafe data platform with high throughput and scalability as primary goal. The data delivery platform is being built upon AWS redshift and S3 cloud storage. The platform expected to manage over billion objects along with daily increment of more than 10 million more »

Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Finance Analytics technology team, tasked with developing, managing, and optimizing data pipelines within our data ecosystem. The Data Engineer will leverage cutting-edge technology in Snowflake, Python, Informatica, and Azure to improve our data capabilities and support our Finance business partners in their decision-making processes. Key responsibilities include: Design, build, and maintain efficient, reliable data pipelines … use within our subsidized onsite canteen Must have skills Experience as a Data Engineer, with a solid background in data pipeline construction and data architecture using Snowflake, Python, and Informatica Familiarity with Azure and other cloud-native technologies Understanding of finance industry data more »

Data Analyst - Hybrid Working Are you a talented Data Analyst seeking a challenging and business critical role within a highly successful global product company who have developed a world renowned brand? Are you looking for the next phase of your career through progressing your technical knowledge … and joining an established and accomplished data management team ? If so this could be the role for you... Why Would you Join? Competitive salary with annual reviews Generous Bonus Scheme Private medical care Finish early on a Friday 25 days holiday Hybrid working - 3 days in the office … days WFH (work from home) Beautiful brand new refurbished office The Opportunity As a data analyst you will conduct data analysis having first selected appropriate statistical methods and provide insights and recommendations based on investigations including deep dives into any relevant metrics. The successful data more »

We are recruiting for a Senior Data Engineer/Analyst for one of our client's near Belfast. The Senior Data Engineer/Analyst will be required to support a major analytics platform utilising Azure Data Factory, SQL Server 2016+, and ETL tools. Role … Infrastructure Support : Assist with infrastructure operations under supervision. ETL Job Monitoring : Oversee and support scheduled ETL (Extract, Transform, Load) jobs at all levels. Data Environment Planning : Help in the planning and design of data environments. Documentation : Develop and maintain all necessary documentation, including requirements, design, testing …/CD Development : Focus on high-quality solution development with Continuous Integration/Continuous Deployment. Database Assistance : Support database-related activities. DataOps : Manage data pipelines, monitor them, and support production. ETL & Data Architecture Knowledge : Gain an understanding of ETL processes and data architecture. Data more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Omni client solutions. These solutions are major differentiators that puts Omnicom ahead of the competition. Specific responsibilities of the team are listed below. Data Taxonomies design & maintenance Data Governance and QA Dashboard design, build and maintenance Data Pipelines design & delivery TW/Planit (& TrackIT … for maintaining and improving tables and business logic for a reporting platform. The Business Intelligence Manager will support an MI Director with all data operations and reporting workstreams for one of Omnicom’s largest global autotive clients and work closely with our engineering team; TSOC. This role will … ensure our AWS data infrastructure is supporting a best-in-class reporting platform for one our our largest accounts within Omnicom Media Group, and will be reporting into the Senior Marketing Intelligence and Reporting Director. Communication skills and the ability to prioritize tasks across projects to meet deadlines more »

Technical Lead Data Engineer (Java/Python/AWS/Glue/Dremio). Investment Management. £150,000 - £160,000 Base + 20% Guaranteed Bonus Target and Benefits. Hybrid 2 Days a week in St Pauls Office. 12 month fixed term rolling contract. CANNOT SPONSOR My client is … a top tier multi asset investment management house based in Central London. The Data Office team is playing a key role in helping build the future of financial services, working together with business partners to create client experiences that are changing the way people invest. You will work … platform’s architectural design Development and testing of the integration, modelling, data persistence and querying tools and analytical systems Data pipeline implementation, maintenance and testing Metadata management processes and tools Monitoring the overall performance and stability of the pipelines Implementing data curation, metadata more »

We are looking for a Korean-speaking Data Analysis Specialist to join a well-established team at one of the world’s top consumer electronics brands. This is a a specialist role that will be primarily focusing on delivering, extending and enhancing data analytics, reporting into … a senior Data Analyst. This role will: Be responsible for generating data reports and providing insight to senior management. Report into a senior Data Analyst and work closely with various supporting teams to achieve key business targets. Design and implement various data … extraction, transformation and loading of data. Analyse large datasets, being able to share insights and generate findings through reports to senior stakeholders. Transform data into structures to be utilised internally for projects and organisational KPIs. Provide solutions and support the wider team to make sure that initiatives are more »

or Potters Bar. The job: You will design and implement automated workflows using Power Automate and Power Apps that enhance the workflows the Data Engineers implement within the core Data Platform. Develop end-to-end automation workflows using Power Automate to streamline business processes, encapsulate data pipelines (ADF/DataBricks) and increase operational efficiency. Integrate Power Automate workflows with ADF/Data Bricks and encapsulate applications like MatLab to enable seamless data exchange and process automation. Troubleshoot and resolve issues related to data visualisation, automation workflows, and data … end-to-end automation workflows using Power Automate/Power Automate Cloud. Experience of working with traditional SQL Server Databases, SQL Development and data design, ideally in a Lakehouse environment. Familiarity with data and information modelling concepts and techniques. Microsoft Power Platform certifications (e.g., Power BI more »

Senior Vice President of AI & Data – London ( Hybrid ) £130,000 – 150,000 What you’ll do Our Artificial Intelligence & Data experts work within integrated teams from enterprise improvement, financial advisory and turnaround and restructuring; meaning the jobs we do cover every aspect of a business. Along … their skills and experience to create measurably improved outcomes for our clients. In this challenging role, you will be responsible for using your data analytics and technology skills to improve your client’s performance. As part of our team, you will lead organisations through their most complex business … problems using data, analytics and technology. You will work across a number of industries, clients, and project roles. As an integral part of the project team you will use data to assess client performance and help define their business objectives and strategy. You will conduct the more »

Data Engineer Remote working (1 day per month on-site) Competitive salary plus an industry leading bonus and pension scheme My client is looking for a Data Engineer to work on innovative projects that balance essential services, optimise cutting-edge technologies, and safeguard valuable assets. As … a Data Engineer, you will develop future-proof pipelines and uncover deep insights from diverse datasets, collaborating with technical teams and clients to design, build, and leverage data architectures for ambitious projects. Why You Should Apply Work on impactful and diverse projects. Flexible working hours and … Architecture, Data Insights, Cloud Platforms, Python Programming, Linux, Windows, Version Control, Git, Unit Testing, Integration Testing, Relational Databases, SQL, ETL Pipelines, Data Cleaning, Data Merging, Data Visualisation, Exploratory Data Analysis, Technology Readiness, Proofs-Of-Concept, Data-Driven more »

Data Engineer – SAS/SQL/Power BI * Sponsorship is not available with this position * Role – Data Engineer Salary – Up to £75k DOE Location – Manchester or London (Hybrid) A well established and award-winning Data consultancy are looking to add a Senior Data Consultant to join their talented data team. You’ll be at the centre of everything they do as a business, supporting a range of top tier clients. The position is offering a basic salary up to £75,000 depending on experience as well as a discretionary … Flexible working environment Inclusive and friendly culture Private Medical Insurance Buy and Sell additional annual leave Funded Learning and development programmes The Successful Data Engineer will have: Experience in developing and designing data pipelines and ETL processes Previous experience of data warehousing Utilise SAS more »

Job title: Data Engineer Client: Elite Quantitative Trading Firm Salary: Up to £1500 p/d Location: London/Hybrid My client are seeking a Data Engineer to own the design and implementation of data solutions, with previous expertise in data extraction … transformation, and loading (ETL) processes from a variety of sources, including websites, PDFs, and real-time data streams. Being a Data Engineer at a truly elite hedge fund, you will join an environment that prides themselves on working with the most cutting edge technologies and boast … a world class technical team where you will work with and learn from the best. Responsibilities: As a Data Engineer, you will design, build and continuously optimise extremely scalable and performant data pipelines. Architect and implement data ingestion, transformation, and storage processes. Develop and more »