76 to 100 of 560 Data Pipeline Jobs in the UK

DATA ANALYST LIVERPOOL STREET - HYBRID (2 DAYS A WEEK) £35,000 - £40,000 THE COMPANY The company specialises in designing, developing, and building innovative solutions, ranging from applications to websites, tailored for recruitment and onboarding purposes. Their main success is their expertise in direct-sourcing solutions, alongside creative … marketing strategies, to align employer brands with digital platforms, thus expanding their reach to a wider audience. ABOUT THE ROLE In this Data Analyst role, you will play a pivotal role in bridging the gap between cross-functional teams, ensuring seamless communication between data engineers and … GMT and GA4. Assume ownership of the reporting platform in Tableau, collaborating with a Tableau Engineer (contractor) for development. Oversee the correctness of data pipelines, particularly within Adverity. Translate data requirements from various business units for data engineers. YOUR EXPERIENCE To qualify for this more »

Principal Data Engineer - London This Digital Services Partner revolutionises how people engage with technology. They pride themselves on delivering innovative solutions that enhance user experiences and drive measurable results. People are genuinely at the heart of this business, and they're looking for a Principal Data Engineer to join. This role will provide technical expertise in data engineering practices both internally and to clients, and provides great opportunity to develop and upskill. The role: Act as a technical SME to help produce user centered software Design and manage software deployment and development … teams to prioritise workload and realign where needed Be a strong communicator, present prototypes and solutions to stakeholders The person: Strong experience in Data Engineering, with python being your primary language Strong cloud exposure - AWS, GCP or Azure Excellent SQL and relational database skills - NoSQL desirable Experienced in more »

Principal Data Engineer - Bristol This Digital Services Partner revolutionises how people engage with technology. They pride themselves on delivering innovative solutions that enhance user experiences and drive measurable results. People are genuinely at the heart of this business, and they're looking for a Principal Data Engineer to join. This role will provide technical expertise in data engineering practices both internally and to clients, and provides great opportunity to develop and upskill. The role: Act as a technical SME to help produce user centred software Design and manage software deployment and development … teams to prioritise workload and realign where needed Be a strong communicator, present prototypes and solutions to stakeholders The person: Strong experience in Data Engineering, with python being your primary language Strong cloud exposure - AWS, GCP or Azure Excellent SQL and relational database skills - NoSQL desirable Experienced in more »

in the firm's technological evolution. The company are looking for a python developer who can design and develop their innovative AWS-native data analytics platform. Using Python, to build high-performance, high-throughput data pipelines for trading exchange, FX and fundamental data. This platform incorporates … real-time extraction, transformation and analysis of data from hundreds of diverse sources, some generating up to 100,000 transactions per minute The ideal candidate should have the majority of the following … Experience Developing and maintaining data pipelines for a company's analytics platform. Knowledge of how to collaborate with various teams to meet pipeline requirements. Be able to Troubleshoot and resolve pipeline issues. Strong experience in cloud-based development (AWS). Experience Optimizing pipelines for performance and more »

join our teams in London, Newcastle, Glasgow and Salford. We are looking for a range of programming languages including Node.js (backend) and Python (Data and Machine Learning). We offer a warm welcome with full support settling in and foster a culture where everyone has an opportunity to … on cloud based environments like AWS and Azure • Solid understanding of software development principles, design patterns and best practices • Experience in feature engineering, data pre-processing, data pipelines • Experience building ranked retrieval algorithms to support end users querying for data • Practical experience of writing more »

energy and commodities markets. They provide a wide range of services to a substantial and diversified customer base. They are seeking a skilled, data focused Python Developer who can design and develop their innovative AWS-native data analytics platform. As a Python Developer, you will be … building high-performance, high-throughput data pipelines for trading exchange, FX and fundamental data. The ideal candidate should have the majority of the following: Bachelor's degree in Computer Science, Engineering, or a related field. Strong Python development. Experience with Pandas is desirable. 3+ years of experience in … data engineering. Experienced in building ETL data pipelines. Relational database experience w/PostgreSQL. Understanding of tech within our stack: AWS/Apache beam/Kafka. Experience with Object Orientated Programming A desire to work in the commodities/trading sector. Permanent/Full-Time Employment. more »

I have partnered with a cutting-edge software business who are looking to hire a Head of Data Engineering, As the Head of Data Engineering, you will be responsible for designing, developing, and maintaining our data infrastructure on GCP. You will work closely with … cross-functional teams to ensure that our data pipelines are robust, scalable and efficient. The best-matched Head of Data Engineering will have the following experience and abilities: Led a team of data engineers in designing, building, and maintaining data pipelines on … the Google Cloud Platform. Evaluate and recommend new technologies and tools to improve our data infrastructure and processes. Monitor and optimize the performance of data pipelines to ensure reliability, scalability, and cost-effectiveness. Hybrid working in London, 2 days a week in the office If this more »

Job Title: Software Engineer (Rust/HPC/Real Time Data) Client: Elite Tech Firm Salary: Up to £200k 1st Year Compensation Location: London Sells: Cutting-edge tech, ownership of multiple greenfield projects, no red tape, a friendly/collaborative environment, beautiful offices, personal projects on Fridays! An … as part of a team of engineers looking after and building a zero-down time low latency solutions for multi petabyte/exabyte data sets Working heavily in Rust Building/Optimising some of the world's most advanced data pipelines Collaborating with ML Engineers, Data … with other incredibly passionate technologists Skills: 5+ years experience working as a Software Engineer ideally using Rust Outstanding CompSci Fundamentals needed! Knowledge of data engineering principles/data lake architectures - Arrow/Parquet etc. Excellent knowledge of low-level concepts (e.g. compilers, x86, LLVM etc. more »

Job Title: Software Engineer (Rust/HPC/Real Time Data) Client: Elite Tech Firm Salary: Up to £200k 1st Year Compensation Location: London Sells: Cutting-edge tech, ownership of multiple greenfield projects, no red tape, a friendly/collaborative environment, beautiful offices, personal projects on Fridays! An … as part of a team of engineers looking after and building a zero-down time low latency solutions for multi petabyte/exabyte data sets Working heavily in Rust Building/Optimising some of the world's most advanced data pipelines Collaborating with ML Engineers, Data … with other incredibly passionate technologists Skills: 5+ years experience working as a Software Engineer ideally using Rust Outstanding CompSci Fundamentals needed! Knowledge of data engineering principles/data lake architectures - Arrow/Parquet etc. Excellent knowledge of low-level concepts (e.g. compilers, x86, LLVM etc. more »

based projects, alongside deep learning and neural networks to support core clients Part of a team of 12 reporting to the Head of Data Science Chance to have 1 direct report within an MLE team of 3 Focusing on end-to-end data pipelines, for training … evaluating and deploying ML models Working closely with Data Scientists on client partners, advising on best practice ML and MLOps infrastructure Driving best practices in a fast paced environment, within a well established company Your Skills and Experience: MSc or PhD level education in STEM subjects. Strong experience more »

timezone is EU/GMT. ThinkAlpha is looking for a Senior Site Reliability Engineer to work in the core infrastructure team supporting our data analytics platform and transactional trading engine. Our team provides solutions for real-time analytics, financial search, data integration, robust transactional systems, backtesting … of professional experience Extensive experience and deep understanding of infrastructure as code (Terragrunt/Terraform). Strong understanding of Docker, Kubernetes, Linux and data pipelines and stream processing tools. Experience with both on-premise/colocated servers as well as cloud infrastructure, and hybrid deployments spanning both types more »

their way to becoming a billion dollar organisation. Key Responsibilities: Oversee the creation, implementation, and maintenance of scalable analytic solutions, working closely with data scientists, software engineers, and other team members. Provide strategic technical direction, support, and mentorship, fostering a culture of continuous learning and innovation. Lead the … improvement initiatives, and address any customer-related challenges. Desirable Technical Experience: Proficiency in Java, Kotlin, or Python. Experience with NLP, ML-Ops, and data pipelines. Familiarity with ML frameworks such as TensorFlow or PyTorch Strong understanding of ML algorithms, statistical techniques, and data analysis. Experience with more »

learning models for new products. The team covers a range of skillsets from embedded firmware development and machine learning to quality assurance and data engineering. We build, deploy and maintain embedded machine learning models to enhance the user experience across our hardware products. We frequently work on new … mass production. You will be responsible for developing machine learning models for deployment on our new hardware products. You should have experience building data pipelines for machine learning model training, testing, and validation. You should also have experience with the optimisation of machine learning models to meet performance … years of relevant software development experience Excellent C and modern C++ coding skills Experience with Tensorflow lite Experience with building machine learning model data pipelines Proven track record of success with embedded system development projects Ability to accurately estimate software tasks and work to schedule. Bachelors/Masters more »

and mapping technology. Key Responsibilities: Create and optimize front-end user interfaces for web and mobile platforms. Develop and enhance core algorithms and data pipelines using C++ and Python. Collaborate on both front-end and back-end development. Work with hardware platforms, including mobile robots and handheld devices … like lidar, vision, GPS, and IMUs. Understanding of modern algorithms for visual and laser odometry and reconstruction. Knowledge of perception pipelines involving 3D data such as point clouds and mesh reconstructions. Experience with AutoDesk’s Revit application in engineering design. Experience in developing Android applications. If you are more »

Role Responsibilities Build connectivity to help us ingest market data and trading activity from traditional and digital exchanges Develop data pipelines to move large volumes of data and allow real time analysis on it Create systems to move large amounts of money between unrelated … at an early-to-medium-stage tech startup Kafka and Snowflake Experience integrating with 3rd-party APIs Experience with standard tooling for big data (much larger than a laptop, much smaller than Google) Experience in cryptocurrency more »

Role Responsibilities Build connectivity to help us ingest market data and trading activity from traditional and digital exchanges Develop data pipelines to move large volumes of data and allow real time analysis on it Create systems to move large amounts of money between unrelated … at an early-to-medium-stage tech startup Kafka and Snowflake Experience integrating with 3rd-party APIs Experience with standard tooling for big data (much larger than a laptop, much smaller than Google) Experience in cryptocurrency more »

per day (Inside IR35). The BI Development with also work across Analytics Engineering to maintain and evolve dashboards to provide stakeholders with data insight across European markets. Key responsibilities: Technical maintenance of Looker Dashboards, developing accuracy, reliability and support for business requirements. Ideate, create and deliver Looker … data models that define business requirements processes and structures around data. Monitor performance of dashboards, data pipelines, technical queries and delivery on time. utilise Looker features, staying abreast of technical updates to continuously improve effectiveness of Business Intelligence solutions. Provide training and support. Help internal understanding … of the platform and demonstrate the benefits and full usability to support data teams. Your background: Minimum 4 years experience within Looker Development or a similar BI role. Track record of LookML development, data modelling and creation of dashboards. Strong skills within SQL for manipulating and more »

per day (Inside IR35). The BI Development with also work across Analytics Engineering to maintain and evolve dashboards to provide stakeholders with data insight across European markets. Key responsibilities: Technical maintenance of Looker Dashboards, developing accuracy, reliability and support for business requirements. Ideate, create and deliver Looker … data models that define business requirements processes and structures around data. Monitor performance of dashboards, data pipelines, technical queries and delivery on time. utilise Looker features, staying abreast of technical updates to continuously improve effectiveness of Business Intelligence solutions. Provide training and support. Help internal understanding … of the platform and demonstrate the benefits and full usability to support data teams. Your background: Minimum 4 years experience within Looker Development or a similar BI role. Track record of LookML development, data modelling and creation of dashboards. Strong skills within SQL for manipulating and more »

be your next challenge! Must have experience: Working in Python on AWS AWS Serverless application (Lambda, Step Functions, S3, Amazon Glue, SNS, SQS) Data products, transforming, harmonising data, messages, etc. Desired experience: Building integration solutions Experience in designing application databases Experience in designing and building data more »

My client is hiring for a Data Architect on a permanent basis. This role is working with Defence and does require SC/DC clearance, it is essential. This role is hybrid - 2 days in the office and 3 days working from home. They have 2 locations, one … will be driven by solving varied and interesting client problems. You will be responsible for the strategy, architecture and high-level design of data intensive solutions, and will also support Client Managers directly in a pre-sales capacity to develop relationships and solutions that can support future business … growth. Skills: Experience of building specifying Data Pipelines in a Cloud environment (Azure, AWS, GCP) Knowledge of commercial and contractual frameworks SC/DV clearance is essential for this role Please apply for immediate interview more »

Senior Data Engineer opportunity to join a well-known financial services company working on a Remote first basis (once a month in the office on average). Senior Data Engineer - Remote First (office Nr Penrith) - Up to £65,000 + Great Benefits Purpose of Job Advise … on and ensure the maximum return of value from the company's data assets; through use of best practice data engineering techniques that aid the delivery of the company's data management strategy and roadmap and align to regulatory requirements. Contribute towards the support … maintenance, and improvement of the company's platform inc data pipelines, and ensure data quality and governance. Responsibilities Advise on the Design, implementation, and maintenance of complex data engineering solutions. Ensure the implementation, and maintenance of complex data engineering solutions to acquire more »

building products that are performant, scalable, and robust to support critical transportation processes. You build web applications that delight our customers, and complex data pipelines to process the data that serves them. We will give you the space to explore new technologies and approaches, and apply … job responsibilities working with AWS technologies such as Lambda, ECS Fargate, API Gateway, RDS, DynamoDB, EMR building customer-facing applications and APIs building data pipelines using Spark + Scala that process Tb of data per day working with customers to understand the business context of new more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

the uptake and success of electric vehicles with GRIDSERVE Car Leasing. Everything we do is underpinned and connected by a technology-agnostic, proprietary data platform that grows and improves every day. Get in touch ROLE OVERVIEW Join GRIDSERVE as the Head of Data. This will be a critical … member of our leadership team, responsible for establishing and driving the data vision and strategy across the company. This role involves harnessing the power of data to optimize our operations, enhance decision-making, and unlock innovative solutions in the renewable energy space. You will lead our … journey towards becoming a data-mature organisation, building a team to leverage data for operational excellence, strategic insights, and market innovations.You will be able to communicate complex data concepts in simple business language, cutting out the jargon and getting to the point of what more »

Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great scope for career progression & you’ll be leading and managing a small team of Data … from the Data Engineering work to contribute towards the Data Science/Analytics. Work across the whole Data pipeline (Data Engineering, Data Warehousing, Analytics) Help shape the strategy and roadmap for whole Data function and contribute towards … Engineering pipeline. Preferably someone who is capable of ‘wearing many hats’ and getting hands on in other areas across the Data Engineering pipeline if necessary! Experience leading team of Data Engineers/Scientists. Min. Bachelors’ degree in STEM subject (ideally from UK university). THE more »