1 to 25 of 88 Data Pipeline Jobs in the UK excluding London with Remote Work Options

We're now recruiting a Senior BI Developer to work in the D2C business area of AJ Bell. The Data and Insights team is a small but dynamic and experienced group of SMEs who work across Google Analytics, Bloomreach CDP and BI/data engineering. The … drive business decisions by product and marketing teams, as well as the Senior Management Team. Youll be responsible for owning and developing our data model for the Direct-to-consumer business as well as creating custom solutions and fulfilling data analysis requests for key stakeholders at … of the role are as follows: Working closely with engineering and streaming teams across Tech Services and Operations to ensure reliable and accurate data is available for D2C data and insights team to develop solutions from. Be subject matter expert in D2C team for cloud-based more »

hybrid role 80% homeworking available and 20% in Stratford Upon Avon About the role We are seeking a skilled Developer to join our Data Engineering team. In this role, you will play a pivotal part inmaintainingand enhancing our technical service offerings, ensuring operational efficiency and effectiveness. As a … Developer in our Data Engineering team, you willbe responsible formanaging technical service operationssupporting data pipelines throughout the Cloud Data Platform. With a focus on problem-solving, adaptability, and analytical skills. Collaborating closely with stakeholders, you will gain a deep understanding of business imperatives and … Experience in data management, with an understanding of data storage and extraction principles. Azure Data Factory (error handling, pipeline triggers), Azure Storage, Azure Synapse and Azure SQL Server. Previous experience in technical service operations or a related field Strong problem-solving abilities, adaptability more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

work in an environment that's fun, fast paced, customer focused and commercial with fantastic development opportunities? Look no further than the Asda Data team! If you have recently graduated or are due to graduate this year, come and join us on a 2-year Data graduate programme, working in the Geospatial & Market Team. Joining Asda as a Data Graduate, you will be working within the Geospatial & Market team, who provide geospatial and market intelligence and insight across Asda. We work most closely with our property team, supporting location planning and finding … at an exciting time as were looking at opening hundreds of new convenience stores over the next couple of years. Furthermore, we provide data to support our Marketing and Buying teams to deliver targeted marketing campaigns and support operational decision-making. For example, we provide insight and analytics more »

The role As a Data Engineer at Storm you will work alongside other software and cloud infrastructure engineers to design, build and maintain data pipelines, data management solutions and analytics components for our client’s projects across the healthcare, justice and local government sectors. … About you We know that many Data Engineer's will come from a variety of backgrounds, and we encourage and value people who bring unique perspectives and knowledge to our team. Your previous experience will include working daily with disparate data sources, ingesting, transforming and processing … data streams into actionable insights for direct use or for onward processing. You will have a proven track record of delivery and a passion for adherence to best practices in the data engineering discipline. You will be passionate about data in all its forms more »

Job DescriptionSenior Data Engineer (Inside IR35) - £700 to 825 per dayLocation: Remote/Hybrid (London)Rate: £825 per dayContract: Inside IR35Are you an experienced Data Engineer with a strong background in banking? Our client are seeking Senior Data Engineers to contribute to innovative data projects within a leading financial institution.Key Responsibilities:Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions.Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines.Distributed Processing: Work with Hadoop, Spark, and other platforms … for large-scale data processing.Real-Time Data Streaming: Develop and manage pipelines using CDC, Kafka, and Apache Spark.Database Management: Handle SQL databases like Oracle, MySQL, or PostgreSQL.Data Governance: Ensure data quality, security, and compliance with best practices.Ideal Candidate:Significant experience in data more »

Our client, an exciting start-up customer obsessed behavioural agency founded by two huge names in the data space (that have grown teams previously to 400+), is looking for a personable and hard-working Junior Data Engineer to design, build, and maintain a variety of solutions … real business results, a stark contrast to the generic approaches often found at larger agencies. “Leading with Relationships and Results” As a Junior Data Engineer, you'll leverage your knowledge of data warehousing and Google Cloud Platform (GCP) to design and build data pipelines. … You'll combine your technical skills in data modelling and transformation with your expertise in cloud-based data services like BigQuery and Dataflow. What will you be doing? Data Engineering in Google BigQuery: Design, build, test, and deploy data models and transformations more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

AI Labs team works collaboratively; and is a multi-disciplinary team with the following skills and capabilities: optimization, machine learning, statistical modeling, exploratory data analysis, natural language processing, data visualization, network/graph modeling, ETL, data pipelines, data architecture, communication, project/… product management and strategy. We work with data from a wide variety of sources including text, news feeds, financial reports, time series transactions, user behavior logs, imagery, and real-time data. AI Labs has offices in New York, Palo Alto, and Edinburgh. The team has several Stanford professors … enable the rapid delivery of machine learning products to production environments Continuously improve existing products, tools, and services, by maintaining close relationships with data scientists, researchers, and other BlackRock users Write quality maintainable code that is comprehensively tested and fit for the intended objective Provide ongoing maintenance and more »

Job DescriptionWe are partnered with a reputable global consultancy that are recruiting AWS DATA ENGINEERS to work on a very exciting LONG-TERM CONTRACT within the financial service sector. Role: AWS Data Engineer Rate: Up to £400 per day (inside IR35)Location: London – Hybrid Duration … cases.Help in backlog grooming.Key skills: Extensive experience in developing Bigdata pipelines in cloud using Bigdata technologies such as Apache SparkExpertise in performing complex data transformation using Spark SQL queriesExperience in orchestrating data pipelines using Apache AirflowProficiency in Git based version control toolsProficiency with Linux commands and … Bash ScriptingWorking experience in AWS Bigdata services (EMR, Glue, Data Pipelines, Athena, S3, Step Functions etc.) & AWS CLIExperience with CI/CD tools such as JenkinsExperience working with relational and/or MPP databasesKnowledge of Data warehousing conceptsExperience with CI/CD build automationExperience with process more »

financial energy and commodities markets. They provide a wide range of services to a substantial and diversified customer base.They are seeking a skilled, data focused Python Developer who can design and develop their innovative AWS-native data analytics platform.As a Python Developer, you will be building … high-performance, high-throughput data pipelines for trading exchange, FX and fundamental data.The ideal candidate should have the majority of the following:Bachelor's degree in Computer Science, Engineering, or a related field.Strong Python development. Experience with Pandas is desirable.3+ years of experience in data engineering.Experienced … in building ETL data pipelines.Relational database experience w/PostgreSQL.Understanding of tech within our stack: AWS/Apache beam/Kafka.Experience with Object Orientated ProgrammingA desire to work in the commodities/trading sector.Permanent/Full-Time Employment.Hybrid working environment (2/3 days' in the office).If more »

Job DescriptionOur client are a renowned name in the Property Sector, they are on the lookout for 2 AWS Data Engineers to come in on a contract basis.Key Skills/Requirements:Must have Python & Spark experienceMust have strong AWS experienceMust have Terraform experienceSQL & NoSQL experienceHave built out Data Warehouses & built Data PipelinesStrong Databricks & Snowflake experienceDocker, ECS, Kubernetes & Orchestration tools like Airflow or Step Functions are nice to haveContracts are running for 6 months initially, paying up to £450p/day (Outside IR35) and will be mostly remote but ideally looking for someone who can more »

Data Engineer – Hybrid Working £50,000 - £55.000 30 Days Holidays + 4 Days Christmas + Bank Holidays Great Pension Career Development Flexible Working - (Hybrid) A Great Working Environment Excellent Sport & Leisure Facilities Training and Personnel Development Offerings Office Location is close to A45, A46, M1, M6, M40, M42 … implement data security measures Design and implement data quality checks and validation processes within the pipelines using expectations with the pipeline, or dedicated testing tools (SODA) Collaborate with data governance, architects, system/product owners and end users to ensure quality issues are … addressed as needed. Create and maintain technical documentation, including data pipeline specifications, data models, and transformation logic Contribute to data modelling and schema design standards and related documentation. Qualifications & Requirements Degree in Computer Science, Data Engineering, or a related field or more »

Job DescriptionJob title: Lead Data EngineerClient: Data Driven Quant FundSalary: Up to £160,000Location: London/HybridMy client are seeking a Lead Data Engineer to own delivery of scalable data pipelines that are critical to the entire firms infrastructure.Being a Lead Data … cutting edge technologies and boast a world class technical team where you will work with and learn from the best.Responsibilities:As a Lead Data Engineer, you will engage with data scientists, software engineer's and product managers to deliver high … quality product based on very specifically tailored data requirements.Architect and implement data ingestion, transformation, and storage processes.Optimise data pipeline performance.Keep up with market developments in the data engineering and AI space and implement these best practices.Requirements and Skills:Bachelor's Degree more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Data Engineer | Bristol (Hybrid) | £50,000 - £60,000 Peaple Talent have partnered exclusively with a family-owned farming and dairy company located in the heart of the picturesque Somerset countryside. With a legacy spanning over four generations, they are dedicated to producing delicious, organic dairy products while maintaining … our commitment to sustainability and environmental stewardship. Position Overview: We are seeking a talented and experienced Data Engineer with expertise in Azure to join our dynamic team. As a Data Engineer, you will play a crucial role in transforming raw data into actionable insights … that drive business decisions and enhance operational efficiency. You will work closely with cross-functional teams to design, develop, and implement robust data pipelines and solutions that support our growing data needs. Responsibilities: Build data pipelines that clean, transform, and aggregate data more »

Data Engineer Overview: An Exciting opportunity has arisen with one of the UK’s largest life insurance brokers to join as a Data Engineer. Reporting to the Data Platform Manager, you will be responsible for ensuring that all of the raw data … to develop and maintain products Working cross-functionally across the business to understand the requirements of the products Designing and implementing performance related data ingestion pipelines from multiple sources using Apache Spark Integrating end-to-end data pipelines ensuring a high level of quality is maintained … Working with an Agile delivery/DevOps methodology to deliver additional data products Delivering and presenting proofs of concept of key technology components to the wider data team and relevant stakeholders Essential Skills & Experience: Strong experience with SQL & Python Competent with designing and delivering solutions using more »

Role: Senior Data Engineer Start: ASAP (ideally end of May) Location: Bristol/Hybrid - 2 days per week Salary: £73k Our market leading Financial Services client is looking for an experienced Data Engineer as they embark on a major change and transformation journey. Key Responsibilities: Design … and Deliver Data Pipelines onto a new Data Platform Act as Principle Data Expert to build out standards and mentor junior analysts Drive Data Engineering Solutions Key Skills Matillion Snowflake SQL Expert in building data pipelines ETL Strong Modelling and … Data warehousing background Financial Services/experience of working in a regulated environment Benefits: 10% non contributory pension Healthy holiday entitlement Health Insurance Life Assurance Share Incentive Scheme Attractive Bonus EV Hire Scheme more »

in the resolution of complex user requests and ensuring a minimum of the agreed service level agreements. Maintain confidentiality in accordance with our data protection policies and procedures. Delivering to service quality KPI's that underpin the management of Masteks services Demonstrate knowledge of the specific technologies necessary … software applications, systems, and networks. Knowledge of programming languages Java, JVM, DynamoDB, AWS IAM, CloudWatch, PagerDuty, Tooling TypeScript, Node.js, SRE, AWS Data Pipeline & Visualisation and scripting is a plus. Excellent problem-solving skills with the ability to analyse complex scenarios. Outstanding communication skills, both written and verbal more »

Power Bi skills some Azure knoweldge would be ideal or other cloud technology and DevOps pipelines experience Our client is looking for a Data Engineer who is technically minded who will have the opportunity to have a broad and varied workload of interesting data enginees, covering … JSON Maintain a rigorous and scalable CI/CD process across multiple DevOps projects Maintain and develop Azure Modules to maturise our automated data pipelines and analyses This is a great opportunity to join a technology focused Insurance firm and a great way to break into the Insurance more »