76 to 100 of 143 Permanent Data Pipeline Jobs in the UK excluding London

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Amazon Redshift, Amazon EMR, Amazon Athena, Amazon Sagemaker and more. Help our customers to remove the constraints that prevent them from leveraging their data to develop business insights Create white papers, writing blogs, build demos and other reusable collateral that can be used by our customers. Work closely … with our Solution Architects, Data Scientists and Service Engineering teams Experience with design, development and operations that leverages deep knowledge in the use of services like Amazon Kinesis, Apache Kafka, Apache Spark, Amazon Sagemaker, Amazon EMR, NoSQL technologies and other 3rd parties Develop and define key business questions … needs of enterprises Basic understanding of machine learning fundamentals Ability to take Machine Learning models and implement them as part of data pipeline IT platform implementation experience Experience with one or more relevant tools ( Flink, Spark, Sqoop, Flume, Kafka, Amazon Kinesis) Experience developing software code in one more »

Data Engineer Birmingham - AWS Hybrid working 1 day every 3 weeks out of their Birmingham City Centre offices. Salary 55-65k plus 10% bonus, 28 days holidays Childcare vouchers, Life Assurance, pension. We are a looking for an experienced Data Engineer to play a pivotal … role in constructing and maintaining data pipelines within a dynamic, Agile environment. This opportunity is based in Birmingham, West Midlands, with a hybrid work model. As a key member of their Data team, you'll be instrumental in translating technical requirements into actionable pipelines, developing solutions … contact us at 0161 438 1178 for more information. Key skills; AWS Data Engineer, AWS Cloud, Python, SQL, AWS, Glue, ETL Pipelines, Data Engineer, Birmingham, West Midlands Follow us on Twitter @erinassociates for updates on similar opportunities. Erin Associates Ltd is an equal opportunity employer. more »

Data Engineer - Contract (Outside IR35) Overview: An Exciting opportunity has arisen with one of the UK’s largest life insurance brokers to join as a Data Engineer. Reporting to the Data Platform Manager, you will be responsible for ensuring that all of the raw … data is prepared into clear and coherent presentations for the stakeholders. The successful candidate will be someone with at least 3-5 years’ experience in a similar environment, strong SQL and Python knowledge and with the ability to communicate effectively with senior stakeholders. Role & Responsibilities: Collaborating with stakeholders … to develop and maintain products Working cross-functionally across the business to understand the requirements of the products Designing and implementing performance related data ingestion pipelines from multiple sources using Apache Spark Integrating end-to-end data pipelines ensuring a high level of quality is maintained more »

At AX, we are looking for a Data Engineering Lead to join our dynamic team. As the Data Engineering Lead you will have a strong background in data analysis, team management, and expertise in utilizing various Microsoft BI tools and cloud-based technologies including … SSRS, SSIS, SSAS, Azure Synapse, Azure Data Factory and lakes and curated business models. A little bit about us AX is an accident assistance and after care service provider who deliver replacement vehicles to customers who have been involved in non-fault accidents. We pride ourselves on keeping … and engaging with our colleagues is fundamental to ensure we provide an industry leading service to our partners and our customers. As our Data Engineering Lead, your responsibilities will include: Team Leadership Provide leadership, guidance and support to team members, ensuring the successful execution of projects and tasks. more »

Data Engineer Birmingham - AWS Hybrid working 1 day every 3 weeks out of their Birmingham City Centre offices. Salary 55-65k plus 10% bonus, 28 days holidays Childcare vouchers, Life Assurance, pension. We are a looking for an experienced Data Engineer to play a pivotal … role in constructing and maintaining data pipelines within a dynamic, Agile environment. This opportunity is based in Birmingham, West Midlands, with a hybrid work model. As a key member of their Data team, you'll be instrumental in translating technical requirements into actionable pipelines, developing solutions … to drive data-centric decision-making, and upholding data quality and organisation standards. Strong skills in Python, SQL, AWS, Glue, ETL and DataOps principles is essential. Core skills: Strong coding skills in Python & SQL Excellent experience in the AWS Cloud platform, including AWS Glue, Amazon DynamoDB more »

Senior Data Engineer - Remote - £70-90K. Austin Fraser is currently recruiting for a Senior Data Engineer on behalf of an innovative and multinational retailer client. You will be responsible for utilising your Data Engineering skills and experience in designing, implementing and supporting secure … cloud-based data platforms. Furthermore, youll be working closely with various stakeholders to propose, design and deliver high quality data products. This is a great opportunity to join an organisation who place huge importance on personal development and keeping up to date with the latest technologies. … Skills/Qualifications required: MUST have experience working with GCP (2+ years experience) Previous experience building cloud-based data pipelines using data orchestration and workflow platforms. Cloud-Based data platforms, preferably Snowflake or BigQuery. Background using Airflow/Cloud Composer with Python highly preferred. more »

Are you a Data Engineer with a passion for engineering various data tools ? We would love to hear from you! Careers at TCS: It means more. TCS is a purpose-led transformation company, built on belief. We don’t just help businesses to transform through technology. … you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation. Be exposed to the future of data Work with some of the brightest global minds in the industry Lead definition and implementation of standards and best practices in Enterprise The Role … This role will support the design, management, checking, and engineering of a diverse range of data using a variety of tools to achieve consistent data sharing across the organization. Your Profile Key responsibilities: Design, create, test and maintain data pipelines to support Digital projects more »

Data Engineer - Belfast - £55 - 60k + Bonus Want to help drive the Data function with one of the most reputable employers in Belfast? This company is known for it’s innovation, delivery, and culture. Their Belfast hub is at the centre of the tech community, promoting … learning and diversity at all levels. They have a new opportunity for a Data Engineer to join their Digital function. AWS is a huge growth area for this company, so it's a great opportunity to really develop your cloud skills. The person Experienced in designing and deploying … production data pipelines within a big data architecture Strong technical skills in Python, SQL and AWS (though they’re very open to any cloud experience) Experience processing large volumes of structured and unstructured data Knowledge of data cleaning, wrangling, visualization and reporting more »

support of BTs Strategic SIEM development. We are seeking a skilled Software Engineer with expertise in Elasticsearch (or other SIEM and/or Data platforms) to join our dynamic team. As a Software Engineer you will play a critical role in designing, developing, and maintaining our security information … will be on leveraging Elasticsearch and related technologies to enhance threat detection, incident response, and overall security posture. What you’ll be doing • Data Ingestion and Enrichment: o Configure Elasticsearch pipelines for data ingestion from various sources, primarily from Kafka o Enhance data enrichment … Lead for the year and work towards achieving these. You'll have the following experience • ETL Processes with Logstash Design, develop, and maintain data pipelines using Logstash, part of the Elastic Stack. Automate data ingestion, transformation, and loading tasks. • Beats for Data Collection Configure more »

Azure Data Engineer An Azure Data Engineer is required by Whitehall Resources for our client based in the south of England. This is a permanent role and can be done from the comfort of the successful candidate’s home with travel into the office one to … two times a month. The successful candidate will come from a Data Engineering background and have experience with the latest Microsoft technologies. Strong knowledge of MS SQL Server on Azure with proficiency in SQL will also be needed. Do you have? Azure Data Engineering experience? Strong … knowledge of MS SQL Server on Azure? A background in the design, build, and maintenance of ADF data pipelines to extract, transform, and load (ETL) data from various sources into Data Warehouses? Exposure to Azure Synapse Analytics? Excellent communication skills? Would you like? Work more »

Data Analysis Specialist (English and Korean Speaking) Methods are looking for a Data Analysis Specialist to work on an initial 7 month contract with a fantastic client of ours. The engagement will run for 7 months, with a view to extend further. The position has been … confirmed to fall Inside IR35. PURPOSE OF THE JOB: The Data Analysis Specialist role is primarily focused on running, extending and enhancing data analytics with Data Analyst. As a Data Analysis Specialist, you will be responsible for generating data report … providing insight to senior management with digitalized documents. Also, Using various systems to gather information such as SCM and ERP. Reporting to the Data Analyst who will work closely with you and supporting team to deliver to achieve key targets. And you will be involved in various different more »

troubleshooting of the SOC’s technology stack (hardware and software). The engineer will also assist with the continued development and maintenance of data pipelines and signature updates and the professional development of the system engineering team. Tasks: • Perform system administration on specific cyber defence applications and systems … network tools in response to new or observed threats within the network environment or enclave. • Manage the compilation, cataloguing, distribution, and retrieval of data from a range of enterprise networks and data sources. • Implement data management standards, requirements, and specifications. • Develop data standards, policies, and procedures. • Analyse data sources to provide actionable recommendations and facilitate data-gathering methods. • To share knowledge, skills and experience, create and improve documentation, and train new members of the data engineering team. Knowledge: • Knowledge of big data more »

the forefront of our journey to Net Zero. Because of this though, they currently use a lot of third parties to store their data and are looking to build out an internal risk function to utilise data more efficiently. You'll get involved in immediately organising … the data structures, building out a Data Warehouse and data pipelines from the multiple data sources. From there you'll start including other data sources including telephony and others to strengthen Risk decision making. It will be your job to … bolster the current Risk function, helping to build better models using Credit Risk Data to allow them to compete across multiple financial sectors. It's a great opportunity to build an overall risk profile, refine the decision engines and eventually manage the processes overall! What you'll need more »

Description Who we are At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in fair and equitable way. … and you can bring your dog to the office! Job Description The job at a glance As a Director of Product Analytics and Data Science, you will responsible for leading an organisation comprising several Product Analytics, Data Analytics and Data Science teams, covering the … Analytics and Data Science needs in the Product organisation at Stepstone. You will be working closely with Senior Leaders in Product, Tech, Marketing and other areas to ensure we turn our data and product strategy into reality. Equally important, you will enable the managers to foster more »

Stride Recruitment is working with a leading data consultancy focused on delivering Data & Analytics Solutions for clients in markets such as; Financial Services, Retail, CPG, and Telco. They specialise in the delivery of Modern Data Solutions for firms in their chosen target markets. Using … innovative technologies, they deliver data pipelines, cloud data architectures, advanced analytical and AI/ML solutions. We are looking for ambitious and self-motivated sales professional with a passion for helping customers achieve more with Data, Analytics and AI. You'll have experience in … Demonstrated ability in negotiating high-value contracts with a track record of successful deal closures. Analytical Mindset: Strong analytical skills to understand complex data environments and articulate the value proposition of our solutions effectively. Technological Proficiency: Familiarity with the latest trends in data analytics, machine learning more »

Exciting Opportunity: Senior Data Analyst Role 🌟 Are you a seasoned data professional looking for your next challenge? We have an exceptional opportunity for a Senior Data Analyst to join a leading global financial institution’s dynamic Risk Analytics team. 🔍 Role Focus: Data provisioning and ensuring seamless access to vital data sources. Managing and optimizing data storage solutions. Automating processes to enhance efficiency and accuracy. Conducting comprehensive data analytics to support risk management and strategic decision-making. 🎯 Key Responsibilities: Develop and maintain data pipelines and infrastructure. Implement and oversee data governance and best practices. Collaborate with cross-functional teams to drive data-driven insights. Utilize advanced analytics techniques to solve complex business problems. Utilize SQL and Python. 💼 What We Offer: A collaborative and innovative work environment. Opportunities more »

new solutions : Be comfortable with research, exploration, experimentation and uncertainty as we are always pushing the boundaries and capabilities of our capabilities. Perform data analysis and mining with your preferred tools to model data structures and concepts Master Data Curation - Enrich our central data repositories ensuring they are up to date while increasing the depth and breadth of what is captured. Codified data pipelines and Business Rules that automate outcomes and data freshness Data implementation of new vendors/customers/products etc into relevant systems more »

We're representing a dynamic business dedicated to extending healthy lifespans and cutting unnecessary medical costs. They're seeking a Senior Data Engineer to propel their Data team forward. Key Responsibilities: Lead Cloud Data Warehouse Project: Oversee the next development phase, ensuring top-notch … scalability, reliability, and performance. Data Management Ownership: Be the go-to expert for data management, ensuring smooth operations and accessibility. Support BAU Workloads: Assist in prioritising and managing day-to-day tasks for efficiency and alignment with goals. Set Technical Direction: Define the systems and tools … technical direction, advancing towards ML and AI integration. Required Experience: Snowflake: Proficiency in setup, configuration, and optimisation. DBT (Data Build Tool): Strong skills in managing transformations and data pipelines. Python: Expertise in scripting, automation, and data manipulation. Beneficial Experience: Dagster/Airflow: Managing complex more »

Senior Data Engineer Bracknell - Flexible Up to £90,000 Austin Fraser has an exciting opportunity for a Senior Data Engineer to join one of the leading retail chains, running two of the busiests sites in the UK. This is a great time to join the business … as they are reshaping the in-house data engineering capability by moving to a cloud native platform, to become more product delivery focused . They are now looking to onboard a Senior Data Engineer with 5+ years of experience working with SQL, GCP, DBT, Big Query … Python and Airflow. In return you will benefit from an excellent remuneration package. The role: Creating, deploying, and maintaining secure data platforms on the cloud. You'll contribute to crafting and delivering data solutions tailored to meet the diverse requirements of stakeholders across the Partnership. You more »

Senior Data Engineer London/Bracknell - Flexible Up to £90,000 Austin Fraser has an exciting opportunity for a Senior Data Engineer to join one of the leading retail chains, running two of the busiests sites in the UK. This is a great time to join … the business as they are reshaping the in-house data engineering capability by moving to a cloud native platform, to become more product delivery focused . They are now looking to onboard a Senior Data Engineer with 5+ years of experience working with SQL, GCP, DBT … Big Query, Python and Airflow. In return you will benefit from an excellent remuneration package. The role: Creating, deploying, and maintaining secure data platforms on the cloud. You'll contribute to crafting and delivering data solutions tailored to meet the diverse requirements of stakeholders across the more »