251 to 275 of 381 Data Pipeline Jobs in the UK

learning models through research, such as reviewing academic papers and adapting them for our use. Drive the development of the cutting-edge 3D AI pipeline, leveraging the latest breakthroughs in 3D data processing, 3D vision, and machine learning techniques. This entails system design and comprehensive testing. Identify … and address bottlenecks in data, pipeline, and operations, proactively devising and implementing agile solutions to enhance scalability and optimize performance. Take ownership of project management for AI/Vision initiatives, overseeing end-to-end execution and effectively coordinating data operations. Mentor and empower junior team more »

Exciting Opportunity: Senior Data Analyst Role 🌟 Are you a seasoned data professional looking for your next challenge? We have an exceptional opportunity for a Senior Data Analyst to join a leading global financial institution’s dynamic Risk Analytics team. 🔍 Role Focus: Data provisioning and ensuring seamless access to vital data sources. Managing and optimizing data storage solutions. Automating processes to enhance efficiency and accuracy. Conducting comprehensive data analytics to support risk management and strategic decision-making. 🎯 Key Responsibilities: Develop and maintain data pipelines and infrastructure. Implement and oversee data governance and best practices. Collaborate with cross-functional teams to drive data-driven insights. Utilize advanced analytics techniques to solve complex business problems. Utilize SQL and Python. 💼 What We Offer: A collaborative and innovative work environment. Opportunities more »

be essential for achieving project success. Key Responsibilities: Software Development: Write high-quality, maintainable code using languages such as Python and SQL Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2 Utilize PowerBI, Tableau, or similar tools to design and create interactive … PoCs to validate new technologies, frameworks, or solutions. Drive the development of MVPs, ensuring timely delivery and alignment with business goals. Azure and Data Engineering: Leverage your Azure expertise to design and implement cloud-based solutions. Collaborate with data engineers to build robust data pipelines and ensure data quality. FAME (Financial Analysis Made Easy): Familiarity with financial systems, including FAME , will be advantageous. Use your knowledge to enhance banking processes and systems. Agile Methodologies: Apply agile practices such as DevOps (including CI/CD), Test-Driven Development, and Infrastructure as more »

SQL DBA - Fully Remote - £55k - £60K Overview An excellent opportunity has arisen with a market leading, data driven Saas company for an experienced, motivated, and autonomous SQL DBA with skills in T-SQL and AWS. Role & responsibilities Manage AWS RDS SQL Server databases. Monitor system's health and … management and support teams. Provide bug-hunting support on the SQL server. Change code (procedures, views, function, triggers) to correct a bug. Perform data-patching operation out of office hours. Create and Restore Native backup for AWS RDS. Skills & experience 2+ years of MS SQL Server, including creation … T-SQL programming. 1+ years of performance tuning. Index analysis. Profiler. Performance monitor. AWS console: RDS Databases. Performance insight. Knowledge of Data Pipeline and Glue (Desirable) Data warehousing. Package: £50K - £60k basic salary Fully remote 25 days annual leave more »

new solutions : Be comfortable with research, exploration, experimentation and uncertainty as we are always pushing the boundaries and capabilities of our capabilities. Perform data analysis and mining with your preferred tools to model data structures and concepts Master Data Curation - Enrich our central data repositories ensuring they are up to date while increasing the depth and breadth of what is captured. Codified data pipelines and Business Rules that automate outcomes and data freshness Data implementation of new vendors/customers/products etc into relevant systems more »

We're representing a dynamic business dedicated to extending healthy lifespans and cutting unnecessary medical costs. They're seeking a Senior Data Engineer to propel their Data team forward. Key Responsibilities: Lead Cloud Data Warehouse Project: Oversee the next development phase, ensuring top-notch … scalability, reliability, and performance. Data Management Ownership: Be the go-to expert for data management, ensuring smooth operations and accessibility. Support BAU Workloads: Assist in prioritising and managing day-to-day tasks for efficiency and alignment with goals. Set Technical Direction: Define the systems and tools … technical direction, advancing towards ML and AI integration. Required Experience: Snowflake: Proficiency in setup, configuration, and optimisation. DBT (Data Build Tool): Strong skills in managing transformations and data pipelines. Python: Expertise in scripting, automation, and data manipulation. Beneficial Experience: Dagster/Airflow: Managing complex more »

Senior Data Engineer Bracknell - Flexible Up to £90,000 Austin Fraser has an exciting opportunity for a Senior Data Engineer to join one of the leading retail chains, running two of the busiests sites in the UK. This is a great time to join the business … as they are reshaping the in-house data engineering capability by moving to a cloud native platform, to become more product delivery focused . They are now looking to onboard a Senior Data Engineer with 5+ years of experience working with SQL, GCP, DBT, Big Query … Python and Airflow. In return you will benefit from an excellent remuneration package. The role: Creating, deploying, and maintaining secure data platforms on the cloud. You'll contribute to crafting and delivering data solutions tailored to meet the diverse requirements of stakeholders across the Partnership. You more »

Senior Data Engineer Bracknell - Flexible Up to £90,000 Austin Fraser has an exciting opportunity for a Senior Data Engineer to join one of the leading retail chains, running two of the busiests sites in the UK. This is a great time to join the business … as they are reshaping the in-house data engineering capability by moving to a cloud native platform, to become more product delivery focused . They are now looking to onboard a Senior Data Engineer with 5+ years of experience working with SQL, GCP, DBT, Big Query … Python and Airflow. In return you will benefit from an excellent remuneration package. The role: Creating, deploying, and maintaining secure data platforms on the cloud. You'll contribute to crafting and delivering data solutions tailored to meet the diverse requirements of stakeholders across the Partnership. You more »

Senior Data Engineer London/Bracknell - Flexible Up to £90,000 Austin Fraser has an exciting opportunity for a Senior Data Engineer to join one of the leading retail chains, running two of the busiests sites in the UK. This is a great time to join … the business as they are reshaping the in-house data engineering capability by moving to a cloud native platform, to become more product delivery focused . They are now looking to onboard a Senior Data Engineer with 5+ years of experience working with SQL, GCP, DBT … Big Query, Python and Airflow. In return you will benefit from an excellent remuneration package. The role: Creating, deploying, and maintaining secure data platforms on the cloud. You'll contribute to crafting and delivering data solutions tailored to meet the diverse requirements of stakeholders across the more »

Senior Data Engineer London/Bracknell - Flexible Up to £90,000 Austin Fraser has an exciting opportunity for a Senior Data Engineer to join one of the leading retail chains, running two of the busiests sites in the UK. This is a great time to join … the business as they are reshaping the in-house data engineering capability by moving to a cloud native platform, to become more product delivery focused . They are now looking to onboard a Senior Data Engineer with 5+ years of experience working with SQL, GCP, DBT … Big Query, Python and Airflow. In return you will benefit from an excellent remuneration package. The role: Creating, deploying, and maintaining secure data platforms on the cloud. You'll contribute to crafting and delivering data solutions tailored to meet the diverse requirements of stakeholders across the more »

are looking for an BI Analyst position for a large business based in Liverpool. The Business Intelligence Analyst is responsible for maintaining the data architecture and data pipelines that support business intelligence systems. This includes ensuring that the data architecture is scalable, secure, and … optimized for performance. They also work closely with other teams to ensure that data is properly integrated and available for analysis. The Business Intelligence Analyst will work closely with the analysts for reporting requirements and ensuring the correct data structure is in place for implementing newly … awarded contracts. The role will be responsible for designing processes and controls to ensure all data presented is tested, and accurate. Good communication skills is crucial for this role as you will need to present key information to managers across the business. It is essential you have strong more »

Senior Data Engineer Financial Services London (Hybrid) £90K plus bonuses and benefits Harrington Starr has partnered with leading data and analytics firm on the forefront of capital markets innovation as they seek to hire an experienced Data Engineer. Our client extends its services to … global exchange groups, banks, brokers, asset managers, and hedge funds. They are seeking to hire a dynamic and highly motivated data engineer for its London team. This individual should have an entrepreneurial mindset and the adaptability to thrive in an extremely fast paced environment. Within this role, you … will be responsible for building data pipelines for a cloud-based warehouse using Azure and Snowflake, enhancing data capabilities for analytics and science. What you need: 3+ years of hands-on experience as a Data Engineer, building ETL pipelines and managing data more »

DATA ENGINEER LONDON BASED £75,000-95,000 PER ANNUM This growing e-commerce trading company are searching for a new Data Engineer. You will be responsible for building and maintaining a new AWS serverless platform. You will also be responsible for building and maintaining data pipelines, using Python. THE COMPANY This E-commerce trading company have been growing since their formation. They are expanding their Data and Analytics team as the CEO has realised how important Data and Technology are to the business and is investing further in Machine … Learning variables. THE ROLE You will be joining an expanding Data and Analytics team, which currently has more than 20 employees. You will be responsible for building and maintaining a new AWS serverless data platform. Improve best coding practices within the Business. Stream real-time Data more »

Data Engineer On-Premise/Excel/SQL We have partnered with a leading client based in Central London who are looking to increase their data engineering team. Role: You will be working on a large volume of various financial reporting data sources. The … client here is using on-premise databases including Excel services & SQL. You will be working to gather data from these various sources for reporting, and creating the data pipelines. Experience: Data engineering experience within financial services (Asset Management/Harrington Starr) Experience working to … gather data from on-premise sources such as Excel, SQL and Oracle. If this is of interest please reach out. archie.odonovan@harringtonstarr.com more »

SENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office. Commutable from London.) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of … Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly … organisation. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years of commercial work as a Senior Data Engineer (responsible for taking decisions, rather than just writing code) An ability to write production quality Python code. Strong SQL Skills Experienced creating data more »

SENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement both Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly … organisation. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years of commercial work as a Senior Data Engineer (responsible for taking decisions, rather than just writing code) An ability to write production quality Python code. Strong SQL Skills Experienced creating data more »

Lead Data Engineer (Azure/SQL) - London - £70k 2-3 days per week in office My client is looking for a Data Lead to take responsibility for the technical design and implementation of data integration projects using Azure and Integration Services. Core duties will … the team whilst ensuring the overall performance of the solutions utilising the latest technologies, processes and best practice. You will design and build data pipelines, ETL processes and data workflows that enable data to be transferred seamlessly across a variety of platforms Required Skills … Demonstrable experience in designing and deploying Azure Integration Services solutions - Proven experience of building data solutions and products in Azure - Data pipelines - SQL knowledge - Agile/Scrum Lead Data Engineer (Azure/SQL) - London - £70k 2-3 days per week in office In accordance more »

Data Engineer - Leading Pharmaceutical Company - Exeter (Tech Stack: Data Engineer, Databricks, Python, Power BI, TSQL, ETL, Agile Methodologies, Refactoring) Are you a talented Data Engineer looking for a new challenge? Our client, a leading pharmaceutical company based in Exeter, is seeking a dedicated and … skilled Data Engineer to join their innovative team. This role offers the flexibility of remote work, with the requirement to be in the office just once a month. Key Responsibilities: Develop and maintain advanced data pipelines using Databricks. Implement and manage rigorous testing processes. Utilise Python … for data manipulation and automation tasks. Create dynamic reports and visualisations with Power BI. Optimise and manage databases using TSQL. Handle complex ETL processes efficiently. Collaborate within Agile frameworks to enhance project delivery. Refactor code to improve performance and maintainability. Essential Skills: Strong proficiency in Databricks. In-depth more »

Data Engineer - Leading Pharmaceutical Company - Bristol (Tech Stack: Data Engineer, Databricks, Python, Power BI, TSQL, ETL, Agile Methodologies, Refactoring) Are you a talented Data Engineer looking for a new challenge? Our client, a leading pharmaceutical company based in Bristol, is seeking a dedicated and … skilled Data Engineer to join their innovative team. This role offers the flexibility of remote work, with the requirement to be in the office just once a month. Key Responsibilities: Develop and maintain advanced data pipelines using Databricks. Implement and manage rigorous testing processes. Utilise Python … for data manipulation and automation tasks. Create dynamic reports and visualisations with Power BI. Optimise and manage databases using TSQL. Handle complex ETL processes efficiently. Collaborate within Agile frameworks to enhance project delivery. Refactor code to improve performance and maintainability. Essential Skills: Strong proficiency in Databricks. In-depth more »

Leading ecommerce client now requires a Data Engineer to join their innovative Machine Learning team. This role will focus on increasing overall data efficiency using Machine Leaning, streamlining data processes to increase overall profitability, and ensuring our clients operations and customer teams can increase … strong exposure to Machine learning principles/practices and technologies such as ML flow/Sage Maker. The role: Develop robust and scalable data pipelines. Collaborate with cross-functional teams to develop and deploy Machine Learning models and algorithms to solve business challenges and create opportunities. Contribute to … the development of our clients in-house Machine Learning operations framework. Support the data science and analytics team in deploying pipelines. Coach and mentor the team to improve development standards. Key requirements: Strong hands-on experience with Databricks, Spark, SQL or Scala. Proven experience designing and building data more »

a dynamic and experienced Business Intelligence Developer to join their innovative team. This role presents an exciting opportunity for individuals passionate about leveraging data to drive business insights and decisions. With a salary range of up to £70,000 per annum, this position offers competitive compensation and ample … room for professional growth. Key Responsibilities: Engineering: Design, develop, and maintain data pipelines using Azure Data Factory (ADF) and Databricks, ensuring the seamless flow of data across various systems and platforms. BI Reporting: Utilize Power BI to create visually appealing and insightful reports and … dashboards that provide actionable insights to stakeholders across the organization. Collaborate closely with cross-functional teams, including data scientists, business analysts, and IT professionals, to understand business requirements and translate them into technical solutions. Optimization: Implement performance tuning techniques to enhance the efficiency and scalability of data more »

Data Architect + Salary: £85,000 - £100,000 + Security Clearance: Must hold SC or DV + Location: Romsey or Woking (Hybrid) *UK Eyes only - Dual Citizenship or overseas card not eligible due to nature of projects Areas of Responsibility/Tasks: Help Defence customers develop their strategy … for data as a strategic asset and define the appropriate level of governance needed and the appropriate processes. Communicate the data strategy to non-technical stakeholders and technical experts. Define and the architecture for data software and analytics solutions, either as standalone engagements or … high level technical requirements. Provide technical guidance and coaching to junior members of the team. Essential skills/experience: Alongside your skills with Data specific technologies, you have a broad technical background which allows you to rapidly understand new systems and domains, and prototype solutions based on your more »

Data Architect + Salary: £85,000 - £100,000 + Security Clearance: Must hold SC or DV + Location: Romsey or Woking (Hybrid) *UK Eyes only - Dual Citizenship or overseas card not eligible due to nature of projects Areas of Responsibility/Tasks: Help Defence customers develop their strategy … for data as a strategic asset and define the appropriate level of governance needed and the appropriate processes. Communicate the data strategy to non-technical stakeholders and technical experts. Define and the architecture for data software and analytics solutions, either as standalone engagements or … high level technical requirements. Provide technical guidance and coaching to junior members of the team. Essential skills/experience: Alongside your skills with Data specific technologies, you have a broad technical background which allows you to rapidly understand new systems and domains, and prototype solutions based on your more »

I'm looking for a Power BI and data analytics enthusiast to join a business services organisation in Central London - this is a hybrid role, requiring 2-3 days per week in the office on average. This is a pivotal role for this business, where you'll be … aligned to one of their major financial services clients as the dedicated "data" person, and will proactively harness untapped data in the client's network to inform decision-making, ensure the delivery of exceptional services to the client, and drive operational efficiency. This will involve identifying … data sources, implementing data capture and storage methodologies, and automating data pipelines from these various sources. You will be responsible for developing regular automated and ad-hoc Power BI reports to provide invaluable insight to management, on how they may reduce costs and improve more »

Job Title: Gen AI Consultant Location: Fully Remote Job Type: Contract/Contract-to-hire Responsibilities: Data Engineering: Collaborate with cross-functional teams to design and implement data pipelines, ensuring efficient extraction, transformation, and loading (ETL) processes. Work with diverse healthcare datasets, integrating and cleaning data from various sources to create a unified and reliable data infrastructure. Develop and maintain databases, ensuring data quality, integrity, and security. AI Integration in Healthcare: Assist in the development and implementation of AI solutions tailored to healthcare challenges. Collaborate with data scientists … and machine learning engineers to deploy models into production environments. Utilize genomics, clinical, and administrative data to derive actionable insights and recommendations. Research and Innovation: Stay abreast of the latest advancements in genomics, healthcare, and AI technologies. Contribute to the development of new methodologies and tools to enhance more »