101 to 125 of 136 Permanent Data Pipeline Jobs with Hybrid or WFH Options

learning models through research, such as reviewing academic papers and adapting them for our use. Drive the development of the cutting-edge 3D AI pipeline, leveraging the latest breakthroughs in 3D data processing, 3D vision, and machine learning techniques. This entails system design and comprehensive testing. Identify … and address bottlenecks in data, pipeline, and operations, proactively devising and implementing agile solutions to enhance scalability and optimize performance. Take ownership of project management for AI/Vision initiatives, overseeing end-to-end execution and effectively coordinating data operations. Mentor and empower junior team more »

SQL DBA - Fully Remote - £55k - £60K Overview An excellent opportunity has arisen with a market leading, data driven Saas company for an experienced, motivated, and autonomous SQL DBA with skills in T-SQL and AWS. Role & responsibilities Manage AWS RDS SQL Server databases. Monitor system's health and … management and support teams. Provide bug-hunting support on the SQL server. Change code (procedures, views, function, triggers) to correct a bug. Perform data-patching operation out of office hours. Create and Restore Native backup for AWS RDS. Skills & experience 2+ years of MS SQL Server, including creation … T-SQL programming. 1+ years of performance tuning. Index analysis. Profiler. Performance monitor. AWS console: RDS Databases. Performance insight. Knowledge of Data Pipeline and Glue (Desirable) Data warehousing. Package: £50K - £60k basic salary Fully remote 25 days annual leave more »

differentiators that puts Omnicom ahead of the competition. Specific responsibilities of the team are listed below: 1. To scope and deliver all Omni Data Ops and Reporting work for Omnicom clients, including: Data Taxonomies design & maintenance Data Governance and QA Dashboard design, build and … maintenance Data Pipelines design & delivery Media Planning Tool Deployment and Maintenance The Data Ops and Reporting team works very closely with the US Marketing Intelligence team and the Annalect India team to deliver scalable solutions at a global level. ROLE SUMMARY: We are looking for a … Data Operations and Reporting Director, who will work on supporting the Head of Marketing Intelligence and Reporting, EMEA in scoping and delivering all team solutions for one or more of Omnicom s clients. KEY RESPONSIBILITIES: Strong oversight across business responsibilities, to the extent that challenges and opportunities are more »

are looking for an BI Analyst position for a large business based in Liverpool. The Business Intelligence Analyst is responsible for maintaining the data architecture and data pipelines that support business intelligence systems. This includes ensuring that the data architecture is scalable, secure, and … optimized for performance. They also work closely with other teams to ensure that data is properly integrated and available for analysis. The Business Intelligence Analyst will work closely with the analysts for reporting requirements and ensuring the correct data structure is in place for implementing newly … awarded contracts. The role will be responsible for designing processes and controls to ensure all data presented is tested, and accurate. Good communication skills is crucial for this role as you will need to present key information to managers across the business. It is essential you have strong more »

Senior Data Engineer Financial Services London (Hybrid) £90K plus bonuses and benefits Harrington Starr has partnered with leading data and analytics firm on the forefront of capital markets innovation as they seek to hire an experienced Data Engineer. Our client extends its services to … global exchange groups, banks, brokers, asset managers, and hedge funds. They are seeking to hire a dynamic and highly motivated data engineer for its London team. This individual should have an entrepreneurial mindset and the adaptability to thrive in an extremely fast paced environment. Within this role, you … will be responsible for building data pipelines for a cloud-based warehouse using Azure and Snowflake, enhancing data capabilities for analytics and science. What you need: 3+ years of hands-on experience as a Data Engineer, building ETL pipelines and managing data more »

Data Engineer - Leading Pharmaceutical Company - Exeter (Tech Stack: Data Engineer, Databricks, Python, Power BI, TSQL, ETL, Agile Methodologies, Refactoring) Are you a talented Data Engineer looking for a new challenge? Our client, a leading pharmaceutical company based in Exeter, is seeking a dedicated and … skilled Data Engineer to join their innovative team. This role offers the flexibility of remote work, with the requirement to be in the office just once a month. Key Responsibilities: Develop and maintain advanced data pipelines using Databricks. Implement and manage rigorous testing processes. Utilise Python … for data manipulation and automation tasks. Create dynamic reports and visualisations with Power BI. Optimise and manage databases using TSQL. Handle complex ETL processes efficiently. Collaborate within Agile frameworks to enhance project delivery. Refactor code to improve performance and maintainability. Essential Skills: Strong proficiency in Databricks. In-depth more »

Data Engineer - Leading Pharmaceutical Company - Bristol (Tech Stack: Data Engineer, Databricks, Python, Power BI, TSQL, ETL, Agile Methodologies, Refactoring) Are you a talented Data Engineer looking for a new challenge? Our client, a leading pharmaceutical company based in Bristol, is seeking a dedicated and … skilled Data Engineer to join their innovative team. This role offers the flexibility of remote work, with the requirement to be in the office just once a month. Key Responsibilities: Develop and maintain advanced data pipelines using Databricks. Implement and manage rigorous testing processes. Utilise Python … for data manipulation and automation tasks. Create dynamic reports and visualisations with Power BI. Optimise and manage databases using TSQL. Handle complex ETL processes efficiently. Collaborate within Agile frameworks to enhance project delivery. Refactor code to improve performance and maintainability. Essential Skills: Strong proficiency in Databricks. In-depth more »

Leading ecommerce client now requires a Data Engineer to join their innovative Machine Learning team. This role will focus on increasing overall data efficiency using Machine Leaning, streamlining data processes to increase overall profitability, and ensuring our clients operations and customer teams can increase … strong exposure to Machine learning principles/practices and technologies such as ML flow/Sage Maker. The role: Develop robust and scalable data pipelines. Collaborate with cross-functional teams to develop and deploy Machine Learning models and algorithms to solve business challenges and create opportunities. Contribute to … the development of our clients in-house Machine Learning operations framework. Support the data science and analytics team in deploying pipelines. Coach and mentor the team to improve development standards. Key requirements: Strong hands-on experience with Databricks, Spark, SQL or Scala. Proven experience designing and building data more »

Data Architect + Salary: £85,000 - £100,000 + Security Clearance: Must hold SC or DV + Location: Romsey or Woking (Hybrid) *UK Eyes only - Dual Citizenship or overseas card not eligible due to nature of projects Areas of Responsibility/Tasks: Help Defence customers develop their strategy … for data as a strategic asset and define the appropriate level of governance needed and the appropriate processes. Communicate the data strategy to non-technical stakeholders and technical experts. Define and the architecture for data software and analytics solutions, either as standalone engagements or … high level technical requirements. Provide technical guidance and coaching to junior members of the team. Essential skills/experience: Alongside your skills with Data specific technologies, you have a broad technical background which allows you to rapidly understand new systems and domains, and prototype solutions based on your more »

Data Architect + Salary: £85,000 - £100,000 + Security Clearance: Must hold SC or DV + Location: Romsey or Woking (Hybrid) *UK Eyes only - Dual Citizenship or overseas card not eligible due to nature of projects Areas of Responsibility/Tasks: Help Defence customers develop their strategy … for data as a strategic asset and define the appropriate level of governance needed and the appropriate processes. Communicate the data strategy to non-technical stakeholders and technical experts. Define and the architecture for data software and analytics solutions, either as standalone engagements or … high level technical requirements. Provide technical guidance and coaching to junior members of the team. Essential skills/experience: Alongside your skills with Data specific technologies, you have a broad technical background which allows you to rapidly understand new systems and domains, and prototype solutions based on your more »

Job Title: Gen AI Consultant Location: Fully Remote Job Type: Contract/Contract-to-hire Responsibilities: Data Engineering: Collaborate with cross-functional teams to design and implement data pipelines, ensuring efficient extraction, transformation, and loading (ETL) processes. Work with diverse healthcare datasets, integrating and cleaning data from various sources to create a unified and reliable data infrastructure. Develop and maintain databases, ensuring data quality, integrity, and security. AI Integration in Healthcare: Assist in the development and implementation of AI solutions tailored to healthcare challenges. Collaborate with data scientists … and machine learning engineers to deploy models into production environments. Utilize genomics, clinical, and administrative data to derive actionable insights and recommendations. Research and Innovation: Stay abreast of the latest advancements in genomics, healthcare, and AI technologies. Contribute to the development of new methodologies and tools to enhance more »

an exciting opportunity to join a great team with opportunity to develop skills and implement new technologies as we look to develop the data platform and support national developments. You will have experience working with large datasets and experience of working with a range of data … the opportunity to implement and improve processes and methodology where necessary. As a Senior Developer you will have experience working in a similar data environment and delivering complex ETL/ELT processes. You will be able to manage the workload of yourself and the team and be able … NHS values underpin everything we do. The development team are a small team within the wider Business Intelligence team responsible for ensuring the data flows and data pipelines operate effectively and efficiently to support onward analysis. The team is based in various locations, mostly working from more »

Principal Data Engineer London (hybrid) Up to £100,000 base + package Here at Anson McCade we are partnering with a leading Digital Transformation Consultancy who are in need of an experienced Data Engineer to join a multi-disciplinary team building, supporting and maintaining User-Centred … is also desirable. Solid experience of at least one Cloud provider such as AWS, Azure or GCP. Strong experience of working with different data formats, e.g., CSV, JSON and XML Building reliable Data Pipelines Broader knowledge of IT — e.g., Security and Networking Working in an Agile … Salary up to £100,000 per annum Professional growth and career development Collaborative and inclusive work environment Health and well-being initiatives Principal Data Engineer London (hybrid) Up to £100,000 base + package If this position is of interest please don't hesitate and apply down below more »

created role within the Business Improvement & Change function responsible for delivering and driving business change across the organisation. Candidate Profile: A passionate experienced data and business intelligence professional with ideally experienced within a highly regulated industry. Skilled in Power BI, DAX, Excel and MS SQL, with hands on … experience developing and designing end user reports Strong management and leadership skills Experience and understanding of data architecture and infrastructure to include data pipelines, data warehousing and ETL Knowledge in supporting regulatory reporting and experience of data governance. If you are interested … experience and skills evidenced on the CV. For information on how your personal details may be used by Sellick Partnership, please review our data processing notice on our website. more »

created role within the Business Improvement & Change function responsible for delivering and driving business change across the organisation. Candidate Profile: A passionate experienced data and business intelligence professional with ideally experienced within a highly regulated industry. Skilled in Power BI, DAX, Excel and MS SQL, with hands on … experience developing and designing end user reports Strong management and leadership skills Experience and understanding of data architecture and infrastructure to include data pipelines, data warehousing and ETL Knowledge in supporting regulatory reporting and experience of data governance. If you are interested … experience and skills evidenced on the CV. For information on how your personal details may be used by Sellick Partnership, please review our data processing notice on our website. more »

drastically improve their offering internally and externally Building an application that will be used globally across the wider business Building the data pipeline, libraries and frameworks Working with the latest AI/ML tools Experience Required: Extensive Python Programming experience Experience working with Gen AI technologies Package more »

secure operation of AI and ML systems. Develop and own robust enterprise security architecture for AI/ML systems, CI/CD and data pipelines. Participate in enterprise-wide architecture initiatives for AI/ML. This is a hybrid role with multiple UK locations Salary up to more »

and also offer you a chance to work in a highly motivated and smart team of engineers? You'll work as a Senior Data Engineer building a data and analytics platform that's used by the hedge fund's trading desks. You'll join at a … time where the fund are diversifying into new markets and therefore you'll play a crucial part in all aspects of data operations in this new area for them. You'll work extremely closely with Portfolio Managers/Quants - You'll work with them to understand exactly what … they need from the data and work fully end to end to create solutions that present data in a way that can be consumed effectively by them. Qualifications: Strong experience with Python for data engineering. Experience building custom Data Pipelines Strong SQL more »

business information accessible to all. Twenty-five years later, we’ve not only realised this dream, changed the market for the better, made data intelligence accessible to all businesses big and small but most importantly, opened new avenues of data intelligence for businesses with machine learning … AI and connected data. From risk management through to opportunity identification, our industry-leading solutions, power decisions for companies by turning their data into actionable insights that help them become stronger, grow faster and thrive. THE TEAM This opportunity is to join a team of highly technically skilled … engineers, who are redesigning Creditsafe data platform with high throughput and scalability as primary goal. The data delivery platform is being built upon AWS redshift and S3 cloud storage. The platform expected to manage over billion objects along with daily increment of more than 10 million more »

the strategic DevOps approach of their ML applications, used by thousands of customers a day. This role would see you collaborate with the Data Science team to design and implement scalable infrastructure for machine learning model deployment and data processing. Whilst also deploying machine learning models … and data pipelines to production environments, ensuring robust monitoring and optimal performance. you will also take on th and develop and maintain automation scripts and tools to streamline ML model deployment and ensure reproducible. Implement security best practices and ensure compliance with data privacy regulations in … all processes. Whilst working with cross-functional with Data Scientists, Software Engineers, and DevOps team members for efficient model development, testing, and deployment. The successful DevOps/MLOps engineer will have the following skills: 1+ years working as a DevOps Engineer Proven experience in DevOps/MLOps with more »

London & Edinburgh Work Mode: Mostly WFH, candidates should be open to travel as required. Job Description: We are seeking a highly skilled Senior Data Engineer with expertise in SAS to join our team and contribute to the transformation of our data pipelines. The successful candidate will … play a crucial role in rewriting existing pipelines from SAS, Info, pearl, and shell scripts to Python and DBT-based solutions, ultimately loading data into Snowflake and Salesforce on Azure. Key Responsibilities: Lead the conversion of existing SAS-based modules to Python-based solutions. Design, develop, and implement … Python and DBT-based pipelines for efficient data transformation and loading. Collaborate with cross-functional teams to understand requirements and ensure successful pipeline migration. Utilize expertise in SAS, pearl, and shell scripts to seamlessly transition to Python and DBT technologies. Implement best practices for data more »

AI solutions that enhance, organise, and enrich their data, cost-effectively, accurately, and scalably Plan and manage their ML/AI delivery pipeline Mentor and coach team members on ML engineering best practices Advise senior management on their ML/AI strategy. Key skills: Python for Machine … Learning and Data Science Computer Vision Frameworks used in Machine Learning and Data Science such as TensorFlow, PyTorch, and scikit-learn. Data Science and Visualisation libraries including Pandas, NumPy, scikit-learn, matplotlib, Seaborn. Cloud services used in machine learning and data science … such as Azure, OpenAI, Hugging Face, AWS ML/AI. Machine Learning Applications development life cycle processes and tools - MLOps, including building ETL data pipelines. Cutting-edge approaches to Machine Learning, including transformer models, diffusion models, and adversarial machine learning. Experience in fine-tuning off-the-shelf Large more »

designing and building In the Macro Quant Engineering group , you will work directly with Portfolio Management, Traders, Quant Researchers, High Performance Software and Data Engineering teams. Your work will be varied and include - Develop Software solutions for Quant Research and Trading communities Automated Research workflows to support idea … generation and strategy development Design and build Backtesting solutions Build Data Pipelines for collection of new Alternate datasets Design and Build Market Data APIs Design and build bespoke Analytics and Risk tools Implementation of new Trading Strategies into Production Skills and Academics required Minimum 3 years … Mathematics/Probability, et al., and Software Development/Computer Science. Expert Python (inc. Pandas, NumPy, SciPy, et al) Excellent understanding of Advanced Data Structures and Algorithms Experience of AWS, GCP or Azure Experience of high performance languages such as C++, C#, (JVM based) is beneficial more »

energy and commodities markets. They provide a wide range of services to a substantial and diversified customer base. They are seeking a skilled, data focused Python Developer who can design and develop their innovative AWS-native data analytics platform. As a Python Developer, you will be … building high-performance, high-throughput data pipelines for trading exchange, FX and fundamental data. The ideal candidate should have the majority of the following: Bachelor's degree in Computer Science, Engineering, or a related field. Strong Python development. Experience with Pandas is desirable. 3+ years of experience in … data engineering. Experienced in building ETL data pipelines. Relational database experience w/PostgreSQL. Understanding of tech within our stack: AWS/Apache beam/Kafka. Experience with Object Orientated Programming A desire to work in the commodities/trading sector. Permanent/Full-Time Employment. more »

I have partnered with a cutting-edge software business who are looking to hire a Head of Data Engineering, As the Head of Data Engineering, you will be responsible for designing, developing, and maintaining our data infrastructure on GCP. You will work closely with … cross-functional teams to ensure that our data pipelines are robust, scalable and efficient. The best-matched Head of Data Engineering will have the following experience and abilities: Led a team of data engineers in designing, building, and maintaining data pipelines on … the Google Cloud Platform. Evaluate and recommend new technologies and tools to improve our data infrastructure and processes. Monitor and optimize the performance of data pipelines to ensure reliability, scalability, and cost-effectiveness. Hybrid working in London, 2 days a week in the office If this more »