176 to 200 of 377 Data Pipeline Jobs in the UK

Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security … policies. Essential Technical Skills 2-3 years Azure data systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. … Building Azure data pipelines. Agile methodology experience. Problem-solving skills. Awareness of industry trends. Stakeholder engagement. Desired Experience Business Objects Reporting. Power BI familiarity. more »

Omni client solutions. These solutions are major differentiators that puts Omnicom ahead of the competition. Specific responsibilities of the team are listed below. Data Taxonomies design & maintenance Data Governance and QA Dashboard design, build and maintenance Data Pipelines design & delivery TW/Planit (& TrackIT … for maintaining and improving tables and business logic for a reporting platform. The Business Intelligence Manager will support an MI Director with all data operations and reporting workstreams for one of Omnicom’s largest global autotive clients and work closely with our engineering team; TSOC. This role will … ensure our AWS data infrastructure is supporting a best-in-class reporting platform for one our our largest accounts within Omnicom Media Group, and will be reporting into the Senior Marketing Intelligence and Reporting Director. Communication skills and the ability to prioritize tasks across projects to meet deadlines more »

Our client, a leading innovation and transformation consulting firm based in London, is seeking a talented Senior Consultant - Data Engineer. This role is perfect for an experienced professional who thrives in dynamic environments and is eager to drive impactful data engineering projects. The firm specializes in … leveraging advanced technology to transform businesses, providing cutting-edge solutions to a diverse range of clients. As a Senior Consultant - Data Engineer, you will play a key role in designing, developing, and optimizing data pipelines and architectures. Your expertise will help clients harness the power of … their data, ensuring robust and scalable solutions that meet business needs. You will work with a talented team, utilizing your skills in ETL processes, AWS, and Python to deliver high-quality data engineering projects. Key Responsibilities: Design and develop ETL pipelines to support data more »

Managers as part of the Fixed Income Technology leadership team. The ideal candidate will be a collaborative leader, with experience of application development, data management and cloud-based architectures. They will be comfortable to empower the team members to be self-reliant in decision making, and ability to … levels, demands good hygiene of code, database design and APIs. You will need to be comfortable with databases, working with SQL to diagnose data issues, and digging into logs and documentation to truly understand what the systems are doing. The team is part of a wider Fixed Income … by Risk Analysts, Portfolio Managers, and Quants. This is a hands-on leadership role that provides an opportunity to tackle sophisticated business, logic, data, and technical challenges. Role summary and job responsibilities Manages a software engineering team to deliver business-focused outcomes. Work closely with Head of Fixed more »

LEAD DATA ENGINEER LONDON BASED £80,000-90,000 PER ANNUM This Real estate company is searching for a new Lead Data Engineer, to Revolutionise their expanding Data and Analytics team, and help build out brand new Data pipelines using Python and … SQL. You will also be responsible for building a new Data platform in GCP. THE COMPANY This growing company are searching for a new Lead Data Engineer, to own the technical direction of their expanding Data and Technology team. They have been investing heavily … in their data team over recent years, and are a very data-focused business. THE ROLE Joining this team as a Lead data engineer, you will be responsible for building the company's next-generation data platform using GCP. This role has more »

Full Stack Developer/Data Engineer opportunity. Full time permanent position. Fully remote or hybrid - office just outside of London. My client is a dynamic and rapidly growing electrification company dedicated to the decarbonisation of heat transport and induction. They have years of experience from across the energy … sector in integrating and connecting renewable generation, EV charging and the digitalisation of energy. They are seeking a Full Stack Developer/Data Engineer with Data bricks expertise to help tackle exciting challenges in the energy sector. In this role, you will: Develop and scale energy … solutions: Bring ideas to life, building robust and scalable applications from proof-of-concept to deployment, working alongside the Energy Solutions team. Design data pipelines for smarter energy: Craft and manage data pipelines using Databricks, integrating best-in-class demand forecasts to optimize energy use. Enhance more »

SENIOR DATA ENGINEER (EU Remote Opportunity) Xcede are delighted to be working with a very exciting Web3/Blockchain organisation with a remote working culture. Their company makes life easier for organisations in the Web3 space by providing managed services across a range of operational tasks and responsibilities … in one space. As a Senior Data Engineer in the company, you will have several clear tasks that are essential to the smooth running of processes that make this Product so unique. Responsibilities Design and implement both batch & stream Data Pipelines around the data stores & data lake. Lead by example, always aiming to work towards software engineering best practice and disaster prevention (rather than recovery). Maintain and optimise the infrastructure across the company. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years more »

Exciting Opportunity: Senior Data Analyst Role 🌟 Are you a seasoned data professional looking for your next challenge? We have an exceptional opportunity for a Senior Data Analyst to join a leading global financial institution’s dynamic Risk Analytics team. 🔍 Role Focus: Data provisioning and ensuring seamless access to vital data sources. Managing and optimizing data storage solutions. Automating processes to enhance efficiency and accuracy. Conducting comprehensive data analytics to support risk management and strategic decision-making. 🎯 Key Responsibilities: Develop and maintain data pipelines and infrastructure. Implement and oversee data governance and best practices. Collaborate with cross-functional teams to drive data-driven insights. Utilize advanced analytics techniques to solve complex business problems. Utilize SQL and Python. 💼 What We Offer: A collaborative and innovative work environment. Opportunities more »

SQL DBA - Fully Remote - £55k - £60K Overview An excellent opportunity has arisen with a market leading, data driven Saas company for an experienced, motivated, and autonomous SQL DBA with skills in T-SQL and AWS. Role & responsibilities Manage AWS RDS SQL Server databases. Monitor system's health and … management and support teams. Provide bug-hunting support on the SQL server. Change code (procedures, views, function, triggers) to correct a bug. Perform data-patching operation out of office hours. Create and Restore Native backup for AWS RDS. Skills & experience 2+ years of MS SQL Server, including creation … T-SQL programming. 1+ years of performance tuning. Index analysis. Profiler. Performance monitor. AWS console: RDS Databases. Performance insight. Knowledge of Data Pipeline and Glue (Desirable) Data warehousing. Package: £50K - £60k basic salary Fully remote 25 days annual leave more »

We're representing a dynamic business dedicated to extending healthy lifespans and cutting unnecessary medical costs. They're seeking a Senior Data Engineer to propel their Data team forward. Key Responsibilities: Lead Cloud Data Warehouse Project: Oversee the next development phase, ensuring top-notch … scalability, reliability, and performance. Data Management Ownership: Be the go-to expert for data management, ensuring smooth operations and accessibility. Support BAU Workloads: Assist in prioritising and managing day-to-day tasks for efficiency and alignment with goals. Set Technical Direction: Define the systems and tools … technical direction, advancing towards ML and AI integration. Required Experience: Snowflake: Proficiency in setup, configuration, and optimisation. DBT (Data Build Tool): Strong skills in managing transformations and data pipelines. Python: Expertise in scripting, automation, and data manipulation. Beneficial Experience: Dagster/Airflow: Managing complex more »

SENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office. Commutable from London.) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of … Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly … organisation. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years of commercial work as a Senior Data Engineer (responsible for taking decisions, rather than just writing code) An ability to write production quality Python code. Strong SQL Skills Experienced creating data more »

SENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement both Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly … organisation. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years of commercial work as a Senior Data Engineer (responsible for taking decisions, rather than just writing code) An ability to write production quality Python code. Strong SQL Skills Experienced creating data more »

Leading ecommerce client now requires a Data Engineer to join their innovative Machine Learning team. This role will focus on increasing overall data efficiency using Machine Leaning, streamlining data processes to increase overall profitability, and ensuring our clients operations and customer teams can increase … strong exposure to Machine learning principles/practices and technologies such as ML flow/Sage Maker. The role: Develop robust and scalable data pipelines. Collaborate with cross-functional teams to develop and deploy Machine Learning models and algorithms to solve business challenges and create opportunities. Contribute to … the development of our clients in-house Machine Learning operations framework. Support the data science and analytics team in deploying pipelines. Coach and mentor the team to improve development standards. Key requirements: Strong hands-on experience with Databricks, Spark, SQL or Scala. Proven experience designing and building data more »

Data Engineer | Yorkshire | up to £45,000 basic | Flexible Working A regular feature in the "UK's Top 10 places to work", my client is an award-winning business with a reputable brand and is widely respected for investing in their employees, placing importance on personal development and … career progression. The Environment you'll be joining: You'll join a friendly 10+ Data Engineering team as the business undergoes a complete greenfield re-architecture from the ground up in Microsoft Azure. The Tech you'll be playing with: Azure Data Factory Azure Databricks PySpark … SQL DBT What you need to bring: 1-3 year's experience in building Data Pipelines SQL experience in data warehousing Python experience would be desirable Experience in Azure/GCP/AWS is a bonus Why join? Joining an award-winning business comes with its more »

team. This team is responsible for and enhancing the business’s lead management and CRM capabilities BI analysts with accurate and relevant application data business insights and predictive models developed by the BI team into self-optimising, productionised systems within the wider business. The ideal candidate will be … responsible for developing and maintaining data pipelines and queries to extract complex datasets needed for our business intelligence and reporting needs. Additionally, the candidate will be involved in writing production-level code to support the organisation’s various CRM and lead-management applications and systems. Key Responsibilities: 1. … Data Extraction and Transformation: Design and develop data pipelines and queries, for efficient data extraction and transformation. Collaborate with cross-functional teams to understand data requirements and ensure accurate and timely delivery of BI solutions. 2. Business Intelligence: Work closely with business more »

the selected Machine Learning Engineer, your background will include: A minimum of fours years industry experience in machine learning. Familiarity with cloud computing, data pipelines, and distributed ML technologies. Strong programming skills in Python, and experience with ML frameworks. Knowledge in Agile methodologies, CI/CD tools (e.g. more »

you want to design and build attractive digital products and services? Are you an analytic thinker? Do you enjoy creating valuable insights with data? Are you confident at iteratively refining user requirements and removing any ambiguity? In your role you will: • transform data into valuable insights … that inform business decisions, making use of our internal data platforms and applying appropriate analytical techniques • provide technology solutions that will solve business problems and strengthen our position as digital leaders in financial services • develop and maintain data pipelines and build out API integrations to support … increases in data volume and complexity • apply a broad range of software engineering practices, from analyzing user needs and developing new features to automated testing and deployment Your team In our agile operating model, crews are aligned to larger products and services fulfilling client needs and encompass multiple more »

About The Role We are recruiting for a Principal Data Engineer to join our team. Principal Data Engineers work in multi-disciplinary teams that build, support, and maintain user-centered digital solutions that offer real value and work for everyone. Our Principal Data Engineers … are experts in their field. You will act as a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships, and be passionate about developing and upskilling others. Your role in a … and ensuring that challenges are overcome. Lead in the recruitment of other engineers, and support other consultants in their professional development. Ensure our Data and Engineering communities contribute to our business at a strategic level. Lead on new business opportunities, writing technical bids and proposals. Promote our Data more »

We are looking for an experienced Senior Data Engineer passionate about designing and building high-quality data pipelines to power cutting-edge genAI products. The ideal person would have a strong background and expertise in real-time data streaming and cloud technologies. They would … The person we’re looking for We are looking for a self-starter who can see the big picture and understand how our data points are connected. You should be able to use your excellent communication skills to simplify and explain concepts to others. You will also be … bringing out the best in them, have excellent communication skills and enjoy fostering best practices. You’ll be responsible for Serving as a data engineering subject matter expert Owning and shaping our data streaming roadmap Collecting use cases and requirements from the wider data more »

created role within the Business Improvement & Change function responsible for delivering and driving business change across the organisation. Candidate Profile: A passionate experienced data and business intelligence professional with ideally experienced within a highly regulated industry. Skilled in Power BI, DAX, Excel and MS SQL, with hands on … experience developing and designing end user reports Strong management and leadership skills Experience and understanding of data architecture and infrastructure to include data pipelines, data warehousing and ETL Knowledge in supporting regulatory reporting and experience of data governance. If you are interested … experience and skills evidenced on the CV. For information on how your personal details may be used by Sellick Partnership, please review our data processing notice on our website. more »

geography perspectives, we provide first-class macro insights within a 0–3-month time horizon. Our unique blend of alternative high-frequency macro data and positioning analysis enables us to predict market movements, creating valuable trading opportunities for our clients. With strategically located offices worldwide, we operate seamlessly … around the clock, ensuring our clients have access to timely and accurate information. Job Description: We are seeking a Data Engineer to join our dynamic team at Vanda Research. As a Data Engineer, you will play a crucial role in developing and maintaining our existing data infrastructure while potentially exploring and implementing new cloud services to enhance efficiency. This role offers the opportunity to grow into a data architect over time with hands-on experience and mentorship from our experienced team. Key Responsibilities: Develop and maintain the existing data architecture more »

Engineering in sculpting and realising the strategic vision, enhancing the analytical prowess of the Actuarial team. Embrace the challenge of refining operations through data automation and harnessing cutting-edge technologies. Key Essentials: Proficiency in Python, SQL, and PowerBI is paramount. Experience with Azure or APIs is highly advantageous. … standards. Showcase technical prowess in Python, SQL, and JSON. Implement and oversee a robust CI/CD process. Enhance Azure modules, advancing automated data pipelines. Question conventional analysis and design, advocating for innovative alternatives. Articulate technical design principles to non-technical stakeholders. Propose enhancements to data efficiency and reliability. Represent the actuarial engineering perspective in key forums and authorities. Explore and introduce new tools for data management and analysis. To apply, please submit your CV and a cover letter detailing your relevant experience and how you can contribute to the success of more »

business information accessible to all. Twenty-five years later, we’ve not only realised this dream, changed the market for the better, made data intelligence accessible to all businesses big and small but most importantly, opened new avenues of data intelligence for businesses with machine learning … AI and connected data. From risk management through to opportunity identification, our industry-leading solutions, power decisions for companies by turning their data into actionable insights that help them become stronger, grow faster and thrive. THE TEAM This opportunity is to join a team of highly technically skilled … engineers, who are redesigning Creditsafe data platform with high throughput and scalability as primary goal. The data delivery platform is being built upon AWS redshift and S3 cloud storage. The platform expected to manage over billion objects along with daily increment of more than 10 million more »

based projects, alongside deep learning and neural networks to support core clients Part of a team of 9 reporting to the Head of Data Science - working closely with a wider Data Engineering function Focusing on end-to-end data pipelines, for training, evaluating and … deploying ML models Working closely with Data Scientists on client partners, advising on best practice ML and MLOps infrastructure Looking for a 'Full Stack Data Scientist' profile Your Skills and Experience: MSc or PhD level education in STEM subjects. Strong knowledge of data science … fundamentals of building and evaluating models Strong experience in data pipelines and deploying ML models Preference for experience in retail/marketing but not required Tech across: Python, AWS, Databricks, PySpark, AB Testing, MLFlow, APIs Apply below more »

in the firm's technological evolution. The company are looking for a python developer who can design and develop their innovative AWS-native data analytics platform. Using Python, to build high-performance, high-throughput data pipelines for trading exchange, FX and fundamental data. This platform incorporates … real-time extraction, transformation and analysis of data from hundreds of diverse sources, some generating up to 100,000 transactions per minute The ideal candidate should have the majority of the following … Experience Developing and maintaining data pipelines for a company's analytics platform. Knowledge of how to collaborate with various teams to meet pipeline requirements. Be able to Troubleshoot and resolve pipeline issues. Strong experience in cloud-based development (AWS). Experience Optimizing pipelines for performance and more »