tasked with building and enhancing a modern Azure data platform, with an expertise in Databricks. About the Role: In this role, you will play a key part in developing ETL pipelines, optimizing data integration processes, and supporting data-driven decision-making across the business. You'll collaborate with stakeholders to understand data requirements, contribute to architectural decisions, and support the … migration of reporting services to Azure. Key Responsibilities: Design, build, and maintain ETL pipelines using Azure Data Factory , Azure Data Lake , Synapse , and Databricks . Design and build a greenfield Azure data platform to support business-critical data needs. Collaborate with stakeholders across the organization to gather and define data requirements. Assist in the migration of reporting services from on More ❯
Senior Data Engineer We are seeking a highly skilled Data Engineer to focus on maintaining data streams andETL pipelines within a cloud-based environment. The ideal candidate will have experience in building, monitoring, and optimizing data pipelines, ensuring data consistency, and proactively collaborating with upstream and downstream teams to enable seamless data flow across the organization. In this role … between 25%-50% of the time per month at the client's office, which is located in London. Key Responsibilities: Data Pipeline Development & Maintenance Build, maintain, and optimize scalable ETL/ELT pipelines using tools such as Dagster, or similar. Ensure high data availability, reliability, and consistency through rigorous data validation and monitoring practices. Collaborate with cross-functional teams to More ❯
Manchester, Lancashire, United Kingdom Hybrid / WFH Options
First Central Services
Finance, Actuarial, and Data Engineering to understand requirements and deliver high-impact data solutions. Expertise in Data Engineering and Development - you'll be comfortable designing, building, and optimising scalable ETL/ELT pipelines using cloud-based technologies and SQL, ensuring data is accessible, accurate, and timely. Financial and Actuarial Knowledge - you'll bring a working understanding of finance and actuarial … you'll use Python to develop scripts for automation, data transformation, and analytics - enabling everything from reserves analysis to forecast simulations. What's involved: Design, build, and optimise scalable ETL/ELT workflows for financial and actuarial datasets. Integrate data from financial systems (e.g., Workday) and actuarial sources into centralised data platforms. Collaborate with finance and actuarial teams to understand More ❯
of large, complex data sets. What You'll Do Develop and maintain automated data processing pipelines using Google Cloud: Design, build, and maintain data pipelines to support data ingestion, ETL, and storage Build and maintain automated data pipelines to monitor data quality and troubleshoot issues Implement and maintain databases and data storage solutions: Stay up-to-date with emerging trends … in SQL and experience with relational databases such as MySQL, PostgreSQL, or Oracle. Experience with big data technologies such as Hadoop, Spark, or Hive. Familiarity with data warehousing andETL tools such as Amazon Redshift, Google BigQuery, or Apache Airflow. Proficiency in Python and at least one other programming language such as Java, or Scala. Willingness to mentor more junior More ❯
Leeds, West Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Hays
for use by internal and external stakeholders. You will be part of the Business Intelligence & Data team, supporting the BI Manager to take forward development projects whilst maintain and developing Extract, TransformandLoad (ETL) pipelines from a range of business systems into the BI environment. You will also be maintaining and developing SQL based reporting and business intelligence within … essential Experience developing and testing reporting solutions Solid knowledge of MS SQL Server 2012-2022 data warehouse development and querying Experience using MS SQL Integration Services to develop complex ETLand automation solutions Expert knowledge of SQL Server Management Studio and Data Tools Knowledge of supporting programming and scripting languages such as C#, XML, PowerShell, Python Excellent communication and stakeholder More ❯
West Yorkshire, England, United Kingdom Hybrid / WFH Options
Hays Specialist Recruitment Limited
for use by internal and external stakeholders. You will be part of the Business Intelligence & Data team, supporting the BI Manager to take forward development projects whilst maintain and developing Extract, TransformandLoad (ETL) pipelines from a range of business systems into the BI environment. You will also be maintaining and developing SQL based reporting and business intelligence within … essential Experience developing and testing reporting solutions Solid knowledge of MS SQL Server 2012-2022 data warehouse development and querying Experience using MS SQL Integration Services to develop complex ETLand automation solutions Expert knowledge of SQL Server Management Studio and Data Tools Knowledge of supporting programming and scripting languages such as C#, XML, PowerShell, Python Excellent communication and stakeholder More ❯
our data lake andtransform it to support business intelligence and machine learning applications. Our work spans the entire data lifecycle; from ingesting data from clients, to developing complex ETL processes, to building systems for scraping external datasets (e.g., traffic, weather, points of interest, etc.). The team is dedicated to delivering high-performance, reliable infrastructure that enables data-driven … scalable data infrastructure that supports our business intelligence and analytics efforts. Key Responsibilities: Data Pipeline Development: Design, develop, and maintain robust data pipelines andETL processes to ingest, transform, andload data from diverse sources into our data warehouse. Data Quality and Governance: Implement and monitor data quality checks, ensuring accuracy, consistency, and reliability of data. Optimization: Optimize data processing More ❯
travel internationally to support delivery of engagements and projects) Ideally, you'll also have some of the following: Familiarity with the application of automation and data technologies (e.g. RPA, ETL tools, visual analytics) Formal project management training certification (e.g. PMP, PRINCE2, MSP) or process improvement certification (e.g. Six Sigma 'belt') is preferred What working at EY offers We offer a More ❯
engineering team sits at the centre of everything we do at Plentific and is constantly tackling challenging problems, such as online payments, quoting, invoicing, booking, search/scoring algorithms, ETL, data pipelines, in-app messaging, real-time notifications and fraud prevention. Our frontend engineers mostly work with TypeScript, JavaScript (ES2022), React, React Query, React Router, MaterialUI, GitHub actions, on an More ❯
transform structured and unstructured data from various policing systems. Collaborate with analysts, data scientists, and operational policing units to understand data requirements and deliver appropriate data solutions. Work with ETL/ELT tools to integrate data from sources such as Niche, Athena, PNC, custody systems, and other law enforcement platforms. Ensure data integrity, security, and compliance with relevant standards including More ❯
efficiency of IT operations. Monitoring and Maintenance : Utilize AIOps tools to monitor systems, detect anomalies, and predict potential issues before they impact operations. Data Pipeline Management : Develop and maintain ETL pipelines within Cribl to ensure data collection and processing. Collaboration : Work closely with development, operations, and observability teams to integrate AI solutions into the everyday workflow. Incident Management : Employ AIOps More ❯
verbal) Desired Skills: Experience with both PostgreSQL and MS SQL Server Advanced SQL query optimization skills Experience deploying and maintaining Kafka for event-driven architectures Experience deploying and maintaining ETL pipelines Experience with DataDog for monitoring and alerting Deep understanding of Site Reliability Engineering principles and best practices Experience with backend languages such as C# and Node.js Experience with scripting More ❯
PySpark, AWS S3, AWS Glue, Databricks, Amazon Redshift, DynamoDB, CI/CD and Terraform. Total 7 + years of experience in Data engineering is required. Design, develop, and optimize ETL pipelines using AWS Glue, Amazon EMR and Kinesis for real-time and batch data processing. Implement data transformation, streaming, and storage solutions on AWS, ensuring scalability and performance. Collaborate with More ❯
and initial 6 months. You'll be responsible for creating new and working on existing dashboards across a range of exciting project. Requirements: Strong Power BI experience Experience with ETL pipelines, data modelling, SQL Azure Data Factory experience Ideally: Experience with Power Platform integrations IT Service Management knowledge More ❯
creation, development, support and tuning. • Experience in managing multiple databases and instances in a cloud environment. • Experience in developing and remediating database views, functions, and stored procedures. • Experience in ETLand Analytics technologies (SSIS, SSAS, Click Replicate, Snowflake, Power BI) • Working for a medium size organisation in a period of rapid change. More ❯
and implement domain-specific data architectures and models, including conceptual, logical, and physical designs. Experience with data modelling tools and methodologies Expertise in designing and managing data integration pipelines, ETL processes, and data warehousing solutions. Hands-on experience with modern tools and platforms Solid experience with database management systems (e.g., SQL Server, Oracle, PostgreSQL) and cloud-based data platforms (e.g. More ❯
AWS and SQL/database skills Experience with geospatial data and FME Solid track record in technical delivery and team leadership AWS/FME certifications preferred Bonus: Experience with ETL tools (Glue, ADF, Databricks) If you are interested in spearheading data transformation in leading company, please apply now. Alternatively, feel free to reach me directly on . co . uk. More ❯
SQL and experience with data modelling tools like ER Studio, Power Designer, or similar. Ability to translate complex business needs into structured, efficient data models. Familiarity with data warehousing, ETL processes, and working in data warehouse environments. Experience in the cargo, logistics, or airline industry is a plus. Benefits: View to Extension Salary: Up to £450 Per Day More ❯
processes and lifecycle management Required Experience: 10+ years in SAP/Data Management, with 3+ years in SAP Datasphere Expertise in SAP Data Services, SAP HANA, SAP BW, SAC, ETL tools Strong hands-on knowledge of data modelling, Python/SQL/Java Experience working in DevOps/Agile delivery models Excellent communication, leadership, and stakeholder engagement skills Nice to More ❯
cloud-native data pipelines Comfortable collaborating with cross-functional teams (engineering, product, stakeholders) Nice to have: Familiarity with tools like dbt, Airflow, or Python scripting Knowledge of data warehousing, ETL frameworks, and modern data stack best practices Why this role: Our client has a clear vision for what success looks like in this role. You'll have direct ownership over More ❯
cloud-native data pipelines Comfortable collaborating with cross-functional teams (engineering, product, stakeholders) Nice to have: Familiarity with tools like dbt, Airflow, or Python scripting Knowledge of data warehousing, ETL frameworks, and modern data stack best practices Why this role: Our client has a clear vision for what success looks like in this role. You'll have direct ownership over More ❯
the core. Supporting the development of a scalable data architecture and engineering roadmap. Helping colleagues across the business solve data problems, from ad hoc data extraction to long-term ETL solutions. Sharing best practices and mentoring junior team members in a newly formed, collaborative data team. Playing an active role in shaping a future-proof data environment as the organisation More ❯
ownership. Work with data infrastructure to triage infra issues and drive to resolution. Skills/Experience: 5+ years experience in the data warehouse space. 5+ years experience in custom ETL design, implementation and maintenance. 5+ years experience with programming languages (Python or Java), Python preferred. 5+ years experience in writing efficient SQL statements. Experience working with either a Map Reduce More ❯
ownership. Work with data infrastructure to triage infra issues and drive to resolution. Skills/Experience: 5+ years experience in the data warehouse space. 5+ years experience in custom ETL design, implementation and maintenance. 5+ years experience with programming languages (Python or Java), Python preferred. 5+ years experience in writing efficient SQL statements. Experience working for a large technology company More ❯
ownership. Work with data infrastructure to triage infra issues and drive to resolution. Skills/Experience: 5+ years experience in the data warehouse space. 5+ years experience in custom ETL design, implementation and maintenance. 5+ years experience with programming languages (Python or Java), Python preferred. 5+ years experience in writing efficient SQL statements. Experience working for a large technology company More ❯