technology budget. Collaborating with various departments to determine ongoing modifications to the data warehouse. Experience: Experience with data warehouse within a cloud environment andETL process management. Experience in a similar role, demonstrating line management and technical capabilities. Excellent written and verbal communications. Please contact Joely at Synchro to explore more »
Over time we will have a Full Lifecycle API Management Framework in place as part of this work. The team also designs and builds ETL pipelines using a modern data and event driven architecture. We provide a central point of expertise to own and manage our integration tools, processes andmore »
processing and transformation. Familiarity with scheduling tasks and jobs for data processing using basic tools or platforms. Proficiency in automating simple data workflows andETL processes. · Data Streaming and Messaging Systems - Proficiency in basic messaging concepts like producers, consumers, and message queues. · Data Quality and Governance - Knowledge of basic data … governance principles and compliance requirements. Competence in implementing data quality frameworks and automated checks. · Data Integration andETL - Demonstrable Ability to author data transformations using ETL tools such as DBT. · Cloud Platforms – The company are Azure hosted and experience of this is a strong preference. However other Cloud platforms like more »
storage systems on Google Cloud Platform (GCP). You will be working with technologies such as Apache Airflow, BigQuery, Python, and SQL to transformandload large data sets, ensuring high data quality and accessibility for business intelligence and analytics purposes. Our business is growing quickly and with that so … Key Responsibilities Design, construct, install, test, and maintain data pipelines. Ensure systems meet business requirements and industry practices for data integrity and quality. Manage ETLand ELT pipelines across many data sources (CSV/parquet files, API endpoints, etc) Design and build data models for the business end users. Write more »
data sources as required. Depending on the project, your daily responsibilities could be quite varied, but typically our Data Engineers: Understand, build and develop ETLand data integration solutions using a wide array of technologies and data sources Work with data and big data components and migration strategies Work with … experience required We’re looking for people with good data engineering skills, and you’ll ideally bring with you: Proven role experience in developing ETLand data integration solutions Good knowledge of the Azure data engineering stack - Azure Data Factory, Azure Synapse, Azure Data Lake, Azure Blob, Cosmos DB Capability more »
defining and executing data solutions with cloud (AWS) first strategy to deliver unparalleled consumer experience. Other responsibilities include designing and delivering data engineering solutions, ETL/ELT pipelines on multi-terabyte SQL/NoSQL databases, data warehouse environments. Strong communication skills with an ability to help business define requirements, articulate … with cloud platforms like AWS, Azure, Google Certification in cloud platforms and/or data/analytics technology Minimum 5 years of experience with ETL/ELT design and development using tools like IICS, AWS Glue, Talend, Databricks, Oracle Data Integrator (ODI) or equivalent Minimum 3 years of experience with more »
dynamic reports and dashboards for business stakeholders. Collaborate with departments across the business to understand their reporting needs and provide BI solutions. Extract, transform, andload data from various sources to build comprehensive data sets. Stay current with industry best practices and emerging technologies in BI and data analytics A more »
developing data driven applications for research users. Your experience will extend to developing APIs and server-side code, client-side applications, database development andETL processes and CLI applications. You will know and apply software engineering best practices for managing, testing, and deploying your code and have demonstrable experience in more »
maintain processes related to data integration YOUR SKILLS AND EXPERIENCE Please apply if you have the following: A strong understanding of data structures, databases, ETL processes and API development Proficient in project management and communication A proven track record of successfully bringing data products to market and driving adoption andmore »
Hertfordshire, England, United Kingdom Hybrid / WFH Options
Crone Corkill
these tools to implement rate changes. Understanding of best practice design and coding principles. A logical aptitude, with strong problem-solving skills. Familiarity with ETL tools such as SAS, SQL and Excel Proficient in writing both technical and business focused documentation. The ability to cater their communication style between non more »
with Polaris ProductWriter and WTW Radar. Understanding of best practice design and coding principles. A logical aptitude, with strong problem-solving skills. Familiarity with ETL tools such as SAS, SQL and Excel Proficient in writing both technical and business focused documentation. Embraces opportunities to develop and learn new skills. For more »
Exeter, England, United Kingdom Hybrid / WFH Options
Hunter Bond
of a team of engineers looking after and building a zero-down time low latency infrastructure Scaling and optimizing some of the most performant ETL pipelines on the planet. Conducting R&D for functional programming within the firm Building out a DevOps environment from scratch in a Software Engineering Capacity more »
client sites when required. Overall objectives for this role are: • To work in Data Migration engagements with our clients and partners, covering the full ETL process chain, from early assessments of data scope all the way through to Post GoLive Support and outside-project support. • Become, through dedicated training, one more »
Greater Bristol Area, United Kingdom Hybrid / WFH Options
Anson McCade
on-site/remote) Salary: Up to £55,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions in the Defence and Security sector. We are dedicated … client sites. We're seeking a Data Engineer with a focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including but not limited to Azure Data Factory, Azure … on-site/remote) Salary: Up to £55,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETLmore »
ad tags and creative user flow testing DMP tech setup, infrastructure, cross-device targeting/reporting, CDP Management of Data Onboarders Site troubleshooting SQL, ETL, knowledge on data transfer via S3, and SFTP Deeplinking and DCO concepts Develop and oversee quality assurance process to act as main point of contact more »
A big initiative they are driving currently is decommissioning a 10+ year old legacy system and moving it into a state of the art ETL system. The team is built with senior leading figures within the industry, so training and career development is paramount to this position. The team has more »
London, England, United Kingdom Hybrid / WFH Options
Pioneer Search
Azure functions as well as Azure Logic Apps. Good knowledge of cloud security and Cyber Security principles. Desirable Skills: Familiarity with Azure Data Factory, ETL processes, and data manipulation. Experience within the Financial Services sector or Specialist insurance. Understanding of ITIL-based service management concepts (Incident Management, Problem Management, Change more »
accelerated time to market without leaving traces of identity. Required Skills and Qualifications: Demonstrated expertise in architecting systems for real-time transaction processing alongside ETL applications, with a focus on discretion. A comprehensive of data modelling, data warehousing principles, and the innovative Lakehouse architecture. Exceptional proficiency in ETL methodologies, preferably … utilising Azure Databricks or equivalent technologies (Spark, Spark SQL, Python, SQL), including deep insight into ETL/ELT design patterns. Proficient in Databricks, SQL, and Python, with a robust understanding of software development life cycles. Familiarity with columnar and/or time series data design patterns, as well as performance more »
using dbt, ensuring the efficient transformation of raw data into actionable insights. Build and optimize query pipelines in dbt and SQL to extract, transform, andload data from various sources into a structured format suitable for analysis. Create interactive and visually appealing dashboards and reports using Tableau to effectively communicate more »
and ensuring business continuity. Key Responsibilities: Support platform, infrastructure, and middleware teams in delivering resilient solutions for critical assets. Provide input on middleware andETL assessments to identify potential gaps. Develop initiatives for operational resilience and change frameworks. Oversee the development of data movement controls and collaborate with platform teams. more »
management of data sources with 3rd party organizations. Working closely with Data Engineers and Data Architects to facilitate various types of integrations, such as ETL processes and API awareness. Researching and sourcing data for new product development, including national datasets and system integrations. Providing insight and adding value to existing more »
Outside IR35 £500 per day Hybrid - 3x Central London 12-Month Contract Relevant context A fast growing Energy & Commodities trading company is embarking on a transition from a CTRM-centric technology architecture to a data-centric model, termed as the more »
Data Engineering role later on in their career! Responsibilities: Collaborate with clients to develop data engineering solutions using Azure Build and maintain robust, scalable ETL pipelines with a focus on data quality and performance. Utilize extensive SQL skills to create and optimize data extraction, transformation, and loading processes. Troubleshoot and … data engineering technologies, suggesting process improvements. Requirements: Bachelor's or Master's degree in Computer Science, Engineering, or a related field. Strong experience building ETL pipelines and integrating data. Proficiency in Azure is preferred, however AWS and GCP considered Excellent SQL skills and experienced in database systems. Strong problem-solving more »
Greater Manchester, England, United Kingdom Hybrid / WFH Options
MBN Solutions
team of Data Engineers. Responsibilities include: Leading a small team of Data Engineers Being an SME in data warehouse design (including build, migration, andETL) Ensure high quality of data through setting best practices & conducting checks and validations Stakeholder management & influencing Work closely with the Analytics team to determine best … a small team 5+ years of experience within Data Engineering Proficiency in MS technologies, including: Azure, SQL, Power BI Experience of SSIS and other ETL tools Proven experience in end-end data warehousing The following skills/experience are advantageous: Experience working within the healthcare and/or manufacturing sectors more »
Greater Sheffield Area, United Kingdom Hybrid / WFH Options
MBN Solutions
team of Data Engineers. Responsibilities include: Leading a small team of Data Engineers Being an SME in data warehouse design (including build, migration, andETL) Ensure high quality of data through setting best practices & conducting checks and validations Stakeholder management & influencing Work closely with the Analytics team to determine best … a small team 5+ years of experience within Data Engineering Proficiency in MS technologies, including: Azure, SQL, Power BI Experience of SSIS and other ETL tools Proven experience in end-end data warehousing The following skills/experience are advantageous: Experience working within the healthcare and/or manufacturing sectors more »