scalable and reliable data pipelines and platforms using various technology solutions. Extract, transform, andload (ETL) data from various sources and formats. Build and maintain ETL pipelines Ensure data quality, integrity, and security by applying data governance and validation rules. Optimise data performance and efficiency by tuning, partitioning, indexing, and … Hands-on experience in designing, planning, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments. Skilled in data integration, ETL processes, and ensuring data quality. Capable of turning data into insights using visualisation and reporting tools. Able to effectively document business use-cases, data sources more »
Salford, Greater Manchester, North West, United Kingdom Hybrid / WFH Options
Aj Bell Limited
data solutions (including Snowflake and AWS Aurora). Work with Data Ingestion Specialist and Enterprise Architecture teams to develop implement robust data pipelines andETL processes to streamline data ingestion and transformation. Support Manager and HoD with delivery of D2C data roadmap and embedding a data-driven mindset in the more »
Milton Keynes, Buckinghamshire, South East, United Kingdom Hybrid / WFH Options
Domino's Pizza
is delivered on all data platforms. Success in this role looks like: Knowledge and experience using SQL server management studio. Experience in data warehousing, ETL processes, and database management. Experience using fact and dimension tables. Managing backlogs in Azure DevOps Strong leadership, mentorship and line management skills. Exceptional communication andmore »
Cambridge, Cambridgeshire, East Anglia, United Kingdom Hybrid / WFH Options
Reed Technology
Data & Systems Team within the IT Development Team. This role is ideal for someone with a passion for data analysis, manipulation, and processing using ETL/ELT techniques. You will also be involved in 3rd line support for internal and third-party systems, DBA tasks, and database deployments. Day to … Perform DBA tasks and manage database deployments effectively. Required Skills & Qualifications: Data-related qualifications or relevant field experience. Proven track record of implementing successful ETL/ELT processes. Strong understanding of data and analytical processing technologies, including transactional databases, SQL Server, various cloud platforms, and services. Proficiency in RDMS, particularly more »
Sunderland, Tyne and Wear, North East, United Kingdom Hybrid / WFH Options
SCS Sofas
Azure DevOps, Visual Studio, Tabular Editor Understanding of Microsoft Dynamics, Business Central would be beneficial Solid understanding and experience of database management systems andETL Framework Experience in leading/motivating teams to deliver meaningful change and drive their professional development. Experience managing and building relationships with internal and external more »
is essential and the role is 2-3 days a week in the Liverpool office - rest remote**** Senior Data Engineer, Data, Data Modelling, Migration, ETL, ETL Tooling (Informatica IICS & IDMC ) SQL, Python or Pyspark, Agile, migrating data from on-prem to cloud. **** Informatica Cloud (IICS & IDMC ) is essential - NOT PowerCenter … data. Essential/core experience required: 10+ years of experience and in-depth knowledge of data delivery and associated architecture principles, data modelling concepts, ETL procedures, and all steps of data production process Prior experience in insurance and/or reinsurance in support of specialty lines is a plus. Extensive … hands on experience in SQL, Python, Data Integration/Ingestion and associated patterns - ETL tooling – Informatica IICS, Warehousing technologies and associated patterns, Cloud platforms – Azure preferred. Experience with on-prem and cloud versions of databases such as Oracle and SQL Server. Professional certifications in public cloud and tooling – Informatica andmore »
Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on business requirements and priorities As part of the BI team you will more »
legacy data to our new cloud-based data platform. Design and implement master and transactional data models to ensure data integrity and consistency. Develop ETL pipelines and cloud data storage solutions that meet business requirements and non-functional needs. Collaborate closely with data analysts, visualization engineers, and project managers to more »
open-source data engineering and scientific Python toolset. Our tech stack includes Airbyte for data ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity andmore »
communication and collaboration skills. Preferred: Familiarity with scripting languages (Python, R) for data analysis. Exposure to machine learning concepts for predictive analytics. Understanding of ETL processes and data warehousing. Ability to work with stakeholders to understand business requirements and translate them into data solutions. Continuous learning mindset to stay updated more »
pipelines, security and networking Expertise with data warehousing, data lakes and data lake houses Experience with master data management software and technologies Experience with ETL technologies including SQL Server, SSIS, Azure Data Factory Working knowledge of agile development, CI/CD, test and data automation Working knowledge or experience of more »
South East London, England, United Kingdom Hybrid / WFH Options
McGregor Boyall
are seeking Senior Data Engineers to contribute to innovative data projects within a leading financial institution.Key Responsibilities:Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions.Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines.Distributed Processing: Work with Hadoop, Spark, and other platforms more »
datasets, including creating dimensional multivariate models. Utilize non-relational data storage solutions such as MongoDB. Work with SQL Server Integration Services (SSIS) and other ETL tools. Develop solutions with SSIS, SSRS, T-SQL (On-prem/Cloud). Manage NoSQL environments, Data Lakes, and Lake-Houses (e.g., Cassandra, MongoDB, Neptune more »
contribute to the technical aspects in the upkeep of the data estate. Focusing on hands-on development, enhancement, and maintenance of data models andETL processes within the data estate You will emphasise the importance of data quality and governance in your project work, contributing to the organisational data model more »
with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETLand data modeling Experience with building large-scale systems with extensive knowledge in data warehousing solutions. Developing prototypes and proof-of-concept systems. Strong analytical more »
and data security standards. Expertise in designing and implementing data platforms, data lakes, data warehouses, and self-service analytics solutions. Proficiency in data modelling, ETL processes, data integration, and data visualisation tools. Previous Cloud Migration experience essential (either Synapse, BigQuery, Redshift) Expert level experience working with Azure and or Certified more »
organization. Developing and implementing data models and algorithms to support data science and machine learning initiatives . Technical Requirements Proven track record leading complex ETLand Data Infrastructure projects, as well as designing and building data intensive applications and services. Experience with data processing and distributed computing frameworks such as more »
big data technologies such as Hadoop and Spark. Experience with data warehousing technologies such as Redshift, Snowflake, or BigQuery. Experience with data pipeline andETL tools such as Apache NiFi, Airflow, or Glue. Knowledge of data governance and security best practices. Strong problem-solving and analytical skills. Ability to work more »
processing efficiency and proposing solutions for improvementsSkills and ExperienceExcellent knowledge of SQLKnowledge of Python (other languages might be equivalent)Experience in creating and maintaining ETL pipelinesKnow your way around Unix based operating systemExperience working with any major cloud provider (AWS, GCP, Azure)Fluency in EnglishExperience using Apache AirflowExperience using DockerExperience more »
of Data Engineering Proficiency in AWS, data warehousing (Snowflake, Databricks, Redshift), big data frameworks (Spark, Kafka), container orchestration platforms (Kubernetes), and data integration/ETL tools. Strong written and verbal communication skills, with the ability to explain technical concepts to non-technical stakeholders.. Strategic thinker with a consultative mindset andmore »
London, England, United Kingdom Hybrid / WFH Options
iO Associates - UK/EU
governance concepts, practices, and frameworks. Strong technical skills in data modelling, metadata management, and data lineage. Datawarehouse design and implementation Experience with SQL Server ETL processes A good knowledge of Power BI reporting Desirable Skills Nexthink Software SNOW Software JAMF Software Accreditations Microsoft Data Analyst Microsoft Data Engineer more »
Reporting and Data Modelling. The primary focus of this role will be the development of a Snowflake data warehouse environment and will include using ETL tools, DBT and Power BI for reporting and data visualisations. As the ideal candidate you will be adept at working with large data sets to more »
in R, Python, and SQL for data manipulation and analysis. Experience with Enterprise Data Management (EDM) tools and concepts. Strong understanding of data modeling, ETL processes, and data quality management. Familiarity with financial services or asset management industry preferred. Excellent problem-solving skills and attention to detail. Ability to work more »
Greater London, England, United Kingdom Hybrid / WFH Options
Oliver Bernard
of Cloud e.g. Azure and or AWS -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc -Excellent experience of ETL, data warehousing and handling a variety of data types -Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes andmore »
up with your own solution. You will be building dashboards in Python as well as be in charge of Transformation when it comes to ETL pipelines.Experience wise, you’ll need to be a SQL Server expert with strong architecture skills and also strong skills with Python, and DBT. The more more »