76 to 100 of 1,538 ETL Jobs in the UK

scalable data solutions. Technical Expertise Deep expertise with the Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow). Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent. Strong SQL and Python (or equivalent language) skills for data manipulation and automation. Hands ...

data modeling, semantic layers, KPI standardization) Modern data platforms: Microsoft Fabric (preferred) or Snowflake/equivalent cloud data platforms Data integration patterns, including: APIs ETL/ELT processes Programming and data manipulation (Python, SQL) Proven ability to: Transition organizations from fragmented reporting to standardized data-driven decision making Drive business ...

party APIs, returning complex data from multiple endpoints. Implement processes to retain and refresh this data within business systems.Data Modeling: Using the businesses preferred ETL tools, generate curated datasets from raw input tables. Ensure all datasets have clear, documented lineage and integrated testing to protect against bad data entering datasets ...

APIs, returning complex data from multiple endpoints. Implement processes to retain and refresh this data within business systems. Data Modeling: Using the businesses preferred ETL tools, generate curated datasets from raw input tables. Ensure all datasets have clear, documented lineage and integrated testing to protect against bad data entering datasets ...

certifications in Azure, Power BI, data, or AI architecture. Core Technology Stack Data platform : Azure Data Factory, Databricks, Azure data lake, SQL, dimensional modeling, ETL/ELT, orchestration. AI platform : Azure OpenAI, Azure AI Foundry, Azure AI Search, Copilot Studio, Semantic Kernel, Prompt Flow. Analytics : Power BI, semantic models ...

e.g. Cloud, Azure, Databricks), and enterprise data and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise scale analytics) Experience with data product thinking, domain-oriented ownership or federated operating models Understanding of data standards and industry models ...

e.g. Cloud, Azure, Databricks), and enterprise data and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise scale analytics) Experience with data product thinking, domain-oriented ownership or federated operating models Understanding of data standards and industry models ...

Initial 6 months + extensions. Job Purpose: The BI Engineer will be responsible for the requirements analysis and design of solutions for data platform, ETL, integration and analysis solutions. Our toolset includes AWS hosted databases (postgres, S3 based data lake, MySQL, Athena), integration services (AWS API gateway, lambda functions), ETL … data warehouses. Collaborate with data visualization and analysts' teams to understand data requirements and translate them into technical specifications. Data Processing: Develop and maintain ETL (Extract, Transform, Load) processes for ingesting data from various sources into the data infrastructure. Optimize data processing and storage for performance and cost-effectiveness. ...

analytics, or related disciplines in a complex, global organisation. Proven delivery of modern cloud‐based data platforms, data lakes or warehouses, integration patterns, ETL/ELT pipelines, semantic models, and analytics solutions. Strong knowledge of the Microsoft data and analytics ecosystem, including Azure data services, SQL, Power BI, and modern ...

EXPERIENCE The successful Data Engineer will have the following skills and experience: Strong commercial experience with SQL and data modelling. Experience designing and managing ETL or ELT processes. Knowledge of data warehousing concepts and best practices. Familiarity with Azure Data Factory and Snowflake. Experience working with Power BI and ...

foundational data systems that underlie modern AI infrastructure, including vector, NoSQL, and document databases. Develop end-to-end data engineering solutions, including robust ETL/ELT pipelines, API services, and data ingestion frameworks. Design and build the storage and processing layers powering our analytics workloads: data lakes, data warehouses, distributed ...

practical, curious and commercially-minded approach to problem-solving. Desirable Experience with machine learning and predictive modelling. Experience with Snowflake. Experience working with ETL/data integration tools, ideally Matillion. Experience with cloud data platforms and modern data stacks Experience working with large-scale video, image or other unstructured datasets. ...

core database systems and data structures. Proficiency in Databricks and big data coding languages, including SQL, Python and Scala. Experience designing and deploying ETL/ELT pipelines using Azure Data Factory, Azure Synapse Analytics or equivalent tools in AWS/GCP. Strong engineering skills, with the ability to write clean ...

experience in data engineering, analytics engineering, or data platform delivery Strong proficiency in SQL, Python, and PySpark is required Experience designing and operating ETL/ELT pipelines, orchestration workflows, data quality checks, and production data products Experience with cloud data platforms, distributed processing, data modelling, and analytics/BI consumption ...

Reference Data. Cloud Platforms: Microsoft Azure; AWS; GCP. Modern Data Platforms: Databricks; Microsoft Fabric; PostgreSQL. Data Integration: Azure Data Factory; API-led Integration; Kafka; ETL/ELT; Streaming and Event-Driven Architectures. Architecture & Modelling: TOGAF; DAMA; ArchiMate; Sparx Enterprise Architect. Data Governance: Microsoft Purview; Collibra; Informatica; Security by Design; Data ...

Reference Data. Cloud Platforms Microsoft Azure; AWS; GCP Modern Data Platforms Databricks; Microsoft Fabric; PostgreSQL Data Integration Azure Data Factory; API-led Integration; Kafka; ETL/ELT; Streaming and Event-Driven Architectures Architecture & Modelling TOGAF; DAMA; ArchiMate; Sparx Enterprise Architect Microsoft Purview, Collibra, Informatica, Security by Design, Data Classification, Information ...

complex environments. Broad understanding of modern data technology domains, including: Cloud data platforms (Azure, AWS, GCP). Data lakes, warehouses and lakehouse architectures. ETL/ELT processes and tooling. Streaming and event‐driven architectures. API‐led integration and data virtualisation. Understanding of data security‐by‐design, privacy, compliance and governance ...

and transform diverse data types into standardized, unified schemas Good understanding of serverless, code-driven data transformation pipelines as well as traditional batch-oriented ETL systems. Technologies While mastery of everything is not required, we are seeking Engineers who possess hands‐on experience with one or more of the following ...

and transform diverse data types into standardized, unified schemas Good understanding of serverless, code-driven data transformation pipelines as well as traditional batch-oriented ETL systems. Technologies While mastery of everything is not required, we are seeking Engineers who possess hands‐on experience with one or more of the following ...

and transform diverse data types into standardized, unified schemas Good understanding of serverless, code-driven data transformation pipelines as well as traditional batch-oriented ETL systems. Technologies While mastery of everything is not required, we are seeking Engineers who possess hands‐on experience with one or more of the following ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business and technology teams Essential Experience Proven Data Architect experience ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business and technology teams Essential Experience Proven Data Architect experience ...

delivery of robust, secure, and high-quality data products. Responsibilities Design, develop and maintain scalable cloud-based data solutions Build and optimise ETL and ELT pipelines Support the migration of existing data services into cloud environments Develop and maintain data products that support reporting and analytics Implement CI/ ...

data quality and deliver reliable reporting and insights. What they're looking for: Strong experience with Python , SQL and Excel Experience building and maintaining ETL/data pipelines Knowledge of data modelling and database design Strong analytical and problem-solving skills Nice to have: Azure (Data Factory, Synapse, Databricks ...

Talend, etc. Understanding of machine learning algorithms and statistics. Experience with data visualization tools like Tableau, PowerBI, etc. Knowledge of data warehousing solutions and ETL tools. Familiarity with data architecture and data modeling techniques. Experience with stream-processing systems: Storm, Spark-Streaming, etc. Knowledge of software development methodologies like Agile ...