101 to 125 of 431 ETL Jobs

following skills: Proven experience in data engineering, with strong skills in SQL, Python (skills in cloud platforms such as Azure a plus) Familiarity with ETL tools such as SSIS and FME. Extensive experience creating beautiful and insightful data visualisations using Tableau, Power BI or other similar platforms Good Communication, both ...

pipelines, and modelling — not just one area Been hands-on with tools like Snowflake, dbt, and Azure (or similar cloud environments) Designed and maintained ETL/ELT pipelines, ideally using tools like Azure Data Factory Strong SQL skills, including complex querying and performance optimisation Experience working with CI/ ...

mentor engineers, and ensure our data infrastructure supports analytics, experimentation, and business enablement at scale. What You'll Do: Architect, evolve, and maintain core ETL/ELT pipelines using dbt, Airflow, and Databricks Design and optimize semantic models in AtScale to support BI tools like Tableau Lead cross-functional collaboration ...

leadership. An Azure Databricks Engineer designs, builds, and optimizes scalable data pipelines and lakehouse solutions within the Microsoft Azure ecosystem. Core Responsibilities Data Engineering & ETL: Develop and maintain batch/streaming data pipelines using Azure Databricks, Azure Data Factory and PowerBI Azure Integration: Integrate Databricks with (ADLS), Power … full data life cycle Experience in architecting enterprise-wide data environments and platforms Heavy experience in data movement, transformation, and modeling processes (ELT/ETL) 4+ years' experience working with large datasets or database systems 2+ Years working with cloud data technologies Azure Experience Proficiency in Python (PySpark), SQL. Strong ...

time and batch data processing - Apache Flink, Kafka, Spark, or similar Proficiency in one or more of: Python, Java, Scala Experience with data modelling , ETL processes, and distributed systems Comfortable working in agile and DevOps environments Experience in sensitive or regulated data environments is highly desirable eDV eligibility ...

Responsibilities Lead solution design activities, collaborating with peers and mentoring junior colleagues to define and execute the team backlog. Develop, test, and document scalable ETL/ELT data pipelines and workflows using Databricks and Azure Synapse to ingest and transform data from a variety of sources. Administer and maintain Azure ...

1.2. To work with our cloud hosting provider to ensure effective resource utilisation and consumption patterns. 1.3. To develop complex data structures, data models and Extract Transformation and Load processes using Azure Synapse Analytics and related Azure services to support the trust Data warehouse at the direction of the Database … complex technical issues. 2.5 Lead the development and implementation data pipelines using Synapse Pipelines and other ETL/ELT tools to ingest, transform and load data from various sources. 2.6 Act as the SME for data engineering, providing authoritative input on schema design, data quality, and interoperability. Person Specification Education ...

role, you will work with engineers and analysts to ingest, transform, and validate structured and unstructured data from multiple sources. Responsibilities include assisting with ETL processes, writing and optimizing SQL or Python scripts, documenting workflows, and helping ensure data quality and reliability. The ideal candidate is pursuing a degree ...

data processes. Skills required: Proven experience as a Data Architect working within Azure. Expertise in Azure Databricks and Azure Synapse. Strong understanding of Datamodelling, ETL processes, and data warehousing concepts. Proficiency in SQL, Python, and other relevant programming languages. Experience with data governance, data quality, and data security best practices. ...

such as Snowflake, BigQuery, Redshift, Databricks, Azure Synapse Experience of testing pipelines in things like Airflow, Azure Data Factory, AWS Glue, Kafka Data Concepts ETL/ELT, data modelling, data warehousing, data governance The role is 100% remote, however you must be based in the UK with the right ...

frameworks (Flask, FastAPI, Django) .Integrate with Databricks SQL endpoints for data access .Ensure performance, scalability, and security of backend systems .Databricks & Data Engineerin gDevelop ETL pipelines and workflows using PySpark on Databricks .Work with Delta Lake, Unity Catalog, and Databricks REST APIs .Optimize queries and pipelines for cost efficiency ...

Azure Data Lake Drive data quality, governance, and performance Collaborate with global teams in an agile environment What you’ll bring: Strong SQL + ETL/ELT experience Knowledge of Python/T-SQL Exposure to cloud platforms (Azure preferred) Nice to have: Databricks, Spark, CI/CD, big data ...

innovation and continuous improvement are genuinely encouraged. Key areas of focus include: • Developing and embedding data management strategy and governance • Leading data migration and ETL initiatives with strong auditability and control • Improving data quality, structure, accessibility, and reporting automation • Supporting analytics and insight generation for operational and strategic decision-making ...

collaborating with stakeholders, producing high-quality documentation, and working across the full data lifecycle in a cloud-first environment. The Role: Design and implement ETL and ELT data pipelines using cloud-native tools Develop and maintain data models and curated data products in Snowflake Build and support batch, micro-batch ...

cloud data platforms (Snowflake and/or Azure Fabric) Expertise in data modelling (dimensional, star/snowflake, 3NF) and ELT/ETL pipeline design Deep hands-on experience with Snowflake (Snowpark, SnowPipe/Streaming, Dynamic Tables, Cortex, Unistore, optimisation, RBAC, warehouses, time travel, zero-copy cloning) Broad experience across modern ...

Desirable Experience in SaaS, telecoms, utilities, construction, or field services environments SQL or Python for data preparation and transformation Azure Data Factory or similar ETL tooling API or webhook integration experience CIMA or ACCA part-qualified or working towards qualification What We Offer Competitive salary with performance-linked progression Genuine ...

deployed to production and be the point person in explaining methodologies to technical and non-technical teams Feature Engineering and Optimization: Develop and maintain ETL pipelines using orchestration tools such as Airflow and Jenkins; deploy scalable streaming and batch data pipelines to support petabyte scale datasets Development Best Practices: Maintain ...

deployed to production and be the point person in explaining methodologies to technical and non-technical teams Feature Engineering and Optimization: Develop and maintain ETL pipelines using orchestration tools such as Airflow and Jenkins; deploy scalable streaming and batch data pipelines to support petabyte scale datasets Development Best Practices: Maintain ...

alert analysis, and compliance technology platforms. Experience in developing AI Agents. Good understanding of RAG and MCP's. Experience with Oracle, relational databases, or ETL processes. Exposure to EDD Verifier, ECS, and Temenos (T24) platforms. Exposure to model validation, model governance, or threshold optimization initiatives. Experience working with large-scale ...

alert analysis, and compliance technology platforms. Experience in developing AI Agents. Good understanding of RAG and MCP's. Experience with Oracle, relational databases, or ETL processes. Exposure to EDD Verifier, ECS, and Temenos (T24) platforms. Exposure to model validation, model governance, or threshold optimization initiatives. Experience working with large-scale ...

environments. Experience leading and developing teams, preferably with data or digital twin relevance. Deep understanding of: Data models, data standards, and contextualization Data integration, ETL, and transformation pipelines Cloud platforms (AWS, Azure) Strong business and domain knowledge from industrial or asset-intensive environments. Proven ability to lead through influence with ...

and investor reporting cycles. Demonstrated experience owning platform-level or infrastructure product workstreams with high technical complexity. Familiarity with data architecture concepts: data modeling, ETL pipelines, API design, and event-driven systems. Experience with agile development methodologies; strong proficiency with product management tools (Jira, Confluence, Productboard, or similar). Exceptional ...

cases, including large-scale document processing Collaborating closely with Data Scientists to support model development, fine-tuning, and lifecycle management Supporting data integration, ETL, and cloud migration initiatives on Azure Acting as a technical thought leader, setting standards and sharing best practice across teams YOUR SKILLS AND EXPERIENCE You will ...

design Enterprise-grade reliability Development Active production coding Full-stack implementation ownership Backend and API development Enterprise integrations Containerized environments Production deployments Data & Analytics ETL/ELT pipelines ERP/CRM integrations Analytics environments KPI engines Dashboards and reporting Data-intensive enterprise applications AI LLMs RAG architectures AI orchestration ...

Extensive Experience of visualisation software essential (e.g. Power BI/Looker). Understanding of analysis methodologies essential (statistical techniques a plus). Awareness of ETL processes and database automation. Experience working with AI tools to generate automated insights Confident in Microsoft Excel and full Microsoft Suite. (Or cloud based equivalents ...