126 to 150 of 431 ETL Jobs

Flask, FastAPI, Django). Integrate with Databricks SQL endpoints for data access. Ensure performance, scalability, and security of backend systems. Databricks & Data Engineering Develop ETL pipelines and workflows using PySpark on Databricks. Work with Delta Lake, Unity Catalog, and Databricks REST APIs. Optimize queries and pipelines for cost efficiency ...

with complex datasets Advanced Power BI experience including data modelling, DAX, and dataset ownership Knowledge of Databricks or similar modern data platforms Understanding of ETL concepts and backend data processes Excellent communication skills with the ability to engage both technical and non technical stakeholders Experience working in commercially driven environments ...

with complex datasets Advanced Power BI experience including data modelling, DAX, and dataset ownership Knowledge of Databricks or similar modern data platforms Understanding of ETL concepts and backend data processes Excellent communication skills with the ability to engage both technical and non technical stakeholders Experience working in commercially driven environments ...

networking concepts. Exceptional communication and stakeholder management skills, with the ability to challenge and influence senior stakeholders. Desirable: Experience designing and implementing data pipelines, ETL/ELT processes, and real-time streaming solutions. Experience integrating AI into products and/or platforms is advantageous. ...

Platform Engineer 12 months Swindon - hybrid Inside IR35 - umbrella only Primary skills Data Engineering & Pipeline Development (ETL/ELT design and implementation) Strong SQL & Data Modeling (query optimization, schema design) Programming Skills (Python/Scala for data processing) Big Data Processing (Spark/Databricks) Cloud Data Platforms (Azure/ ...

will join a collaborative, 3-person local team to bridge capability gaps and maintain delivery momentum. Key Responsibilities Data Engineering: Build and maintain ETL/ELT pipelines using Python, SQL, and Snowflake . Automation & CRM: Create dashboards and automated workflows via Microsoft Power Platform (Power BI, Power Apps, Power Automate ...

Strong Power BI (Desktop, Service, DAX, Power Query) Strong Power Apps experience Solid SQL (joins, CTEs, window functions) Data modelling/data warehouse experience ETL pipeline experience Strong stakeholder engagement & communication skills Nice to have: Atlassian tools (JIRA, Confluence) ServiceNow (GRC/data structures) Deadline for applications is Tuesday ...

working across complex datasets Deep Power BI experience including datasets, DAX, data modelling, and app deployment Comfort working with Databricks and broader backend or ETL style data concepts Strong communication skills, able to explain data clearly to both technical and non technical audiences Confidence engaging directly with senior stakeholders and ...

capability across the wider engineering team. What we're looking for You'll bring strong experience in modern data engineering practices, including data modelling, ETL/ELT development, orchestration frameworks, cloud-based data platforms, and data quality management. You will be comfortable working with technologies such as dbt, Airflow, PostgreSQL ...

capability across the wider engineering team. What we're looking for You'll bring strong experience in modern data engineering practices, including data modelling, ETL/ELT development, orchestration frameworks, cloud-based data platforms, and data quality management. You will be comfortable working with technologies such as dbt, Airflow, PostgreSQL ...

with tools such as Erwin or ER Studio Experience integrating data from core enterprise systems, for example SAP, Oracle, Salesforce or Workday Knowledge of ETL processes and cloud-native data storage and processing services Exposure to MDM tools such as Informatica, or API integration using JSON and tools such ...

Proven background designing and delivering enterprise-scale data platforms Strong knowledge of Microsoft Azure, Databricks, Delta Lake, and data warehousing Advanced data modelling and ETL/ELT optimisation experience Familiarity with regulatory frameworks such as IFRS 17 , BCBS 239 , and UK Data Protection Excellent stakeholder communication and cross-functional collaboration ...

3+ years of experience in Software Development Active SC is required for this role Strong experience using Python for data processing, transformation, and ETL workloads. Practical experience working with AWS cloud services, including compute, storage, and security tooling. Infrastructure-as-code experience using Terraform. Distributed data processing using Apache Spark. ...

Warehouse environment with involvement in design and development of database solution in both traditional as well as columnar databases. Experience in data integration with ETL techniques and frameworks Experience in Big Data querying tools, such as Hive, Impala and Spark SQL Work Schedule: MULTIPLE SHIFTS AVAILABLE Work Type: Full Time ...

integration, data platforms and AI-enabled products and services within a complex enterprise environment. Strong understanding of modern data engineering practices, including data pipelines, ETL/ELT, data modelling, data governance, security, privacy and access management. Experience working with data platforms and technologies such as Snowflake, SQL-based data environments ...

live operational platform, used every day by manufacturing teams running real production environments. The stack includes Laravel + Livewire, SQL Server, Python services, ETL pipelines and Power BI — with real users and real operational impact when things go wrong. Upcoming work includes a labour management platform replacing Excel-based shift ...

Extras: Understands financial processes such as P2P, R2R, and O2C, and how to use relevant data markers from these processes to link datasets, develop ETL pipelines and identify transactions of potential concern Has an understanding of advanced data science techniques such as machine learning, natural language processing and statistical analysis. ...

preferred) and/or AWS/GCP; Kubernetes/Docker; serverless (Azure Functions/Lambda); secure networking/IAM. Data engineering: Spark/Databricks, ETL/ELT pipelines; integration with client data sources and enterprise systems; runbooks and operational handover. Product delivery: workshop facilitation, PRDs, user stories and acceptance criteria ...

unreliable APIs, shifting requirements Cloud AI (AWS/Azure): Deploying AI solutions in production, including monitoring and reliability Data pipelines: Comfortable building and maintaining ETL/ELT pipelines connecting messy source systems to AI applications SQL: Solid querying and data modelling skills AI model management: MLFlow, Hugging Face, or equivalent ...

movement of information and working with system owners to support tracking and controls. Work closely with the IT Data Architect - who owns technical schema, ETL pipelines, warehouse architecture, and system integration - to align business objectives with technical infrastructure. Provide the IT Data Architect with business-context requirements for schema design ...

driven architectures. • Hands on experience with containerization and orchestration technologies such as Docker and Kubernetes. • Familiarity with data engineering concepts including data ingestion, ETL/ELT, transformation, and storage. • Experience working with SQL and NoSQL databases. • Basic understanding of machine learning concepts and AI model integration workflows. • Experience developing ...

practical implementation and real-world delivery, not just theoretical knowledge. You will play a key role in shaping and delivering high-quality data models, ETL/ELT pipelines, and integration patterns, working closely with architects and analysts to enable reliable and performant analytics across the organisation. Key Responsibilities Lead … design, development, and maintenance of large-scale data systems, including data warehouses, data lakes, and pipelines. Design, develop, and maintain ETL/ELT processes utilising tools such as Matillion. Create and maintain optimal data flows and data pipeline architectures. Create and implement semantic data models, including fact and dimension tables. ...

including data lakes and warehouses. Support the ongoing migration and modernisation of legacy/on-premise data infrastructure into Azure cloud services. Develop robust ETL/ELT pipelines and API integrations across multiple internal and external data sources. Automation & Intelligent Workflows Support automation initiatives aimed at improving operational efficiency and … and technology functions. Required Skills & Experience Technical Skills Strong experience with Python and SQL for Data Engineering and automation. Experience building and maintaining scalable ETL/ELT pipelines. Strong understanding of relational and non-relational databases. Experience with Azure data technologies such as Data Factory, Synapse, or Fabric. Familiarity with ...

cloud-based data platform as the business continues to expand significantly. Role The Data Engineer will design, build, and maintain scalable data pipelines and ETL/ELT processes within a modern cloud data environment. Develop and optimise data solutions using Snowflake to support analytics, reporting, and business intelligence requirements. Collaborate … Experience within the fashion, sportswear, retail, ecommerce, or consumer goods sector would be highly advantageous. Strong SQL development and database optimisation skills. Experience building ETL/ELT pipelines using tools such as dbt, Fivetran, Matillion, Azure Data Factory, or Airflow. Experience working with Azure. Familiarity with Python or Scala ...

Family : Software Development & Support Travel Required : Up to 50% Clearance Required : None What You Will Do : Develop and maintain Celonis integrations, including ETL (Extract, Transform, Load) pipelines and data connectors, leveraging SQL, Python, and the Celonis Platform. Lead the design, development, and implementation of data models and ETL solutions … Ensure reliable and secure connections to source systems using technologies such as JDBC for database connectivity and Kafka for real-time data streaming. Perform ETL operations, troubleshoot data connections, and validate large datasets for accuracy and performance. Optimize Celonis data models and ETL processes for performance and scalability. Design, develop ...