101 to 125 of 311 Permanent ETL Jobs

Flask, FastAPI, Django). Integrate with Databricks SQL endpoints for data access. Ensure performance, scalability, and security of backend systems. Databricks & Data Engineering Develop ETL pipelines and workflows using PySpark on Databricks. Work with Delta Lake, Unity Catalog, and Databricks REST APIs. Optimize queries and pipelines for cost efficiency ...

with complex datasets Advanced Power BI experience including data modelling, DAX, and dataset ownership Knowledge of Databricks or similar modern data platforms Understanding of ETL concepts and backend data processes Excellent communication skills with the ability to engage both technical and non technical stakeholders Experience working in commercially driven environments ...

with complex datasets Advanced Power BI experience including data modelling, DAX, and dataset ownership Knowledge of Databricks or similar modern data platforms Understanding of ETL concepts and backend data processes Excellent communication skills with the ability to engage both technical and non technical stakeholders Experience working in commercially driven environments ...

networking concepts. Exceptional communication and stakeholder management skills, with the ability to challenge and influence senior stakeholders. Desirable: Experience designing and implementing data pipelines, ETL/ELT processes, and real-time streaming solutions. Experience integrating AI into products and/or platforms is advantageous. ...

working across complex datasets Deep Power BI experience including datasets, DAX, data modelling, and app deployment Comfort working with Databricks and broader backend or ETL style data concepts Strong communication skills, able to explain data clearly to both technical and non technical audiences Confidence engaging directly with senior stakeholders and ...

capability across the wider engineering team. What we're looking for You'll bring strong experience in modern data engineering practices, including data modelling, ETL/ELT development, orchestration frameworks, cloud-based data platforms, and data quality management. You will be comfortable working with technologies such as dbt, Airflow, PostgreSQL ...

capability across the wider engineering team. What we're looking for You'll bring strong experience in modern data engineering practices, including data modelling, ETL/ELT development, orchestration frameworks, cloud-based data platforms, and data quality management. You will be comfortable working with technologies such as dbt, Airflow, PostgreSQL ...

with tools such as Erwin or ER Studio Experience integrating data from core enterprise systems, for example SAP, Oracle, Salesforce or Workday Knowledge of ETL processes and cloud-native data storage and processing services Exposure to MDM tools such as Informatica, or API integration using JSON and tools such ...

Proven background designing and delivering enterprise-scale data platforms Strong knowledge of Microsoft Azure, Databricks, Delta Lake, and data warehousing Advanced data modelling and ETL/ELT optimisation experience Familiarity with regulatory frameworks such as IFRS 17 , BCBS 239 , and UK Data Protection Excellent stakeholder communication and cross-functional collaboration ...

Warehouse environment with involvement in design and development of database solution in both traditional as well as columnar databases. Experience in data integration with ETL techniques and frameworks Experience in Big Data querying tools, such as Hive, Impala and Spark SQL Work Schedule: MULTIPLE SHIFTS AVAILABLE Work Type: Full Time ...

integration, data platforms and AI-enabled products and services within a complex enterprise environment. Strong understanding of modern data engineering practices, including data pipelines, ETL/ELT, data modelling, data governance, security, privacy and access management. Experience working with data platforms and technologies such as Snowflake, SQL-based data environments ...

live operational platform, used every day by manufacturing teams running real production environments. The stack includes Laravel + Livewire, SQL Server, Python services, ETL pipelines and Power BI — with real users and real operational impact when things go wrong. Upcoming work includes a labour management platform replacing Excel-based shift ...

Extras: Understands financial processes such as P2P, R2R, and O2C, and how to use relevant data markers from these processes to link datasets, develop ETL pipelines and identify transactions of potential concern Has an understanding of advanced data science techniques such as machine learning, natural language processing and statistical analysis. ...

preferred) and/or AWS/GCP; Kubernetes/Docker; serverless (Azure Functions/Lambda); secure networking/IAM. Data engineering: Spark/Databricks, ETL/ELT pipelines; integration with client data sources and enterprise systems; runbooks and operational handover. Product delivery: workshop facilitation, PRDs, user stories and acceptance criteria ...

unreliable APIs, shifting requirements Cloud AI (AWS/Azure): Deploying AI solutions in production, including monitoring and reliability Data pipelines: Comfortable building and maintaining ETL/ELT pipelines connecting messy source systems to AI applications SQL: Solid querying and data modelling skills AI model management: MLFlow, Hugging Face, or equivalent ...

movement of information and working with system owners to support tracking and controls. Work closely with the IT Data Architect - who owns technical schema, ETL pipelines, warehouse architecture, and system integration - to align business objectives with technical infrastructure. Provide the IT Data Architect with business-context requirements for schema design ...

including data lakes and warehouses. Support the ongoing migration and modernisation of legacy/on-premise data infrastructure into Azure cloud services. Develop robust ETL/ELT pipelines and API integrations across multiple internal and external data sources. Automation & Intelligent Workflows Support automation initiatives aimed at improving operational efficiency and … and technology functions. Required Skills & Experience Technical Skills Strong experience with Python and SQL for Data Engineering and automation. Experience building and maintaining scalable ETL/ELT pipelines. Strong understanding of relational and non-relational databases. Experience with Azure data technologies such as Data Factory, Synapse, or Fabric. Familiarity with ...

Family : Software Development & Support Travel Required : Up to 50% Clearance Required : None What You Will Do : Develop and maintain Celonis integrations, including ETL (Extract, Transform, Load) pipelines and data connectors, leveraging SQL, Python, and the Celonis Platform. Lead the design, development, and implementation of data models and ETL solutions … Ensure reliable and secure connections to source systems using technologies such as JDBC for database connectivity and Kafka for real-time data streaming. Perform ETL operations, troubleshoot data connections, and validate large datasets for accuracy and performance. Optimize Celonis data models and ETL processes for performance and scalability. Design, develop ...

and FastStats. Identify, propose, and implement process improvements to enhance productivity, accuracy, and the overall efficiency of the Production team. Develop and maintain robust ETL (Extract, Transform, Load) logic tailored to production requirements. Documentation & Operations Create, maintain, and update all in-scope documentation for the Production Team. Map and document ...

modelling Experience developing and implementing knowledge graphs Proficiency in scaling AI solutions from concept to production Working knowledge of backend systems, data pipelines, and ETL processes Familiarity with cloud platforms, particularly Microsoft Azure Understanding of microservices architecture and distributed systems Experience with DevOps practices for AI/ML workflows (MLOps ...

looking for an experienced AWS Data Engineer with strong expertise in ETL, cloud migration, and large-scale data engineering. The ideal candidate is hands-on with AWS, Python/PySpark, and SQL, and can design, optimize, and manage complex data pipelines. This role requires collaboration across teams to deliver secure ...

Risk Data Warehouse and regulatory reporting environments. Good understanding of Basel 3.1, SA-CCR, Credit Risk, and Murex-related data flows . Expertise in ETL architecture, data modelling, and large-scale data integration. Experience supporting critical production systems in financial services environments. Strong problem-solving and stakeholder management skills. Ability ...

Spark • Airflow • Data pipelines • AWS or GCP Experience Required • 4+ years in data engineering • Experience working with large-scale structured and unstructured datasets • Strong ETL development and pipeline optimisation skills • Experience building reliable and scalable data processing solutions Nice to Have • ML platform exposure • Vector databases • Real-time streaming systems ...

usual wishlist! Key Skills required: Python Sql Data Engineering Agentic AI Responsibilities Design, build, and maintain scalable data ingestion pipelines Develop and optimise ETL/ELT workflows for batch and streaming data Build data models and schemas to support analytics and reporting Monitor and improve pipeline performance, reliability, and scalability ...

Consultant Strong development skills in Python Advanced SQL skills with experience working on complex datasets Experience with core data engineering tools and technologies (e.g. ETL/ELT pipelines, data warehouses, orchestration tools) Strong understanding of data modelling, data quality, and performance optimisation Desirable Experience Experience with Palantir (Foundry, Gotham) Willingness ...