9 of 9 Permanent ETL Jobs in Hertfordshire

Design, implement, and maintain AWS-based data infrastructure leveraging Redshift, S3, EMR, and other cloud services. Develop and oversee CI/CD pipelines for ETL processes and Power BI deployments, ensuring rapid, error-free code releases. Automate environment provisioning and data workflows using Terraform, Docker, Kubernetes, Python, and other automation ...

Oversee logical and physical data modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform ...

performance tuning and model management. Proven ability to manage and optimize very large datasets in Power BI and Azure. Solid understanding of SQL, ETL processes, and data warehousing. Familiarity with Azure Synapse, Data Lake, and Analysis Services (AAS/SSAS). Strong performance tuning: aggregations, incremental refresh, Hybrid tables, Direct ...

Data Warehousing, Data Migrations, Business Intelligence, Analytics, Big Data, Cloud (AWS/Azure) transformations. Key Responsibilities : Own the technical delivery roadmap across data ingestion, ETL/ELT pipelines, data lake/warehouse models, streaming workloads, and analytics products. Own and Supervise Quality, Testing & Release Governance Required Expertise:- Overall experience ...

comapny core and non-core IT systems, working with business owners and suppliers for system upgrades, patching, releases, and fault resolution. * Lead the Extract, Transform, Load element of the company data warehouse and ensure databases are optimised. * Provide platform support for all applications and operating systems, including system builds and ...

major cloud data platform (e.g., Snowflake, Databricks, BigQuery, Redshift, Cloudera, Synapse, or similar). · Strong understanding of data warehousing, data lakes/lakehouse, and ETL/ELT concepts (staging, modeling, performance tuning, cost/perf tradeoffs). · Data engineering and integration including unstructured data processing (PDFs, logs, images, text) and … with document processing pipelines, chunking strategies, and semantic search patterns. · Familiarity with data pipeline and orchestration tools (e.g., Airflow, dbt, Spark, Kafka, cloud-native ETL tools) and batch vs. streaming patterns. · Understanding of data governance (catalog, lineage, security, RBAC, masking, compliance requirements like GDPR/CCPA). · Analytics, BI, and ...

understand business requirements for data migration. Design and implement robust data migration strategies. Develop scripts and processes to automate data extraction, transformation, and loading (ETL) processes. Work closely with stakeholders, including business users and IT teams, to ensure data requirements are met, and migrations proceed without disruption to business operations. … Responsibilities: Plan, coordinate, and execute data migration projects within set timelines. Design and build ETL solutions, ensuring data quality and integrity throughout the migration process. Troubleshoot and resolve data-related issues promptly to minimise disruption. Collaborate with various teams to align migration processes with organisational goals and regulatory standards. Proficiency ...

premise infrastructure , ensuring our Generative AI capabilities are powerful, private, and resilient. Key Responsibilities Architect & Build: Design, develop, and optimize scalable data pipelines (ETL/ELT) within air-gapped or on-premise data centers. AI Integration: Engineer data structures specifically for Natural Language Processing (NLP) and Large Language Models (LLMs … transition GenAI prototypes into production-ready, locally-hosted solutions. Technical Requirements Languages Expert-level Python and advanced SQL . Data Engineering Experience with ETL/ELT and orchestration tools like Apache Airflow or NiFi . On-Prem Tech Proficiency with Hadoop/HDFS , Spark , and containerization via Docker/Kubernetes ...

and optimise data usage Ensure data quality, governance and compliance standards are met across all data assets Support data exchange and processing solutions including ETL, APIs and integration layers Contribute to the ongoing improvement of data platforms and architectures Stay up to date with emerging technologies and provide input into … technologies such as MS SQL or Oracle Experience with noSQL technologies such as MongoDB, InfluxDB or Neo4J Strong data exchange and processing experience including ETL, ESB and API-based integrations Development experience, ideally using Python Knowledge of big data technologies such as the Hadoop stack Exposure to NLP and ...