25 of 25 ETL Jobs in Somerset

translate business requirements into robust technical architectures, ensuring best practices in data governance, security, and performance. Key Responsibilities Design and optimise data pipelines and ETL processes using Azure Data Factory and Databricks. Develop and maintain data models, transformations, and integrations across multiple systems. Collaborate with client teams to deliver high ...

best practises, including data security, data quality and data lineage. Other requirements include: Comfortable working in Microsoft Stack (Fabric, Azure, Power BI) Knowledge of ETL processes, semantic layers and tools like DBT Proficiency in Python for data manipulation and automation Ability to challenge assumptions and educate senior staff on data ...

Terraform, AWS CodePipeline), and integration with databases such as SQL Server, PostgreSQL, Oracle, Redshift, and Synapse Strong hands-on background in building and optimising ETL/ELT pipelines using modern tooling and best practices Proficiency in reporting tools such as Power BI, Tableau, and QlikView Let's connect for more ...

Looker or similar Familiarity with modern data transformation tools and workflows Experience working with cloud-based data warehouses Solid understanding of data architecture, ETL/ELT processes and reporting principles Ability to interpret business requirements and translate them into technical solutions A mindset focused on accuracy, performance and continuous improvement ...

helping make it better. Must have — strong practical experience in most of: Python for data workflows and automation Advanced SQL (optimisation, analytical functions, modelling) ETL/ELT pipeline design, build, and orchestration Docker and containerisation Cloud environments (Azure, AWS, or GCP) Version control (Git) Bonus points for: Airflow, Prefect ...

Doing Designing and building a greenfield data architecture from scratch Creating scalable data pipelines for large, text-heavy and unstructured datasets Building ETL/ELT workflows that produce AI-ready datasets Implementing dataset versioning, reproducibility and data lifecycle management Supporting AI teams with training, validation and test data splits Embedding ...

conscience of the programme - reviewing architecture, data models, pipelines, and design decisions Support development of data pipelines, Fabric workloads, and Power BI integration Validate ETL/ELT processes, migrated datasets, and performance optimisation approaches Ensure data governance, security, privacy, and quality standards are embedded from day one Confidently challenge vendors ...

Python for data engineering tasks hands-on experience with cloud platforms – AWS or GCP is essential, both would be highly beneficial Deep understanding of ETL/ELT processes and data pipeline development Strong problem-solving skills and the ability to work independently in remote settings Excellent communication skills and ...

frameworks (TensorFlow, PyTorch, scikit-learn, etc.) - DevOps practices, CI/CD, IaC, Docker, Kubernetes - Version control (Git) and collaborative development tools - Data engineering and ETL workflows - Monitoring/logging tools (Prometheus, Grafana, ELK, etc.) - Cloud platforms (AWS, Azure, Google Cloud) with focus on Google Cloud - Strong analytical, problem-solving, communication ...

audit readiness. Required Skillset: Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing and ETL tools like Apache Kafka, Spark, or Hadoop Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools such ...

handover and audit readiness. • Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. • Experience with additional data processing and ETL tools like Apache Kafka, Spark, or Hadoop. • Familiarity with containerization and orchestration tools such as Docker and Kubernetes. • Experience with monitoring and alerting tools such ...

Oracle Analytics Cloud (OAC dashboards, DV, RPD/semantic modelling). Experience with Autonomous Data Warehouse (ADW) and Oracle Fusion data structures. Data modelling, ETL/ELT, SQL tuning and general analytics engineering skillset. Proven ability to collaborate with AI teams, data scientists or ML engineers in shared workloads. ...

Integration architecture Event-driven architecture patterns (distributed design patterns more generally is an advantage) API design, management, and governance Extensive experience improving and optimising ETL processes, presumably using IPaaS tooling Data architecture Data modelling, cataloguing, and associated governance Data lakes, distributed storage Metadata management Cloud & Platform Architecture Proficient ...

Server, MySQL) to support scalable data architectures. Leverage BI tools like Power BI and Tableau for data visualisation and reporting. Collaborate on ETL and data engineering tasks, ensuring efficient data transformations with SQL, Excel, and DevOps tools. Support teams in utilizing JIRA, Visual Studio, and Office Suite for project management … experience with Databricks, Azure, Data Factory, Synapse, and ADLS. Experience with R & Shiny Proficient with BI/data analytics tools (Power BI, Tableau) and ETL/data engineering. Advanced SQL skills, with experience in SQL Server and MySQL. Familiar with DevOps practices and project management tools like JIRA and Visual ...

collaborate with internal stakeholders and external partners to deliver high-quality data for analytics, reporting, and decision-making. Key Responsibilities Develop and maintain automated ETL pipelines for data cleansing, transformation, and validation. Design and implement hybrid data ingestion strategies (batch, incremental, real-time). Contribute to unified data models and … knowledge transfer sessions. What We're Looking For Proven experience in data engineering, ideally with cloud platforms (Snowflake preferred). Strong understanding of ETL processes, data modelling, and integration from multiple sources. Familiarity with BI tools (PowerBI, Tableau) and data visualisation. Knowledge of data governance and compliance frameworks. Excellent collaboration ...

Modeling SaaS/Cloud architectures Oracle database architecture Architecting and tuning integrations (with products like Oracle Integration Cloud, Boomi, Mulesoft, Celigo, Workato or Snaplogic) ETL tools and techniques Experience in the following areas are desired: Software development life-cycles (SDLC) Release management and/or Agile scrum master experience Developing ...

work closely with client services, strategy and digital colleagues to build and maintain data pipelines and architecture, including data dictionaries, databases, and ETL processes using tools such as Adverity and BigQuery. You'll also help design and QA bespoke dashboards, maintain data integrity, and ensure consistent, clean, and accurate data ...

take ownership of migration tasks, proactively identify risks, and collaborate closely with technical and business stakeholders. Key Responsibilities Design, develop, and execute ETL processes to migrate data from legacy systems to target platforms. Write and optimise complex SQL queries (preferably MySQL) to support data extraction, transformation, and validation. Apply … Essential: Proven experience in public sector large-scale data migration projects. Strong SQL development skills within MySQL environments. Solid understanding of data transformations and ETL workflows. Knowledge and application of data quality dimensions in migration processes. Familiarity with case management systems and associated data structures. Strong problem-solving mindset, with ...

balance autonomy with alignment Ideally, experience working on payment systems such as Stripe or similar Ideally, experience working on data extraction, integration, or ETL platforms Interview Process 2 stages over Zoom 1st stage will be an introductory call 2nd stage will involve a pair programming session ...

governance, and risk policies. Skills & Experience - Essential Strong SQL Server or Snowflake skills. Advanced knowledge of low-code/no-code data engineering/ETL tools - ideally Markit EDM (v19.2+) or similar (e.g. Informatica). Proven delivery experience in Financial Services/Banking sector. Deep understanding of SDLC, systems integration … bank with long-term stability, world-class resources, and clear career progression routes. Enterprise Data Architect, EDM Developer, Data Engineering Lead, Data Architect, ETL Developer, Data Solutions Architect, Senior Data Engineer (Financial Services). Apply today for full details. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy ...

both technical and executive audiences, whether impromptu on a whiteboard or using presentations and demos Understanding of complete data analytics stack and workflow, from ETL to data platform design to BI and analytics tools Extensive hands-on expertise with SQL and SQL analytics and scripting languages like Python, Bash, Shell … Business Objects, Tableau) Experience and understanding of large-scale infrastructure-as-a-service platforms (e.g. Amazon AWS, Microsoft Azure, GCP, OpenStack, etc.) Experience implementing ETL pipelines using custom, packaged tools and software development experience using C/C++, Java etc. SnowPro Core Certification ...

play a pivotal role in delivering innovative, data-driven solutions for high-profile government clients. You'll be responsible for designing and implementing robust ETL pipelines, leveraging cutting-edge big data technologies, and driving excellence in cloud-based data engineering. This role offers the opportunity to work with leading technologies … collaborate with data architects and scientists, and make a significant impact in a fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure ...

through personally developed code, solution architectures and implementation recommendations Act as a trusted advisor to customer executive leadership for thought leadership and solution approaches Extract business requirements from customers and translate them into a well-architected recommendation Develop and provide forward looking guidance and future state roadmaps Leverage known best … lead role for analytics projects for large enterprises Experience implementing and operating Snowflake centric solutions Understanding of complete data analytics stack and workflow, from ETL to data platform design to BI and analytics tools Familiarity with industry common BI and ETL solutions Hands-on experience in a technical role leveraging ...

Experienced with Laravel/PHP (10.x/8.1 +) and MySQL An expert with APIs, data, transformations and calculations Strong experience with data optimisation: ETL System Development (Extract, Transform, Load) API development and integrations Data analytics TDD - phpunit/pest SOLID Design Principles Experienced with Cloud Infrastructure (AWS preferred) Excellent ...

data systems. What you'd be working on: • Developing and maintaining in-house Python applications • Building & optimising user interfaces and APIs • Designing and managing ETL pipelines with concurrency for large-scale processing • Monitoring, troubleshooting and improving a broad range of AWS services What they're looking for: • 4+ years' professional … Python development experience • Strong understanding of API development principles • Hands-on background with ETL pipelines & concurrent processing • Experience working with AWS (ECS, S3, EC2, RDS, CloudWatch) Role details: Bristol - 2/3 days onsite £50k–£60k Work that directly contributes to the transition to clean, sustainable energy ...