25 of 25 ETL Jobs in the East of England

responsible for: Building and managing data pipelines using Azure Synapse, Data Factory, Databricks, or Microsoft Fabric Designing and maintaining data lakes, data warehouses, and ETL/ELT processes Developing scalable data models for reporting in Power BI Work closely with stakeholders to understand the needs of their individual business and ...

performance tuning and model management. Proven ability to manage and optimize very large datasets in Power BI and Azure. Solid understanding of SQL, ETL processes, and data warehousing. Familiarity with Azure Synapse, Data Lake, and Analysis Services (AAS/SSAS). Strong performance tuning: aggregations, incremental refresh, Hybrid tables, Direct ...

production environments. Solid knowledge of Hive, Impala, HDFS, and Parquet . Advanced SQL skills; experience with Oracle databases . Experience designing and supporting ETL/ELT pipelines and data quality frameworks . Working knowledge of Autosys & Apache Airflow Experience with CI/CD tools (Git, Harness, UrbanCode Deploy ...

production environments. Solid knowledge of Hive, Impala, HDFS, and Parquet . Advanced SQL skills; experience with Oracle databases . Experience designing and supporting ETL/ELT pipelines and data quality frameworks . Working knowledge of Autosys & Apache Airflow Experience with CI/CD tools (Git, Harness, UrbanCode Deploy ...

production environments. Solid knowledge of Hive, Impala, HDFS, and Parquet . Advanced SQL skills; experience with Oracle databases . Experience designing and supporting ETL/ELT pipelines and data quality frameworks . Working knowledge of Autosys & Apache Airflow Experience with CI/CD tools (Git, Harness, UrbanCode Deploy ...

insight across a complex, multi-site business. Key responsibilities but not limited to as the Python Data Engineer: Build and maintain data pipelines and ETL processes Integrating legacy and modern systems Deliver data migrations, including mapping, transformation, and validation Ensure data quality, performance, and reliability Collaborate with technology and business ...

driven decision-making Strong understanding of data governance, stewardship frameworks, and operating models Hands-on experience with data engineering and large-scale processing, including ETL/ELT, Python, and Spark Proven experience designing and operating modern cloud data platforms on Azure, including Fabric and Databricks Ability to design and govern ...

based dashboards with strong UX; apply row and object-level security as needed. Collaborate with Finance, Operations, and Sales on data readiness (staging, transformations, ETL). Provide ongoing support: answer stakeholder questions about metrics, explain calculations and data lineage, and triage issues. Document data sources, refresh schedules, dependencies, and change ...

Proven experience in Power BI development and data visualization Strong skills in DAX, SQL, and data modeling techniques Understanding of data warehousing concepts and ETL processes Experienced with Dynamics BC or 4PS Ability to communicate complex data insights effectively to diverse audiences Experience in project management and a collaborative mindset ...

security - 0Auth 2.0, JWT, managed identities, secrets Experience integrating with enterprise platforms such as Salesforce, ServiceNow, SAP, Pega Coding/scripting experience (Python, JavaScript, ETL tools) Excellent communication skills, with the ability to engage non-technical stakeholders Strong documentation skills - diagrams, data flows, design specs Desirable Qualifications Working within secure ...

understand business requirements for data migration. Design and implement robust data migration strategies. Develop scripts and processes to automate data extraction, transformation, and loading (ETL) processes. Work closely with stakeholders, including business users and IT teams, to ensure data requirements are met, and migrations proceed without disruption to business operations. … Responsibilities: Plan, coordinate, and execute data migration projects within set timelines. Design and build ETL solutions, ensuring data quality and integrity throughout the migration process. Troubleshoot and resolve data-related issues promptly to minimise disruption. Collaborate with various teams to align migration processes with organisational goals and regulatory standards. Proficiency ...

modelling Work with domain teams to scale data processing Job Requirements: Technical expertise in designing, building, and maintaining data pipelines and warehouses Experience with ETL/ELT frameworks and Big Data Processing Tools (e.g., Spark, Airflow, Hive) Knowledge of programming languages (e.g., Python, SQL) Hands-on experience with SQL/ ...

Python, REST/SOAP web services, HTML and CSS Proven use of data technologies including MySQL and SQL Server databases, database schemas, SQL syntax, ETL techniques and best practice, as well as an understanding of and solutions for issues arising with data integration across multiple systems Proven use of data ...

hours, Monday Friday (9am 5.15pm) Location: Hybrid, with weekly presence in Milton Keynes or Boston Snapshot of your role Youll design, build and maintain ETL/ELT pipelinesin the Microsoft cloud, primarily using Azure Data Factory, Databricks and related Azure services. Your focus will be on producing data pipelines that … What were looking for Youll be a motivated data engineer with strong technical foundations and a practical mindset. Youll bring: Hands-on experience building ETL/ELT pipelines in a cloud environment Strong SQL skills and experience with data modelling Experience working with Databricks (PySpark/SQL) and Azure data ...

problems and improve processes Gathering requirements and delivering ERP enhancements Developing and maintaining BI and operational reporting (Infor M3, Crystal Reports, Excel) Owning data, ETL processes and ERP system administration Managing ERP security, access and system releases Supporting, training and developing users at all levels Maintaining EDI and API integrations ...

will be responsible for: Diagnosing and resolving SQL Server performance issues across queries, indexes and execution plans Tuning stored procedures, user-defined functions and ETL processes to improve scalability and speed Working closely with clients and internal teams to understand requirements and deliver efficient technical solutions Promote performance best practices ...

Data source understanding (JSON, CSV etc) Strong SQL ETL/ELT Testing Background Strong Domain understanding Test Planning Resource prioritization Test Approach Automation strategy Azure Experience API (Postman Experience) Strong communication Responsibilities Manage Releases Review user stories (Test Scope) Define Test types Create approach for any new patterns Test evidence ...

performance tuning, reconciliation logic). Strong proficiency in Python for data analysis and automation (pandas, data validation frameworks, scripting). Experience supporting or validating ETL/ELT pipelines and data quality frameworks (rules, thresholds, exception handling). Working knowledge of Autosys & Apache Airflow (monitoring schedules, reruns, failure triage). Experience … OpenShift). Familiarity with AWS S3 for large-scale data storage and dataset movement patterns. Experience supporting Tableau dashboards (data validation, extract refresh checks, reconciliation to source). Nice-to-Have Ideally, you have experience with tools including PySpark, Spark SQL, Hive, Impala, HDFS, Parquet, and Oracle databases. Experience ...

performance tuning, reconciliation logic). Strong proficiency in Python for data analysis and automation (pandas, data validation frameworks, scripting). Experience supporting or validating ETL/ELT pipelines and data quality frameworks (rules, thresholds, exception handling). Working knowledge of Autosys & Apache Airflow (monitoring schedules, reruns, failure triage). Experience … OpenShift). Familiarity with AWS S3 for large-scale data storage and dataset movement patterns. Experience supporting Tableau dashboards (data validation, extract refresh checks, reconciliation to source). Nice-to-Have Ideally, you have experience with tools including PySpark, Spark SQL, Hive, Impala, HDFS, Parquet, and Oracle databases. Experience ...

performance tuning, reconciliation logic). Strong proficiency in Python for data analysis and automation (pandas, data validation frameworks, scripting). Experience supporting or validating ETL/ELT pipelines and data quality frameworks (rules, thresholds, exception handling). Working knowledge of Autosys & Apache Airflow (monitoring schedules, reruns, failure triage). Experience … OpenShift). Familiarity with AWS S3 for large-scale data storage and dataset movement patterns. Experience supporting Tableau dashboards (data validation, extract refresh checks, reconciliation to source). Nice-to-Have Ideally, you have experience with tools including PySpark, Spark SQL, Hive, Impala, HDFS, Parquet, and Oracle databases. Experience ...

Support Engineer/Data Engineer Telecom Domain (JD) Key Skills & Expertise AWS Core Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing ETL pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) Working with structured/semi-structured telecom datasets (CDRs, network … styles, sort keys Workload management (WLM) Performance optimization & troubleshooting Python: Automation scripts Data processing workflows Monitoring, debugging, validation scripts AWS Support/Operations: Troubleshooting ETL failures, performance bottlenecks, pipeline issues Monitoring cloud workloads (CloudWatch, CloudTrail) Handling incidents, root-cause analysis (RCA), patching & releases Cost optimization and resource usage tracking Telecom ...

process Key Responsibilities Analyse existing data structures and understand business and technical requirements for migration initiatives. Design and deliver robust data migration strategies and ETL solutions. Develop automated data extraction, transformation, and loading (ETL) processes using industry-standard tools and scripts. Work closely with stakeholders to ensure seamless migration and … promptly. Collaborate with wider engineering and architecture teams to ensure migrations align with organisational and regulatory standards. Relevant exposure; Strong hands-on experience with ETL processes and tools (Talend, Informatica, Matillion, Pentaho, MuleSoft, Boomi) or scripting using Python, PySpark, and SQL. Proficient-level SQL skills for complex query development, performance ...

policies Security must be baked into delivery not an afterthought. Power Platform, Fabric & Data Modelling Power BI (data modelling, DAX fundamentals) Power Query/ETL thinking Familiarity with Microsoft Fabric or modern data platforms Can design a single source of truth , not just reports Someone who moves from spreadsheets models … experience useful: BAQs, REST/API, upgrades SQL literacy (views, joins, performance awareness) Understanding of manufacturing concepts: BOMs, routings, work centres Ability to extract ERP data cleanly for reporting & forecasting Process, Documentation & Knowledge Capture Comfortable documenting systems and processes Can create repeatable runbooks, not Word documents nobody reads Thinks ...

premise infrastructure , ensuring our Generative AI capabilities are powerful, private, and resilient. Key Responsibilities Architect & Build: Design, develop, and optimize scalable data pipelines (ETL/ELT) within air-gapped or on-premise data centers. AI Integration: Engineer data structures specifically for Natural Language Processing (NLP) and Large Language Models (LLMs … transition GenAI prototypes into production-ready, locally-hosted solutions. Technical Requirements Languages Expert-level Python and advanced SQL . Data Engineering Experience with ETL/ELT and orchestration tools like Apache Airflow or NiFi . On-Prem Tech Proficiency with Hadoop/HDFS , Spark , and containerization via Docker/Kubernetes ...

and optimise data usage Ensure data quality, governance and compliance standards are met across all data assets Support data exchange and processing solutions including ETL, APIs and integration layers Contribute to the ongoing improvement of data platforms and architectures Stay up to date with emerging technologies and provide input into … technologies such as MS SQL or Oracle Experience with noSQL technologies such as MongoDB, InfluxDB or Neo4J Strong data exchange and processing experience including ETL, ESB and API-based integrations Development experience, ideally using Python Knowledge of big data technologies such as the Hadoop stack Exposure to NLP and ...