26 to 50 of 75 ETL Jobs in the North of England

code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/CD, Infrastructure as Code Container technologies Experience working in secure or regulated environments Security Requirement: Applicants must be eligible to obtain ...

modern, AI-enabled data platform Real ownership and influence in a growing, forward-thinking data team What You'll Do: Build and maintain ETL/ELT pipelines and data models in Fabric (Data Factory, Notebooks, Spark) Write high-performance Spark SQL, T-SQL, Python/PySpark Manage ingestion, transformation, and ...

looking for: Commercial experience in data engineering role Hands-on experience with tools such as Python, SQL, Spark/PySpark Understanding of data pipelines, ETL/ELT processes, and data storage solutions Exposure to data modelling and designing scalable data structures Background or grounding in software engineering principles Strong problem ...

analytic skills related to working with unstructured datasets\ N\n\nPython (PySpark, Pandas, PyArrow)\ N\n\nDistributed data processing (Apache Spark)\ N\n\nData ETL(Apache Airflow, AWS Step Functions, Apache NiFi)\ N\n\nCloud services (AWS, Azure or GCP)\ N\n\nMessaging/Streaming (Kafka, AWS SQS, Other Cloud ...

integration, data platforms and AI-enabled products and services within a complex enterprise environment. Strong understanding of modern data engineering practices, including data pipelines, ETL/ELT, data modelling, data governance, security, privacy and access management. Experience working with data platforms and technologies such as Snowflake, SQL-based data environments ...

driven integration, data platforms and AI-enabled products and services within a complex enterprise environment.\ NStrong understandingof modern data engineering practices, including data pipelines, ETL/ELT, data modelling, data governance, security, privacy and access management.\ NExperience working with data platforms and technologies such as Snowflake, SQL-based data environments ...

Extensive Experience of visualisation software essential (e.g. Power BI/Looker). Understanding of analysis methodologies essential (statistical techniques a plus). Awareness of ETL processes and database automation. Experience working with AI tools to generate automated insights advantageous Confident in Microsoft Excel and full Microsoft Suite. (Or cloud based ...

data-intensive workloads. Familiarity with GCP services such as Cloud Storage, Cloud Functions, Pub/Sub, or Cloud Composer. Experience with data pipeline development (ETL/ELT) and orchestration tooling. Exposure to Infrastructure as Code such as Terraform, and CI/CD pipelines such as Git, GitLab. Methodical, with high ...

data validation and investigation Experience with data profiling, reconciliation, and quality assessments Proven track record of root cause analysis and remediation Understanding of ETL processes and Data Warehouse environments Experience defining data quality metrics, KPIs, and dashboards Knowledge of Data Governance and Data Stewardship practices Exposure to Azure Purview, Collibra ...

performance-tune data-intensive workloads.\ NFamiliarity with GCPservices such as Cloud Storage, Cloud Functions, Pub/Sub, or Cloud Composer.\ NExperience with datapipeline development (ETL/ELT) and orchestration tooling.\ NExposure to Infrastructure as Code such as Terraform, and CI/CD pipelines such as Git, GitLab.\ NMethodical, with high ...

Microsoft's fastest-growing data platforms, this is a fantastic opportunity. You Will Work With Designing, building and maintaining scalable data pipelines. Developing ETL/ELT processes to ingest and transform data from multiple sources. Apache Airflow for workflow orchestration, scheduling and automation. Azure SQL and cloud-based data platforms. … Excellent opportunity for a Data Engineer looking to develop towards a more senior position over time. Key Experience Previous experience in a Data Engineer, ETL Developer or similar role. Strong SQL skills, ideally within Azure SQL or SQL Server environments. Experience building, maintaining and optimising data pipelines. Knowledge of ETL ...

both greenfield initiatives and the enhancement of existing data capabilities. Key Responsibilities Design, build and maintain a modern cloud-based data platform. Develop scalable ETL/ELT pipelines to integrate data from multiple operational systems, ERP platforms and high-volume transactional sources. Build reliable, high-performance data solutions for reporting … both relational and NoSQL databases. Experience building cloud-based data platforms using Azure, AWS, GCP or similar. Strong Python experience. Solid understanding of ETL/ELT processes and modern data warehousing principles. Experience with dimensional modelling, data governance and data architecture. Experience with Power BI and DAX. Experience integrating ...

stakeholders to ensure successful delivery. Follow governance, security, and quality standards throughout project delivery. Your Skills: Understanding of Oracle Data Integration concepts. Knowledge of ETL (Extract, Transform, Load) processes and data integration practices. Strong analytical and problem-solving capabilities. Ability to work effectively within a team environment. Good communication and ...

service improvement identification and ownership of service outcomes across the team Knowledge, Skills & Experience - Significant experience with managing service on a data platform, including ETL, Analytics, Integration and other key capabilities - Experience working within an agile, iterative customer-facing engineering environment - Clear and confident communicator, effective at all levels including ...

with cross-functional teams to deliver scalable solutions What You'll Bring Strong experience with SQL Server, SSIS, and data integrations Solid understanding of ETL processes and working with APIs A problem-solving mindset with a focus on quality and performance Experience working in an Agile environment using tools such ...

Analyse and understand source data structures within legacy healthcare systems to design robust transformation, cleansing, and validation strategies. Solution Delivery: Support the development of ETL processes and data pipelines to ensure absolute data integrity and clinical safety compliance. Problem Solving: Proactively identify, triage, and resolve intricate data quality issues during ...

Analyse and understand source data structures within legacy healthcare systems to design robust transformation, cleansing, and validation strategies. Solution Delivery: Support the development of ETL processes and data pipelines to ensure absolute data integrity and clinical safety compliance. Problem Solving: Proactively identify, triage, and resolve intricate data quality issues during ...

enable data loading and LLM workflows. Use Python/Java and large-scale data workflow orchestration platforms e.g. Airflow to construct software artifacts for ETL, interfacing with diverse data formats and storage technologies, and incorporate them into robust data workflows and dynamic systems What You Need to Have: Work experience ...

into a governed, value-generating asset. Key Responsibilities Capture needs and deliver end-to-end data solutions across technical and business domains. Build scalable ETL/ELT and streaming pipelines from simulators, HIL/SIL benches, MES/SCADA, ERP, and PLM. Architect data lakes, warehouses, lakehouses, and time-series … Service - integration model on hybrid/on-prem environments. Hard Skills Experience in data engineering, ideally aerospace/defence or industrial sectors. ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka). Strong Python and SQL; C++, C#, or MATLAB a plus. Databases: PostgreSQL, SQL Server, Oracle, Snowflake ...

security clearance (SC/DV). We highly encourage applications if you bring any of the following equivalent expertise: From Big Data/ETL to Telemetry Pipelines: If you have built high-throughput streaming pipelines using Apache Kafka, Airflow, NiFi, or Spark, you already know how to route and transform ...

client management skills Experience leading Oracle Cloud data migration workstreams Solid understanding of Oracle databases, Oracle RDBMS, and Oracle Cloud technologies Good knowledge of ETL processes and tools Strong SQL/PL-SQL skills Experience with data profiling, cleansing, reconciliation, and validation Understanding of database design, data modelling, and architecture ...

opportunity for an individual who is passionate about data engineering and keen to work with modern cloud solutions. Key Responsibilities Design, develop, and maintain ETL pipelines using Azure services, with a specific focus on Databricks and Azure Data Factory. Develop and optimize ETL processes leveraging Notebooks to ensure efficient data … similar role, with expertise in Azure cloud services. Experience with Azure services like Azure Data Lake and Azure Databricks. Proficiency in designing and managing ETL processes using Notebooks. Experience with Power BI for semantic model creation and report development. Familiarity with integrating various data sources within Azure environments. Basic understanding ...

Prefect). Proven track record with data governance, quality, lineage, and security practices. Experience with real-time/streaming data technologies, data Ingestion/ETL (e.g., Apache Kafka, Apache NiFi, Kinesis, Pub/Sub). Strong proficiency in relational and non-relational databases (e.g., PostgreSQL, MongoDB, Cassandra). Deep knowledge … data transformation and ETL pipelines and APIs. Security cleared or ability to obtain (SC or above). Desirable Skills and Experience: Degree in Data Engineering or equivalent professional accreditation such as CEng. Experience with graph databases and advanced query languages (e.g., Neo4j, Gremlin). Knowledge of machine learning data pipelines ...

support analytics, AI/ML, and real-time insights. Key Responsibilities Architecture & Solution Design Architect end-to-end Databricks Lakehouse solutions including data ingestion, ETL/ELT pipelines, Delta Lake, data warehousing, and data governance frameworks. Define and enforce best practices, security standards, and performance optimization across Databricks workloads. Design … architecture design on Azure/AWS/GCP (based on organization need) integrated with Databricks. Data Engineering & Platform Build Build and optimize large-scale ETL/ELT pipelines using PySpark, SQL, and Delta. Oversee data quality frameworks, metadata management, lineage, and monitoring. Leadership & Stakeholder Engagement Work closely with business leaders ...

ownership of technical delivery while ensuring quality, scalability, and maintainability. Key Responsibilities Design, develop, and maintain data products and data pipelines. Build and optimise ETL/ELT processes within a cloud-based data platform. Work closely with stakeholders to understand requirements and deliver effective technical solutions. Analyse complex data challenges … and a focus on delivering value are key to your success. Essential Skills & Experience 3+ years' experience in Data Engineering with a focus on ETL/ELT development. Strong SQL and Python programming skills. Experience with DBT, Git, Terraform, IAM, Airflow/Composer, and Docker. Experience working with cloud platforms ...