1 to 25 of 26 ETL Jobs in Manchester

engineering, ideally within the defence, aerospace or industrial sectors Strong Python and SQL programming skills, with experience developing and maintaining data pipelines Familiarity with ETL/ELT technologies and data streaming tools such as Airflow, Azure, SSIS, Spark or Kafka Experience working with databases and data platforms such as PostgreSQL ...

validation and reconciliation. Communicating analytical findings clearly to a range of audiences. Nice to have Experience with Databricks, Salesforce reporting, Python, Azure/AWS, ETL technologies or data modelling would be highly beneficial. Why this role? This is a great opportunity for a hands-on Data Analyst to join ...

data modelling and an understanding of backup, recovery and resilience in partnership with DBA and infrastructure teams. Data Pipelines, Transformation and Quality Experience overseeing ETL/ELT pipeline design and operation, including CDC, orchestration, monitoring and alerting. Establishing data quality controls and measures, such as validation rules, reconciliation, profiling, exception ...

experience integrating Salesforce with enterprise systems using APIs, event-driven architecture and data integration tooling Good understanding of SQL, data modelling, data warehousing and ETL/ELT concepts Proficiency in JavaScript, Apex, Java or Python Solid grasp of Salesforce security, governance, data privacy and GDPR Experience with CI/ ...

engineeringEssential experienceProduction data engineering, including SQL, Python, a modern data platform such as Databricks, Snowflake or Fabric, and orchestration tooling, with practical experience of ETL/ELT, data testing, Git and CI/CD; PySpark or dbt experience is beneficial. Working knowledge of finance data structures, including chart of accounts ...

such as dbt, Airflow or Spark. Experience with cloud data warehouses, such as Snowflake, BigQuery or Amazon Redshift. A solid understanding of data modelling, ETL/ELT and data quality. Knowledge of data governance, security and privacy. Confidence taking ownership and making practical technical decisions in an early-stage environment. ...

casesStrong experience integrating Salesforce with enterprise systems using APIs, event-driven architecture and data integration toolingGood understanding of SQL, data modelling, data warehousing and ETL/ELT conceptsProficiency in JavaScript, Apex, Java or PythonSolid grasp of Salesforce security, governance, data privacy and GDPRExperience with CI/CD, source control, automated ...

Defence and Security programmes What We're Looking For Experience working with Palantir Foundry Strong xehkeey data engineering and data modelling skills Experience building ETL/data pipelines and integrating complex data sources Understanding of data governance, quality and lineage Ability to translate business requirements into technical solutions Strong consulting ...

Defence and Security programmes What We're Looking For Experience working with Palantir Foundry Strong xehkeey data engineering and data modelling skills Experience building ETL/data pipelines and integrating complex data sources Understanding of data governance, quality and lineage Ability to translate business requirements into technical solutions Strong consulting ...

correctly and loads as expected. Able to validate data quality by checking for issues like missing data, duplicates, incorrect values, or broken logic in ETL/ELT processes. Comfortable using SQL to look at data, troubleshoot issues, and confirm that transformed data is correct across different layers. Responsible for planning ...

Azure, ideally including GKE. Knowledge of Docker, Kubernetes, Helm, Jenkins, IAM and API gateways such as Apigee. Experience with Python, Pytest, API automation and ETL testing. Strong understanding of TDD, BDD, shift-left testing, unit, integration and regression testing. Familiarity with security and performance testing, and observability tools such ...

with analytics and IT teams. Understanding of data security and compliance requirements. Problem-solving skills and a proactive approach to troubleshooting Technical Skills: SQL ETL Databricks Data Modelling Job Offer Based in Wythenshawe/Manchester, this is a hybrid role, 3 days working from home 2 days on site. ...

Engineering or Integration Engineering. Practical experience with Informatica Cloud Data Integration and Cloud Application Integration (CAI)Advanced SQL expertiseDesigning and supporting integrations at scaleStrong ETL/ELT developmentSnowflake data engineering experienceStrong REST API development and integration experienceUnderstanding of event-driven integrationData modelling and data quality principlesCI/CD, DevOps practices ...

teams to deliver production-ready solutions. Skills & Experience - Strong Python development skills. - Commercial experience delivering solutions using Microsoft Azure. - Experience with data integration and ETL pipelines, such as Azure Data Factory. - Familiarity with vector databases or search technologies, such as OpenSearch. - Experience with Terraform, infrastructure-as-code and containerised applications. ...

procedures and performance tuning. Working knowledge of GCP services such as Cloud Storage, Cloud Functions, Pub/Sub or Cloud Composer. Experience of building ETL or ELT data pipelines. Exposure to orchestration tooling for scheduled and dependency-driven workloads. Familiarity with SQL Server in support of legacy systems. Experience with ...

with others and using data to create positive outcomes, we'd love to hear from you. Day to Day Design, build and maintain reliable ETL/ELT data pipelines using AWS or Azure cloud-native services and established engineering patterns Develop and support data integration components and services, including Java … Functions and Logic Apps PySpark SQL (Athena, Redshift, Azure Synapse SQL) AWS S3 or Azure Data Lake Storage Gen2 Python and/or Java ETL/ELT data pipeline development Data quality, validation and monitoring Git, CI/CD and Agile delivery practices Current active SC or eligibility ...

with others and using data to create positive outcomes, we'd love to hear from you. Day to Day Design, build and maintain reliable ETL/ELT data pipelines using AWS or Azure cloud-native services and established engineering patterns Develop and support data integration components and services, including Java … Functions and Logic Apps PySpark SQL (Athena, Redshift, Azure Synapse SQL) AWS S3 or Azure Data Lake Storage Gen2 Python and/or Java ETL/ELT data pipeline development Data quality, validation and monitoring Git, CI/CD and Agile delivery practices Experience being most Senior of Lead within ...

deploy R-based applications and data workflows within AWS Work with structured and unstructured data to identify trends, patterns and insights Build and maintain ETL/ELT pipelines and data workflows Work with AWS services including S3, RDS, Lambda, ECS, Glue and CloudWatch Monitor data quality, pipeline performance and production … years' commercial experience developing in R using RStudio/Posit Strong working knowledge of statistics and machine learning Hands-on experience building or maintaining ETL/ELT data pipelines Practical experience working with AWS, ideally including S3 and a managed database service such as RDS Strong SQL skills Experience working ...

native software solutions utilizing AWS services such as Lambda, ECS, RDS, S3, SQS, API Gateway, and CloudWatch. Design, develop, and maintain data pipelines and ETL workflows using technologies such as Glue, Spark/PySpark, Kafka, or similar platforms. Implement and maintain Infrastructure as Code (IaC) using Terraform or equivalent tools. … systems, APIs, and microservices architectures. Extensive experience developing cloud-native applications and services within AWS environments. Strong background in data engineering, including data modeling, ETL development, pipeline design, and large-scale data processing. Demonstrated experience building and deploying production-grade AI agents and agentic systems that solve real-world business ...

platform cut-overs across Scala, D365, Azure, and Databricks. Data, Analytics and MLOps Integration: Drive the delivery of end-to-end data products. Coordinate ETL/ELT ingestion pipelines on Azure Databricks, integrate machine learning lifecycles (MLOps) into sprint cadences, and oversee governed Power BI deployment pipelines. GDS and Public … and API-led architectures. Data and Analytics Delivery: Demonstrated track record delivering analytics solutionsspecifically Azure Databricks Lakehouse architecture (medallion/Delta Lake, Unity Catalog), ETL/ELT pipelines, MLOps workflows, and enterprise Power BI reporting. Rigor in SAFe Ceremonies and Tooling: Expert facilitation of PI planning boards, ROAMing risks, managing ...

working model Active SC required Up to £75k DoE + 6% pension, 30 days leave Experience required in Python, AWS, Git, CI/CD, ETL, Data Pipelines, IaC Role Opportunity Join a growing public sector technology consultancy delivering digital, data and technology transformation across central government. You'll take … Responsibilities: Build and maintain scalable data platforms, pipelines and services. Develop robust Python-based data solutions using modern engineering practices. Deliver batch, streaming, ETL/ELT and data transformation solutions. Implement CI/CD, IaC and DataOps across production environments. Translate client requirements into technical solutions and measurable outcomes. Provide ...

This is not a paper-architect role. The successful candidate will pick up an in-flight, multi-year programme to decouple and replatform the ETL processes that sit behind every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake … layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. \n · Hands-on T-SQL, stored procedure, ETL framework and PowerShell development at expert level — partition design and partition-aligned indexing, clustered/nonclustered index strategy, deduplication, parallel-run cutovers, schema migration, performance tuning ...

and request/response payloads. Use SQL to investigate data issues and reconcile UI and API results against underlying database data. Investigate data pipelines, ETL processes and dashboard calculations where required. Read and understand application source code to support technical investigations. Work with Git, pull requests, code reviews and … Experience with the following would also be beneficial: Node.js React/Redux Docker/Docker Compose AWS RDS Advanced Cucumber.js JSON Schema/AJV ETL and data-pipeline testing Analytics and dashboard testing Python or R Performance testing and investigation Figma Canvas-based visualisation libraries such as Chart.js ...

including data modelling and query optimisation Advanced SQL capabilities, covering complex queries, stored procedures and performance tuning Proven track record designing, building and supporting ETL or ELT pipelines Practical knowledge of GCP services such as Cloud Storage, Cloud Functions, Pub/Sub and Cloud Composer Background in modernising or supporting … major workstreams from planning through to operational delivery Design, develop and maintain robust reporting systems across SQL Server and Google Cloud Platform Build resilient ETL and ELT pipelines for data ingestion, transformation and validation Modernise legacy SQL Server reporting solutions into scalable, cloud-native GCP architectures Deliver data-quality checks ...

offering a 'boots on the ground' approach to complex public and private sector challenges. As a trusted Palantir partner we help our clients to extract the most value from their technology. We are working at the cutting edge of Palantir technology and harnessing its capabilities with purpose. Our teams … core languages (Python, SQL, TypeScript and/or REACT) and the capability to pick up others quickly. You should understand data engineering principles, ETL pipelines, and application developmentFamiliarity with Palantir (Foundry, Gotham, or similar) is preferred but not mandatory provided you have a strong willingness to learnHigh EQ & Curiosity ...