26 to 50 of 53 ETL Jobs in Lancashire

pipelines, ensuring data quality, and supporting a reliable, cloud-native data platform. What You’ll Do: Design, build, and maintain scalable data pipelines and ETL/ELT workflows Work with Snowflake , SQL , and Python to transform and manage large datasets Leverage AWS services (e.g., S3, Lambda, Glue) to build modern More ❯

and working with Azure (Azure DevOps, Azure ML, Azure SQL, ADF etc.) Able to work with databases like SQL Server, NoSQL, etc Experience with ETL process, data pipelines, Devops This role is hybrid, with requirement to be in one of their UK offices in either Scotland or England on occasion More ❯

delivery approach within a DevOps environment Extensive experience in creating technical specifications and code for data migration Proven expertise in extracting, transforming, and loading (ETL) financial data during migration from on-premise systems to the cloud Demonstrated ability to track, report, and improve data migration quality metrics It would be More ❯

an agile framework preferable, including defining functional and non-functional requirements and sprint tasks. Understanding of data engineering, some experience with building production-grade ETL pipelines, as well as backend web development, backend-for-frontend, GraphQL, and FastAPI. Strong communication skills, able to communicate with both technical and commercial people. More ❯

that meet business goals. Architecture & Engineering Excellence: Design and implement scalable, cost-effective data architectures across AWS, Azure, and GCP; build and maintain robust ETL/ELT pipelines and implement CDC and delta load frameworks to enhance data integration and performance. Platform Modernization & SAP Expertise: Lead complex migrations from legacy More ❯

would have 10+ years experience in Data Engineering/Architecture and have good knowledge within: Cloud (AWS, GCP, Azure) Data Warehousing (Snowflake, Redshift, BigQuery) ETL (Data Fabric, Data Mesh) DevOps (IaC, CI/CD, Containers) Leadership/Line Management Consulting/Client Facing Experience In return they would be offering More ❯

major teams in sports such as American football, soccer, NBA, Formula 1, and Olympic events. Key Responsibilities: Design and build large-scale data warehouses, ETL pipelines, and reporting platforms that are robust and efficient. (Looking at going down Snowflake or BigQuery) Utilize your expertise in backend languages; the tech stack More ❯

to security policies. • Develop and enforce GCP security hardening measures (network segmentation, access controls, encryption, GDPR/ISO 27001 compliance). • Design and implement ETL pipelines for marketing data into BigQuery for Looker. • Optimise BigQuery data models and schemas for Looker exploration and reporting. • Implement robust monitoring, logging, and alerting More ❯

the continued scaling and optimisation of these. Their ideal candidate would have good knowledge within: Cloud (AWS, GCP, Azure) Data Warehousing (Snowflake, Redshift, BigQuery) ETL (Data Fabric, Data Mesh) DevOps (IaC, CI/CD, Containers) Consulting/Client Facing Experience In return they would be offering Free Certification Scheme (AWS More ❯

of software design principles and coding standards Preferred Skills and Capabilities · Experience with vector databases and embedding models · Knowledge of data pipeline tools and ETL processes · Familiarity with React or other frontend technologies for better cross-team collaboration · Experience implementing LLM integration frameworks · Background in pharmaceutical or healthcare domain · Experience More ❯

What you'll do: Develop and maintain automated data processing pipelines using Google Cloud: Design, build, and maintain data pipelines to support data ingestion, ETL, and storage Build and maintain automated data pipelines to monitor data quality and troubleshoot issues Implement and maintain databases and data storage solutions: Stay up … relational databases such as MySQL, PostgreSQL, or Oracle. Experience with big data technologies such as Hadoop, Spark, or Hive. Familiarity with data warehousing and ETL tools such as Amazon Redshift, Google BigQuery, or Apache Airflow. Proficiency in at least one programming language such as Python, Java, or Scala. Strong analytical More ❯

requirements into functional and technical specifications Develop business rules , configure data models, and create financial reports and dashboards Support data integration and transformation tasks (ETL) as part of broader solution delivery Contribute to system testing, user training, go-live support, and documentation Build long-term relationships with finance stakeholders and More ❯

driven culture. Essential Skills Proven leadership of data teams within fast-growth, early-stage environments Advanced expertise in BI, SQL, and data warehousing/ETL processes Strong commercial acumen – able to translate business needs into analytical frameworks Skilled in experimentation design, A/B testing, and statistical methodologies Experienced in More ❯

a global small/medium Asset Management firm. Your new role Working as a Data Engineer in three key areas, firstly the support of ETL monitoring and maintaining the ETL process, where you will manage, support and develop ETL pipelines to ingest data into their data lake/data warehouse … analysis and resolve data issues, providing ad-hoc reporting. Finally, development and testing to automate key business activities. Modernising the data management, reporting and ETL processes. You will transition manual activities to robust automated processes. What you'll need to succeed Great experience working in Financial Services and in Asset … Logic App/Azure Functions to support/development. Expertise with Power BI and DAX (for business intelligence reporting). Strong experience working on ETL processes. Great programming ability to develop stored procedures & for data analytics with Python/R. You have the ability to extend and debug using C# More ❯

Azure Synapse, Azure Data-bricks, etc.). Define and enforce best practices for data architecture, governance, and security across the organization. Develop and optimise ETL/ELT processes to support data analytics and AI-driven initiatives. Collaborate with data scientists and process engineers to integrate machine learning models into production … field. Proven experience in data engineering and team management, preferably in a dynamic and fast-paced environment. Strong understanding of data architecture, data modelling, ETL/ELT processesand data pipeline development. Competency with cloud platforms (e.g., AWS, Azure, GCP) and big data technologies (e.g., Hadoop, Spark, Kafka etc). Excellent More ❯

. Mobile Testing Focus on mobile app quality across Android/iOS devices. Manual and automation testing using Appium , XCUITest , TestFairy . Data/ETL Testing Ensures accurate data flow, transformation, and validation in data pipelines. Works with SQL, Informatica , Talend , SSIS , Snowflake . AI/ML Model Testing Test More ❯

Job Description: We are seeking a candidate with good SSIS skills and experience in developing automated/zero-touch ETL processes. Refer a friend for a £1000 bonus, which is unlimited. If you are starting your career and looking for an opportunity to grow, our company offers a welcoming and More ❯

a comprehensive benefits package. About the Role As a Lead Data Engineer, you will drive the strategic development of data engineering solutions, focusing on ETL processes, data migration, and the development of diverse data products. You’ll play a pivotal role in delivering robust, scalable, and efficient systems while collaborating … to achieve strategic goals. This hybrid position requires on-site presence three days per week. Key Responsibilities Lead the design, development, and implementation of ETL pipelines and data integration solutions. This role is a 60% hands on (Technical Leadership/Code Reviews/Actual Coding) and 40% management (Stand Up … Engineering, or a related field. 10+ years of experience in data engineering, with at least 5 years in a leadership role. Strong expertise in ETL tools such as Talend and programming with Python. Proven experience working with No-SQL databases and diverse data products. Knowledge of data migrations, real-time More ❯

planning migrations, establishing client relationships, and understanding industry-specific requirements. You should have experience in designing and implementing SAP BW solutions, developing data models, ETL processes, security, documentation, performance optimization, troubleshooting, and collaboration with technical teams. Certification in relevant technologies and experience with SAP data tools are preferred. Connect to More ❯

seeking a highly skilled and motivated Data Engineer to join a dynamic team. The ideal candidate will have a strong background in SQL, Python, ETL processes, and data integration, ideally in Databricks. You will play a crucial role in continuing an exciting project designing, developing, and maintaining data infrastructure to … ensure the seamless inflow, data sanitation/consolidation and automated report production for clients. Key Responsibilities: Design and Development: Design, develop, and maintain scalable ETL pipelines to process and integrate data from various sources. Implement data validation routines to ensure data quality and integrity. Develop and optimize SQL queries for … related field. Proven experience as a Data Engineer or in a similar role. Strong proficiency in SQL or Python or ideally both. Experience with ETL processes and tools. Knowledge of data validation routines and data integration techniques. Familiarity with relational database design and management. Experience with API development and testing More ❯

and influence outcomes Home-based flexibility with a focus on work-life balance Key Responsibilities Design and deliver robust Azure data solutions across strategy, ETL, analytics, and AI Lead client workshops and translate business needs into technical design Build scalable, secure, high-performance data platforms using the latest Azure services … in the Azure ecosystem Deep expertise across the Azure Data Platform (Fabric, Synapse, Databricks, Data Lake, Data Factory, Purview, etc.) Strong data pipeline and ETL skills, including data modelling and transformation Experience implementing Medallion Architecture (Bronze, Silver, Gold layers) in lakehouse or Databricks environments Familiarity with DevOps, CI/CD More ❯

contracts across internal and external APIs are robust, secure, and scalable. System Integration & Platform Ownership Oversee integration between business systems using APIs, middleware, and ETL pipelines, including Salesforce, Power Platform (PowerApps, PowerAutomate, LogicApps), SharePoint, and custom web applications. Lead optimization and governance around API design (RESTful services, rate limiting, versioning … Backend : PHP (Symfony, Smarty), C# (.NET Core), Azure Functions (Node.js/PowerShell), PowerShell Database : MSSQL, PostgreSQL (including JSON), MySQL/MariaDB Integration : REST APIs, ETL, Azure Data Factory DevOps/Infra : CI/CD pipelines (e.g., GitHub Actions, Azure DevOps), containerization, Azure PaaS Security : Secure development lifecycle, OWASP, authentication/ More ❯

to drive innovation, inform decision-making, and create value for customers. With our commitment to excellence, we continuously push the boundaries of data integration, ETL process and issue resolution. Idox fosters a culture that celebrates curiosity, collaboration, and continuous learning, empowering our team to explore new ideas and solve complex … from back-office software solutions commonly used in Local Government regulatory services, ensuring completeness and accuracy. Lead and execute upon a portfolio of complex ETL project deliveries (transformations and merges) using a combination of internal and industry-standard ETL tools and scripting languages. Contribute to the ongoing development and evolution … of innovative and efficient processes that improve delivery quality, scalability and consistency across our data consulting services. Develop and maintain documentation for ETL processes, including data mappings, transformations, technical specifications, and workflows for reference and compliance. Stay informed of industry trends, best practices and advancements in ETL and data management. More ❯

timelines and resource constraints. Provide hands-on support to delivery teams during implementation, testing, and deployment. Integration & Data Architecture Define and document API strategies, ETL designs, and middleware integration patterns for seamless interoperability across our client’s and third-party platforms. Align integration designs with the enterprise data model and … Hands-on understanding of systems such as eFront, Yardi, Investran, Viewpoint, Fenergo, and client-facing portals. Proficiency in solution architecture disciplines including integration (API, ETL, middleware), application interoperability, and secure design. Skilled at working with non-standard, custom client requirements and translating them into structured technical designs. Effective communicator with More ❯

of software development. You will play a crucial role in shaping our enterprise SaaS platform, especially in the Operational Experience space—covering onboarding processes, ETL workflows, and backend systems. You must be able to operate confidently at senior or lead level , designing and evolving test frameworks, mentoring teams, and driving … We’re Looking For 🌟 Extensive experience in test automation and software engineering, operating at senior or lead level 🔗 Proven experience testing systems involving onboarding, ETL workflows, and third-party integrations ⚙️ Deep understanding of automated QA in continuous deployment environments 🖥️ Proven programming experience in C# and JavaScript 📡 Strong knowledge of REST More ❯