1 to 25 of 950 Permanent ETL Jobs

their contributions and empowered to build meaningful, long-term careers. Position Summary: The Data Engineer will be pivotal in designing, developing, and maintaining robust ETL (Extract, Transform, Load) processes to ensure seamless data flow between our diverse data sources and target data stores. You will be responsible for building and … requires a strong technical foundation and a proactive approach to problem-solving. Primary Responsibilities: Pipeline Design & Development: Design, develop, and implement scalable and efficient ETL pipelines using modern data integration tools and technologies. Data Transformation: Transform and cleanse data from various sources (databases, APIs, cloud storage, etc.) to ensure accuracy ...

Data Engineer, you will play a crucial role in designing, developing, and maintaining our clients data infrastructure. Your expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub), and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data … robust data architecture solutions. Develop data models and schema designs to optimize data storage and retrieval. ETL Development: Implement ETL processes to extract, transform, and load data from various sources. Ensure data quality, integrity, and consistency throughout the ETL pipeline. Python and PySpark Development: Utilize your expertise in Python and ...

architecture, data engineering, or analytics consulting Deep expertise with at least one major cloud platform (Azure, AWS, or GCP) Strong understanding of lakehouse architectures, ETL/ELT design, and distributed data storage Hands-on experience with Microsoft Fabric, Databricks, or Snowflake Proficiency in SQL, Python, and enterprise data modeling (Kimball ...

based data platforms (AWS, Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data ...

data architectures. Knowledge and practical application of DevOps principles, tools, and methodologies. Strong SQL development and data modelling skills. Experience designing, developing, and maintaining ETL/ELT processes and data pipelines. Excellent analytical and problem-solving skills with the ability to translate complex requirements into effective technical solutions. Strong communication ...

Spark Proven experience designing data pipelines, integrations, and scalable data platforms Deep knowledge of Microsoft Fabric and Azure data services Experience with dimensional modeling, ETL or ELT processes, and semantic modeling Familiarity with CI CD and DevOps practices within data environments Strong communication skills with the ability to work cross ...

medallion architecture. Strong Azure Data Factory, Azure Data Lake, Python/PySpark, SQL, MS SQL/Azure SQL experience. Good understanding of data modelling, ETL/ELT, data quality, governance, and lineage. Experience working in financial services or another regulated environment. Desirable Experience Wealth management, investment management, pensions, banking ...

equivalent experience Minimum 3+ years of professional experience in data engineering, data integration, or related technical roles Experience developing and maintaining data pipelines, ETL/ELT workflows, or ingestion frameworks Experience working within cloud or modern data platform environments Experience supporting federal, government, or mission-focused environments Strong understanding ...

will work within a modern Microsoft data ecosystem including: Microsoft Azure Microsoft Fabric Power BI SQL Python Data Lake technologies API Integrations Data Warehousing ETL/ELT Frameworks Data Modelling Analytics and Reporting Platforms Essential Skills & Experience Strong commercial experience as a Senior Data Engineer, Data Architect or Lead Data ...

and problem-solving skills Ability to work independently and collaboratively in a fast-paced environment Desirable Skills Microsoft Fabric experience Databricks or Snowflake exposure ETL/data integration tool experience API integration experience Python scripting/automation knowledge Experience working with complex or regulated datasets Understanding of data governance frameworks ...

Understanding of Direct Lake semantic modelling design considerations (model creation, table choices, and enforcing access rules). Proven experience with ingestion and transformation patterns (ETL/ELT concepts), data modelling, and delivering analytics-ready datasets. Ability to implement approaches that improve delivery reliability: data quality checks, monitoring, and operational feedback ...

value Drive best practice in data governance, cataloguing, lineage, and standards across the organisation Promote data re-use and reduce duplication across systems Oversee ETL processes, data integration, and BI architecture Manage and develop a small, high-performing data team, including mentoring, 1:1s, and continuous improvement initiatives Work closely ...

responsible for: Build and Manage Data Pipelines Develop, construct, test, and maintain highly scalable data management systems and pipelines using Python. Extract, transform, and load (ETL) complex datasets from the Fiserv DNA core system to support various business units. Troubleshoot data issues and optimize pipeline performance to ensure reliability and … documentation for data pipelines, data dictionaries, and architectural diagrams. How Success is Measured Pipeline Reliability: Ensuring the reliability, accuracy, and timeliness of data pipelines and ETL processes that support business units and executive reporting Data Quality: Improving data quality and consistency across the organization through effective validation and reconciliation frameworks ...

responsible for: Build and Manage Data Pipelines Develop, construct, test, and maintain highly scalable data management systems and pipelines using Python. Extract, transform, and load (ETL) complex datasets from the Fiserv DNA core system to support various business units. Troubleshoot data issues and optimize pipeline performance to ensure reliability and … documentation for data pipelines, data dictionaries, and architectural diagrams. How Success is Measured Pipeline Reliability: Ensuring the reliability, accuracy, and timeliness of data pipelines and ETL processes that support business units and executive reporting Data Quality: Improving data quality and consistency across the organization through effective validation and reconciliation frameworks ...

collaboration with project managers and Scrum Masters Skills & Experience Proven experience delivering data solutions, with a strong understanding of: Relational databases Data warehousing concepts ETL processes and data modelling Advanced T-SQL skills Experience working in Agile delivery environments, using tools such as Kanban boards and CI/CD pipelines ...

Delivery Own It End-to-End: Manage and deliver BI infrastructure from initial brief and requirement gathering through to data pipeline development (APIs/ETL/ELT/SQL). Enable the Analysts: Work alongside your Data Analyst colleagues to help them generate impactful business insights and analysis. Data Platform ...

deliver robust data solutions that support operational and strategic objectives. This role requires active Security Check (SC) clearance Key Responsibilities Design, develop, and maintain ETL/ELT pipelines for structured and unstructured data sources. Build scalable data ingestion and transformation frameworks using cloud-native and on-premise technologies. Develop and ...

high-quality reporting, insight generation, and future AI/ML initiatives across the business. What You'll Do * Build & Maintain Pipelines: Develop ELT/ETL pipelines using dbt, Python, and orchestration tools. * Work with Snowflake: Design and optimise data models, manage performance, and adopt advanced Snowflake features. * Ensure Data Quality ...

support safety, performance, regulatory compliance, and strategic decision‐making. Some of the main responsibilities of the Data Analyst will include: Develop and maintain robust ETL/ELT pipelines using Azure Data Factory to ingest data from operational systems, sensors, maintenance logs, and regulatory datasets. Use Azure Databricks (SQL/PySpark ...

Kimball, Data Vault) Experience exposing Delta Lakehouse to Power BI or Tableau Skilled in Python, Scala or SQL for data engineering Experience building scalable ETL pipelines (Workflows, Delta Live Tables) Hands-on experience with Azure, AWS or GCP (storage, compute, networking) Knowledge of Databricks security: RBAC, IAM, encryption Excellent analytical ...

Redshift, Glue), Azure (Data Factory, Synapse) or GCP (BigQuery, Dataflow) Advanced proficiency in SQL, including optimisation and performance tuning Strong experience with ETL/ELT pipelines and data transformation frameworks Programming capability in Python, Scala or Java for data processing Deep understanding of data warehousing concepts and best practices Experience ...

enhances frameworks and design proof of concepts, and review code for correctness, and its impact on software architecture. Lead the development of high-performance ETL/ELT pipelines using tools like dbt, Python, Airflow and more to integrate diverse data sources. Provide mentorship and direction to more junior software engineers ...

enhances frameworks and design proof of concepts, and review code for correctness, and its impact on software architecture. Lead the development of high-performance ETL/ELT pipelines using tools like dbt, Python, Airflow and more to integrate diverse data sources. Provide mentorship and direction to more junior software engineers ...

enhances frameworks and design proof of concepts, and review code for correctness, and its impact on software architecture. Lead the development of high-performance ETL/ELT pipelines using tools like dbt, Python, Airflow and more to integrate diverse data sources. Provide mentorship and direction to more junior software engineers ...

and dashboards. ·Foundational knowledge of Python for data manipulation, automation, or analysis. ·Experience with cloud data environments such as Azure or AWS. ·Familiarity with ETL tools, or similar data‐integration technologies. ·Understanding of data modelling concepts. ·Familiarity with legal industry data and metrics. Equal Opportunities Our approach to our people ...