51 to 75 of 575 Remote ETL Jobs

their AI/ML services.Data Engineering: Proficiency in data manipulation and analysis using SQL and big data technologies (e.g., Spark, Hadoop). Experience with ETL, data pipelines, and automated workflows for moving and processing data.Data Governance: Adherence to data governance, security, and privacy standards throughout the development lifecycle, including metadata ...

Initial 6 months + extensions. Job Purpose: The BI Engineer will be responsible for the requirements analysis and design of solutions for data platform, ETL, integration and analysis solutions. Our toolset includes AWS hosted databases (postgres, S3 based data lake, MySQL, Athena), integration services (AWS API gateway, lambda functions), ETL … data warehouses. Collaborate with data visualization and analysts' teams to understand data requirements and translate them into technical specifications. Data Processing: Develop and maintain ETL (Extract, Transform, Load) processes for ingesting data from various sources into the data infrastructure. Optimize data processing and storage for performance and cost-effectiveness. ...

analytics, or related disciplines in a complex, global organisation. Proven delivery of modern cloud‐based data platforms, data lakes or warehouses, integration patterns, ETL/ELT pipelines, semantic models, and analytics solutions. Strong knowledge of the Microsoft data and analytics ecosystem, including Azure data services, SQL, Power BI, and modern ...

analytics, or related disciplines in a complex, global organisation. Proven delivery of modern cloud-based data platforms, data lakes or warehouses, integration patterns, ETL/ELT pipelines, semantic models, and analytics solutions. Strong knowledge of the Microsoft data and analytics ecosystem, including Azure data services, SQL, Power BI, and modern ...

Experience with SQL, Python, schema definition, and software engineering best practices including secure, testable, and maintainable code - Understanding of distributed systems, data integration techniques (ETL vs. federation), database optimization (partitioning, indexing), and relational database performance tuning - Current, active US Government Security Clearance of Top Secret or above PREFERRED QUALIFICATIONS - Experience ...

practical, curious and commercially-minded approach to problem-solving. Desirable Experience with machine learning and predictive modelling. Experience with Snowflake. Experience working with ETL/data integration tools, ideally Matillion. Experience with cloud data platforms and modern data stacks Experience working with large-scale video, image or other unstructured datasets. ...

Reference Data. Cloud Platforms: Microsoft Azure; AWS; GCP. Modern Data Platforms: Databricks; Microsoft Fabric; PostgreSQL. Data Integration: Azure Data Factory; API-led Integration; Kafka; ETL/ELT; Streaming and Event-Driven Architectures. Architecture & Modelling: TOGAF; DAMA; ArchiMate; Sparx Enterprise Architect. Data Governance: Microsoft Purview; Collibra; Informatica; Security by Design; Data ...

Reference Data. Cloud Platforms Microsoft Azure; AWS; GCP Modern Data Platforms Databricks; Microsoft Fabric; PostgreSQL Data Integration Azure Data Factory; API-led Integration; Kafka; ETL/ELT; Streaming and Event-Driven Architectures Architecture & Modelling TOGAF; DAMA; ArchiMate; Sparx Enterprise Architect Microsoft Purview, Collibra, Informatica, Security by Design, Data Classification, Information ...

complex environments. Broad understanding of modern data technology domains, including: Cloud data platforms (Azure, AWS, GCP). Data lakes, warehouses and lakehouse architectures. ETL/ELT processes and tooling. Streaming and event‐driven architectures. API‐led integration and data virtualisation. Understanding of data security‐by‐design, privacy, compliance and governance ...

their AI/ML services.Data Engineering: Proficiency in data manipulation and analysis using SQL and big data technologies (e.g., Spark, Hadoop). Experience with ETL, data pipelines, and automated workflows for moving and processing data.Data Governance: Adherence to data governance, security, and privacy standards throughout the development lifecycle, including metadata ...

industry and understand the complexities of insurance data, systems, and business processes. What You'll Do Design, develop, and maintain scalable data pipelines and ETL/ELT processes. Build and optimise cloud-based data solutions and data platforms. Integrate data from multiple source systems into enterprise data environments. Work closely ...

data modeling tools and techniques (e.g., ER/Studio, Erwin).Strong SQL and database proficiency (SQL Server, Oracle, Snowflake, Databricks).Experience with data integration (ETL/ELT, APIs).Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) a plus.Domain Knowledge:Exceptional understanding of the Funds ...

time‐series (TimescaleDB/InfluxDB), and document (MongoDB) stores used by applications Design the data ingestion and movement architecture – real‐time CDC pipelines, batch ETL/ELT patterns, and event‐driven feeds from the NATS messaging layer into Snowflake Define data domain boundaries, ownership, and lineage standards aligned with Project ...

Ability to leverage CI/CD pipelines to maintain code quality and facilitate deployments Knowledge of Data Engineering fundamentals, including Batch/Streaming and ETL/ELT Familiarity with various data architectures such as Lakes and Warehouses Hands-on experience with data cleansing and transformation within unified, standardised schemas Technologies ...

Ability to leverage CI/CD pipelines to maintain code quality and facilitate deployments Knowledge of Data Engineering fundamentals, including Batch/Streaming and ETL/ELT Familiarity with various data architectures such as Lakes and Warehouses Hands-on experience with data cleansing and transformation within unified, standardised schemas Technologies ...

Ability to leverage CI/CD pipelines to maintain code quality and facilitate deployments Knowledge of Data Engineering fundamentals, including Batch/Streaming and ETL/ELT Familiarity with various data architectures such as Lakes and Warehouses Hands-on experience with data cleansing and transformation within unified, standardised schemas Technologies ...

and data productsWrite clean, maintainable, and efficient code, ensuring adherence to best practices through code reviewsBig Data EngineeringDesign, develop, and maintain data pipelines and ETL workflows using Apache Spark and Apache AirflowOptimise data storage, retrieval, and processing systems to ensure reliability, scalability, and performanceDevelop and fine-tune complex queries using ...

languages relevant to data manipulation and scripting.Proficiency in data manipulation and analysis using SQL and big data technologies (e.g., Spark, Hadoop). Experience with ETL/ELT, data warehousing, and automated workflows for moving and processing data.Familiarity with data modelling techniques (e.g., dimensional, relational) and data architecture principles.Connect to your ...

and with different software solutions (Snowflake, Azure, SQL, Python); Provide the handling of (and where needed training of) Large Language Models (LLMs) in the Extract, Transform, and Load (ETL) of large corpus of data into a data lake; Participate in the Natural Language Processing (NLP) extract of unstructured data into … Knowledge of developing dimensional data models from unstructured content and awareness of the advantages and limitations of Star Schema and Snowflake schema designs; Solid ETL development, reporting knowledge based off intricate understanding of business process and measures; Knowledge of Snowflake cloud data warehouse and Azure cloud is preferred; Knowledge ...

and with different software solutions (Snowflake, Azure, SQL, Python);Provide the handling of (and where needed training of) Large Language Models (LLMs) in the Extract, Transform, and Load (ETL) of large corpus of data into a data lake;Participate in the Natural Language Processing (NLP) extract of unstructured data into … Knowledge of developing dimensional data models from unstructured content and awareness of the advantages and limitations of Star Schema and Snowflake schema designs;Solid ETL development, reporting knowledge based off intricate understanding of business process and measures;Knowledge of Snowflake cloud data warehouse and Azure cloud is preferred;Knowledge ...

reports and dashboards in Power BIExcellent SQL skills for querying, transforming and analysing dataExperience with DAX, Power Query and data modellingKnowledge of data warehousing, ETL processes and reporting best practiceThe ability to communicate complex information clearly and influence decision-makingStrong analytical skills with excellent attention to detailExperience working with multiple ...

Acceldata, and data governance/quality platforms like Informatica, Collibra or Microsoft Purview is highly desirable. Experience within the Azure ecosystem (data lakes, ETL/ELT pipelines) would be a strong advantage. Working across Data Engineering and Data Governance teams, you’ll help shift the organisation from reactive issue resolution ...

systems, and architect scalable, future-proof solutions Building medallion architecture and strong canonical models for ORM Design, build, and maintain production-grade ELT/ETL pipelines using modern data stack tools and frameworks Deploy and govern cloud-based data platforms on Azure and AWS, selecting the right approach for each ...

technical BI solutions, and present actionable insights clearly. Data Management & Optimisation: Utilise strong SQL skills for data manipulation, querying, and validation while implementing robust ETL/ELT processes and troubleshooting performance bottlenecks across datasets. Champion Data Governance: Ensure high standards of data quality, data integrity, security, and BI platform best ...

Designing and presenting technical solutions to customers and stakeholders. Building and optimising modern data platforms using Microsoft Fabric and Azure technologies. Developing data pipelines, ETL solutions and scalable analytics architectures. Creating presentations, proposals and technical solution decks. Supporting pre-sales activities and helping secure new project opportunities. Working closely with ...