26 to 50 of 311 Permanent ETL Jobs

teamwork skills. Experience with cloud data platforms such as Databricks or Snowflake on AWS. Strong skills in Python, PySpark, and SQL. Good understanding of ETL/ELT pipelines and data transformation. Experience with data modelling and database optimisation. Strong knowledge of DBT and SQL best practices. Experience using CI/ ...

lakehouse solutions using Databricks, including integration with AWS-native services such as S3, Glue, Lambda, IAM, and Redshift where appropriate. Design, build, and optimize ETL/ELT pipelines leveraging Databricks, Apache Spark, Delta Lake, Python, and SQL, supporting batch and streaming use cases. Define and enforce data architecture standards including ...

lakehouse solutions using Databricks, including integration with AWS-native services such as S3, Glue, Lambda, IAM, and Redshift where appropriate. Design, build, and optimize ETL/ELT pipelines leveraging Databricks, Apache Spark, Delta Lake, Python, and SQL, supporting batch and streaming use cases. Define and enforce data architecture standards including ...

development. Strong SQL skills, including querying and manipulating data from relational databases and data warehouses (Snowflake preferred), with familiarity with DAX, data architecture, and ETL processes. Advanced Excel skills for data analysis and manipulation, with familiarity with the broader Microsoft Office Suite. Familiarity with project management tools and user acceptance ...

helping to design, build, and maintain scalable data pipelines and cloud-based data solutions. Key Responsibilities • Design, build, and maintain scalable data pipelines and ETL processes. • Develop and optimise data models for analytics and reporting. • Work closely with software engineers, analysts, and stakeholders. • Ensure data quality, reliability, and performance. • Implement ...

Data Engineer should have: Strong experience designing and building scalable data platforms in Azure. Deep expertise in Azure Data Factory, SQL, and Python for ETL/ELT pipelines Proven ability to lead, mentor, and develop data engineering teams Hands-on experience with data warehousing, modelling, and performance tuning Solid understanding ...

solution delivery. Microsoft certification in Azure fundamentals, data engineer, Power BI, AI or AWS certified data engineer. Integration knowledge using enterprise/open source ETL toolsets, REST API, Docker. Experience or exposure to performance fine tuning (indexing, execution plans, views), data profiling and query analytics. Knowledge of security compliance standards ...

Synapse, Azure Data Factory, and Azure Fabric. Developing and fine-tuning PySpark notebooks to efficiently manage large-scale data workloads. Implementing, troubleshooting, and enhancing ETL/ELT workflows in Azure Synapse and Microsoft Fabric. Managing and organizing Data Lakes for seamless data access and high performance. Integrating AI/ ...

Programming Languages: Java, Scala, SQL, HiveQL Big Data Technologies: Hadoop, Spark, HDFS, Hive, Cloudera, Hortonworks Cloud Platforms: AWS (Glue, Lambda, Redshift, S3, CloudWatch) ETL/ELT Tools: AWS Glue, PySpark, Databricks Data Integration & Migration: Hadoop ecosystems, Kafka, real-time streaming, data lakes Data Modeling: dimensional models, structured and unstructured data ...

stakeholders. Hands on experience in: Python Machine Learning Data Pipelines Databricks Data engineering, including data enrichment and validation. Database management, including partitioning of data ETL processes Azure - pipelines, data factory, function apps SQL Pyspark HDFS Big data, including how to optimise operations Core Competencies & Technical Skills (AI and emerging technology ...

define their information strategy, enable mission critical insights and data-driven decision making, reduce cost and complexity, increase trust, and improve operational effectiveness. Conduct ETL/ELT and data quality analysis using various technologies (i.e., Python, Databricks, Palantir Foundry). Manage ETL/ELT functions and develop, build, test, and … pipeline architectures and tools. Develop integrated data pipelines and models to measure program performance and report on progress Work in cloud-based databases and ETL/ELT architecture. Design and build distributed systems for scalability and security. Work with data integration and management tools and databases. Gather requirements, design, implement ...

Programming & Frameworks Strong Python development skills PyTorch TensorFlow Scikit-Learn LangChain LangGraph Hugging Face FastAPI REST APIs Data Technologies SQL NoSQL Databases Data Modelling ETL Development Data Pipeline Engineering Vector Databases such as Pinecone, Weaviate or ChromaDB Cloud & DevOps Experience with at least one major cloud platform: AWS (preferred) Bedrock ...

reporting best practices. Strong communication and stakeholder management skills. Desirable Experience with Microsoft Fabric, DAX, Power Query, SQL Server, or Oracle SQL. Knowledge of ETL processes, data warehousing, and automation tools. Experience with Python, R, Pandas, or similar analytical tools. Familiarity with version control and CI/CD practices. Benefits ...

with Python or R for data analysis Familiarity with Agile/Scrum methodologies Prior experience in business analysis or data analytics roles Knowledge of ETL processes and data warehousing Key Competencies: Critical thinking Attention to detail Business acumen Communication skills Time management ...

commodities, trading, or financial markets Experience with derivatives pricing or risk systems Knowledge of Numerix or similar quant/risk platforms Understanding of ETL and data pipeline design Experience working in Agile delivery environments McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds. ...

and continuously improve data products. Your Profile Strong product management experience (ideally in data or analytics products) Solid understanding of: Data architecture and pipelines (ETL/ELT) Data warehousing (e.g., Snowflake, Azure Synapse, Big Query) BI tools (Power BI, Tableau, Looker) Knowledge of SQL and data querying (hands ...

powered workflows and integrations using modern LLM technologies. Support analytics and reporting initiatives through high-quality, reliable data delivery. Apply best practices around ETL/ELT, data governance, version control, and automation. Additional Experience & Attributes: Strong SQL and Python skills, with experience using data processing libraries and API integrations. Experience ...

application to our client in conjunction with this vacancy only. KEY SKILLS Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data ...

solutions aligned to their analytical needs Build modern Data Warehouse and Data Lake/Lakehouse solutions (primarily using Microsoft Fabric) Design and develop complex ETL/ELT pipelines Deliver secure, scalable, and high-performing data platforms and infrastructure Implement best practices across data architecture, performance, and security Produce clear technical ...

large-scale data transformation, migration, or analytics programmes. Technical Literacy: Strong understanding of modern data stacks (e.g., Cloud data platforms like Databricks/Azure, ETL/ELT pipelines, BI tools). Ability to read/interpret data models and SQL queries to drive product decisions. Methodology:Extensive experience working ...

/Data Engineering Develop complex SQL queries, stored procedures, views, and functions to support analytics and custom applications. Perform data extraction, transformation, and loading (ETL) activities across multiple data sources. Ensure data quality, accuracy, and integrity within reporting and application ecosystems. Work with Azure SQL, SQL Server, or other relational ...

Skills & Experience Proven experience in a data-focused role Strong background in data warehousing and dimensional modelling Understanding of database management systems, OLAP and ETL frameworks Experience with cloud data platforms (ideally Microsoft Fabric) Familiarity with Power BI or similar BI tools Ability to optimise and troubleshoot query performance Strong ...

engineering, data analytics, or data platform roles supporting business users Strong SQL skills for data transformation and analysis; experience with Python and/or ETL tools for automation and processing Solid understanding of CRM platforms, cloud data architectures, and API-based integrations Experience working with regulated or sensitive datasets, including ...

data platforms including SQL, Databricks, and cloud-based environments. Working knowledge of Salesforce ecosystem including Data Cloud, CRM, and Marketing Cloud. Demonstrated experience with ETL tools (Alteryx or comparable). Experience with Master Data Management solutions, preferably Informatica. Exposure to CDPs and modern marketing data platforms. Prior experience owning ...

data platforms including SQL, Databricks, and cloud-based environments. Working knowledge of Salesforce ecosystem including Data Cloud, CRM, and Marketing Cloud. Demonstrated experience with ETL tools (Alteryx or comparable). Experience with Master Data Management solutions, preferably Informatica. Exposure to CDPs and modern marketing data platforms. Prior experience owning ...