26 to 50 of 418 ETL Jobs

and dashboards. ·Foundational knowledge of Python for data manipulation, automation, or analysis. ·Experience with cloud data environments such as Azure or AWS. ·Familiarity with ETL tools, or similar data‐integration technologies. ·Understanding of data modelling concepts. ·Familiarity with legal industry data and metrics. Equal Opportunities Our approach to our people ...

experience implementing modern designs using at least one cloud-based solution/platform (AWS, Azure, GCP) Advanced level proficiency with at least one ETL/Data Orchestration technology (Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion) Experience cloud-based data warehousing and data lake solutions like Snowflake ...

management, and compliance with DoW regulations to promote consistency and reliability across hybrid environments. Collaborates with stakeholders to define enterprise data strategies, optimize pipelines (ETL/ELT), and incorporate technologies such as cloud platforms (e.g., AWS GovCloud, Azure Government), Big Data tools (e.g., Spark, Hadoop), and relational/NoSQL databases ...

vital part in building data pipelines, delivering analytical insights, and enabling data-driven decision-making across the business. Key Responsibilities Develop and maintain robust ETL/ELT data pipelines using Python, SQL, and Snowflake Cleanse, transform, and validate large datasets to ensure data accuracy and integrity Manage scheduled data loads ...

infrastructure. Develop and manage robust data pipelines to ingest, clean and transform data for reporting and analytics. Support and enhance the data warehouse, including ETL processes and data modelling activities. Collaborate with analysts, engineers and business stakeholders to deliver high-quality, data-led solutions. Monitor data performance and identify opportunities ...

relevant data to intelligence analysts Integrate, cleanse, and transform Multi INT and GEOINT datasets from diverse classified and unclassified collection systems Build and optimize ETL/ELT workflows to support analytic tradecraft, targeting, and operational planning Implement rigorous data quality, validation, and auditing checks to ensure accuracy and reliability ...

with Pentaho Business Analytics (Pentaho BA). Strong Oracle database knowledge. Experience delivering data solutions within AWS cloud environments. Solid understanding of: Data integration ETL/ELT processes Data transformation Data orchestration Version control and release management Experience working in Agile delivery teams. Desirable Experience Exposure to AI, Machine Learning ...

teamwork skills. Experience with cloud data platforms such as Databricks or Snowflake on AWS. Strong skills in Python, PySpark, and SQL. Good understanding of ETL/ELT pipelines and data transformation. Experience with data modelling and database optimisation. Strong knowledge of DBT and SQL best practices. Experience using CI/ ...

lakehouse solutions using Databricks, including integration with AWS-native services such as S3, Glue, Lambda, IAM, and Redshift where appropriate. Design, build, and optimize ETL/ELT pipelines leveraging Databricks, Apache Spark, Delta Lake, Python, and SQL, supporting batch and streaming use cases. Define and enforce data architecture standards including ...

lakehouse solutions using Databricks, including integration with AWS-native services such as S3, Glue, Lambda, IAM, and Redshift where appropriate. Design, build, and optimize ETL/ELT pipelines leveraging Databricks, Apache Spark, Delta Lake, Python, and SQL, supporting batch and streaming use cases. Define and enforce data architecture standards including ...

development. Strong SQL skills, including querying and manipulating data from relational databases and data warehouses (Snowflake preferred), with familiarity with DAX, data architecture, and ETL processes. Advanced Excel skills for data analysis and manipulation, with familiarity with the broader Microsoft Office Suite. Familiarity with project management tools and user acceptance ...

Bronze/Silver/Gold). Develop robust, secure, and observable ingestion and transformation pipelines using Azure-based tools. Lead the migration from legacy ETL tools to modern cloud pipelines (ADF, Azure Functions, event-driven frameworks). Build performant SQL transformations and reusable data models. Implement CI/CD, automated ...

helping to design, build, and maintain scalable data pipelines and cloud-based data solutions. Key Responsibilities • Design, build, and maintain scalable data pipelines and ETL processes. • Develop and optimise data models for analytics and reporting. • Work closely with software engineers, analysts, and stakeholders. • Ensure data quality, reliability, and performance. • Implement ...

Data Engineer should have: Strong experience designing and building scalable data platforms in Azure. Deep expertise in Azure Data Factory, SQL, and Python for ETL/ELT pipelines Proven ability to lead, mentor, and develop data engineering teams Hands-on experience with data warehousing, modelling, and performance tuning Solid understanding ...

solution delivery. Microsoft certification in Azure fundamentals, data engineer, Power BI, AI or AWS certified data engineer. Integration knowledge using enterprise/open source ETL toolsets, REST API, Docker. Experience or exposure to performance fine tuning (indexing, execution plans, views), data profiling and query analytics. Knowledge of security compliance standards ...

Synapse, Azure Data Factory, and Azure Fabric. Developing and fine-tuning PySpark notebooks to efficiently manage large-scale data workloads. Implementing, troubleshooting, and enhancing ETL/ELT workflows in Azure Synapse and Microsoft Fabric. Managing and organizing Data Lakes for seamless data access and high performance. Integrating AI/ ...

Programming Languages: Java, Scala, SQL, HiveQL Big Data Technologies: Hadoop, Spark, HDFS, Hive, Cloudera, Hortonworks Cloud Platforms: AWS (Glue, Lambda, Redshift, S3, CloudWatch) ETL/ELT Tools: AWS Glue, PySpark, Databricks Data Integration & Migration: Hadoop ecosystems, Kafka, real-time streaming, data lakes Data Modeling: dimensional models, structured and unstructured data ...

stakeholders. Hands on experience in: Python Machine Learning Data Pipelines Databricks Data engineering, including data enrichment and validation. Database management, including partitioning of data ETL processes Azure - pipelines, data factory, function apps SQL Pyspark HDFS Big data, including how to optimise operations Core Competencies & Technical Skills (AI and emerging technology ...

define their information strategy, enable mission critical insights and data-driven decision making, reduce cost and complexity, increase trust, and improve operational effectiveness. Conduct ETL/ELT and data quality analysis using various technologies (i.e., Python, Databricks, Palantir Foundry). Manage ETL/ELT functions and develop, build, test, and … pipeline architectures and tools. Develop integrated data pipelines and models to measure program performance and report on progress Work in cloud-based databases and ETL/ELT architecture. Design and build distributed systems for scalability and security. Work with data integration and management tools and databases. Gather requirements, design, implement ...

with excellent communication and project coordination skills. Key Responsibilities Design, develop, and maintain interactive dashboards and reports using Power BI Build and optimise scalable ETL (Extract, Transform, Load) pipelines Develop and manage automated workflows using Python and Apache Airflow Manage and optimise SQL and Oracle database environments for performance, reliability … data processing and automation Solid experience with SQL and Oracle database systems Hands-on experience with Apache Airflow for workflow orchestration Strong understanding of ETL processes, data pipelines, and data architecture Experience managing data-focused projects including planning, coordination, and risk management Ability to communicate effectively with both technical and ...

Programming & Frameworks Strong Python development skills PyTorch TensorFlow Scikit-Learn LangChain LangGraph Hugging Face FastAPI REST APIs Data Technologies SQL NoSQL Databases Data Modelling ETL Development Data Pipeline Engineering Vector Databases such as Pinecone, Weaviate or ChromaDB Cloud & DevOps Experience with at least one major cloud platform: AWS (preferred) Bedrock ...

and develop scalable BI solutions, data models, dashboards, and reporting frameworks that turn complex data into clear business insights. Key responsibilities include: Building automated ETL/ELT pipelines and data models Creating dashboards and reports for senior leaders and business users Improving data quality, documentation, and governance Optimising SQL queries ...

reporting best practices. Strong communication and stakeholder management skills. Desirable Experience with Microsoft Fabric, DAX, Power Query, SQL Server, or Oracle SQL. Knowledge of ETL processes, data warehousing, and automation tools. Experience with Python, R, Pandas, or similar analytical tools. Familiarity with version control and CI/CD practices. Benefits ...

with Python or R for data analysis Familiarity with Agile/Scrum methodologies Prior experience in business analysis or data analytics roles Knowledge of ETL processes and data warehousing Key Competencies: Critical thinking Attention to detail Business acumen Communication skills Time management ...

commodities, trading, or financial markets Experience with derivatives pricing or risk systems Knowledge of Numerix or similar quant/risk platforms Understanding of ETL and data pipeline design Experience working in Agile delivery environments McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds. ...