26 to 50 of 431 ETL Jobs

enhances frameworks and design proof of concepts, and review code for correctness, and its impact on software architecture. Lead the development of high-performance ETL/ELT pipelines using tools like dbt, Python, Airflow and more to integrate diverse data sources. Provide mentorship and direction to more junior software engineers ...

enhances frameworks and design proof of concepts, and review code for correctness, and its impact on software architecture. Lead the development of high-performance ETL/ELT pipelines using tools like dbt, Python, Airflow and more to integrate diverse data sources. Provide mentorship and direction to more junior software engineers ...

within the Microsoft Azure ecosystem. Responsibilities Design and develop data pipelines and ingestion frameworks Build and maintain data lakes, warehouses, and lakehouse architectures Develop ETL/ELT workflows using Azure Data Factory, Databricks, or Synapse Optimize data processing and transformation workflows Collaborate with analytics teams to support reporting, BI, and ...

and dashboards. ·Foundational knowledge of Python for data manipulation, automation, or analysis. ·Experience with cloud data environments such as Azure or AWS. ·Familiarity with ETL tools, or similar data‐integration technologies. ·Understanding of data modelling concepts. ·Familiarity with legal industry data and metrics. Equal Opportunities Our approach to our people ...

experience implementing modern designs using at least one cloud-based solution/platform (AWS, Azure, GCP) Advanced level proficiency with at least one ETL/Data Orchestration technology (Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion) Experience cloud-based data warehousing and data lake solutions like Snowflake ...

management, and compliance with DoW regulations to promote consistency and reliability across hybrid environments. Collaborates with stakeholders to define enterprise data strategies, optimize pipelines (ETL/ELT), and incorporate technologies such as cloud platforms (e.g., AWS GovCloud, Azure Government), Big Data tools (e.g., Spark, Hadoop), and relational/NoSQL databases ...

vital part in building data pipelines, delivering analytical insights, and enabling data-driven decision-making across the business. Key Responsibilities Develop and maintain robust ETL/ELT data pipelines using Python, SQL, and Snowflake Cleanse, transform, and validate large datasets to ensure data accuracy and integrity Manage scheduled data loads ...

infrastructure. Develop and manage robust data pipelines to ingest, clean and transform data for reporting and analytics. Support and enhance the data warehouse, including ETL processes and data modelling activities. Collaborate with analysts, engineers and business stakeholders to deliver high-quality, data-led solutions. Monitor data performance and identify opportunities ...

relevant data to intelligence analysts Integrate, cleanse, and transform Multi INT and GEOINT datasets from diverse classified and unclassified collection systems Build and optimize ETL/ELT workflows to support analytic tradecraft, targeting, and operational planning Implement rigorous data quality, validation, and auditing checks to ensure accuracy and reliability ...

with Pentaho Business Analytics (Pentaho BA). Strong Oracle database knowledge. Experience delivering data solutions within AWS cloud environments. Solid understanding of: Data integration ETL/ELT processes Data transformation Data orchestration Version control and release management Experience working in Agile delivery teams. Desirable Experience Exposure to AI, Machine Learning ...

teamwork skills. Experience with cloud data platforms such as Databricks or Snowflake on AWS. Strong skills in Python, PySpark, and SQL. Good understanding of ETL/ELT pipelines and data transformation. Experience with data modelling and database optimisation. Strong knowledge of DBT and SQL best practices. Experience using CI/ ...

lakehouse solutions using Databricks, including integration with AWS-native services such as S3, Glue, Lambda, IAM, and Redshift where appropriate. Design, build, and optimize ETL/ELT pipelines leveraging Databricks, Apache Spark, Delta Lake, Python, and SQL, supporting batch and streaming use cases. Define and enforce data architecture standards including ...

lakehouse solutions using Databricks, including integration with AWS-native services such as S3, Glue, Lambda, IAM, and Redshift where appropriate. Design, build, and optimize ETL/ELT pipelines leveraging Databricks, Apache Spark, Delta Lake, Python, and SQL, supporting batch and streaming use cases. Define and enforce data architecture standards including ...

development. Strong SQL skills, including querying and manipulating data from relational databases and data warehouses (Snowflake preferred), with familiarity with DAX, data architecture, and ETL processes. Advanced Excel skills for data analysis and manipulation, with familiarity with the broader Microsoft Office Suite. Familiarity with project management tools and user acceptance ...

/CD pipelines and tools (Jenkins, GitHub Actions, etc.). Knowledge of cloud environments, particularly AWS or Azure Government. Experience testing data pipelines, ETL processes, or analytics platforms. Understanding of DoD or federal government compliance and security testing requirements. Experience in SAFe Agile environments, including participation in PI planning and ...

Bronze/Silver/Gold). Develop robust, secure, and observable ingestion and transformation pipelines using Azure-based tools. Lead the migration from legacy ETL tools to modern cloud pipelines (ADF, Azure Functions, event-driven frameworks). Build performant SQL transformations and reusable data models. Implement CI/CD, automated ...

helping to design, build, and maintain scalable data pipelines and cloud-based data solutions. Key Responsibilities • Design, build, and maintain scalable data pipelines and ETL processes. • Develop and optimise data models for analytics and reporting. • Work closely with software engineers, analysts, and stakeholders. • Ensure data quality, reliability, and performance. • Implement ...

Data Engineer should have: Strong experience designing and building scalable data platforms in Azure. Deep expertise in Azure Data Factory, SQL, and Python for ETL/ELT pipelines Proven ability to lead, mentor, and develop data engineering teams Hands-on experience with data warehousing, modelling, and performance tuning Solid understanding ...

solution delivery. Microsoft certification in Azure fundamentals, data engineer, Power BI, AI or AWS certified data engineer. Integration knowledge using enterprise/open source ETL toolsets, REST API, Docker. Experience or exposure to performance fine tuning (indexing, execution plans, views), data profiling and query analytics. Knowledge of security compliance standards ...

/Next.js), backend development (Java or Python), and building secure, scalable APIs and distributed applications. Expertise in data engineering & platforms including SQL, data warehousing, ETL/ELT pipelines, data modelling, and integration of data science and analytics. Experience delivering cloud-native solutions, ideally within Google Cloud Platform (GCP), or equivalent ...

Synapse, Azure Data Factory, and Azure Fabric. Developing and fine-tuning PySpark notebooks to efficiently manage large-scale data workloads. Implementing, troubleshooting, and enhancing ETL/ELT workflows in Azure Synapse and Microsoft Fabric. Managing and organizing Data Lakes for seamless data access and high performance. Integrating AI/ ...

Programming Languages: Java, Scala, SQL, HiveQL Big Data Technologies: Hadoop, Spark, HDFS, Hive, Cloudera, Hortonworks Cloud Platforms: AWS (Glue, Lambda, Redshift, S3, CloudWatch) ETL/ELT Tools: AWS Glue, PySpark, Databricks Data Integration & Migration: Hadoop ecosystems, Kafka, real-time streaming, data lakes Data Modeling: dimensional models, structured and unstructured data ...

stakeholders. Hands on experience in: Python Machine Learning Data Pipelines Databricks Data engineering, including data enrichment and validation. Database management, including partitioning of data ETL processes Azure - pipelines, data factory, function apps SQL Pyspark HDFS Big data, including how to optimise operations Core Competencies & Technical Skills (AI and emerging technology ...

define their information strategy, enable mission critical insights and data-driven decision making, reduce cost and complexity, increase trust, and improve operational effectiveness. Conduct ETL/ELT and data quality analysis using various technologies (i.e., Python, Databricks, Palantir Foundry). Manage ETL/ELT functions and develop, build, test, and … pipeline architectures and tools. Develop integrated data pipelines and models to measure program performance and report on progress Work in cloud-based databases and ETL/ELT architecture. Design and build distributed systems for scalability and security. Work with data integration and management tools and databases. Gather requirements, design, implement ...

with excellent communication and project coordination skills. Key Responsibilities Design, develop, and maintain interactive dashboards and reports using Power BI Build and optimise scalable ETL (Extract, Transform, Load) pipelines Develop and manage automated workflows using Python and Apache Airflow Manage and optimise SQL and Oracle database environments for performance, reliability … data processing and automation Solid experience with SQL and Oracle database systems Hands-on experience with Apache Airflow for workflow orchestration Strong understanding of ETL processes, data pipelines, and data architecture Experience managing data-focused projects including planning, coordination, and risk management Ability to communicate effectively with both technical and ...