51 to 75 of 9,841 Python Jobs

contribute to engineering excellence through best practices, mentoring, and thoughtful technical direction. Job responsibilities Design scalable, reusable data processing and data quality frameworks using Python, PySpark, and dbt Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability Develop and operate workflow orchestration (e.g., Apache … data movement and transformations Model and transform data for analytics using SQL and dbt to support business intelligence and reporting workloads Write production-grade Python/PySpark code with disciplined testing, performance tuning, and maintainable object-oriented design Implement infrastructure-as-code (e.g., Terraform) to provision and manage cloud-based ...

contribute to engineering excellence through best practices, mentoring, and thoughtful technical direction. Job responsibilities Design scalable, reusable data processing and data quality frameworks using Python, PySpark, and dbt Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability Develop and operate workflow orchestration (e.g., Apache … data movement and transformations Model and transform data for analytics using SQL and dbt to support business intelligence and reporting workloads Write production-grade Python/PySpark code with disciplined testing, performance tuning, and maintainable object-oriented design Implement infrastructure-as-code (e.g., Terraform) to provision and manage cloud-based ...

reporting and analytics solutions using Microsoft Power BI and Microsoft Fabric. Build scalable data models, semantic models, dashboards, and self-service reporting capabilities. Develop Python-based data processing and automation solutions to ingest, transform, validate, and analyze large datasets. Collaborate with engineering and business stakeholders to identify performance trends, operational … including DAX, Power Query, semantic models, and dashboard design. Experience with Microsoft Fabric, Azure Data Services, or modern cloud-based analytics platforms. Advanced Python programming skills for data processing, automation, and analytics. Strong SQL development and database querying experience. Experience working with source control and collaborative development practices using GitHub. ...

using modern cloud-native data engineering technologies. Provide technical direction across data modelling, ingestion, transformation, orchestration and integration. Apply practical experience of Spark, PySpark, Python and SQL within enterprise data environments. Governance, Security & Quality Embed effective data governance, security, quality and access controls within cloud data environments. Ensure architecture decisions … another cloud data platform. Strong understanding of modern data architecture patterns, data modelling and ETL/ELT approaches. Practical experience with Spark, PySpark, Python and SQL and the design of scalable batch and real-time data pipelines. Experience designing appropriate data governance, security and data quality controls. Experience with modern ...

teams. Design, build, test and deploy scalable batch and near-real-time data pipelines, reusable data products and analytics solutions on Snowflake using SQL, Python, Snowpark, Snowpipe, Streams, Tasks and Dynamic Tables. Deliver across the full data engineering lifecycle, from requirements analysis and solution design through development, testing, deployment, operational … skills. Technical proficiency Experience developing or supporting cloud data warehouses using Snowflake and at least one of AWS, Azure or GCP. Proficiency in SQL, Python, data stack frameworks, integration libraries and orchestration tools, including Snowpark, Snowpipe, Streams, Tasks and Dynamic Tables. Knowledge of Snowflake architecture, stages, file formats, virtual warehouse ...

OpenAI, AWS Bedrock) Experience building scalable data products and analytics solutions Expert Power BI development, including semantic models and Power BI Service administration Expert Python development for data, analytics and automation Experience integrating REST APIs and multiple data sources Knowledge of traditional machine learning techniques, including tree-based models (e.g. ...

closely related field. Proven experience designing and building scalable data pipelines (ETL/ELT) for batch and streaming use cases using modern technologies (e.g., Python, SQL, Spark, Flink, Airflow) and advanced knowledge on the workings of these. Hands-on experience in building and operating workloads Databricks. Hands-on experience creating ...

reporting. Including storage, data pipelines to ingest and transform data, and querying & reporting of analytical data. You’ve worked with technologies such as Python, Spark, SQL, Pyspark, PowerBI etc. You’ve got a background in software engineering, including Front End technologies like JavaScript. You’re a problem-solver, pragmatically exploring ...

creating Genie Agents, configuring data assets for Natural Language Querying and using Metric Views to create semantic layers. Experience of programming languages: SQL, python & pySpark etc. Experience of development practices: the use of versioning tools such as GitHub, work tracking tools such as Azure DevOps, or equivalents. A proven track ...

Databricks and/or Snowflake, including the design, implementation, and optimization of data platforms at scale Strong SQL expertise and software engineering experience using Python and/or other modern programming languages. Experience developing and orchestrating data pipelines using technologies such as DBT, Apache Spark, Airflow, Dagster, Kafka, Flink ...

engineering (or 3+ years with strong Foundry depth). Proven, hands-on experience working with Palantir Foundry in a production environment. Strong proficiency in Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema design, metadata management ...

engineering (or 3+ years with strong Foundry depth). Proven, hands-on experience working with Palantir Foundry in a production environment. Strong proficiency in Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema design, metadata management ...

Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such as Python Reporting tools (e.g. Tableau, PowerBI, Qlik) GDPR and Government Service Standard (desirable) Passionate, motivated and enthusiastic about developing technology solutions. Experience working in an Agile ...

systems into analytical platforms, using ETL/ELT tools (such as Azure Data Factory, Synapse Pipelines, SSIS, Notebooks) and data engineering languages (Python, SQL). Proficiency in designing and optimizing modern data architectures, including data lakehouse/cloud patterns, dimensional modeling (star/snowflake schemas), and Power BI analytics (datasets ...

systems into analytical platforms, using ETL/ELT tools (such as Azure Data Factory, Synapse Pipelines, SSIS, Notebooks) and data engineering languages (Python, SQL). Proficiency in designing and optimizing modern data architectures, including data lakehouse/cloud patterns, dimensional modeling (star/snowflake schemas), and Power BI analytics (datasets ...

Working closely with clients and multidisciplinary teams to solve complex data challenges What We're Looking For Commercial experience delivering Data Engineering solutions Strong Python and SQL skills, with experience of Java or Scala beneficial Experience building large-scale ETL/ELT and data processing pipelines Hands-on experience with ...

frameworks natively in Databricks (audit logging, reconciliation, DQ checks) Experience with Delta Lake features: MERGE, CDC, time travel, schema enforcement Data Engineering & Development Strong Python and SQL programming skills Experience with ETL/ELT at scale: denormalization, surrogate keys, directory tables, curated data models Experience integrating complex data sources: Oracle ...

other ad-hoc duties as required. Skills and Experience Strong understanding of data engineering principles, data architecture, and cloud-based data platforms. Proficient in Python (PySpark) and SQL for building and optimising data transformations at scale. Strong hands-on Databricks experience. Experience with Azure data storage technologies (Azure SQL, Data ...

GitOps experience (GitLab CI/CD or equivalent), with a solid understanding of what 'good' continuous delivery looks like. Strong scripting ability in Python and/or Bash. Solid networking fundamentals — TCP/IP, DNS, HTTP, TLS. Experience with relational and non-relational databases (e.g. SQL Server, MySQL, DynamoDB, Elasticsearch ...

maintaining reliable data pipelines and data platforms, with a strong understanding of data engineering principles and cloud-based technologies. You will be proficient in Python, SQL, and at least one ETL/ELT framework, with the ability to develop scalable solutions that support data processing, analytics, and AI-driven applications. ...

embedded into business processes and decision-making.**Technical Skills:**Hands-on experience in one or more of the following areas:Programming & Analytics – Python, SQL, R, Spark, machine learning and advanced analyticsCloud & Data Platforms – Microsoft Fabric, Databricks, Snowflake, Azure, AWS and GCPAI Technologies – GenAI frameworks, Agentic AI, vector databases, semantic search ...

problem solving, leading with empathy• Ability to converse with both internal and external stakeholders, always holding the appropriate level of conversationGeneral• Strong scripting ability (Python plus one systems language such as Go or Rust, or Bash)• Experience with financial services, insurance, or other regulated-industry engineering is a strong plus ...

embedded into business processes and decision-making.**Technical Skills:**Hands-on experience in one or more of the following areas:Programming & Analytics – Python, SQL, R, Spark, machine learning and advanced analyticsCloud & Data Platforms – Microsoft Fabric, Databricks, Snowflake, Azure, AWS and GCPAI Technologies – GenAI frameworks, Agentic AI, vector databases, semantic search ...

embedded into business processes and decision-making.**Technical Skills:**Hands-on experience in one or more of the following areas:Programming & Analytics – Python, SQL, R, Spark, machine learning and advanced analyticsCloud & Data Platforms – Microsoft Fabric, Databricks, Snowflake, Azure, AWS and GCPAI Technologies – GenAI frameworks, Agentic AI, vector databases, semantic search ...

embedded into business processes and decision-making.**Technical Skills:**Hands-on experience in one or more of the following areas:Programming & Analytics – Python, SQL, R, Spark, machine learning and advanced analyticsCloud & Data Platforms – Microsoft Fabric, Databricks, Snowflake, Azure, AWS and GCPAI Technologies – GenAI frameworks, Agentic AI, vector databases, semantic search ...