26 to 50 of 222 PySpark Jobs

Knowledge of data warehousing and modern data architectures Strong problem-solving and stakeholder communication skills Desirable Skills Experience with Azure Data Factory Python or PySpark development experience Experience working within cloud data transformation programmes Understanding of data governance and security best practices Contract Details 6-Month Contract ...

such as S3, Kinesis, DMS, SNS, Glue, Athena, RDS • Experience with Data Warehouse databases like Snowflake/Redshift/BigQuery • Experience with Python/PySpark • Experience with implementing Rest APIs. • Experience with using and integrating BI tools such as QuickSight, Looker, Power BI, Tableau • Business Intelligence (BI) knowledge/ ...

pipelines. Experience working with cloud data platforms (AWS preferred). Exposure to data warehousing, data lakes and modern data architecture. Python experience (including PySpark) is beneficial but not essential. Exposure to BI platforms such as Power BI, Tableau or QuickSight, with an understanding of how backend data models support ...

platforms (AWS preferred). Exposure to data warehousing, data lakes and modern data architecture. Understanding of workflow orchestration and automation tools. Python experience (including PySpark) is beneficial but not essential. Exposure to BI platforms such as Power BI, Tableau or QuickSight, with an understanding of how backend data models ...

CompetenciesSignificant hands-on experience in data engineering, analytics engineering, or related disciplines delivering enterprise data solutionsStrong proficiency in Databricks, SQL, and Python/PySpark, including building, optimizing, and troubleshooting ETL pipelinesExperience designing scalable, maintainable data architectures and dimensional models for BI, reporting, and analytical use casesProven ability to partner ...

with cloud data platforms (AWS preferred).Exposure to data warehousing, data lakes and modern data architecture.Understanding of workflow orchestration and automation tools.Python experience (including PySpark) is beneficial but not essential.Exposure to BI platforms such as Power BI, Tableau or QuickSight, with an understanding of how backend data models support ...

Computational Complexity.Strive for excellence and continuous improvement in software architecture, software delivery and best practices.Hands on experience in C#, OOP python, Spark/PySpark and other C#, Python framework ecosystem.Debug and resolve issues in large datasets quickly.Co-ordinating handoffs between different time zones and allocating priorities to dev team.Desirable ...

Complexity.* Strive for excellence and continuous improvement in software architecture, software delivery and best practices.* Hands on experience in C#, OOP python, Spark/PySpark and other C#, Python framework ecosystem.* Debug and resolve issues in large datasets quickly.* Co-ordinating handoffs between different time zones and allocating priorities ...

Data Engineering Foundation: Practical experience with data modelling, ETL/ELT, and various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow, Spark, Databricks, Fabric. Cloud Capability: Experience with at least one major cloud provider (AWS, Azure ...

experience, including design and delivery of complex pipelines and data models in a cloud environment Strong proficiency in SQL; solid Python and/or PySpark capabilityDemonstrable experience with Databricks, Apache Spark, and Delta Lake architectureProven ability to design and own enterprise-grade canonical data models across multiple upstream source ...

collaborative environment.Key ResponsibilitiesDesign, develop and maintain modern data platform solutions.Build, optimise and manage data ingestion pipelines.Develop data transformation and modelling solutions using Python, PySpark and SQL.Support the implementation of data lakes, data warehouses and modern analytics architectures.Ensure high standards of data quality, security and performance.Work closely with stakeholders ...

Data Platforms: Hands-on experience with Databricks and Azure Data Lake . ETL: Proven ability to build efficient pipelines (ADF, SSIS, APIs). Desirable: PySpark, Dimensional Modelling, DAX/SSAS, or an interest in AI/ML applications. Interested in learning more? Send me a DM or comment below ...

engagement skills, including requirements gathering, expectation management and delivery planning. Desirable Knowledge and practical experience of hospital systems and datasets (where relevant locally). PySpark experience. Experience with NLP and/or computer vision techniques (where relevant to Trust priorities). Experience using deep learning frameworks such as TensorFlow ...

customers’ pain points and explain important areas for business value to develop a trusted advisor skillset. Code in a core programming language such as PySpark, Python, Java, or Scala. Knowledgeable in a core Big Data Analytics domain with some exposure to advanced proofs‐of‐concept and an understanding ...

customers' pain points and explain important areas for business value to develop a trusted advisor skillset. Code in a core programming language such as PySpark , Python, Java, or Scala. Knowledgeable in a core Big Data Analytics domain with some exposure to advanced proofs‐of‐concept and an understanding ...

cross functional teams entrusted with business-critical platforms.Desirable skills & experienceWorking to an Agile methodology and familiarity with Azure DevOpsDeep automation knowledge with PythonSkilled in Pyspark and SynapseExperience with data modelling and visualisation in Power BI (or alternative)A strong understanding of architecting data platforms, BI, MI, or analytics solutionsStrong ...

relevant data solutions development qualifications (e.g. Microsoft certification; Databricks Certification; data apprenticeship qualifications)Additional InformationTech StackSQL Server, SSIS, T-SQLADF, ADLS, Azure SQL Database, PySpark, Spark SQL, Databricks, Delta lakeSummaryType: Full-timeFunction: Analyst ...

They are also a key driver in translating Vision and Data Strategy into IT solutions and delivering on them.Strong hands-on expertise in Databricks, PySpark, Python and SQL is central to this role.Key SkillsAzure Stack ELT Experience Data Modeling Data Integration & Ingestion Data Manipulation and Processing GitHub, GitHub Actions ...

Hands-on Microsoft Fabric experience-Lakehouse, data pipelines, notebooks, and capacity monitoring.- Strong SQL and dimensional (star schema) data modeling; working proficiency in Python (PySpark).- Working knowledge of Dynamics 365 Finance & Operations and Dataverse data structures. Desired: Domain Knowledge (Preferred): Experience with manufacturing data including Bills of Materials ...

principles. Strong understanding of data modelling, governance and data quality frameworks. Experience delivering large-scale data transformation initiatives. Knowledge of technologies such as SQL, PySpark, Snowflake, Kafka and modern BI platforms including Power BI or Tableau. Excellent communication skills with the ability to influence senior technical and business stakeholders. ...

architectural direction, mentoring engineers, and defining standards in a data engineering context. Strong proficiency in Python, with experience applying data engineering frameworks (e.g. Spark, PySpark, Dask, pandas) to large, complex datasets. Familiarity with API‐driven data integration, including REST, GraphQL, and Foundry Action APIs. Experience with Git‐based development ...

5+ years of experience in one or more of the following statistical/analytic languages such as Python (Pandas, Scikit-Learn), Apache Spark (or PySpark), Hive, and Scala in a cloud computing environment 5+ years of experience in one or more of the following: database query and management tools ...

Looking ForProven expertise with the Databricks platform, including Unity Catalog, Delta Lake, orchestration, and enterprise-scale Azure deployments.Strong technical skills in Python, PySpark, and distributed data processing frameworks, with experience building production-grade data platforms.Extensive experience implementing CI/CD pipelines using Azure DevOps, Jenkins, GitHub Actions, or equivalent ...

Engineer to join a key programme. You'll be responsible for building scalable data pipelines and data lake architecture across Azure Databricks , using Python, PySpark, SQL, Azure Data Factory and Microsoft Fabric . We're looking for someone who has previously delivered data engineering projects within the UK public ...

solution design, workshops and Proof of Concepts. What you'll bring: Proven experience designing enterprise data platforms using Databricks . Strong knowledge of Spark, PySpark, Delta Lake, SQL and modern data engineering. Expertise with Microsoft Azure Strong understanding of data modelling, governance and ETL pipelines. Excellent stakeholder management ...