51 to 75 of 201 PySpark Jobs

They are also a key driver in translating Vision and Data Strategy into IT solutions and delivering on them.Strong hands-on expertise in Databricks, PySpark, Python and SQL is central to this role.Key SkillsAzure Stack ELT Experience Data Modeling Data Integration & Ingestion Data Manipulation and Processing GitHub, GitHub Actions ...

Strong stakeholder management and communication skills. Experience working across cross-functional delivery teams. Data Engineering & Platforms Databricks Delta Lake Unity Catalog dbt Spark/PySpark Data pipeline development Lakehouse and modern data platform architectures Cloud Technologies AWS S3 Glue Airflow Data Modelling & Architecture Data Vault Kimball Data warehousing concepts ...

years consulting (or equivalent) experience required 7+ years Databricks solution design, implementation, engineering experience required Either 5+ years building data pipelines in Databricks using PySpark, Scala and/or Spark SQL and ability to work across structured, semi-structured and unstructured data OR 5+ years ML Engineering ...

about its values Values | PA ConsultingWe use a range of different tools and technologies depending on the specific task, these include: Data Bricks, Python, PySpark, R, Excel, Palantir Foundry and PowerBI.QualificationsEssential requirements Even if you don’t meet every requirement below, feel free to still apply ...

about its values Values | PA ConsultingWe use a range of different tools and technologies depending on the specific task, these include: Data Bricks, Python, PySpark, R, Excel, Palantir Foundry and PowerBI.QualificationsEssential requirements Even if you don’t meet every requirement below, feel free to still apply ...

Strong knowledge of data extraction, transformation, and loading (ETL) processes, leveraging tools such as Talend, Informatica, Matillion, Pentaho, MuleSoft, Boomi, or scripting languages (Python, PySpark, SQL). Solid understanding of data warehousing and data modelling techniques (Star Schema, Snowflake Schema). Familiarity with security frameworks (GDPR, HIPAA ...

required as well as a solid understanding of working in a cloud-based environment (AWS is preferred).Proficient using transformation tools such as PySpark/Pandas.Knowledge and practice of graph databases is preferred but not required.Key responsibilities/Skills and experienceFamiliarity using data quality frameworks, ie. Great Expectations.Experience building ...

required as well as a solid understanding of working in a cloud-based environment (AWS is preferred).Proficient using transformation tools such as PySpark/Pandas.Knowledge and practice of graph databases is preferred but not required.Key responsibilities/Skills and experienceFamiliarity using data quality frameworks, ie. Great Expectations.Experience building ...

present insights clearly to both technical and non-technical audiences.Some other highly valued skills include:Strong SQL and database experience.Knowledge of Python/PySpark and data analytics.Experience working in a Call Centre or Contact Centre environment.Strong communication and stakeholder management skills.Ability to lead technical teams and mentor junior developers.You ...

present insights clearly to both technical and non-technical audiences.Some other highly valued skills include:Strong SQL and database experience.Knowledge of Python/PySpark and data analytics.Experience working in a Call Centre or Contact Centre environment.Strong communication and stakeholder management skills.Ability to lead technical teams and mentor junior developers.You ...

solutions Requirements: Enterprise data warehouse architecture and design Microsoft Fabric, Azure Data Platform technologies and modern Lakehouse architectures Databricks, Unity Catalog and Delta Lake PySpark, Databricks, SQL Medallion Architecture implementation Data modelling approaches including Star Schema and Data Vault Data governance, security and access management Why This Opportunity Greenfield ...

solutions Requirements: Enterprise data warehouse architecture and design Microsoft Fabric, Azure Data Platform technologies and modern Lakehouse architectures Databricks, Unity Catalog and Delta Lake PySpark, Databricks, SQL Medallion Architecture implementation Data modelling approaches including Star Schema and Data Vault Data governance, security and access management Why This Opportunity Greenfield ...

optimisation and leading delivery teams. Strong experience designing and delivering cloud-native data platforms within Azure and/or AWS environments. Advanced experience with PySpark, SparkSQL and large-scale distributed data processing. Strong understanding of modern data architecture, ETL/ELT frameworks and data modelling. Excellent SQL skills ...

position requires comfort with ambiguity, strong execution discipline, and accountability for results.Essential Job FunctionsDesign, build, and maintain reliable, scalable data pipelines using Python and PySpark on the Microsoft Azure data platform.Develop and operate batch and incremental data pipelines leveraging Azure Data Factory for orchestration and Azure Data Lake Storage … active contributor.Proactively identify data quality issues, pipeline risks, and improvement opportunities, and communicate them clearly in a fast‐paced environment.DutiesDevelop and maintain PySpark notebooks and jobs to ingest, transform, and curate data within the enterprise data platform.Build and modify Azure Data Factory pipelines for batch and incremental data ingestion.Implement ...

reuse. Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks ...

teamworkStrong problem-solving and analytical skillsPreferred qualifications, capabilities, and skillsExperience with modern data platforms such as Databricks or SnowflakeHands-on expertise with Spark/PySpark and big data processing technologiesKnowledge of open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks and model serving ...

delivering secure and scalable solutionsPreferred qualifications, capabilities, and skillsExperience with modern data platforms such as Databricks or SnowflakeDeep hands-on experience with Spark/PySpark and other big data processing technologiesExpertise in open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks and model ...

engineering best practicesYou have experience with Databricks, ideally also AzureYou have experience of working with technologies such as SQL, Apache Spark and Python including PySpark and PandasYou're excited to join a start-up in a role that you can shape and influenceYou're collaborative with excellent communication skillsApply ...

tools, and emerging technologies. \* Develop reference architectures, solution blueprints, and best-practice playbooks for Databricks implementations. \* Architect scalable ETL/ELT pipelines using PySpark, Spark SQL, Delta Live Tables, and Databricks Workflows. \* Implement performance optimization strategies for notebooks, clusters, job orchestration, and data storage. \* Guide teams in building curated ...

deliver dashboards that meet Barclays standards and business needs.Some other highly valued skills may include:Experience with SQL and database technologies.Knowledge of Python/PySpark and data analytics.Experience in a Call Centre or Contact Centre environment.Strong communication and stakeholder management skills.Ability to collaborate effectively across technical and business teams.You ...

deliver dashboards that meet Barclays standards and business needs.Some other highly valued skills may include:Experience with SQL and database technologies.Knowledge of Python/PySpark and data analytics.Experience in a Call Centre or Contact Centre environment.Strong communication and stakeholder management skills.Ability to collaborate effectively across technical and business teams.You ...

fields.· Proven track record of designing, developing, and deploying AI systems in production environments.· Proficient in Python and key ML libraries (e.g. PyTorch, PySpark, scikit-learn, Hugging Face Transformers).· Hands-on experience with modern data platforms and AI tooling such as Azure ML, Databricks, MLflow, LangChain, LangGraph.· Proven ...

Logical, Physical and Dimensional) Extensive Azure Databricks experience within large-scale enterprise environments Databricks Lakehouse Architecture and Medallion Design Patterns Databricks Data Engineering using PySpark and Spark SQL Delta Live Tables (DLT) Unity Catalog implementation and governance Databricks Workflows Databricks Asset Bundles (DABs) Databricks Solution Accelerators Metadata-Driven Ingestion … Power BI semantic models and enterprise reporting environments Technical Environment Azure Databricks Delta Live Tables (DLT) Unity Catalog Databricks Asset Bundles (DABs) Databricks Workflows PySpark Spark SQL MLflow Mosaic AI Azure Data Factory Azure Synapse Azure Data Lake Storage Dynamics 365 Finance & Operations (D365 F&O) Azure DevOps Power ...

cloud‐native experience Preferred Qualifications, Capabilities, and Skills Experience with modern data technologies such as Databricks or Snowflake Hands‐on experience with Spark/PySpark and other big data processing technologies Demonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial intelligence, machine ...

cloud‐native experience Preferred Qualifications, Capabilities, and Skills: Experience with modern data technologies such as Databricks or Snowflake Hands‐on experience with Spark/PySpark and other big data processing technologies Demonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial intelligence, machine ...