51 to 75 of 160 Remote/Hybrid PySpark Jobs

Databricks Serverless configuration and workload optimisation Databricks SQL and Delta Lake development Cluster management, compute policies, autoscaling, and workload monitoring Data Engineering Strong Python, PySpark, and SQL development skills Design and build ingestion and transformation pipelines Full and incremental data loading CDC (Change Data Capture) implementation Data quality controls ...

Looking For Strong SQL Data Engineering or Analytics Engineering experience Databricks or comparable platforms such as Snowflake, Hadoop or SQL Server Python and ideally PySpark ETL/ELT and data modelling Strong problem-solving and critical-thinking skills Good understanding of data architecture and infrastructure Ability to work independently ...

relevant data solutions development qualifications (e.g. Microsoft certification; Databricks Certification; data apprenticeship qualifications)Additional InformationTech StackSQL Server, SSIS, T-SQLADF, ADLS, Azure SQL Database, PySpark, Spark SQL, Databricks, Delta lakeSummaryType: Full-timeFunction: Analyst ...

Engineer Associate (DP-600), Power BI Data Analyst Associate (PL-300), or Azure Data Fundamentals (DP-900). Proficiency in Python and SQL, including PySpark and Spark SQL, used across our Microsoft Fabric data platform. Experience with ERP/finance systems data (NetSuite, SAP, Dynamics, etc.) Experience picking ...

ingest, cleanse and model data for BI reporting, ML and AI, ensuring quality and governance. The role emphasizes strong Azure skills (ADF, ADLS, Databricks), PySpark, Python and SQL, with a DevOps and CI/CD mindset. Hybrid work with three days in the office weekly is offered. #J ...

pipeline development, data modelling, semantic layers and Power BI delivery. This role focuses on building a modern data platform using Azure Databricks, Python, PySpark and SQL, tying together marketing, sales and operations data to drive commercial performance. #J-18808-Ljbffr ...

that deeply cares about its values. To use a range of different tools and technologies depending on the specific task, these include: Databricks, Python, PySpark, R, Excel, Palantir Foundry, SQL and PowerBI. Qualifications Even if you don’t meet every requirement below, feel free to still apply ...

Lake and Lakehouse architecture for efficient data management; experience with ETL processes and optimizing data pipelines for performance Be strong in Python, SQL, and PySpark Be passionate about building data products for stakeholders and customers, ensuring they are stable, scalable, secure, accurate, observable, and performant Enjoy collaborating closely with ...

about its values Values | PA ConsultingWe use a range of different tools and technologies depending on the specific task, these include: Data Bricks, Python, PySpark, R, Excel, Palantir Foundry and PowerBI.QualificationsEssential requirements Even if you don’t meet every requirement below, feel free to still apply ...

required as well as a solid understanding of working in a cloud-based environment (AWS is preferred).Proficient using transformation tools such as PySpark/Pandas.Knowledge and practice of graph databases is preferred but not required.Key responsibilities/Skills and experienceFamiliarity using data quality frameworks, ie. Great Expectations.Experience building ...

solutions Requirements: Enterprise data warehouse architecture and design Microsoft Fabric, Azure Data Platform technologies and modern Lakehouse architectures Databricks, Unity Catalog and Delta Lake PySpark, Databricks, SQL Medallion Architecture implementation Data modelling approaches including Star Schema and Data Vault Data governance, security and access management Why This Opportunity Greenfield ...

platform architect, defining reference architectures, integration patterns, and target-state designs across enterprise Databricks environments.Deep expertise across Databricks including Delta Lake, Unity Catalog, Spark, PySpark, Databricks SQL, Databricks Workflows, Lakeflow, Lakehouse architecture, MLflow, AI/BI Genie, Mosaic AI, and Agent Bricks.Proven experience leading engineering teams across both onshore … Technical Design Authority, with responsibility for architecture, solution governance, and technical decision making.Demonstrable experience leading offshore engineering teams.Strong hands-on expertise in Python, PySpark, and SQL.Experience designing & delivering enterprise Generative AI & Agentic AI solutions including AI Agents, RAG, Vector Search, LLM Orchestration and AI governance.Experience designing & delivering production-grade ...

looking for a Senior Data Engineer - Tech Lead (Databricks, PySpark) to join our team in London, UK, in a hybrid working mode. In this role, you will lead the design, development and optimization of scalable cloud-native data architectures, focusing on Azure Databricks, PySpark and Lakehouse principles. … design and build of large-scale data platforms using Azure Databricks and modern cloud technologies Implement and optimize ETL workflows and streaming pipelines with PySpark and Delta Live Tables following Lakehouse principles Enhance performance, manage cloud costs and ensure platform reliability for structured streaming workloads Define data governance, security ...

engineering best practicesYou have experience with Databricks, ideally also AzureYou have experience of working with technologies such as SQL, Apache Spark and Python including PySpark and PandasYou're excited to join a start-up in a role that you can shape and influenceYou're collaborative with excellent communication skillsApply ...

management, network design and access control; Databricks and OCI, or comparable platforms Strong Python and SQL, and experience building and monitoring production pipelines using PySpark or Spark Experience with infrastructure as code, CI/CD and a Git and GitHub workflow A track record of setting engineering standards ...

client sites or in our office, with hybrid work plan of at least two days per week. Use tools such as Data Bricks, Python, PySpark, R, Excel, Palantir Foundry and PowerBI to deliver scalable, high‐performance applications. Qualifications Essential requirements A degree, Masters or PhD in data science, mathematics ...

data architecture, data warehousing and cloud data platforms Hands-on experience with Azure technologies Experience developing ETL/ELT solutions Experience with Python, PySpark, Microsoft Fabric, streaming technologies or large-scale enterprise environments would be advantageous. In return they are offering A salary of up to £50,000 Hybrid ...

fields.· Proven track record of designing, developing, and deploying AI systems in production environments.· Proficient in Python and key ML libraries (e.g. PyTorch, PySpark, scikit-learn, Hugging Face Transformers).· Hands-on experience with modern data platforms and AI tooling such as Azure ML, Databricks, MLflow, LangChain, LangGraph.· Proven ...

experience Strong hands-on experience with Azure Data Factory (ADF) Experience in data migration and ETL/ELT pipeline development Proficiency with Azure Databricks, PySpark, and Azure SQL Experience with Azure Data Lake (ADLS) and cloud data integration Strong SQL and performance tuning skills Experience working in Agile environments ...

Experience debugging moderately complex systems and improving reliability/performance Strong fundamentals: data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code ...

complex data led organisation* Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI* Expertise in Streaming Data, Event Driven Design ...

complex data led organisation* Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI* Expertise in Streaming Data, Event Driven Design ...

complex data led organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design ...

complex data led organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design ...

team environment.What You'll Need:Strong experience as a Senior Azure Data EngineerAn expert in Azure Databricks and Medallion Architecture Strong skills in PySpark, Python, Delta Lake and Unity CatalogKnowledge of Kimball data modelling, such as star schema, snowflake, etc. Strong SQL skillsA flexible approach to getting things done ...