101 to 125 of 201 PySpark Jobs

communicate future challenges, ensuring operational effectiveness. Skills and Experience: Essential: Full-stack Python Software Developer skills, specialising in numerical processing using Pandas, Numpy, Polars, PySpark, Coroutines, async tasks and Unix Building scalable applications, with intensive risk-based processing. Package software for distribution (eg Docker, Poetry, python-wheels, PyInstaller, Databricks ...

continuous integration/continuous delivery, application resiliency, and securityDemonstrated knowledge of software applications and technical processes within a technical discipline (e.g., cloud, Databricks, PySpark, artificial intelligence, machine learning, mobile, etc.)Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, testing ...

Data Manager/Lead Location : London (Hybrid) Comp : £115,000 P/A (FTC) Duration: 12 Months Skills: Python (Programming Language), SQL, Apache Spark, PySpark, Azure Databricks, Data Lakes, Data Warehouse Architecture, Leadership, Software Development, Management The role We're partnering with a large, data-driven organisation seeking ...

excellence. Champion AI and data architecture as strategic enablers of business transformation—linking technology decisions directly to measurable client outcomes. Technologies & Concepts Programming & APIs: PySpark , Python, FastAPI , FastMCP , SQL, OAuth2 AI Architectures: Retrieval-Augmented Generation, In-Context Learning, Agent Design, Function Calling, LLM Fine-Tuning & Adaptation Strategies Data Analytics ...

experience using Pandas. Experience working with SQL and cloud-based data warehousing technologies. Knowledge of Google BigQuery would be highly beneficial. Exposure to PySpark and distributed data processing environments. Ability to analyse, transform, and optimise complex datasets. Strong problem-solving and stakeholder communication skills. How to Apply ...

passion for solving complex data challengesWhile we advocate using the right tech for the right task, we often leverage the following technologies: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such ...

workflow orchestration, and machine learning operations.Excellent communication skills with the ability to influence cross-functional teams and stakeholders.Experience with Python, SQL, Java, HQL, Hive, Pyspark, or similar programming languages preferred.Well-versed in design thinking principles.Great problem-solving and analytical skills. The total cash range for this position in Seattle ...

machine learning operations. Excellent communication skills with the ability to influence cross-functional teams and stakeholders. Experience with Python, SQL, Java, HQL, Hive, Pyspark, or similar programming languages preferred. Well-versed in design thinking principles. Great problem-solving and analytical skills. The total cash range for this position ...

efficient, and user-friendly reports that serve a demanding user base. * Creating and automating analytical pipelines using Power BI (DAX, Power Query), SQL, and PySpark to optimise data processing and reporting. * Integrating diverse data sources into a central environment, providing real-time insights into customer, financial, and operational metrics. ...

DESIRABLE Understanding of SQL and relational datasets Experience building dashboards in SaaS (software as a service) products Knowledge of DAX, Power Query Knowledge of Pyspark Experience supporting live dashboards and reporting environments Experience automating reporting solutions Experience of other reporting and dashboard tools (Databricks, Qlik, Tableau, Looker, Amazon ...

implement batch and streaming data pipelines using Databricks (Spark), Delta Lake , and orchestrators (e.g., Workflows , Airflow, ADF). Develop and optimize Spark jobs (PySpark/Scala) and SQL transformations for performance, reliability, and cost efficiency. Build and maintain curated data models (bronze/silver/gold), data quality checks … Required qualifications, skills and capabilities Experience with building data pipelines on Databricks and/or Apache Spark in production. Strong coding skills in Python (PySpark) and SQL (Scala a plus). Hands-on experience with Delta Lake (MERGE/UPSERT patterns, schema evolution, partitioning, Z-ORDER, OPTIMIZE/VACUUM ...

implement batch and streaming data pipelines using Databricks (Spark), Delta Lake , and orchestrators (e.g., Workflows , Airflow, ADF). Develop and optimize Spark jobs (PySpark/Scala) and SQL transformations for performance, reliability, and cost efficiency. Build and maintain curated data models (bronze/silver/gold), data quality checks … Required qualifications, skills and capabilities Experience with building data pipelines on Databricks and/or Apache Spark in production. Strong coding skills in Python (PySpark) and SQL (Scala a plus). Hands-on experience with Delta Lake (MERGE/UPSERT patterns, schema evolution, partitioning, Z-ORDER, OPTIMIZE/VACUUM ...

data platforms. Responsibilities Design, develop and maintain scalable data pipelines using Microsoft Fabric, Azure Databricks and Azure Synapse. Develop ETL/ELT solutions using PySpark and SQL. Build and optimise data integration solutions using Azure Data Factory and Microsoft Fabric. Design scalable lakehouse and data warehouse solutions. Optimise data … engineering standards. Troubleshoot production issues and continuously improve platform performance. Requirements Strong commercial experience as a Data Engineer (5+ years). Strong experience with PySpark . Advanced SQL skills. Experience with Microsoft Fabric , Azure Databricks and/or Azure Synapse Analytics . Experience building data pipelines using Azure Data ...

teams to deliver trusted datasets, performant ETL/ELT pipelines, and well-governed data products. The role emphasizes batch/streaming pipelines, Spark/PySpark, Delta Lake, governance and security, with CI/CD and collaboration across environments. #J-18808-Ljbffr ...

junior engineers while translating Vision and Data Strategy into IT solutions and driving delivery across programs. The role requires hands-on work with Databricks, PySpark, Python and SQL, with a focus on data modeling, integration and cloud data services. #J-18808-Ljbffr ...

architecture experience. Dimensional data modelling experience. Kimball/Inmon Azure Data engineering with exposure to Synapse, Databricks, Data Factory Azure SQL. Python Scripting for Pyspark C# Experience Experience with TDD and Unit Testing. Desirables - Experience working on Multi Cloud Solutions Azure Integration experience with Azure Function Apps/Logic ...

architecture experience. Dimensional data modelling experience. Kimball/Inmon Azure Data engineering with exposure to Synapse, Databricks, Data Factory Azure SQL. Python Scripting for Pyspark C# Experience Experience with TDD and Unit Testing. Desirables - Experience working on Multi Cloud Solutions Azure Integration experience with Azure Function Apps/Logic ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTClient Advisory & Translation: Sit directly alongside clients, distinguish their goals ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark ark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTClient Advisory & Translation: Sit directly alongside clients, distinguish their ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark ark code repos - to building user-facing front-end applications and widgets in TypeScript or REACTClient Advisory & Translation: Sit directly alongside clients, distinguish their ...

promote best practice across the analytics function. Independently own projects from discovery through to delivery. Skills & Experience Strong SQL skills. Python and/or PySpark experience. Experience within Product Analytics or Digital Analytics. Strong understanding of experimentation and A/B testing. Good grounding in statistics and analytical methodologies. ...

harness data.What we expect from you Degree in Statistics, Mathematics, Physics, Economics, or a related quantitative fieldStrong programming skills — Python and SQL are essential; PySpark experience is highly advantageousExperience with version control tools (e.g. GIT)Solid understanding of analytical technologies, tools, and techniquesExcellent logical thinking and problem‐solving abilitiesStrong ...

What we expect from you Degree in Statistics, Mathematics, Physics, Economics, or a related quantitative field Strong programming skills - Python and SQL are essential; PySpark experience is highly advantageous Experience with version control tools (e.g. GIT) Solid understanding of analytical technologies, tools, and techniques Excellent logical thinking and problem ...

unlock business value. You will collaborate with data scientists, analysts and software engineers, implement governance and security, and contribute to engineering standards. Strong PySpark and SQL skills, plus experience with cloud platforms are essential for success. #J-18808-Ljbffr ...

engineering is done across the organisation. Skills & Experience Strong hands‐on experience with Azure data platforms Advanced SQL skills Commercial experience using Databricks and PySpark Proven background building and maintaining scalable data pipelines #J-18808-Ljbffr ...