7 of 7 Spark SQL Jobs in London

AWS Databricks Engineer

Hiring Organisation
Capgemini
Location
London Area, United Kingdom
considering: We are looking for an experienced AWS Databricks Engineer with strong hands-on expertise in Databricks, AWS cloud services, PySpark, Spark SQL, Delta Lake, Python, SQL, and data engineering. The candidate will be responsible for designing, developing, optimizing, and supporting scalable data pipelines … support code reviews, design reviews, and engineering best practices. Your Skills: Strong hands-on experience with Databricks on AWS. Strong experience with Apache Spark/PySpark. Excellent programming skills in Python. Strong SQL skills including complex queries, joins, CTEs, window functions, and query optimization. Experience with ...

Data Architect - Databricks - Dbt - Azure

Hiring Organisation
Square One Resources
Location
London, United Kingdom
Employment Type
Contract
Contract Rate
£500/day
experience to join their team for a contract until the end of the year. Job Responsibilities/Objectives Mandatory Skills: Databricks (PySpark/Spark SQL) , DBT , Azure DevOps (Repos, Pipelines, CI/CD), SQL ,Azure Data Services (Data Lake, Data Factory) Strong experience with … Databricks (PySpark/Spark SQL) Hands-on expertise in DBT Expertise in Azure DevOps (Repos, Pipelines, CI/CD) Proficiency in SQL and Python Experience with Azure Data Services (Data Lake, Data Factory) Strong knowledge of Data warehousing and ETL/ELT concepts Knowledge ...

Developer (PySpark + Fabric)

Hiring Organisation
Tata Consultancy Services
Location
London Area, United Kingdom
solutions. Create and maintain technical documentation, standards, and knowledge repositories. Your Profile: Essential skills/knowledge/experience Strong proficiency in Python, PySpark, Spark SQL, DataFrame APIs, Structured Streaming, and Java. Experience developing and maintaining large-scale data processing and mastering pipelines using PySpark. Strong experience … GitLab CI, Azure DevOps, or similar. Experience working with YAML and JSON configuration files and Infrastructure-as-Code concepts. Strong experience with Spark for large-scale data processing using DataFrames, RDDs, and Spark SQL. Hands-on experience developing ETL workflows, lakehouse solutions, dataflows, pipelines, and semantic ...

Data Architect

Hiring Organisation
Capgemini
Location
London Area, United Kingdom
modelling, dimensional modelling, canonical data models, and enterprise data models. Strong experience in designing ETL/ELT data pipelines. Good understanding of PySpark, Spark SQL, Python, and SQL. Strong knowledge of data warehouse, data lake, data mart, and semantic layer architecture. Experience in defining data quality ...

Senior Data Scientist

Hiring Organisation
Formula
Location
City of London, London, United Kingdom
high-stakes and the upside of getting it right is visible at company level. You'll design and deploy solutions in Python, SQL and Spark SQL, working across Azure Synapse, Snowflake, Databricks and Azure ML. The environment is modern and evolving. You'll help … afterthought Strong candidates will come from a background in data science or applied statistics, with hands-on ML experience and the Python/SQL depth to match. Experience with Azure tooling is useful; the ability to think clearly about business problems and turn them into scalable analytical solutions ...

Senior Data Scientist

Hiring Organisation
Formula
Location
City of London, London, United Kingdom
track record of delivering impactful solutions • Proven experience developing and deploying machine learning models and statistical analysis • Strong proficiency in Python and SQL, with experience in Spark SQL • Familiarity with cloud platforms and distributed computing tools such as Azure Synapse, Snowflake, or Databricks • Ability ...

Principal Consultant - Lead Data Analyst / Data Modeller

Hiring Organisation
Transform Together Consulting
Location
City of London, London, United Kingdom
experience designing canonical data models or enterprise logical data models. Strong understanding of data modelling techniques, including conceptual, logical and physical modelling. Strong SQL skills and ability to interrogate complex relational data structures. Experience working with cloud data platforms, ideally AWS and Databricks. Understanding of modern data architecture … platforms. Experience with regulatory, client or operational reporting. Experience supporting data migration, legacy system modernisation or platform replacement. Experience with Databricks, Delta Lake, Spark SQL or PySpark. Experience defining validation frameworks, data quality dashboards or metadata-driven rule engines. Experience working in consultancy or client-facing ...