5 of 5 Spark SQL Jobs in London

What we're looking for Extensive experience using python, especially using libraries such as Pandas, scikit-learn and NumPy. Strong programming skills in SQL or Spark SQL Experience in Natural language processing and working and developing LLMs Full ML model lifecycle experience Relevant experience … experienced data professional who will bring strong technical expertise in data science, machine learning and advanced analytics, with extensive experience using Python, SQL or Spark SQL, statistical modelling, natural language processing and large language models. You will have experience across the full machine learning ...

Azure | Databricks | SQL | Outside IR35 | Hybrid THE COMPANY We're partnering with a global mining organisation that is investing heavily in the evolution of its enterprise data platform. Following significant growth and a wider transformation programme, they're looking to bring in an experienced Senior Data Engineer … stakeholders, understand technical and commercial requirements and translate them into scalable Azure data solutions. The platform is built around Azure and Databricks, with SQL sitting at the centre of the engineering approach. The team strongly believes in solving transformation challenges through Spark SQL wherever ...

approved; relevant data solutions development qualifications (e.g. Microsoft certification; Databricks Certification; data apprenticeship qualifications)Additional InformationTech StackSQL Server, SSIS, T-SQLADF, ADLS, Azure SQL Database, PySpark, Spark SQL, Databricks, Delta lakeSummaryType: Full-timeFunction: Analyst ...

bring: Extensive data engineering/integration/migration experience Hands-on Azure Data Factory, Fabric Data Factory, or Synapse Pipelines Strong SQL - profiling, transformation, validation, reconciliation PySpark/Spark SQL notebook experience (Databricks or Fabric) Proven experience on a data migration project ...

experience designing canonical data models or enterprise logical data models. Strong understanding of data modelling techniques, including conceptual, logical and physical modelling. Strong SQL skills and ability to interrogate complex relational data structures. Experience working with cloud data platforms, ideally AWS and Databricks. Understanding of modern data architecture … platforms. Experience with regulatory, client or operational reporting. Experience supporting data migration, legacy system modernisation or platform replacement. Experience with Databricks, Delta Lake, Spark SQL or PySpark. Experience defining validation frameworks, data quality dashboards or metadata-driven rule engines. Experience working in consultancy or client-facing ...