10 of 10 Spark SQL Jobs in London

What we're looking for Extensive experience using python, especially using libraries such as Pandas, scikit-learn and NumPy. Strong programming skills in SQL or Spark SQL Experience in Natural language processing and working and developing LLMs Full ML model lifecycle experience Relevant experience … experienced data professional who will bring strong technical expertise in data science, machine learning and advanced analytics, with extensive experience using Python, SQL or Spark SQL, statistical modelling, natural language processing and large language models. You will have experience across the full machine learning ...

department. This is an exciting opportunity to work on cutting edge technologies including Big Data and NoSQL databases (Hadoop, HBase, Hive, Spark and MongoDB) to allow the business to gain advanced insight into their portfolios and valuation metrics. Key responsibilities include:* Lead business requirements elicitation, analysis, and documentation … efforts* Assist technology team in Azure cloud solution implementation; write Spark SQL queries to analyze and transform data; provide feedback to User Interface team; testing and documentation* Analyze solution requirements; understand project scope; determine project priorities; ensure efficient and on-time delivery of project tasks ...

Azure | Databricks | SQL | Outside IR35 | Hybrid THE COMPANY We're partnering with a global mining organisation that is investing heavily in the evolution of its enterprise data platform. Following significant growth and a wider transformation programme, they're looking to bring in an experienced Senior Data Engineer … stakeholders, understand technical and commercial requirements and translate them into scalable Azure data solutions. The platform is built around Azure and Databricks, with SQL sitting at the centre of the engineering approach. The team strongly believes in solving transformation challenges through Spark SQL wherever ...

Dimensional) Extensive Azure Databricks experience within large-scale enterprise environments Databricks Lakehouse Architecture and Medallion Design Patterns Databricks Data Engineering using PySpark and Spark SQL Delta Live Tables (DLT) Unity Catalog implementation and governance Databricks Workflows Databricks Asset Bundles (DABs) Databricks Solution Accelerators Metadata-Driven Ingestion … semantic models and enterprise reporting environments Technical Environment Azure Databricks Delta Live Tables (DLT) Unity Catalog Databricks Asset Bundles (DABs) Databricks Workflows PySpark Spark SQL MLflow Mosaic AI Azure Data Factory Azure Synapse Azure Data Lake Storage Dynamics 365 Finance & Operations (D365 F&O) Azure DevOps ...

bring: Extensive data engineering/integration/migration experience Hands-on Azure Data Factory, Fabric Data Factory, or Synapse Pipelines Strong SQL - profiling, transformation, validation, reconciliation PySpark/Spark SQL notebook experience (Databricks or Fabric) Proven experience on a data migration project ...

emerging technologies. \* Develop reference architectures, solution blueprints, and best-practice playbooks for Databricks implementations. \* Architect scalable ETL/ELT pipelines using PySpark, Spark SQL, Delta Live Tables, and Databricks Workflows. \* Implement performance optimization strategies for notebooks, clusters, job orchestration, and data storage. \* Guide teams in building ...

7+ years Databricks solution design, implementation, engineering experience required Either 5+ years building data pipelines in Databricks using PySpark, Scala and/or Spark SQL and ability to work across structured, semi-structured and unstructured data OR 5+ years ML Engineering or AI Engineering deploying, promoting ...

engineering, and modern Lakehouse solutions. The client is looking for a hands‐on engineering professional with strong Microsoft Fabric, Spark, PySpark and SparkSQL expertise, capable of designing, building and supporting enterprise‐scale data platforms. Start Date: ASAP Duration: 3 Months Initially Pay Rate: Competitive IR35 Status: Outside IR35 … Location: London (1 day per week onsite, remainder remote) The Role: The core requirement is strong Lakehouse expertise, particularly Spark, PySpark, and SparkSQL. Hands‐on experience in low‐code is essential. Data & Analytics Expertise: Data architecture (Lakehouse, Medallion, Kimball, 3NF). Data ingestion and processing. Data quality frameworks ...

drive to make a positive impact on the world Experience working within a finance team and senior stakeholders Proficiency in writing robust, performant SQL queries Some experience building robust data pipelines, using Python and dbt Strong analytical skills, commercial interest, and the ability to distinguish between what matters … tracking Circle CI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Spark for data processing SparkSQL for analytics Why else you'll love it here Wondering what the salary for this role is Just ask us! On a call with ...

focused on data platforms, analytics engineering and Lakehouse solutions. You will design, build and support enterprise-scale data platforms with Spark, PySpark, SparkSQL and Microsoft Fabric. The role requires hands-on coding, data governance, ingestion and API integration capabilities, plus a passion for modern analytics and low-code ...