select, design, implement and manage data lake/data warehouse platforms. (Some of the following types of providers: AWS, Microsoft Azure, Google Cloud Platform, Databricks, Snowflake, Cloudera, Spark, MongoDB) Done this at companies using high volumes of data, ideally in retailing. Other sectors where used high volume data would also more »
resolving operational or customer experience-related problems such as workforce management, demand forecasting, or root cause analysisStrong visualisation skills including experience with TableauFamiliarity with Databricks and PySpark for data manipulation and analysisFamiliarity with Git-based source control methodologies, including branching and pull requestsA self-starter, passionate about converting data into more »
least 18 months. My client is seeking experienced Azure Data Engineers for a stakeholder-facing project. This role will have particular emphasis on Azure, Databricks and DevOps. Our client is in the consultancy sector but does not have a preference for previous experience within a consultancy role. There is also … experience and confidence to speak up when several teams can be involved in delivering the project. There is a massive emphasis on Pyspark and Databricks for this particular role. Technical Skills Required: Azure (ADF, Functions, Blob Storage, Data Lake Storage, Azure Data Bricks) Databricks Spark Delta Lake SQL Python PySpark more »
a pivotal role in designing, building, and maintaining their data infrastructure while collaborating closely with senior stakeholders across the organisation. Your expertise in Azure, Databricks, Spark, Python, and data modelling will be critical in driving the success of their data initiatives. Key Responsibilities: Lead the complete development cycle of data … focus on discretion. A comprehensive of data modelling, data warehousing principles, and the innovative Lakehouse architecture. Exceptional proficiency in ETL methodologies, preferably utilising Azure Databricks or equivalent technologies (Spark, Spark SQL, Python, SQL), including deep insight into ETL/ELT design patterns. Proficient in Databricks, SQL, and Python, with a more »
to deliver data solutions.Surface data for analytical consumption and prepare data for ML/predictive and prescriptive models.What we are looking for: Proficiency with Databricks and building data pipelines on Azure cloud platforms.Strong data modeling and analysis skills.Experience across functional areas such as Clinical, Finance, Procurement, Operations, HR, Risk, or more »
data solutions. Surface data for analytical consumption and prepare data for ML/predictive and prescriptive models. What we are looking for: Proficiency with Databricks and building data pipelines on Azure cloud platforms. Strong data modeling and analysis skills. Experience across functional areas such as Clinical, Finance, Procurement, Operations, HR more »
For more information, please send an up-to-date CV to Data Engineering Manager, Data pipelines, ETL, ELT, Modern tech stack, Azure , Python, SQL, Databricks, Data Modelling, Leadership, Strategy, Global more »
and analytics Desired experience: Worked with Python 3.9+ Familiar with Python test automation Experience with SQL and Timeseries databases Familiar with Parquet, Arrow, Airflow, Databricks Experience with cloud AWS services, such as S3, EC2, RDS etc Quality engineering best practice and tooling including TDD, BDD This is an inside IR more »
London, England, United Kingdom Hybrid / WFH Options
Understanding Recruitment
d love to see: Strong proficiency with Python and SQL Extensive Machine Learning experience: forecasting, predictive performance analysis & optimisation Experience with Snowflake, DataIQ or Databricks Cloud platform experience (AWS preferred) Adobe analytics & sales platform experience is a bonus Previous experience working with Marketing Ecosystems Hybrid working with offices in Central more »
notebooks, type-checking, functional programming, PyTest, Pandas, SciKit, PyTorch, CI/CD, and Git Experience with Docker, Kubernetes, and cloud platforms such as AWS, Databricks, Snowflake Experience visualizing data using Plotly and Matplotlib In accordance with the Employment Agencies and Employment Businesses Regulations 2003, this position is advertised based upon more »
performance, driving improved targeted promotions, which in turn aligns with their hyper personalisation strategy for the end customer. Technically they operate a Snowflake and DataBricks environment, leveraging SQL to extract data and R and Python for modelling and statistical analysis, building code and tools. They also have PowerBI for data more »
performance, driving improved targeted promotions, which in turn aligns with their hyper personalisation strategy for the end customer. Technically they operate a Snowflake and DataBricks environment, leveraging SQL to extract data and R and Python for modelling and statistical analysis, building code and tools. They also have PowerBI for data more »
validate and evaluate the benefits of a technology against a business need * Experience of other Cloud Service Providers (Azure, Google Cloud) * Experience of Azure Databricks architecture. * ExperiEnce of snowflake architecture and/or implementation * Familiarity in Infrastructure as Code and CI/CD Pipeline * Familiarity with Dev Ops Services * Facilitation more »
and administration of AWS data platform including security areas and have working knowledge of tools like Hive and Pyspark. Good to have: Experience in Databricks platform. Insurance domain knowledge (Pensions & Annuity.) Understand the data platform solutions like data lake, data warehouse, data marts. AWS solution architect certifications. Rewards & Benefits: TCS more »
pipelines for large scale organisations. We are seeking someone with deep technical skills in a variety of technologies, specifically SPARK performance\tuning\optimisation and Databricks, to play an important role in developing and delivering early proofs of concept and production implementation. You will ideally have experience in building solutions using … high quality work to tight deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and … methodology to deliver proof of concept and production implementation in iterative sprints. Qualifications Direct experience of building data piplines using Azure Data Factory and Databricks Spark. Building data integration with Python Hands on experience designing and delivering solutions using the Azure Data Analytics platform. Experience building data warehouse solutions using more »
Senior Data Engineer - 6 month FTC London (Hybrid Role) £85,000 per annum Senior Data Engineer Opportunity An exciting opportunity has arisen for a Senior Data Engineer to join a dynamic team dedicated to shaping effortless, digital-first customer experiences. more »
an organization who are committed to utilizing the latest Microsoft technologies! Requirements: Hands-on experience with Azure Data Factory Hands-on experience with Azure Databricks Excellent SQL and T-SQL skills Visualisation experience using Power BI and use of DAX Experience of working in Agile teams Excellent communication and stakeholder more »
We are seeking a dynamic and experienced Databricks professional to join our client, a Boutique Data & AI consultancy, as a Databricks Practice Lead in London. As Databricks Practice Lead, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales … strong technical acumen, consulting skills, and effective team management. Key Responsibilities: Presales Expertise: Leverage your in-depth understanding of Databricks to engage with clients in presales activities, providing comprehensive insights and solutions tailored to their unique needs. Collaborate with the sales team to create compelling proposals, presentations, and demonstrations that … showcase the value of Databricks solutions. Technical Mastery: Possess a robust technical background in Databricks, enabling you to guide clients through complex technical challenges and articulate the benefits of adopting Databricks technologies. Stay current with industry trends and emerging technologies related to Databricks, ensuring our client's offerings remain innovative more »
will be comfortable working with non technical colleagues to build a platform that benefits the entire business Desired Skills ⚙️ Python (SQL Server, Azure SQL) Databricks Ariflow, Kafka Azure Benefits 🏖 Modern office in the heart of London with work from home options Opportunity to work in small, diverse and skilled cross more »
from the data.Unlock the potential of metadata within the data, exploring innovative methods to extract valuable insights.Experience Required:Proficient data engineering experienceExperience with Azure Databricks and building ETL pipelinesPackage:Up to £120,000Competitive BonusMarket leading benefitsHybrid workingHow to Apply:If you’re interested, submit your CV and Daniel Akanni will more »
Greater London, England, United Kingdom Hybrid / WFH Options
Source Technology
Unlock the potential of metadata within the data, exploring innovative methods to extract valuable insights. Experience Required: Proficient data engineering experience Experience with Azure Databricks and building ETL pipelines Package: Up to £120,000 Competitive Bonus Market leading benefits Hybrid working How to Apply: If you’re interested, submit your more »
Greater London, England, United Kingdom Hybrid / WFH Options
Agora Talent
B2B SaaS experience involving client-facing projects • Experience in front-end development and competency in JavaScript • Knowledge of API development • Familiarity with Airflow, DBT, Databricks • Experience working with Enterprise Resource Planning (e.g. Oracle, SAP) and CRM systems. If this role sounds of interest, please apply using the link and we more »
London, England, United Kingdom Hybrid / WFH Options
Client Server
you: You're an experienced Data Engineer with a range of skills and experience You have strong AWS, Snowflake and DBT (will also consider Databricks or Redshift) You have a good understanding of IaC, ideally Terraform experience You have a good knowledge of Data Warehousing, data modelling and data transformation more »
engineers onshore to create exceptional product experiences. You do not need to have fintech experience for this role knowledge would be beneficial Experience in Databricks or Kafka is advantageous. Equal Opportunities: We are committed to promoting equality of opportunity for all employees and job applicants. In line with the Equality more »
Privacy technologies such as homomorphic encryption, SMPC, Federated Learning, TEE. Any prior experience with Data management or tooling hugely beneficia (Data Lakes, Snowflake or Databricks). Experience working closely with engineering teams (particularly those working on Machine Learning and Cryptography products). Ability to deliver product presentations, and showcase software more »