Data Mart. Utilize Vector Databases, Cosmos DB, Redis, and Elasticsearch for efficient data storage and retrieval. Demonstrate proficiency in programming languages including Python, Spark, Databricks, Pyspark, SQL, and ML Algorithms. Implement Machine Learning models and algorithms using Pyspark, Scikit Learn, and other relevant tools. Manage Azure DevOps, CI/CD … pipelines, GitHub, and Kubernetes (AKS) for efficient software development and deployment. Implement ML/OPS solutions using Azure ML, Databricks MLFlow, and LLMOps for streamlined Machine Learning operations. Ensure data governance and data cataloging standards are maintained, utilizing tools such as Collibra and Talend Data Catalogue. Collaborate with stakeholders to … Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Experience with Vector Databases, Cosmos DB, Redis, Elasticsearch. Strong programming skills in Python, Spark, Databricks, Pyspark, SQL, ML Algorithms, Gen AI. Knowledge of Azure DevOps, CI/CD pipelines, GitHub, Kubernetes (AKS). Experience with ML/OPS tools such more »
in PowerBI, DAX, Power Query, and SQL Strong understanding of data modelling and database concepts Familiarity with data visualisation techniques Experience with Azure and Databricks is a plus Prior experience in financial services or commodities is a must If interested please come back with an updated CV and contact number more »
data transformation tools, and data governance techniques Good understanding of Quality and Information Security principles Experience with Azure, ETL Tools such as ADF and Databricks Advanced Database and SQL skills, alng with SQL, Python, Pyspark, Spark SQL Strong understanding of data model design and implementation principles Data warehousing design patterns more »
software development principles. Extensive experience with Azure AI solutions, including Azure Open AI Service, Azure Cognitive Services, and Azure Machine Learning. Familiarity with Azure Databricks is a plus. Solid background in machine learning algorithms, data pre-processing, feature engineering, and model evaluation. Experience with deep learning frameworks like TensorFlow or more »
practices. A team player with excellent communication & collaboration skills. Desirable: Experience developing and maintaining data warehouses/lakes using big data solutions (e.g., Snowflake, Databricks). Familiarity with SQL Server, PostgreSQL or NoSQL database technologies. Previous experience within banking or finance desirable, but by no means necessary. If you're more »
Python Experience developing in the cloud (AWS preferred) Solid understanding of libraries like Pandas and NumPy Experience in data warehousing tools like Snowflake, Pyspark, Databricks Commercial experience with performant database programming in SQL Capability to solve complex technical issues, comprehending risks prior to the circumstance. Please apply today or get more »
bring fresh ideas to the table. Key Responsibilities Engineer and orchestrate data flows & pipelines in a cloud environment using a progressive tech stack e.g. Databricks, Spark, Python, PySpark, Delta Lake, SQL, Logic Apps, Azure Functions, ADLS, Parquet, Neo4J, Flask Ingest and integrate data from a large number of disparate data … in training and learn new technologies and techniques Tackle challenging project tasks demonstrating ownership and responsibility Skills: Experience in processing data using Spark/Databricks or similar Experience working in a cloud environment (Azure, AWS, GCP) Experience in at least one of: Python (or similar), SQL, PySpark Experience in building more »
like Snowflake, FiveTran, and dbt. Requirements: Proven experience leading and mentoring data engineering teams. Hands-on with cloud-based data warehousing (Snowflake, Redshift, or Databricks) and SQL. Extensive knowledge of data management and Data Ops (ingestion, pipelines, CI/CD). Strong project management skills in a fast-paced environment. more »
/marketing models but not required Candidates should be looking to work in a fast paced startup feel environment Tech across: Python, SQL, AWS, Databricks, MLFlow, APIs Apply below more »
Headcount, Staff Reconciliation Adhoc Represent Tech Media at Kantar Tech Finance forums and initiatives. Understand and reallocate central recharges such as Kyndryl, Azure, AWS, Databricks Work with advisors on annual UK R&D tax credit. Form relationships with key vendor partners such as Cognizant and Persistent Supplier/procurement/ more »
and coordinating release schedules Preferred Qualifications Experience owning/driving roadmap strategy and definition Understanding of data warehouses or Lakehouses, such as on BigQuery, Databricks or Snowflake Experience designing or architecting (design patterns, reliability and scaling) of new and existing systems WHO WE ARE: Do Your Best Work The opportunity more »
Principal Data Engineer £80,000 - £103,000 + 15% Bonus London based - Hybrid working A consultancy at the heart of ground-breaking innovation and transformative solutions where expertise meets ambition. With a focus on collaborative brilliance shaping industries and propelling more »
Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good/Charity Rate: £500-650 per day Duration: 6-12 months IR35: Outside Location: Remote with occasional travel to London (Once every two months max) Essential skills required: Azure – solid more »
some greenfield project wins. I'm looking for an experienced Lead Data Engineer to play a pivotal role in building state-of-the-art Databricks and Snowflake Lakehouse solutions from scratch. If you have experience with Azure, Databricks or Snowflake, SQL, ETL, and a passion for consulting, please get in … touch. Key Responsibilities: Design, develop, and maintain cutting-edge Databricks or Snowflake Lakehouse solutions from scratch Collaborate with cross-functional teams to understand data requirements and translate them into efficient ETL processes. Work with Azure services to ensure data storage, security, and scalability. Develop and optimize SQL queries for data … changes within the insurance sector to inform data strategies and solutions. Experience: Proven experience in building and maintaining data lakes or data warehouses using Databricks on Azure. Strong expertise in SQL and ETL processes. Recent experience working within consulting, with a deep understanding of how to be a true 'consultant more »
Senior Data Engineering Lead - Analytics & Infrastructure Financial Services £120,000 + 20% Bonus 3 days in the office per week (Central London) A leading global financial service firm is on a transformative journey to become the benchmark for quality across more »
About Tredence: - Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions more »
Python & Spark experience Must have strong AWS experience Must have Terraform experience SQL & NoSQL experience Have built out Data Warehouses & built Data Pipelines Strong Databricks & Snowflake experience Docker, ECS, Kubernetes & Orchestration tools like Airflow or Step Functions are nice to have Contracts are running for 6 months initially, paying up more »
Engineer A brand new and exciting opportunity has recently arisen for a Data Engineer with an excellent knowledge in ETL, Azure Data Factory, Azure Databricks and SQL to join one of the UK's Largest Charity based in London. As the Data Engineer you will be shaping the data eco … working on greenfield projects and improving their data function. If you are currently a Data Engineer with experience in ETL, Azure Data Factory, Azure DataBricks, SQL and keen to be influential in greenfield projects then this is the perfect opportunity for you! Skills that are required for a Data Engineer … are: Experience in Azure Data Factory and Databricks Experience working with ETL pipelines Great understanding of Data Engineering principles Salesforce would be a nice to have but not essential Azure Data Engineer/Data Engineer/Senior Data Engineer/Azure/ETL/SQL/Azure Data Factory Salary more »
to the Director, Strategic Sales, as a Strategic Account Executive your mission will be to grow one of our most strategic customer partnerships in Databricks globally. You will be dedicated to managing a single, high-value customer in the Life Sciences industry. You will be a part of a purpose … goalsYou will lead your team, customers and partners to identify impactful big data and AI use cases whilst proving out their value on the Databricks Data Intelligence platformYou will implement the big data and AI transformation goals of your customer through a combination of strategic partnerships, well scoped professional services … and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded more »
experience working in industry as an Azure Data Engineer and/or BI Developer. Proficiency in Azure data tools such as Data Factory, Synapse, Databricks, SQL, Data Lake or Delta Lake. Strong data engineering and data modeling skills, with the ability to craft complex data models. In-depth understanding of more »
varying levels of experience Flexibility and willingness to adapt to new software and techniques Nice to Have Experience working with projects in Apache Spark, Databricks of similar Expert cloud platform knowledge, e.g. Azure What will be your key responsibilities?A technical expert and leader on the Petcare D&A Platform more »
varying levels of experience. Flexibility and willingness to adapt to new software and techniques. Nice to Have Experience working with projects in Apache Spark, Databricks of similar. Expert cloud platform knowledge, e.g. Azure What will be your key responsibilities? A technical expert and leader on the Petcare D&A Platform more »
of Python Experience developing in the cloud (AWS preferred) Solid understanding of libraries like Pandas and NumPy Experience in data warehousing tools like Snowflake, Databricks, BigQuery Familiar with AWS Step Functions, Airflow, Dagster, or other workflow orchestration tools Commercial experience with performant database programming in SQL Capability to solve complex more »
Greater London, England, United Kingdom Hybrid / WFH Options
BJSS
You can expect to get involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge more »
high availability Desired experience: Worked with Python 3.9+ Familiar with Python test automation Experience with SQL and Timeseries databases Familiar with Parquet, Arrow, Airflow, Databricks Experience with cloud AWS services, such as S3, EC2, RDS etc Quality engineering best practice and tooling including TDD, BDD This is an inside IR35 more »
