Senior Data Engineer/Up to £95k + Benefits//Global Facilities Services Business Senior Data Engineer 1 Day per Week in London Azure Stack & DataBricks Summary My client is seeking a highly skilled Senior Data Engineer to join their team. This role involves building out … a robust data platform on Databricks, with a primary focus on facilitating seamless data migrations. As a Senior Data Engineer, you will leverage your expertise in Databricks and dataengineering to develop scalable solutions that enhance data integration, transformation, and accessibility across the organization. … Key Responsibilities responsible for designing, developing, and managing data ingestion processes and pipelines within Azure and Databricks environments. The role involves utilizing Databrick's medallion architecture to create well-defined and governed data consumption models, adopting a data-as-a-product mindset. The ideal candidate will have more »
Key Responsibilities This role is in the Sky Data [Customer/Product/Viewing/Regulatory] family. Act as a technical authority and subject matter expert for the teams in your area Provide technical leadership and mentoring to ensure that quality is high and consistent across all individuals and … teams Lead and represent the team on a portfolio of work Provide technical support and assistance to the Head of Department and DataEngineering Team Lead Ensure the correct tools and technologies are being used and that their use is both effective and in-line with broader department … across the technology stacks Be at the forefront of significant technology initiatives from inception to successful deployment Manage solution architects and work closely with DataEngineering, other architecture teams and wider technology communities Look ahead and drive adoption of advanced features and new capabilities Create and build frameworks more »
Key Responsibilities This role is in the Sky Data [Customer/Product/Viewing/Regulatory] family. Act as a technical authority and subject matter expert for the teams in your area Provide technical leadership and mentoring to ensure that quality is high and consistent across all individuals and … teams Lead and represent the team on a portfolio of work Provide technical support and assistance to the Head of Department and DataEngineering Team Lead Ensure the correct tools and technologies are being used and that their use is both effective and in-line with broader department … across the technology stacks Be at the forefront of significant technology initiatives from inception to successful deployment Manage solution architects and work closely with DataEngineering, other architecture teams and wider technology communities Look ahead and drive adoption of advanced features and new capabilities Create and build frameworks more »
Key Responsibilities This role is in the Sky Data [Customer/Product/Viewing/Regulatory] family. Act as a technical authority and subject matter expert for the teams in your area Provide technical leadership and mentoring to ensure that quality is high and consistent across all individuals and … teams Lead and represent the team on a portfolio of work Provide technical support and assistance to the Head of Department and DataEngineering Team Lead Ensure the correct tools and technologies are being used and that their use is both effective and in-line with broader department … across the technology stacks Be at the forefront of significant technology initiatives from inception to successful deployment Manage solution architects and work closely with DataEngineering, other architecture teams and wider technology communities Look ahead and drive adoption of advanced features and new capabilities Create and build frameworks more »
Key Responsibilities This role is in the Sky Data [Customer/Product/Viewing/Regulatory] family. Act as a technical authority and subject matter expert for the teams in your area Provide technical leadership and mentoring to ensure that quality is high and consistent across all individuals and … teams Lead and represent the team on a portfolio of work Provide technical support and assistance to the Head of Department and DataEngineering Team Lead Ensure the correct tools and technologies are being used and that their use is both effective and in-line with broader department … across the technology stacks Be at the forefront of significant technology initiatives from inception to successful deployment Manage solution architects and work closely with DataEngineering, other architecture teams and wider technology communities Look ahead and drive adoption of advanced features and new capabilities Create and build frameworks more »
Key Responsibilities This role is in the Sky Data [Customer/Product/Viewing/Regulatory] family. Act as a technical authority and subject matter expert for the teams in your area Provide technical leadership and mentoring to ensure that quality is high and consistent across all individuals and … teams Lead and represent the team on a portfolio of work Provide technical support and assistance to the Head of Department and DataEngineering Team Lead Ensure the correct tools and technologies are being used and that their use is both effective and in-line with broader department … across the technology stacks Be at the forefront of significant technology initiatives from inception to successful deployment Manage solution architects and work closely with DataEngineering, other architecture teams and wider technology communities Look ahead and drive adoption of advanced features and new capabilities Create and build frameworks more »
Key Responsibilities This role is in the Sky Data [Customer/Product/Viewing/Regulatory] family. Act as a technical authority and subject matter expert for the teams in your area Provide technical leadership and mentoring to ensure that quality is high and consistent across all individuals and … teams Lead and represent the team on a portfolio of work Provide technical support and assistance to the Head of Department and DataEngineering Team Lead Ensure the correct tools and technologies are being used and that their use is both effective and in-line with broader department … across the technology stacks Be at the forefront of significant technology initiatives from inception to successful deployment Manage solution architects and work closely with DataEngineering, other architecture teams and wider technology communities Look ahead and drive adoption of advanced features and new capabilities Create and build frameworks more »
Our client who is a house hold UK name branded business are urgently looking for a DataEngineering Manager to lead a small team of data engineers. Responsibilities: Manage a team of data engineers. (must have managed before, not looking for senior data engineers looking … to make the next step. Oversee the design, development, and maintenance of data pipelines. Collaborate with cross-functional teams to ensure data quality and availability. Lead projects related to data integration, transformation, and storage. Implement best practices for dataengineering processes. Requirements: Previous experience managing … a team of data engineers. Proficiency in Azure (including services like Azure Data Factory, Azure Databricks, etc.). Strong programming skills in Python . Familiarity with data modeling, ETL processes, and data warehousing. Excellent communication and leadership abilities. Additional Information: This role offers a £100k + more »
Data Engineer Grade: Senior Consultant – Senior Manager Location: London Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks a highly ambitious and technically astute AWS Data Engineer to help design, build and deploy cloud-based data solutions - transforming raw data into actionable insights … that inspire ingenuity. The Company: The Organisation consists of 4000 high-performing Digital Strategists and Engineering Technologists - united in delivering human-centred innovation and making a meaningful impact on global society. Boasting a vast network of FTSE 100 and Fortune 500 clients, the Group specialises in executing complex technology … industry verticals: Consumer & Manufacturing, Defence & Security, Energy & Utilities, Financial Services, Government & Public Services, Healthcare, Life Sciences, and Transport. Essential Skills & Experience: • Design and deploy data pipelines using Java, Python, Scala, Spark, and SQL in big data architecture. • Execute tasks involving scripting, API data extraction, and SQL queries. more »
Morgan Hunt is working with a leading and reputable organisation to recruit a Data Architect on a permanent basis. This position can be worked through a hybrid model and there are offices in London, Manchester, Bristol, or Cheltenham. Candidates MUST hold active DV clearance in order to be considered … for this role. The role sits within the Data Intelligence department, consisting of 100 Data Consultants covering several data specialisms ranging from Data Strategy, Architecture and Governance to Data Science, DataEngineering, Artificial Intelligence and Machine Learning. They are currently looking for Data Architects to help their clients across a wide range of industries in their mission to establish consistency and realise business benefit from data and information assets. They will be given the freedom and director level support to establish data agendas with clients where they will bring their more »
Roles and Responsibilities: • Analyse and organize raw data • Build data systems, pipelines, and data products. • Evaluate business needs and objectives • Interpret trends and patterns • Conduct complex data analysis and report on results • Prepare data for prescriptive and predictive modelling • Build algorithms and prototypes • Combine raw … information from different sources • Explore ways to enhance data quality and reliability • Identify opportunities for data acquisition • Develop analytical tools and programs • Collaborate with data scientists and architects on several projects • Automate Tasks • Create Models and Identify Patterns Key Skills: • Previous experience as a data engineer … or in a similar role • Technical expertise with data models, data mining, data migration, Data warehousing and segmentation techniques (GCP). • Big query, big tables and Compute engine in GCP. • Knowledge of programming languages Python, R, and java. • Machine learning will be added advantage. • Hands-on more »
Job Overview Position: Senior Data Engineer In this role, you will be responsible for storing, processing, modeling, and applying data science to ensure that data and insights are available for data analytics and business intelligence (BI) systems. You must be proficient in data assessment and … profiling, source system analysis, and providing a clear vision for processing and interpreting data to support its end-use. Ideal Candidate Profile The ideal candidate will have a background in DataEngineering or Data Warehousing (Data Engineer/DW Developer) with robust DW development and … ETL/ELT data pipeline experience, along with expert knowledge of SQL. Key Skills - Mandatory Strong data modeling and SQL/database design skills Proficiency in ETL/ELT processes Extensive experience with Python Excellent numerical, analytical, and statistical skills Ability to visualize and present data and more »
Lead Azure Data Engineer PySpark (Python) & Synapse Tech for Good/Charity Essential skills required: Azure solid experience required of the Azure Data ecosystem Python - ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure Data Engineers This is the chance to work for a unique organisation Our client is a not-for-profit charity that reviews/certifies companies … circa in the UK). You will be reporting to the CTO who manages the tech team of circa 30 people comprising developers, data engineers, QA and DevOps. Essential skills required: Azure solid experience required of the Azure Data ecosystem Python - ESSENTIAL as PySpark is used heavily. You more »
FTE or Contract Pay Range: Based on experience level GENERAL DESCRIPTION & RESPONSIBILITIES The Azure AI Solution Architect will lead the creation of high-value data driven solutions leveraging Cyclotron s proven implementation methodology and solutions for enterprise projects, as well as contributing to technical pre-sales activities as required. … Cyclotron s sales, service delivery and project management organizations in service to Cyclotron s clients. The ideal candidate will have extensive Microsoft/Azure data services and Azure OpenAI technology experience. The role requires a combination of technical expertise, leadership skills and industry knowledge. Candidates will be expected to … contribute to all stages of the data lifecycle. Technical Proficiency: Strong background in artificial intelligence, machine learning, and data science. Proficiency in Microsoft AI technologies, including Azure Machine Learning, Azure Cognitive Services, and related tools. Leadership Skills: Proven experience in leading and managing teams, especially in the AI more »
heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a … of creativity, experimentation, and continuous improvement. You will be an essential part of this mission, using your technical expertise to demonstrate how our Databricks Data Intelligence Platform can help customers solve their complex data challenges. You'll work with a collaborative, customer-focused team that values innovation and … solutions to help our customers achieve their goals and guide their businesses forward. Join us in our quest to change how people work with data and make a better world! You will be reporting to the Manager, Field Engineering. The impact you will have: Form successful relationships with clients more »
GOAT Interactive is looking for a Junior Data Engineer to join our DataEngineering team, this role will be responsible for the development, testing, and maintenance of data pipelines and data storage systems on Google Cloud Platform (GCP). You will be working with technologies … such as Apache Airflow, BigQuery, Python, and SQL to transform and load large data sets, ensuring high data quality and accessibility for business intelligence and analytics purposes. Our business is growing quickly and with that so the scale of our data, we are currently working on several … initiatives to improve our data solution and you would become an integral part of this. Key Responsibilities Design, construct, install, test, and maintain data pipelines. Ensure systems meet business requirements and industry practices for data integrity and quality. Manage ETL and ELT pipelines across many datamore »
My client is a dynamic and innovative specialty insurer and reinsurer. They are looking for a talent data product owner to join their team. Key Responsibilities: Deliver value from data to stakeholders. Define, document, and prioritize business requirements with stakeholders. Share data team capabilities and tools to … help stakeholders improve processes and make better decisions. Document requirements, business outcomes, data flows, and data using identified tools and techniques. Ensure the business value of requirements is understood by the team. Support engagement partners with delivery of requirements through analysis and testing, as needed. Communicate timelines, expected … outcomes, and provide transparency to stakeholders. Embed Service Excellence principles in data contracts. Stay informed about the technology stack, data architecture, and data culture principles to represent the data team effectively. Become an expert in specific datasets, interrogate data, and specify views to support reporting more »
I have partnered with a cutting-edge software business who are looking to hire a Head of DataEngineering, As the Head of DataEngineering, you will be responsible for designing, developing, and maintaining our data infrastructure on GCP. You will work closely with cross … functional teams to ensure that our data pipelines are robust, scalable and efficient. The best-matched Head of DataEngineering will have the following experience and abilities: Led a team of data engineers in designing, building, and maintaining data pipelines on the Google Cloud Platform. … Evaluate and recommend new technologies and tools to improve our data infrastructure and processes. Monitor and optimize the performance of data pipelines to ensure reliability, scalability, and cost-effectiveness. Hybrid working in London, 2 days a week in the office If this looks like it could be of more »
is fragile and career outlook right now is very uncertain. What about working at a hedge fund where their growth is almost certain? This dataengineering team hired multiple people last year – most from big-tech – and plan to do the same this year. A large portion of … your work will technically be non-finance, with the main finance focused work completed by other teams. The real-world, complex dataengineering problems are all yours. You’ll be joining a team that builds and has built thousands of ingestion pipelines, with data coming from every … single potential avenue it possibly can. To get the best understanding of an investment, all data points are considered. You’ll bring the data into the business, build the data infrastructure around it and deliver the data to the right person in the business to build more »
Graduate Software Engineer - London - Exciting Fin-Tech Scale-Up 🚀 📢 Permanent + Fun Social Team + Share options Are you a 2024 graduate passionate about DataEngineering and working with MLOps? Are you looking for a fantastic environment to start your career in? Here’s your chance to be … social FinTech scale-up and take the first big step in your career! This firm is looking for a Software Engineer to join their Data team and work with developing new data pipelines, helping to deploy new features to their stack, and help build and run their MLOps … have 🖥️: Degree from top Russell Group universities in a related field (i.e. Maths, Physics, Computer Science, etc.) Experience using Python and SQL Experience with dataengineering, data cleaning, data pipelines A passion for pushing boundaries in technology Great problem-solving abilities Excellent time management and communication more »
City of London, London, United Kingdom Hybrid / WFH Options
The Health Foundation
an independent charity committed to bringing about better health and health care for people in the UK. This is an exciting role in the Data Analytics directorate, a team of around 25 staff. Data Analytics plays a core role in delivering the Foundations overall mission and strategy. We … the UK population, as well as health and care system performance. The Improvement Analytics Unit (IAU) is a sub-team of 14 staff within Data Analytics. It is a unique partnership between NHS England and the Health Foundation. We evaluate innovative and complex initiatives in health care in order … to support learning, improvement and policy development. Our Senior Data Engineer will work within the Improvement Analytics Unit (IAU).They will support our Assistant Director and Senior Analytical Managers to deliver an ambitious work programme, leading on dataengineering, data management and information governance. The datamore »
Employment Type: Permanent, Part Time, Work From Home
high aspirations for strategic expansion and growth to be achieved through both organic and acquisitive means. The Role: We are currently hiring for a Data Architect, who will be accountable for architecting, enhancing, managing, and supporting a highly available, distributed, cloud data platform for Sysco International business units … and enterprise data. The Architect will collaborate with the International business units, US architecture team and Sysco 3rd party Vendors to create data solution andl ensure alignment between the international businesses in the deployment of initiatives. The role will also be the point of escalation for the International technology … will form part of the International Business Technology Team and will work closely with all the International business units and 3rd party contractors. The Data Architect will play a key role in Data Platform projects, the implementation of which is critical to the business operations and business-wide more »
Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good/Charity Rate: £500-650 per day Duration: 6-12 months IR35: Outside Location: Remote with occasional travel to London (Once every two months max) Essential skills required: Azure – solid experience required of the Azure Data ecosystem Python … ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure Data Engineers This … circa in the UK). You will be reporting to the CTO who manages the tech team of circa 30 people comprising developers, data engineers, QA and DevOps. As this is a lead role 50% of your time will be leading and assisting the other data engineers and more »
us with problems that need genuine thought, intelligence and knowledge; we're not just putting bodies on seats. We are currently seeking a skilled Data Engineer with Quantexa experience to join one of our most trusted clients. The project is key to the business and focuses on implementation of … across all departments within the bank. Experience & Skills: Background in hands-on technical development, with at least five years of industry experience in a dataengineering role or engineering equivalent Proficiency in Scala, Java, Python, or a programming language associated with dataengineering Expertise building … and deploying production level data processing batch systems maintained by application support teams Experience with a variety of modern development tooling (eg Git, Gradle, Nexus) and technologies supporting automation and DevOps (eg Jenkins, Docker) Experience working in an Agile environment A strong technical communication ability with demonstrable experience of more »
Greater London, England, United Kingdom Hybrid / WFH Options
Anson McCade
Data Engineer Location: London – Hybrid Employment: Full Time All applicants must hold a SC or DV (Developed Vetting) clearance to apply. The Opportunity: For the UK Government, maintaining National Security is a 24-hour-a-day, 365-day-a-year mission. To support these complex operations, the MoD partners … with this Big4 Firm to empower critical thinking and drive value across its strategic initiatives and Data & AI technology investments. The Role: As an AI & Cloud DataEngineering practitioner, you’ll build large-scale data pipelines and infrastructure, utilising data integration tools to optimise complex … data solutions. Collaborating with high-performing Data Science and ML Engineering teams to drive innovation and insight through AI and Data across the Defence & Security sector. Required Skills/Experience: British Passport Holder with active DV (Developed Vetting Clearance) End-to-end development with datamore »
