Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security … policies. Essential Technical Skills 2-3 years Azure data systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. … Building Azure data pipelines. Agile methodology experience. Problem-solving skills. Awareness of industry trends. Stakeholder engagement. Desired Experience Business Objects Reporting. Power BI familiarity. more »
Our client, a leading innovation and transformation consulting firm based in London, is seeking a talented Senior Consultant - Data Engineer. This role is perfect for an experienced professional who thrives in dynamic environments and is eager to drive impactful data engineering projects. The firm specializes in … leveraging advanced technology to transform businesses, providing cutting-edge solutions to a diverse range of clients. As a Senior Consultant - Data Engineer, you will play a key role in designing, developing, and optimizing datapipelines and architectures. Your expertise will help clients harness the power of … their data, ensuring robust and scalable solutions that meet business needs. You will work with a talented team, utilizing your skills in ETL processes, AWS, and Python to deliver high-quality data engineering projects. Key Responsibilities: Design and develop ETL pipelines to support datamore »
LEAD DATA ENGINEER LONDON BASED £80,000-90,000 PER ANNUM This Real estate company is searching for a new Lead Data Engineer, to Revolutionise their expanding Data and Analytics team, and help build out brand new Datapipelines using Python and … SQL. You will also be responsible for building a new Data platform in GCP. THE COMPANY This growing company are searching for a new Lead Data Engineer, to own the technical direction of their expanding Data and Technology team. They have been investing heavily … in their data team over recent years, and are a very data-focused business. THE ROLE Joining this team as a Lead data engineer, you will be responsible for building the company's next-generation data platform using GCP. This role has more »
Full Stack Developer/Data Engineer opportunity. Full time permanent position. Fully remote or hybrid - office just outside of London. My client is a dynamic and rapidly growing electrification company dedicated to the decarbonisation of heat transport and induction. They have years of experience from across the energy … sector in integrating and connecting renewable generation, EV charging and the digitalisation of energy. They are seeking a Full Stack Developer/Data Engineer with Data bricks expertise to help tackle exciting challenges in the energy sector. In this role, you will: Develop and scale energy … solutions: Bring ideas to life, building robust and scalable applications from proof-of-concept to deployment, working alongside the Energy Solutions team. Design datapipelines for smarter energy: Craft and manage datapipelines using Databricks, integrating best-in-class demand forecasts to optimize energy use. Enhance more »
SENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office. Commutable from London.) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of … Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement DataPipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly … organisation. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years of commercial work as a Senior Data Engineer (responsible for taking decisions, rather than just writing code) An ability to write production quality Python code. Strong SQL Skills Experienced creating datamore »
the selected Machine Learning Engineer, your background will include: A minimum of fours years industry experience in machine learning. Familiarity with cloud computing, datapipelines, and distributed ML technologies. Strong programming skills in Python, and experience with ML frameworks. Knowledge in Agile methodologies, CI/CD tools (e.g. more »
Engineering in sculpting and realising the strategic vision, enhancing the analytical prowess of the Actuarial team. Embrace the challenge of refining operations through data automation and harnessing cutting-edge technologies. Key Essentials: Proficiency in Python, SQL, and PowerBI is paramount. Experience with Azure or APIs is highly advantageous. … standards. Showcase technical prowess in Python, SQL, and JSON. Implement and oversee a robust CI/CD process. Enhance Azure modules, advancing automated data pipelines. Question conventional analysis and design, advocating for innovative alternatives. Articulate technical design principles to non-technical stakeholders. Propose enhancements to data efficiency and reliability. Represent the actuarial engineering perspective in key forums and authorities. Explore and introduce new tools for data management and analysis. To apply, please submit your CV and a cover letter detailing your relevant experience and how you can contribute to the success of more »
based projects, alongside deep learning and neural networks to support core clients Part of a team of 9 reporting to the Head of Data Science - working closely with a wider Data Engineering function Focusing on end-to-end datapipelines, for training, evaluating and … deploying ML models Working closely with Data Scientists on client partners, advising on best practice ML and MLOps infrastructure Looking for a 'Full Stack Data Scientist' profile Your Skills and Experience: MSc or PhD level education in STEM subjects. Strong knowledge of data science … fundamentals of building and evaluating models Strong experience in datapipelines and deploying ML models Preference for experience in retail/marketing but not required Tech across: Python, AWS, Databricks, PySpark, AB Testing, MLFlow, APIs Apply below more »
in the firm's technological evolution. The company are looking for a python developer who can design and develop their innovative AWS-native data analytics platform. Using Python, to build high-performance, high-throughput datapipelines for trading exchange, FX and fundamental data. This platform incorporates … real-time extraction, transformation and analysis of data from hundreds of diverse sources, some generating up to 100,000 transactions per minute The ideal candidate should have the majority of the following … Experience Developing and maintaining datapipelines for a company's analytics platform. Knowledge of how to collaborate with various teams to meet pipeline requirements. Be able to Troubleshoot and resolve pipeline issues. Strong experience in cloud-based development (AWS). Experience Optimizing pipelines for performance and more »
energy and commodities markets. They provide a wide range of services to a substantial and diversified customer base. They are seeking a skilled, data focused Python Developer who can design and develop their innovative AWS-native data analytics platform. As a Python Developer, you will be … building high-performance, high-throughput datapipelines for trading exchange, FX and fundamental data. The ideal candidate should have the majority of the following: Bachelor's degree in Computer Science, Engineering, or a related field. Strong Python development. Experience with Pandas is desirable. 3+ years of experience in … data engineering. Experienced in building ETL data pipelines. Relational database experience w/PostgreSQL. Understanding of tech within our stack: AWS/Apache beam/Kafka. Experience with Object Orientated Programming A desire to work in the commodities/trading sector. Permanent/Full-Time Employment. more »
I have partnered with a cutting-edge software business who are looking to hire a Head of Data Engineering, As the Head of Data Engineering, you will be responsible for designing, developing, and maintaining our data infrastructure on GCP. You will work closely with … cross-functional teams to ensure that our datapipelines are robust, scalable and efficient. The best-matched Head of Data Engineering will have the following experience and abilities: Led a team of data engineers in designing, building, and maintaining datapipelines on … the Google Cloud Platform. Evaluate and recommend new technologies and tools to improve our data infrastructure and processes. Monitor and optimize the performance of datapipelines to ensure reliability, scalability, and cost-effectiveness. Hybrid working in London, 2 days a week in the office If this more »
Job Title: Software Engineer (Rust/HPC/Real Time Data) Client: Elite Tech Firm Salary: Up to £200k 1st Year Compensation Location: London Sells: Cutting-edge tech, ownership of multiple greenfield projects, no red tape, a friendly/collaborative environment, beautiful offices, personal projects on Fridays! An … as part of a team of engineers looking after and building a zero-down time low latency solutions for multi petabyte/exabyte data sets Working heavily in Rust Building/Optimising some of the world's most advanced datapipelines Collaborating with ML Engineers, Data … with other incredibly passionate technologists Skills: 5+ years experience working as a Software Engineer ideally using Rust Outstanding CompSci Fundamentals needed! Knowledge of data engineering principles/data lake architectures - Arrow/Parquet etc. Excellent knowledge of low-level concepts (e.g. compilers, x86, LLVM etc. more »
projects, alongside deep learning and neural networks to support core internal projects Part of a team of 7 reporting to the Head of Data Science Chance to upskill and mentor juniors whilst remaining fully hands on Focusing on end-to-end datapipelines, for training, evaluating … and deploying ML models Working closely with Data Scientists on client partners, advising on best practice ML and MLOps infrastructure Driving best practices in a fast paced environment, within a well established company Your Skills and Experience: MSc or PhD level education in STEM subjects. Strong experience in more »
I'm looking for a Power BI and data enthusiast to join a business services organisation in Central London - this is a hybrid role, requiring 2-3 days per week in the office on average. This is a pivotal role for this business, where you'll be aligned … to one of their major financial services clients as the dedicated "data" person, and will proactively harness untapped data in the client's network to inform decision-making, ensure the delivery of exceptional services to the client, and drive operational efficiency. This will involve identifying data sources, implementing data capture and storage methodologies, and automating datapipelines from these various sources. You will be responsible for developing regular automated and ad-hoc Power BI reports to provide invaluable insight to management, on how they may reduce costs and improve operational more »
Data Platform Manager Location: dmg::media Headquarters – London Position: Permanent Package Description Our benefits package increases the longer you’ve been with us. Here’s what to expect: 25 days’ holiday (increasing by 1 per year up to a total of 30) Upon joining you will be automatically … many other benefits…. Job Introduction DMG:Media own some of the world’s biggest news brands, and as such processes billions of data points every month in order to provide insights and targeting criteria for teams and stakeholders as part of our ambition to be the world … s leading Publisher when it comes to the sophisticated application of data – to power relentless growth. DMG:Media is seeking an experienced and talented Data Platform Manager to evolve its Big Data Platform and advance its overall data proposition. The successful candidate more »
Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great scope for career progression & you’ll be leading and managing a small team of Data … from the Data Engineering work to contribute towards the Data Science/Analytics. Work across the whole Datapipeline (Data Engineering, Data Warehousing, Analytics) Help shape the strategy and roadmap for whole Data function and contribute towards … Engineering pipeline. Preferably someone who is capable of ‘wearing many hats’ and getting hands on in other areas across the Data Engineering pipeline if necessary! Experience leading team of Data Engineers/Scientists. Min. Bachelors’ degree in STEM subject (ideally from UK university). THE more »
Senior Data Engineer 6 month fixed term contract – 2 x a week in London £80,000 - £90,000 per annum + excellent benefits I am very excited to be partnering with a well-known fintech company! We're seeking a talented Senior Data Engineer to join … the data engineering team on a 6-month fixed-term contract, with the potential to extend but within a different department in the company. Role Overview: As a Senior Data Engineer, you'll play a pivotal role in maturing the data warehouse. You'll … collaborate closely with various stakeholders to gather business requirements and translate them into scalable data pipelines. Your expertise in Azure will be crucial in building robust infrastructure to support our data-driven initiatives. Key Responsibilities: with stakeholders to understand business requirements and translate them into technical more »
Senior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great … opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely … Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. DataPipeline Development: Design and construct datapipelines to automate data flow, involving ETL processes as needed. Modern tech stack - Python, AWS more »
Job Title: Data Engineer Job Type: Full Time, Permanent Working location: London, Hybrid Role Purpose At Travelex we are developing modern data services, which will be at the heart of our relationship with our customers. Our data architecture is becoming more service-oriented and … for you to solve. Our work is fast-paced although our team remains collaborative and flexible even when delivering fast. Your role as data engineer has a wide remit: working with product owners, subject matter experts and managers across the company, to design and deliver new components of … to the traditional data engineering type! Significant hands-on experience with AWS, especially AWS services focused on data flow, pipelines, data transformation, storage and streaming. Excellent data engineering skills, for example with SQL, Python, DBT and Airflow. Good understanding of service-oriented more »
Greater London, England, United Kingdom Hybrid / WFH Options
Anson McCade
Data Engineer Location: London – Hybrid Employment: Full Time All applicants must hold a DV (Developed Vetting) clearance to apply. The Opportunity: For the Ministry of Defence (MOD), maintaining National Security is a 24-hour-a-day, 365-day-a-year mission. For this reason, it partners with this … Big 4 Firm to support its multidisciplinary AI & Cloud Data Engineering Capabilities. The Role: As an AI & Cloud Data Engineering practitioner, you’ll build large-scale datapipelines and infrastructure, utilising data integration tools to optimise complex data solutions. Collaborating … with high-performing Data Science and ML Engineering teams to drive innovation and insight through AI and Data across the Defence & Security sector. Required Skills/Experience: British Passport Holder with active DV (Developed Vetting Clearance) End-to-end development with datapipelines, ETL more »
Lead Data Engineer Opportunity | 🌩️ Azure Cloud | 🛡️ Lloyds Insurer ✨🌟 A leading insurance business collaborates with DATAHEAD to find a talented Senior Data Engineer to join their Data Team 🚀. This is an incredible chance to work with technology and data-driven Lloyd's … offers agility and allows you to help shape its future 🌐! 🔧 You'll be joining the technology Engineering Team, focusing on designing and developing data solutions within an Azure cloud native environment 🌩️. The landscape is a greenfield setting, where a new Azure and Databricks-based platform will be … from scratch. Strong skills in Azure tooling (ADF), SQL, and Python are essential 🛠️. 🎯 Key Responsibilities: 🔹 Expertise in Azure platform architecture and developing data engineering pipelines 🌩️ 🔹 Proficiency in SQL and Python (Spark) 🐍 🔹 Provide technical assistance in data engineering, analysis, orchestrations, and enrichment 📊 🔹 Build relationships within the more »
be essential for achieving project success. Key Responsibilities: Software Development: Write high-quality, maintainable code using languages such as Python , SQL . Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2 Utilize PowerBI, Tableau, or similar tools to design and create interactive … PoCs to validate new technologies, frameworks, or solutions. Drive the development of MVPs, ensuring timely delivery and alignment with business goals. Azure and Data Engineering: Leverage your Azure expertise to design and implement cloud-based solutions. Collaborate with data engineers to build robust datapipelines and ensure data quality. SQL and Data Interface: Develop and optimize SQL queries for data retrieval and manipulation. Work on data interfaces to connect various systems within the bank. Qualifications: Bachelor’s degree in Computer Science, Information Technology, or more »
A highly prestigious Investment Management firm are looking to hire a Senior Cloud Data Engineer with strong Python and Snowflake experience to join their new Data & AI team in a permanent position. The Cloud Data Engineer will join alongside Data Scientists and … Data Modellers to manage and improve the cloud-based Data Warehouse (Azure, Snowflake), and guide the organisation through an unprecedented period of data change. Your Key responsibilities will be: Engineering scalable and secure cloud data solutions for high-performance Data Science workloads and Generative AI applications Enhancing and managing the cloud-based Data Warehouse (Azure, Snowflake) Designing, building and deploying datapipelines to support advanced analytics and the development of Machine Learning algorithms and Generative AI (GenAi) applications Providing technology thought leadership and supporting more »
Amazon well architected frameworks, serverless solutions and improving existing platforms using AWS technologies with Agile delivery methods Demonstrable experience of Python 3, Python data management/… manipulation libraries and usage of Python with AWS components Demonstrable experience working in the Data domain, covering the full datapipeline from ingestion, mastering, management and consumption/distribution of large datasets Financial Services expertise preferred working with Equity and Fixed Income asset classes and … a working knowledge of Indices Experience with No-SQL and Relational databases and data analysis using SQL. Enter key behaviours and skills required to be successful in the role: Education & Work experience: 7+ years of AWS and Python development engineer experience within the Financial Services and Datamore »
digital avatars and human clones. Role: MLOps Engineer Location: London Salary: Up to £100,000 Responsibilities: Develop ML Pipelines: Build and maintain scalable data processing systems. Ensure data quality and integrity. Automate ML Processes: Integrate machine learning solutions into existing systems and automate workflows. Deploy and … implementation practices. Ensure Security: Adhere to security and compliance standards in ML deployments. Requirements: Education: Bachelor’s or Master’s in Computer Science, Data Science, or related field. Experience: 2-3 years in ML, data engineering, or MLOps. Abilities: Strong analytical, problem-solving … and communication skills. Skills: Proficient in Python, ML frameworks like TensorFlow or PyTorch. Experienced with CI/CD, Docker, Kubernetes, and datapipeline tools like Airflow. more »