176 to 200 of 490 Permanent Data Engineer Jobs

Matillion Specialist Data Engineer (Snowflake) Start: June Location: Hybrid/West Midlands Rate: £450-525 per day, OUTSIDE IR35. Duration: 6 Months - extension possible. iO Associates are working exclusively with a Data Analytics company who are looking for a Matillion Specialist Data Engineer within Snowflake more »

We're representing a dynamic business dedicated to extending healthy lifespans and cutting unnecessary medical costs. They're seeking a Senior Data Engineer to propel their Data team forward. Key Responsibilities: Lead Cloud Data Warehouse Project: Oversee the next development phase, ensuring top-notch scalability, reliability … and performance. Data Management Ownership: Be the go-to expert for data management, ensuring smooth operations and accessibility. Support BAU Workloads: Assist in prioritising and managing day-to-day tasks for efficiency and alignment with goals. Set Technical Direction: Define the systems and tools' technical direction, advancing towards … ML and AI integration. Required Experience: Snowflake: Proficiency in setup, configuration, and optimisation. DBT (Data Build Tool): Strong skills in managing transformations and data pipelines. Python: Expertise in scripting, automation, and data manipulation. Beneficial Experience: Dagster/Airflow: Managing complex workflows. Qlik Sense Cloud/Tableau: Data more »

Lead Data Engineer (Java/Python/AWS/Glue/Dremio). Investment Management. £160,000 - £170,000 + 25% Bonus Target and Benefits. Hybrid 2 Days a week in St Pauls Office. CANNOT SPONSOR CANNOT SPONSOR My client is a top tier multi asset investment management … house based in Central London. The Data Office team is playing a key role in helping build the future of financial services, working together with business partners to create client experiences that are changing the way people invest. You will work with smart, talented people across our business. We … of view to the table—because that is how they help their clients succeed. You will be an individual contributor on the Analytics and Data Platform engineering team responsible for architecting, building, testing, and maintaining the data platform whilst managing a small squad of 3-5 Data more »

Data Engineer Bristol (2 days per week) £60,000 - £90,000 + bonus, shares, 30 days hol + 8 BH, private medical An awesome opportunity to join a great company! They aren’t the new kids on the block, and their name continues to spread and be pretty … big throughout Bristol! The business has announced a multi-billion (yep with a B) investment over the next 3 years into their data, people and security. This is a huge opportunity as we start to build out multiple new teams across Bristol. Lots of greenfield projects, work to reduce … technology to modern tech inc moving everything onto the cloud (they are a GCP partner). We are looking to hire a couple of Data Engineers to form a brand new team. Reporting to Rich, Head of Engineering within their servicing & engagement platform. You will collaborate with BA’s more »

Complexio is Foundational AI. This works to automate business activities by ingesting whole company data – both structured and unstructured – and making sense of it. Using proprietary models and algorithms, Complexio forms a deep understanding of how humans are interacting and using it. Automation can then replicate and improve these … Marfin Management, C Transport Maritime, Trans Sea Transport and BW Epic Kosan. Key Responsibilities 👥 Collaborate with cross-functional teams to design and build scalable data solutions that support product innovations and business insights. 🔨 Develop and maintain robust data pipelines that support complex data collection, ingestion, and transformation … processes. 🧑‍💻 Work closely with R&D within data science and AI to provide data. 📈 Design and implement mechanisms for data validation, quality, and reliability to ensure the accuracy and trustworthiness of data sources. 🪲 Diagnose and resolve data-related issues to improve the performance and scalability of more »

Leading ecommerce client now requires a Data Engineer to join their innovative Machine Learning team. This role will focus on increasing overall data efficiency using Machine Leaning, streamlining data processes to increase overall profitability, and ensuring our clients operations and customer teams can increase overall value. … with strong exposure to Machine learning principles/practices and technologies such as ML flow/Sage Maker. The role: Develop robust and scalable data pipelines. Collaborate with cross-functional teams to develop and deploy Machine Learning models and algorithms to solve business challenges and create opportunities. Contribute to … the development of our clients in-house Machine Learning operations framework. Support the data science and analytics team in deploying pipelines. Coach and mentor the team to improve development standards. Key requirements: Strong hands-on experience with Databricks, Spark, SQL or Scala. Proven experience designing and building data more »

We are looking for an experienced Senior Data Engineer passionate about designing and building high-quality data pipelines to power cutting-edge genAI products. The ideal person would have a strong background and expertise in real-time data streaming and cloud technologies. They would also be … . The person we’re looking for We are looking for a self-starter who can see the big picture and understand how our data points are connected. You should be able to use your excellent communication skills to simplify and explain concepts to others. You will also be … and bringing out the best in them, have excellent communication skills and enjoy fostering best practices. You’ll be responsible for Serving as a data engineering subject matter expert Owning and shaping our data streaming roadmap Collecting use cases and requirements from the wider data team and more »

Are you an experienced Data Engineer ? Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ? Its a Hybrid working role and you will be based from either their London, Leeds, Manchester or Edinburgh office, typically 3 days a week … from home and 2 day in office/on client site. Preferred skills: SAS Data Engineering Proficiency in SQL and/or similar data technologies Familiarity with data pipeline tools and ETL processes Knowledge of cloud platforms and data architecture Experience working in the Retail Banking more »

About The Role We are recruiting for a Principal Data Engineer to join our team. Principal Data Engineers work in multi-disciplinary teams that build, support, and maintain user-centered digital solutions that offer real value and work for everyone. Our Principal Data Engineers are experts … in their field. You will act as a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships, and be passionate about developing and upskilling others. Your role in a nutshell: Act as … identifying and ensuring that challenges are overcome. Lead in the recruitment of other engineers, and support other consultants in their professional development. Ensure our Data and Engineering communities contribute to our business at a strategic level. Lead on new business opportunities, writing technical bids and proposals. Promote our Data more »

Position: Data Engineer - 55k-60k GBP + bonus Industry: Insurance Workplace: Hybrid 🏡 - 2 days per month in the office....or more if you'd like :-) Location: Surrey The 4 main things we need are.... Someone who's a good team player Experience with Python programming A good understanding of … Azure technologies Financial Services domain knowledge Do you tick these 4 boxes? Must haves: Python coding experience (Pure Python) - JSON format Data modelling, data warehousing and ETL frameworks SQL Our client have 2,500 lines of Python code for you to maintain and optimize. You'll need hands more »

Senior Data Engineer AWS/Bedrock/Glue/EKS/Redshift Contract - Inside - London Harrington Starr have partnered exclusively with a long-standing client of ours within the commodities trading space who are looking to increase headcount within their Data Engineering team at the start of … the year here with 2024. The role will require you to have: 5+ years data engineering background working on cloud architecture Must have specific experience with AWS Bedrock and other newer technologies Cloud experience (AWS Redshift) would be beneficial Power BI or another similar technology would be an advantage more »

Position: Data Engineer - 55k-60k GBP + bonus Industry: Insurance Workplace: Hybrid 🏡 - 2 days per month in the office....or more if you'd like :-) Location: Surrey The 4 main things we need are.... Someone who's a good team player Experience with Python programming (JSON format) A good … understanding of Azure technologies Financial Services domain knowledge Do you tick these 4 boxes? Must haves: Python coding experience (Pure Python) - JSON format Data modelling, data warehousing and ETL frameworks SQL Our client have 2,500 lines of Python code for you to maintain and optimize. You'll more »

A leading Energy & Commodities client is seeking a Senior Data Engineer to join their growing IT team on an initial 6 month contract basis with high chance of extension thereafter to over 12 months. The role requires the individual to work with Solution and Data Architects to … design the next generation Big Data platform to support the digital marketing platform. The role, therefore, doesn't necessarily require Energy or Trading experience. The role is Inside IR35 and will be a couple of days per month onsite in London. Skills Required: Essential experience in Databricks, ADF, SQL … PySpark, CI/CD. Strong design and coding skills (e.g. Python, Scala, JavaScript). Experience with Microsoft or AWS data stack e.g. Microsoft Azure Data Lake, Hadoop (preferably with Spark), Cosmos DB, HDInsight/HBase, MongoDB, Redis, Azure Table/Blob stores etc. Exposure to tools like SAP more »

Digital with Purpose. DWP Digital is seeking a Senior Data Engineer to apply data engineering on a massive scale, influencing issues which affect millions of citizens and making a real difference to how the UK works. DWP is the UK's largest department, every year we pay … with huge datasets (quite possibly the largest on offer in the UK), you'll be delivering benefits that positively impact thousands of UK citizens. Data modelling is key in this role - you'll be running platforms and transforming raw data into model raw datasets. Our production environment is more »

Title: Azure Data Engineer Rate: Up to £800 P/D Length: 12 month rolling Location: London (Hybrid) Description (Full spec avail): To work with an established team on developing a new strategic big data platform for our customer, we are searching for a Senior Azure Data Engineer. The current Oracle and Java stack will be replaced with a new platform that is an Azure-based data lake with APIs and events to enable data consumption by analytics teams. The needs for this multi-year migration project include engineering to facilitate the transfer of … data masters from the old platform to the new one. Key requirements : CompSci or equivalent degree from a top global university Awareness of and comprehension of Agile approaches, including TDD and BDD knowledge. familiarity with working in agile development teams Excellent written and verbal communication The initiative to resolve more »

LEAD DATA ENGINEER £100,000 - £120,000 HYBRID - LONDON This new position is great for someone who is excited by companies with a great start-up culture and the opportunity to have a clear business impact. You would be going in to take ownership of this FinTech's … are now looking to take a modern approach to how they use data. THE ROLE You would play a core role in using this data to map out their continued growth. Entering this role you will interact with the C-suite and decipher how best to grow their capabilities. more »

UK’s leading marketplace platform is looking for a Principal Data Engineer to take a lead on several aspects of their data platform built in Python, Airflow, Kafka, Sagemaker, AWS and GCP. 💰 Salary: up to £130k + 15% bonus 📍 Location: can be based anywhere in the UK … Must have requirements: Mastery of Python and SQL Significant experience with orchestration tools, ideally Airflow Strong Data Architecture experience Cloud expertise in either GCP or AWS (ideally in both) Knowledge of MPP systems such as Athena, BigQuery, EMR, Hive, Iceberg Exposure to data streaming technologies such as Kafka more »

operating with 10 locations across the country and fast approaching 1000 employees. As part of their growth they are now looking for an experienced Data Engineer to join their London office. The ideal candidate for this role will be experienced in migrating data from various sources into … efficiency throughout. Skills & Experience: Holds a bachelor's or Master's degree in Computer Science or related fields. Proven experience with Insurance Broking Systems data migration (ideally Acturis). Proficiency in SQL and data manipulation languages. Experience with ETL tools. Strong analytical and critical thinking skills, with a … focus on practical solutions. Excellent communication and people skills for conveying data concepts to diverse audiences. Proven ability to collaborate with cross-functional teams and build strong relationships. Agile/Scrum/Kanban experience. Benefits: Competitive base salary (DOE). To be discussed on intro call. Hybrid work place more »

strategy and supporting the mission to deliver exceptional Management (MI) products and services? Do you want to collect and manage a vast array of data which is used by the Secretary of State? DWP Digital is seeking a Senior Data Engineer to join our MI team who … me more about the position: Working with modern cloud environments and a mix of legacy on-premises technologies, you'll help develop the DWP Data Engineering Strategy for MI products and services that enables the department to gain insight and make more informed choices. The work is fast paced … with a large and growing portfolio of MI products built upon hundreds of data sets. You'll focus on back-end data processes to support MI reporting, rather than visu... more »

Role: Senior Data Developer Rate : up to £1400 P/D - DoE Length : 6 Month rolling! Location: London - Office based My client is a well-established and successful tech house working in the finance sector who are looking for a Senior Data Engineer/Developer, with outstanding … on some of the most modern, innovative software in finance. you will get the opportunity to build one of the most scalable and performant data platforms, not only in the finance space, but in the world. Working alongside some of the smartest people in Paris, you will get a more »

for an interview, please make sure your application is full in line with the job specs as found below. Are you a leader in data engineer with the experience and drive to lead a team of talented Data Engineers to success? Are you passionate about building and … supporting data capabilities that are essential to DWP services? Do you want to be involved in projects that have genuine impact on millions on UK citizens? DWP Digital is transforming the way government services work, an... JBLK1_UKTJ more »

Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security policies. Essential … Technical Skills 2-3 years Azure data systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. Building Azure data pipelines. Agile methodology more »

Top Employer” as part of the Top Employer Institute annual listings. We were assessed on several key HR practices including Diversity and Inclusion. Role : Data Lake Engineer Key Responsibilities Help customers learn and use AWS services such as Athena, Glue, Lambda, S3, DynamoDB, NoSQL, Relational Database Service (RDS … Amazon EMR and Amazon Redshift Deliver on-site technical engagements with customers. This includes understanding customer requirements, and creating packaged Data & Analytics service offerings Proving the use of AWS services to support new distributed computing solutions that often span private cloud and public cloud services. Engagements will include migration … greater value from use of AWS cloud services Engage with the customer’s business and technology stakeholders to create a compelling vision of a data-driven enterprise in their environment Qualifications Bachelor’s degree, or equivalent experience, in Computer Science, Engineering, Mathematics or a related field Experience of IT more »

Senior Data Platform Engineer Location: 🌐 Hybrid working across the UK with a central London base of operations 🌐 Eligibility: You must either possess or be eligible to apply for Security Clearance (SC) Salary range: 💷 £80,000 to £105,000 💷 Technology: AWS/Azure, Python, CI/CD Burns Sheehan more »

ASSOCIATE BUSINESS ENGINEER HYBRID - 2 DAYS IN THE OFFICE A WEEK LONDON UP TO £70K This role does not offer sponsorship THE COMPANY A global asset management firm specialising in credit investments, that has a strong reputation for innovation to their investment approach and delivering value to their clients … THE ROLE AND RESPONSIBILITIES This role will focus on the designing, development, and implementation of data, platforms, processes, and reporting across the business In this role you will be: Delivery of data processing pipelines for the analytics team Assisting in streamlining the current data flows and reporting … optimising existing business workflows, identifying opportunities for automation and efficiency improvements Providing ongoing support maintaining implemented solutions, and troubleshooting issues as they arise Ensuring data integrity and accuracy YOUR SKILLS AND EXPERIENCE Please apply if you have the following experience: Demonstrable experience being a SQL or Python developer A more »