151 to 175 of 504 Data Engineer Jobs

Scalexperts are partnered with a VC backed education group who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function. They are looking for a Senior Data Engineer to join them to work on building a brand new … data platform which is still in early stage development. They are looking to combine all the data into one common data platform heavily on Azure so that reporting & insight/analytics becomes much clearer and more consistent. This role will require someone to line manage 2 data … first time! Previous management is not essential at all! Key Experience Required: In-depth knowledge of and experience with Databricks 3+ years experience in Data Engineering Azure experience ideally worked with tools such as Synapse, Azure Data Factory, Data Lake etc Experience with SQL is a must more »

DATA ENGINEER – UP TO £60,000! Location : Sheffield Benefits: 25 Days + Bank Holidays! Life Assurance! Flexible Working! Company: A chance to have a positive societal impact if you launch yourself into a fast growing, but firmly established, company in the much sought after EdTech sector APPLY NOW … Responsibilities: To build and maintain scalable data pipelines To gather requirements and deliver data projects To document processes and data pipelines To maintain a backlog of future improvements/features in Jira To build effective relationships with technical and non-technical colleagues Requirements: Should have exceptional SQL … skills Should have data pipeline development experience in Python Should have experience with AWS tools including Glue & Lambda Should have an understanding of CI/CD concepts Should have an understanding of different data warehouse architectures Salary They offer an excellent salary of up to £60,000 per more »

Data Engineer | Yorkshire | up to £45,000 basic | Flexible Working A regular feature in the "UK's Top 10 places to work", my client is an award-winning business with a reputable brand and is widely respected for investing in their employees, placing importance on personal development and … career progression. The Environment you'll be joining: You'll join a friendly 10+ Data Engineering team as the business undergoes a complete greenfield re-architecture from the ground up in Microsoft Azure. The Tech you'll be playing with: Azure Data Factory Azure Databricks PySpark SQL DBT … What you need to bring: 1-3 year's experience in building Data Pipelines SQL experience in data warehousing Python experience would be desirable Experience in Azure/GCP/AWS is a bonus Why join? Joining an award-winning business comes with its perks. Outside of the more »

Are you an experienced Data Engineer ? Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ? Its a Hybrid working role and you will be based from either their London, Leeds, Manchester or Edinburgh office, typically 3 days a week … from home and 2 day in office/on client site. Responsibilities: Developing and optimizing data pipelines Building and maintaining data architectures Leading projects and teams Ensuring data quality and integrity Preferred skills: Proficiency in AWS Glue, AWS Redshift, and Python Experience with ETL processes, data integration, and data warehousing. Strong SQL skills Experience with Big Data technologies such as Hadoop, Spark, and Kafka Familiarity with cloud platforms (AWS, Azure, Google Cloud) Working knowledge of data visualisation tools (PowerBI, Tableau, Qlik Sense) Additional skills: Client-facing and communication skills Leadership and mentoring more »

Matillion Specialist Data Engineer (Snowflake) Start: June Location: Hybrid/West Midlands Rate: £450-525 per day, OUTSIDE IR35. Duration: 6 Months - extension possible. iO Associates are working exclusively with a Data Analytics company who are looking for a Matillion Specialist Data Engineer within Snowflake more »

Complexio is Foundational AI. This works to automate business activities by ingesting whole company data – both structured and unstructured – and making sense of it. Using proprietary models and algorithms, Complexio forms a deep understanding of how humans are interacting and using it. Automation can then replicate and improve these … Marfin Management, C Transport Maritime, Trans Sea Transport and BW Epic Kosan. Key Responsibilities 👥 Collaborate with cross-functional teams to design and build scalable data solutions that support product innovations and business insights. 🔨 Develop and maintain robust data pipelines that support complex data collection, ingestion, and transformation … processes. 🧑‍💻 Work closely with R&D within data science and AI to provide data. 📈 Design and implement mechanisms for data validation, quality, and reliability to ensure the accuracy and trustworthiness of data sources. 🪲 Diagnose and resolve data-related issues to improve the performance and scalability of more »

Leading ecommerce client now requires a Data Engineer to join their innovative Machine Learning team. This role will focus on increasing overall data efficiency using Machine Leaning, streamlining data processes to increase overall profitability, and ensuring our clients operations and customer teams can increase overall value. … with strong exposure to Machine learning principles/practices and technologies such as ML flow/Sage Maker. The role: Develop robust and scalable data pipelines. Collaborate with cross-functional teams to develop and deploy Machine Learning models and algorithms to solve business challenges and create opportunities. Contribute to … the development of our clients in-house Machine Learning operations framework. Support the data science and analytics team in deploying pipelines. Coach and mentor the team to improve development standards. Key requirements: Strong hands-on experience with Databricks, Spark, SQL or Scala. Proven experience designing and building data more »

We are looking for an experienced Senior Data Engineer passionate about designing and building high-quality data pipelines to power cutting-edge genAI products. The ideal person would have a strong background and expertise in real-time data streaming and cloud technologies. They would also be … . The person we’re looking for We are looking for a self-starter who can see the big picture and understand how our data points are connected. You should be able to use your excellent communication skills to simplify and explain concepts to others. You will also be … and bringing out the best in them, have excellent communication skills and enjoy fostering best practices. You’ll be responsible for Serving as a data engineering subject matter expert Owning and shaping our data streaming roadmap Collecting use cases and requirements from the wider data team and more »

Data Integration Engineer We require a Data Integration Engineer to join a new function within the Data Services area of IT Services. The team will help to establish an API-led approach to integrating our clients complex systems landscape. That approach will provide scalable and more »

Are you an experienced Data Engineer ? Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ? Its a Hybrid working role and you will be based from either their London, Leeds, Manchester or Edinburgh office, typically 3 days a week … from home and 2 day in office/on client site. Preferred skills: SAS Data Engineering Proficiency in SQL and/or similar data technologies Familiarity with data pipeline tools and ETL processes Knowledge of cloud platforms and data architecture Experience working in the Retail Banking more »

About The RoleHippo Digital is recruiting for a Principal Data Engineer to join our Hippo Herd. Principal Data Engineers work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. Hippo’s Principal Data Engineers are … experts in their field. You will act as a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships and be passionate about developing and upskilling others.Your role in nutshell:Act as a … stakeholders, identifying and ensuring that challenges are overcomeLead in the recruitment of other engineers, and support other consultants in their professional developmentEnsure Hippo’s Data and Engineering communities contribute to Hippo’s business at a strategic levelLead on new business opportunities, writing technical bids and proposalsPromote Hippo’s Data more »

About The RoleHippo Digital is recruiting for a Principal Data Engineer to join our Hippo Herd. Principal Data Engineers work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. Hippo’s Principal Data Engineers are … experts in their field. You will act as a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships and be passionate about developing and upskilling others.Your role in nutshell:Act as a … stakeholders, identifying and ensuring that challenges are overcomeLead in the recruitment of other engineers, and support other consultants in their professional developmentEnsure Hippo’s Data and Engineering communities contribute to Hippo’s business at a strategic levelLead on new business opportunities, writing technical bids and proposalsPromote Hippo’s Data more »

About The RoleHippo Digital is recruiting for a Principal Data Engineer to join our Hippo Herd. Principal Data Engineers work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. Hippo’s Principal Data Engineers are … experts in their field. You will act as a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships and be passionate about developing and upskilling others.Your role in nutshell:Act as a … stakeholders, identifying and ensuring that challenges are overcomeLead in the recruitment of other engineers, and support other consultants in their professional developmentEnsure Hippo’s Data and Engineering communities contribute to Hippo’s business at a strategic levelLead on new business opportunities, writing technical bids and proposalsPromote Hippo’s Data more »

About The Role We are recruiting for a Principal Data Engineer to join our team. Principal Data Engineers work in multi-disciplinary teams that build, support, and maintain user-centered digital solutions that offer real value and work for everyone. Our Principal Data Engineers are experts … in their field. You will act as a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships, and be passionate about developing and upskilling others. Your role in a nutshell: Act as … identifying and ensuring that challenges are overcome. Lead in the recruitment of other engineers, and support other consultants in their professional development. Ensure our Data and Engineering communities contribute to our business at a strategic level. Lead on new business opportunities, writing technical bids and proposals. Promote our Data more »

Position: Data Engineer - 55k-60k GBP + bonus Industry: Insurance Workplace: Hybrid 🏡 - 2 days per month in the office....or more if you'd like :-) Location: Surrey The 4 main things we need are.... Someone who's a good team player Experience with Python programming A good understanding of … Azure technologies Financial Services domain knowledge Do you tick these 4 boxes? Must haves: Python coding experience (Pure Python) Data modelling, data warehousing and ETL frameworks SQL Our client have 2,500 lines of Python code for you to maintain and optimize. You'll need hands-on coding more »

Position: Data Engineer - 55k-60k GBP + bonus Industry: Insurance Workplace: Hybrid 🏡 - 2 days per month in the office....or more if you'd like :-) Location: Surrey The 4 main things we need are.... Someone who's a good team player Experience with Python programming A good understanding of … Azure technologies Financial Services domain knowledge Do you tick these 4 boxes? Must haves: Python coding experience (Pure Python) Data modelling, data warehousing and ETL frameworks SQL Our client have 2,500 lines of Python code for you to maintain and optimize. You'll need hands-on coding more »

Senior Data Engineer AWS/Bedrock/Glue/EKS/Redshift Contract - Inside - London Harrington Starr have partnered exclusively with a long-standing client of ours within the commodities trading space who are looking to increase headcount within their Data Engineering team at the start of … the year here with 2024. The role will require you to have: 5+ years data engineering background working on cloud architecture Must have specific experience with AWS Bedrock and other newer technologies Cloud experience (AWS Redshift) would be beneficial Power BI or another similar technology would be an advantage more »

The OpportunityReporting into the Head of AI Platforms, the ML/Gen AI Lead will manage all the processes from data collection, cleaning, and preprocessing, to training models and deploying them to production for the enterprise AI platforms.The RoleCollaborate with project teams to ensure that ML/Gen AI … solutions align with business requirements and data governance standards.Recommend new artificial intelligence and machine learning technologies to improve the effectiveness of our data infrastructure.Verify data quality, and/or ensuring it via data cleaning including supervising the data acquisition process if more data is … are implemented with the understanding of an emerging AI ethics framework.Define the preprocessing or feature engineering to be done on a given dataset, defining data augmentation pipelines.Train models and tuning their hyperparameters, analyzing the errors of the model and designing strategies for continuous improvement pipeline.Develop machine learning (ML) or more »

UK’s leading marketplace platform is looking for a Principal Data Engineer to take a lead on several aspects of their data platform built in Python, Airflow, Kafka, Sagemaker, AWS and GCP. 💰 Salary: up to £130k + 15% bonus 📍 Location: can be based anywhere in the UK … Must have requirements: Mastery of Python and SQL Significant experience with orchestration tools, ideally Airflow Strong Data Architecture experience Cloud expertise in either GCP or AWS (ideally in both) Knowledge of MPP systems such as Athena, BigQuery, EMR, Hive, Iceberg Exposure to data streaming technologies such as Kafka more »

operating with 10 locations across the country and fast approaching 1000 employees. As part of their growth they are now looking for an experienced Data Engineer to join their London office. The ideal candidate for this role will be experienced in migrating data from various sources into … efficiency throughout. Skills & Experience: Holds a bachelor's or Master's degree in Computer Science or related fields. Proven experience with Insurance Broking Systems data migration (ideally Acturis). Proficiency in SQL and data manipulation languages. Experience with ETL tools. Strong analytical and critical thinking skills, with a … focus on practical solutions. Excellent communication and people skills for conveying data concepts to diverse audiences. Proven ability to collaborate with cross-functional teams and build strong relationships. Agile/Scrum/Kanban experience. Benefits: Competitive base salary (DOE). To be discussed on intro call. Hybrid work place more »

Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security policies. Essential … Technical Skills 2-3 years Azure data systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. Building Azure data pipelines. Agile methodology more »

Top Employer” as part of the Top Employer Institute annual listings. We were assessed on several key HR practices including Diversity and Inclusion. Role : Data Lake Engineer Key Responsibilities Help customers learn and use AWS services such as Athena, Glue, Lambda, S3, DynamoDB, NoSQL, Relational Database Service (RDS … Amazon EMR and Amazon Redshift Deliver on-site technical engagements with customers. This includes understanding customer requirements, and creating packaged Data & Analytics service offerings Proving the use of AWS services to support new distributed computing solutions that often span private cloud and public cloud services. Engagements will include migration … greater value from use of AWS cloud services Engage with the customer’s business and technology stakeholders to create a compelling vision of a data-driven enterprise in their environment Qualifications Bachelor’s degree, or equivalent experience, in Computer Science, Engineering, Mathematics or a related field Experience of IT more »

Senior Data Platform Engineer Location: 🌐 Hybrid working across the UK with a central London base of operations 🌐 Eligibility: You must either possess or be eligible to apply for Security Clearance (SC) Salary range: 💷 £80,000 to £105,000 💷 Technology: AWS/Azure, Python, CI/CD Burns Sheehan more »

ASSOCIATE BUSINESS ENGINEER HYBRID - 2 DAYS IN THE OFFICE A WEEK LONDON UP TO £70K This role does not offer sponsorship THE COMPANY A global asset management firm specialising in credit investments, that has a strong reputation for innovation to their investment approach and delivering value to their clients … THE ROLE AND RESPONSIBILITIES This role will focus on the designing, development, and implementation of data, platforms, processes, and reporting across the business In this role you will be: Delivery of data processing pipelines for the analytics team Assisting in streamlining the current data flows and reporting … optimising existing business workflows, identifying opportunities for automation and efficiency improvements Providing ongoing support maintaining implemented solutions, and troubleshooting issues as they arise Ensuring data integrity and accuracy YOUR SKILLS AND EXPERIENCE Please apply if you have the following experience: Demonstrable experience being a SQL or Python developer A more »

Our client are a rapidly growing organisation who are looking to further expand their capabilities. They would like to hire a Data Ops Engineer who would be able to start moving the team in the right direction & work from a hands on perspective to deliver a variety of … things (below): • Automating SQL Releases internally and via enterprise 3rd parties • Working closely with the DevOps teams using Octopus Deploy • Good focus on Data protection and security • Good cloud experience, any experience migrating to Azure would be great • Someone who is conscious of new tech/new ways of more »