of a team of engineers looking after and building a zero-down time low latency infrastructure Scaling and optimizing some of the most performant ETL pipelines on the planet Conducting R&D for functional programming within the firm Building out a DevOps environment from scratch in a Software Engineering Capacity … Python programming experience Knowledge of Monitoring tools is a plus Knowledge of configuration management, IaC, CI/CD etc is a plus! Exposure to ETL pipelines is a nice to have! Strong experience with functional programming languages etc. Exposure to build tools (e.g. CMake or Bazel) is a plus A more »
City of London, London, United Kingdom Hybrid / WFH Options
Develop
their next step in their career and wants to take on more responsibility. Technical Skillset: Experience as a data engineer developing and maintenance of ETL/ELT processes Good experience in Data Modeling within a cloud-based data platform Strong experience with SQL Server Azure data engineering stack, including Azure more »
Greater London, England, United Kingdom Hybrid / WFH Options
Validis
believe in the power of being... YOU! About the role We are seeking a highly skilled Senior Data Engineer with a strong focus on Extract, Transform, Load (ETL) processes to join our growing team. This role will be fully remote, offering flexibility and the chance to contribute significantly to our … data infrastructure. Key responsibilities of the Senior Data Engineer; Design, develop, and implement robust ETL pipelines to extract data from various sources (databases, APIs, etc.). Cleanse, transform, and validate data to ensure high quality and consistency before loading it into data warehouses or data lakes. Designing and implementing CI …/CD workflows for data engineering projects. Optimize ETL processes for efficiency, scalability, and performance. Develop and maintain documentation for data pipelines and data models. Troubleshoot and resolve ETL-related issues, ensuring data accuracy and integrity. Collaborate with data analysts, data scientists, and other engineers to understand data needs andmore »
London, England, United Kingdom Hybrid / WFH Options
McGregor Boyall
seeking Senior Data Engineers to contribute to innovative data projects within a leading financial institution. Key Responsibilities: Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions. Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines. Distributed Processing: Work with Hadoop, Spark, andmore »
London, England, United Kingdom Hybrid / WFH Options
AWTG Ltd
development processes. Additional duties as needed. Preferred Skills: Experience with additional frameworks and libraries such as PyTorch or TensorFlow. Knowledge of data engineering andETL processes. Experience with version control systems, particularly Git. Knowledge of telecommunications technologies and industry standards. Qualifications: Bachelor's or Master's degree in Computer Science more »
technical colleagues and providing updates on data activity progress. Proficient in SQL and data modeling. Experience with Python Extensive technical expertise in data warehousing, ETL processes, and BI reporting technologies. Experience in working with and administering modern BI platforms like Looker, Qlik, Domo, or Power BI. Please contact Joely Callaghan more »
London, England, United Kingdom Hybrid / WFH Options
Jobleads-UK
frameworks and platforms Agile and Continuous Delivery Continuous integration pipelines Strong Python AWS or Azure with large-scale streaming data (Pulsar, Kafka, Kinesis, etc) ETL management; structured or custom (Airflow, Luigi, etc) Bonus Robust experience managing and developing an engineering team Delta lake or Iceberg Trino or Presto Graphql Good more »
environments Excellent knowledge of data technology, data transformation tools, and data governance techniques Good understanding of Quality and Information Security principles Experience with Azure, ETL Tools such as ADF and Databricks Advanced Database and SQL skills, alng with SQL, Python, Pyspark, Spark SQL Strong understanding of data model design andmore »
London, England, United Kingdom Hybrid / WFH Options
Data Idols
are looking for a new challenge, please submit your CV for initial screening and more details. Data Architect Desired Skills and Experience AWS|Snowflake|ETLmore »
data models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the … and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of more »
and driven by success. They are looking for someone who can promote engineering standards, best practices, and testing while building out APIs, Cloud-based ETL pipelines, customer UIs, and end-to-end data processing solutions.Ideally, you will have strong JavaScript/TypeScript, Python, and AWS experience, as well as a more »
understanding of data integration principles, methodologies, and technologies Ability to dissect complex data integration challenges and devise effective solutions Familiarity with various database systems, ETL processes, and APIs to ensure efficient integration solutions Knowledge of relational and non-relational database systems, including SLQ & Oracle Ability to understand and construct complex more »
the efficiency and performance of data models, focusing on improving fitness-for-purpose, increasing accessibility of data, reducing runtimes, and eliminating wasteEstablish and maintain ETL pipelines for our Snowflake Data Warehouse, adhering to the best practices in data integration, management, and protection of personally identifiable informationAdvise engineering leaders on analytical … solving abilities, with a proactive and autonomous approach to workAdded bonusComponents used in our Data Stack: Fivetran, Prefect, Snowflake, dbt and PeriscopeExperience in writing ETL pipelines with SQL and Python, using orchestration tools like Airflow or PrefectExperience working in fast-paced venture-backed startup environmentsAt Fresha, we value passion andmore »
London, England, United Kingdom Hybrid / WFH Options
Spectrum IT Recruitment
and day to day operations. Knowledge and experience in NEC's data loaders and configuration will be essential. You will also develop and manage ETL workloads to run predictably, efficiently and effectively whilst monitoring, maintaining and supporting all data management services and processes, liaising with IT, service vendors and internal … data exploration. Identification and resolution of problems in databases, data processes, data products and services Analysis and reporting of test activities and results Extensive ETL experience Experience of other housing management systems such as Active H, Open Housing or Northgate would be highly beneficial Spectrum IT Recruitment (South) Limited is more »
/Contract-to-hire Responsibilities: Data Engineering: Collaborate with cross-functional teams to design and implement data pipelines, ensuring efficient extraction, transformation, and loading (ETL) processes. Work with diverse healthcare datasets, integrating and cleaning data from various sources to create a unified and reliable data infrastructure. Develop and maintain databases … our service offerings. Qualifications: Bachelor's degree in Computer Science, Data Science, or a related field. Strong foundation in data engineering, including experience with ETL processes, data modeling, and database management, as well as SQL. Knowledge of healthcare industry standards, regulations, and data interoperability. Familiarity with AI and machine learning more »
London, England, United Kingdom Hybrid / WFH Options
Zego
You will be responsible for making data available to internal and external stakeholders in a digestible form. This might include designing and create appropriate ETL processes and partnering with the Data Analytics and Data Engineering teams to implement them You will work closely with Customer Support, Product and Engineering teams … Engineering, Finance, Economics, or similar Familiarity with Python or R Previous experience in a rapidly growing startup, InsurTech, or FinTech Prior experience in developing ETL processes and financial modeling What's it like to work at Zego? Joining Zego is a career-defining move. People go further here, reaching their more »
London, England, United Kingdom Hybrid / WFH Options
Client Server
tech team. As a Data Developer you'll focus on building data systems, using the latest .Net technology to develop pipelines to extract, transformandload financial data from disparate sources, build out the company's data collection platform to incorporate new sources and markets and validate the quality of more »
London, England, United Kingdom Hybrid / WFH Options
Data Idols
opportunity to work at scale with a fantastic team of people to build out a Data Warehouse to implement changes and improvements within the ETLand Data Warehouse products. Working with Ab Initio at scale is a highly desirable skill for this position. The Opportunity Work at scale with one … of the largest data organisations in the world Implement changes and improvements within the ETLand Data Warehouse products. Be a key part of changing business requirements and large-scale changes Develop ETL routines using Ab Initio What's in it for you? £60,000 - £65,000 Bonus Eye Care … Life Assurance Skills and Experience Ab Initio SQL GCP Strong communicator and proactive attitude ETL If you would like to be considered for the role and feel you would be an ideal fit with our team then please send your CV to us by clicking on the Apply button below. more »
Data Engineering Manager A brand-new and exciting opportunity has arisen for a Data Engineering Manager with extensive experience in Azure, SQL, ETLand mentoring/managing engineers to join the UK's Largest Charity based remote. The Data Engineering Manager will be intrumental in their migration over to Azure … the data engineering function. If you are currently a Data Engineering Manager who has a strong experience in Azure (ADF, Databricks, Data Lake), SQL, ETLand mentoring/managing a team who is looking for a step up then this would be perfect for you! Skills that are required for … Data Lake) Experience leading/mentoring/managing a team and keen to manage a bigger team Strong data engineering principles working with SQL, ETL Pipelines and Cloud infrastructure Keen to work in a large charity Data Engineering Manager/Lead Data Engineer/Data Engineering/Azure/SQL more »
SE1, Chaucer, Greater London, United Kingdom Hybrid / WFH Options
Royal College Of Obstetricians And Gynaecologists
through to developing user reports. They will work on the technical aspects of system integration and be involved in the development and maintenance of ETL (extract, transform, load) processes across all systems. The post holder will work closely with colleagues across the organisation to gather requirements and ensure data integrity … ensure that our technical solutions are fully integrated into business processes. Responsibilities: Advanced T-SQL and SSIS development for the creation and maintenance of ETLand reporting solutions. To lead the development and maintenance of custom applications to provide bespoke functionality, for example using .NET Framework, C# or Python. Development … expertise to internal stakeholders for College supported databases. Requirements: Experience of Advanced T-SQL querying and development: Stored Procedures, Views, functions etc. Experience of ETL development using SSIS or similar Knowledge of database and data warehouse design principles Experience of developing and maintaining custom applications to provide bespoke functionality, for more »
City of London, London, United Kingdom Hybrid / WFH Options
Adecco
teams to understand data requirements and design efficient data pipelines. Develop and maintain scalable data models and databases. Design and implement data integration andETL/ELT processes. Optimise and tune data storage and retrieval processes. Collaborate with the Data Science team to implement machine learning algorithms and AI models. … and Python Proficiency in building and optimising data pipelines, architectures, and datasets Familiarity with Medallion architecture and data lakes. Experience with data integration andETL/ELT processes. Knowledge of DataOps principles and experience with CI/CD tools Strong problem-solving and troubleshooting skills. Excellent communication and collaboration skills. more »
API design, RESTful APIs, and other integration protocols. Ideally some knowledge of Azure cloud technologies and Terraform IaC Knowledge of data integration patterns andETL processes is important for effectively moving and transforming data between different systems. Understanding cloud security best practices, data privacy laws, and compliance standards. Knowledge of more »
South East London, London, United Kingdom Hybrid / WFH Options
Stepstone UK
Occasionally, being able to lend hands-on support to the team working on and using the following technologies:Data Warehousing, Data Modelling, Database Design, ETL, AWS Redshift, SQL Server, Power BI, Cloud/DevOps AWS, Docker, Terraform, Bitbucket, Bamboo, Team City, Octopus CI/CD deploy pipeline, Agile, pair programming more »
experience within the industry Lead Engineering engagement with Actuarial SMEs and Underwriters Mentor Analytics Engineering team members to develop and maintain end-to-end ETL processes Maintain a high level of coding and technical standards across the team Demonstrate a high level of technical capability in Python, SQL, and JSON more »
Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure Data Factory Data warehouse development experience using Azure Synapse Analytics Experience with Snowflake would be desirable but not essential Excellent communication more »