Dudley, West Midlands, United Kingdom Hybrid / WFH Options
Get Recruited (UK) Ltd
processes and uncover valuable insights from complex datasets. Key Responsibilities: Design and maintain interactive Power BI dashboards and reports Develop complex SQL queries for ETL processes Work with stakeholders to identify KPIs and translate business requirements Apply advanced analytics and AI/ML techniques where appropriate Manage MS Dynamics more »
Leeds, England, United Kingdom Hybrid / WFH Options
Fruition IT
managing scalable data pipelines. Experience in a similar capacity, with a focus on designing and implementing robust data pipelines and infrastructure. Thorough knowledge of ETL processes, with the ability to optimize data extraction, transformation, and loading. Extensive commercial expertise with AWS, including services like Glue, Data Catalog, R and large more »
execution and data quality checks for the migrations you conduct. Key Skills: SQL Migration (On-prem to Cloud/On-prem to On-prem) ETL (Databricks, Data Factory, SSIS) Azure Communication Stakeholder management If the above sounds suitable then please apply! *Please note that we do not offer sponsorship, so more »
Lincoln, Lincolnshire, East Midlands, United Kingdom Hybrid / WFH Options
Frontier Agriculture Limited
influence stakeholders on why they should be built. You will look backwards at the data warehouse process and enable reports that can monitor the ETL estate. Your Role As a Software Developer your role will involve: Actively participate in all Agile ceremonies Working with other developers to design algorithms andmore »
and prioritisation skills Technical requirements and professional skills: IT skills - strong working knowledge of MS Office/Office365 Suite MS Fabric/Azure Databricks ETL Methodology PowerPoint You'll be able to be yourself; we'll recognise and value you for who you are and celebrate and reward your contributions more »
join their team. Key Responsibilities: Design, build, and maintain scalable data pipelines and architectures tailored to client requirements. Develop ETL processes to extract, transform, andload data from various sources into centralised systems. Optimise data storage and retrieval for efficiency and cost-effectiveness, considering client-specific contexts. Collaborate with data more »
Leeds, England, United Kingdom Hybrid / WFH Options
Mastek
Leeds, UK Roles & Responsibilities: Be a part of an end-to-end data migration projects, ensuring data integrity and quality. Develop, implement, and optimize ETL/ELT processes using ODI, OBIEE, Workato and PL/SQL. Design and build data solutions on Azure, leveraging Databricks, Data Factory, and other Azure … Required Skills Primary Skills: ODI, OBIEE: Advanced knowledge and hands-on experience. Oracle SQL, PL/SQL: Proficiency in writing complex queries and scripts. ETL/ELT concepts: Strong understanding and practical implementation experience. Azure Technologies: Databricks, Data Factory: Expertise in data engineering and orchestration. DevOps, Storage Explorer, Data Studio more »
Greater London, England, United Kingdom Hybrid / WFH Options
Aventum Group
Store the normalised data in the data warehouse or in a relational database. Data normalisation and modelling as part of the transform step of ETL/ELT pipelines. Model business logic, extract key performances metrics, and create reusable data structures. Maintain data so that it remains available and usable e.g. … SQL (Basic, Advanced modelling, Efficient, Big Data and Programmatic). Data managing such as reshaping, aggregating, joining disparate sources, etc. small-scale ETL, API interaction, and automation e.g. Python. Interface with cross-functional teams to build centralised tools that will allow for rapid defect detection and repair. Analyse and synthesize more »
customer based in London that are looking for a Lead Data Engineer that will focus on enhancing and transforming the data capabilities including their ETL processes, automation, assessing and implementing performance improvements to existing pipelines and cloud setup and also lead a small team of data engineers in a hands more »
systems with cloud platforms, especially AWS (S3, Lambda, Redshift). Strong background in Java and Python, with knowledge of SQL/NoSQL databases andETL processes. Although a senior position, this is still hands-on 80% of the time. Familiarity with data governance, security, and data warehousing architectures. Experience in more »
You’ll Bring Experience : 3+ years in data engineering, with a strong focus on financial data. Technical Expertise : Proficiency in SQL, data modeling, andETL processes. Vendor Knowledge : Familiarity with external financial data vendors, especially Bloomberg. Programming Skills : Proficiency in Python or Java for data management and integration. more »
AWS services like EC2, S3, IAM, Lambda, RDS, VPC. •Proficiency in Python, Scala, or SQL for data engineering tasks. •Solid understanding of Apache Spark, ETL pipelines, and big data processing. •Familiarity with DevOps practices, automation tools (Terraform, Ansible), and CI/CD pipelines. more »
in executing data transformation projects. Knowledge of Data Lake architecture and cloud platforms such as AWS, Azure, or Google Cloud. Proficiency in data modelling, ETL processes, and data governance. Important Note: As part of the onboarding process, associates will undergo comprehensive financial and criminal background checks, which may take up more »
ML libraries like TensorFlow, PyTorch, and Scikit-learn. Skilled in cloud-based deployment (eg, AWS, Azure, GCP) and experience with big data tools andETL pipelines. Exceptional problem-solving abilities with a collaborative approach. Strong communication and leadership skills, adept at managing and motivating teams. Ability to operate effectively in more »
Redshift, RDS, EMR Cluster and IAM) ? Programming Languages (PySpark, Python) ? Big Data Processing Frameworks (Spark) ? Data Modelling ? Database Management and Advanced skill of SQL ? ETL Process tools such as Apache, AWS Glue ? BIG Data Technologies Familiar with Hadoop, Spark, Hive, SQS and DTO for processing large datasets ? Data Pipeline andmore »
experienced Data Engineer with a strong knowledge of modern data engineering tools and best practices You have a strong knowledge of Data Warehousing andETL You have indepth experience with DataMesh including putting it into production You have strong Python coding skills You have experience with Spark and Data Bricks more »
Lake, Databricks). Extensive experience with cloud-based data platforms, particularly in Microsoft Azure. Proficiency in using Azure SQL Database, Azure Data Factory for ETL processes, Azure Data Lake Storage for scalable data storage, and Azure Stream Analytics for real-time analytics. Familiarity with Azure Purview for data governance andmore »
Docklands, London, Royal Docks, United Kingdom Hybrid / WFH Options
Aatom Recruitment
resources such as ADLS, Synapse, Databricks, Stream Analytics, SQL DW, COSMOS DB, Analysis Services, and Azure Functions. You should be skilled in data modelling, ETL processes and SQL-based analytics, and have experience in building and optimising 'big data' pipelines, architectures, and data sets. You'll be a good communicator more »
functional teams to ensure that data models align with business processes, financial products, and reporting needs. Experienced in collaborating with data architects, engineers, andETL developers to implement models and support data integration, migration, and quality assurance efforts. Familiarity with SDLC process, version control systems (Git) and CI/CD more »
Nottingham, Nottinghamshire, United Kingdom Hybrid / WFH Options
Akkodis
Are you Data Engineering enthusiast who thrives from designing and implementing robust ETL processes, highly scalabale data structures and data pipelines within a truly enterprise-scale environment.. Look no further. My client launched their award-winning, enterprise-scale SaaS platform under 5 years ago and it has since revolutionized its more »
Edinburgh, York Place, City of Edinburgh, United Kingdom Hybrid / WFH Options
Quorum Network Resources
Microsoft Azure Carrying out SQL Server performance reviews and tuning work at both small and very large scales Upgrade/consolidation/migration projects ETL project work including SSIS and Azure Data Factory What we are looking for in our new SQL DBA: 3+ years of experience as a SQL more »
Nottingham, Nottinghamshire, United Kingdom Hybrid / WFH Options
Akkodis
Are you Data Engineering enthusiast who thrives from designing and implementing robust ETL processes, highly scalabale data structures and data pipelines within a truly enterprise-scale environment? If so - look no further. This is your chance to help my client build their new Data Infrastructure and essentially help them to more »
b. Ability to work other relevant programming languages such as R or Python (A/I/T) c. Able to create and run ETL packages using SQL Service Data Tools (A/I/T) d. Expert use of Excel, including experience in building models within Excel (A/ more »
Job title Data Engineer Contract :Telford 6 Month Contract Skills: Talend, Client RDBMS, AWS, CICD, Talend ETL, ETL SC is required for this role. We require a software engineer with experience of ETL tooling and processes, ideally within Talend and usage of Client RDS databases. Software engineering experience ETL projects … and development. Talend Client RDS Pentaho/Informatica/other ETL tooling Other database software experience Deployment pipelines Monitoring and alerting development (Grafana more »
Greater London, England, United Kingdom Hybrid / WFH Options
X4 Technology
in the United Kingdom. AWS (Redshift) Data Engineer Responsibilities: Data Integration: Configure AWS Glue to automate data ingestion into Amazon Redshift. Develop and manage ETL processes using AWS Glue for data extraction, transformation, and loading. Data Modelling: Design and maintain Amazon Redshift schema for performance and business needs. Use AWS more »