Databricks Spark Delta Lake SQL Python PySpark ADLS Day To Day Responsibilities: Extensive experience in designing, developing, and managing end-to-end data pipelines, ETL (Extract, Transform, Load), and ELT (Extract, Load, Transform) solutions. Maintains a proactive approach to staying updated with emerging technologies and a strong desire to continuously more »
DN4 5PL, Doncaster, South Yorkshire, United Kingdom Hybrid / WFH Options
Keepmoat
Business Intelligence/Analytics (Power BI). They will have experience with Microsoft BI stack, relational database and SQL experience alongside experience working with ETLand/or data integration tools (preferably Informatica). Experience working in an agile environment (preferably with Azure DevOps) is also essential. Experience within the more »
Manchester Area, United Kingdom Hybrid / WFH Options
Airtime Rewards
Requirements Bachelor’s degree in Computer Science, a relevant technical field, or equivalent experience. Experience designing cloud data warehouse solutions, data modelling, and building ETL/ELT processes, preferably on GCP or equivalent platforms (AWS, Azure, Snowflake). Proficiency with SQL, Python, Docker, and Terraform (or similar IaC tools). more »
development, Blazor, NServiceBus, CQRS and Domain-driven design, Scrum/Agile, API Design and management skills Data Engineering projects using Data Lakes, Data factories, ETL techniques, Synapse and PowerBI MS Logic and Power Apps Azure DevOps Experience with the following would be beneficial: AI + Machine Learning Analytics: Analysis Services more »
West London, London, United Kingdom Hybrid / WFH Options
Morgan Hunt UK Limited
/SQL Proven expertise with Microsoft SQL Server Integration Services and BI tools like Power BI, Power Pivot, and SSRS Experience in data warehousing, ETL, data modelling, and data orchestration Excellent stakeholder management and communication skills A degree in Computer Science, IT, or a related STEM subject Morgan Hunt is more »
City Of London, England, United Kingdom Hybrid / WFH Options
Morgan Hunt
/SQL Proven expertise with Microsoft SQL Server Integration Services and BI tools like Power BI, Power Pivot, and SSRS Experience in data warehousing, ETL, data modelling, and data orchestration Excellent stakeholder management and communication skills A degree in Computer Science, IT, or a related STEM subject Morgan Hunt is more »
demonstrate working on large engagements * Experience of AWS tools (e.g. Athena, Redshift, Glue, EMR) * Java, Scala, Python, Spark, SQL * Experience of developing enterprise grade ETL/ELT data pipelines. * Deep understanding of data manipulation/wrangling techniques * Demonstrable knowledge of applying Data Engineering best practices (coding practices to DS, unit more »
model to meet new business requirements2+ years managing an analytics engineering team using a scrum/agile methodologyExperience working with commercial data warehouses (Redshift), ETL tools (Dbt), data visualization (Python notebook, Thoughtspot, Looker, Tableau, Hex), and Data Dictionary tools (Atlan)Demonstrated experience leading 2 or more multi-department analytics projects more »
open-source data engineering and scientific Python toolset. Our tech stack includes Airbyte for data ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity andmore »
Greater Bristol Area, United Kingdom Hybrid / WFH Options
Anson McCade
consulting firm. Proficiency in Azure data services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, etc. Strong understanding of ETL processes, data modeling, and data warehousing principles. Experience with programming languages such as SQL and Python. Familiarity with data visualization tools such as Power BI more »
and data transformation.Strong experience in managing and leading data engineering teams.Strong proficiency in Scala, Python, SQL, Snowflake and DBT.In-depth understanding of data modelling, ETL processes, and data warehousing concepts.Experience with cloud-based data platforms (e.g., AWS, Azure, GCP) and containerisation technologies (e.g., Docker, Kubernetes) is a plus.Excellent problem-solving more »
London, England, United Kingdom Hybrid / WFH Options
Aventum Group
responsible for accessing, validating, and querying data from various repositories using available tools. Build and maintain data integration processes using SQL Services and other ETL/ELT processes and scripting tools as well as ongoing requests and projects related to the data warehouse, MI, or fast-moving financial data. Designing … Architecting, building, testing, and maintaining data platform. Develop and support a wide range of data transformations and migrations for the whole business. Construct custom ETL processes: Design and implement data pipelines, data marts and schemas, access versatile data sources and apply data quality measures. Monitoring the complete process and applying … ML is a plus Experience with Azure SQL Database, Cosmos DB, NoSQL, MongoDB Experience with Agile, DevOps methodologies Awareness and knowledge of ELT/ETL, DWH, APIs (RESTful), Spark APIs, FTP protocols, SSL, SFTP, PKI (Public Key Infrastructure) and Integration testing Skills and Abilities Knowledge of Python, SQL, SSIS, andmore »
high-performance data systems that are foundational to driving business growth and success. Key responsibilities: Implementing scalable data architectures and systems. Developing and maintaining ETL (Extract, Transform, Load) pipelines. Managing data storage, backup, and recovery mechanisms. Writing complex SQL queries to extract data for analysis. Developing and implementing data security more »
requirements into technical requirements & development experience using data discovery tools such as MS Power BI, QlikView, Tableau Ability to model andtransform data, build ETL solutions and present data in a useful business context Experience developing data warehouses & data marts using the Kimball methodology Experience or awareness of Big Data more »
in your approach to designing and delivering high-quality solutions that meet or exceed client expectations.Responsibilities include:Architect Databricks Enterprise Data Platform solutions including ETL/ELT and Lakehouse architecture and design and lead use case delivery across a variety of use cases (e.g. legacy migrations, enterprise analytics, data engineering more »
Reading, Berkshire, United Kingdom Hybrid / WFH Options
Deloitte
in your approach to designing and delivering high-quality solutions that meet or exceed client expectations.Responsibilities include:Architect Databricks Enterprise Data Platform solutions including ETL/ELT and Lakehouse architecture and design and lead use case delivery across a variety of use cases (e.g. legacy migrations, enterprise analytics, data engineering more »
Birmingham, West Midlands, West Midlands (County), United Kingdom Hybrid / WFH Options
Clearwater People Solutions
Databricks, Power BI Strong in delivering solutions at scale, on time and within budget. Strong background in data warehousing, data architecture, data modelling, integration, ETL/ELT processes Please apply as directed more »
Databricks, Power BI Strong in delivering solutions at scale, on time and within budget. Strong background in data warehousing, data architecture, data modelling, integration, ETL/ELT processes Please apply as directed more »
Cheltenham, Gloucestershire, United Kingdom Hybrid / WFH Options
Third Nexus Group Limited
client sites. We're seeking a Data Engineer with a focus on Azure, showcasing proficiency in: · Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. · Utilizing Azure data and analytics services, including but not limited to Azure Data Factory, Azure more »
and Business teams to enhance our customer-centric culture. Ideal Candidate Profile: Proven track record in big data engineering with a solid understanding of ETL pipelines and data system projections. Proficiency in Python, PySpark, SQL, and familiarity with data science tools like R, ML, AI. Strong foundation in database management more »
Manchester Area, United Kingdom Hybrid / WFH Options
MBN Solutions
part of a large-scale project to develop a new Data Warehouse. Responsibilities include: Being an SME in designing & building the Data Warehouse Customising ETL procedures, data mappings, and transformations to coordinate data integration Documenting solutions, tools and processes Implementing validation procedures to ensure high quality of data Collaboration with more »
Reading, England, United Kingdom Hybrid / WFH Options
Xpertise Recruitment
venture into the world of MLOps/AIOps. Key experience desired/what you will learn: Design, develop, and maintain scalable data pipelines andETL processes leveraging GCP, AWS, and/or Azure services Cloud Database Management: BigQuery, Snowflake, Databricks, and Redshift Architect data models and schemas in BigQuery to more »
Milton Keynes, England, United Kingdom Hybrid / WFH Options
Xpertise Recruitment
venture into the world of MLOps/AIOps. Key experience desired/what you will learn: Design, develop, and maintain scalable data pipelines andETL processes leveraging GCP services such as BigQuery, Dataflow, and Cloud Storage. If you have experience across AWS and Azure, we can train you up on more »
Newcastle Upon Tyne, England, United Kingdom Hybrid / WFH Options
Xpertise Recruitment
venture into the world of MLOps/AIOps. Key experience desired/what you will learn: Design, develop, and maintain scalable data pipelines andETL processes leveraging GCP services such as BigQuery, Dataflow, and Cloud Storage. If you have experience across AWS and Azure, we can train you up on more »
Olney, Buckinghamshire, United Kingdom Hybrid / WFH Options
Nigel Frank International
Azure Data Lake. * Experience delivering some aspect of leadership/mentoring whilst still working in a hands on environment. * Good data platform development skills: ETL development, Data Warehousing, SQL database development.Benefits * Car allowance of 5,500. * Hybrid work pattern - weekly visits to the office in Banbury. * Private health and dental more »