Data Engineer

Data Engineer

We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our client's data capabilities and supporting the launch of our new platform and mobile app.

Key Responsibilities:

 

  • Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs.
  • Build data pipelines to connect APIs, files, databases, and data streams to our clients Data Platform.
  • Shape data from various sources into a transactional ODS for detailed reporting and a Kimball-modelled Data Warehouse for analytics and dashboards.
  • Define and embed data quality measures within data pipelines.
  • Ensure data integrity, monitoring, and alerting are integrated into all solutions.
  • Create and manage Build and Deployment pipelines.
  • Enhance and support our archive Data Lake.
  • Collaborate with analysts and data scientists to translate requirements into solutions and ensure successful business outcomes.
  • Contribute to the overall design of the Data Platform.
  • Develop visualisations in Power BI.
  • Work in an Agile Kanban workflow to safely code, review, test, and deploy solutions using source control.
Personal Qualities and Cultural Fit:
  • Intellectual curiosity and a growth mindset.
  • Ability to understand and work within operational constraints.
  • Focus on building technology solutions that are scalable and cost-effective.
  • Strong collaboration skills to work across departments.
Required Skills and Experience:
  • Implement data solutions in an AWS environment using native technologies and RDS (SQL Server) toolsets.
  • Experience with transactional reporting solutions for critical business reporting.
  • Experience with dimensionally modelled databases for analytics use cases.
  • Knowledge of ETL tools and approaches.
  • Hands-on experience with AWS technologies, including Lambda, SQS, Event Bridge, S3 & RDS.
  • Experience with Python for scripting and automating data tasks.
  • Knowledge of CI/CD approaches for Data Platforms using Bitbucket and Bitbucket Pipelines.
  • Knowledge of AWS data lake approaches using Athena & Apache Iceberg tables.
  • Exposure to visualisation development using Power BI.
  • Knowledge of MS SQL Server, SSIS, Visual Studio, and SSDT projects.
  • Experience in a relevant sector is a plus.
  • Degree or equivalent qualification/experience in computer science, data science, or a related field.
Benefits:
  • Competitive salary and benefits.
  • A collaborative and innovative work environment.
  • Opportunities for professional growth and development.
  • Hybrid working -one to two days office based 
How to Apply:

Interested? Please Click Apply Now!

Join our client and be part of a team that is shaping the future through data-driven solutions!

Data Engineer 

 

Are you passionate about data engineering and looking for a dynamic role with room for growth? Our client, a leading technology company, is seeking a skilled Data Engineer to join their team. In this role, you will have the opportunity to work with cutting-edge technologies such as Bitbucket and AWS Data Lake while collaborating with a team of innovative individuals.

 

As a Data Engineer, your main responsibility will be developing and maintaining data pipelines on Bitbucket using Bitbucket Pipelines. You will also use your knowledge of AWS data lake approaches to optimize performance by implementing Apache Iceberg tables. This is an exciting chance to gain experience in visualisation development using Power BI and working with MS SQL Server, SSIS, Visual Studio, and

Company
Adria Solutions Ltd
Location
Manchester, United Kingdom
Hybrid / WFH Options
Employment Type
Permanent
Salary
£50000 - £60000/annum
Posted
Company
Adria Solutions Ltd
Location
Manchester, United Kingdom
Hybrid / WFH Options
Employment Type
Permanent
Salary
£50000 - £60000/annum
Posted