14 of 14 Data Lake Jobs in Shropshire

enterprise-grade data solutions. The role requires hands-on expertise in developing advanced data pipelines, architecting data lake structures, aligning governance frameworks, and enabling robust reporting capabilities. The ideal candidate will be someone who can take end-to-end ownership of data … years' experience as a Senior Data Engineer in Azure cloud environments Strong hands-on skills with ADF, Data Lake, Power BI, and Azure DevOps Demonstrated ability to architect scalable, secure, and governed data platforms Solid understanding of data governance and Data ...

Databricks. You will play a key role in shaping our data strategy, ensuring scalability, performance, and governance while working with Delta Lake, Data Catalog, and PySpark. Key Responsibilities: Databricks Lakehouse Architecture: Design and implement scalable Databricks Lakehouse solutions with Delta Lake for optimized storage … Automation: Implement Databricks workflows and integrate with Azure/AWS/GCP data ecosystems. Primary Skills (Must-Have): Databricks – Architecture, Delta Lake, Lakehouse, Unity Catalog/Data Catalog PySpark (optimization, UDFs, Delta operations) SQL (advanced querying, performance tuning) Data Lake/Warehouse ...

Lead Data Architect £67,000 – £84,000 per year Location: Leeds (with UK-wide flexibility) Full-time | Data Specialist About the Role Our client, a leading digital consultancy, is seeking a Lead Data Architect to join their growing data practice. This role … data literacy. Essential Skills & Experience • Demonstrable experience defining and delivering enterprise data architectures. • Deep understanding of data lake and data warehouse design, with hands-on experience in modern platforms such as Snowflake or Databricks. • Strong experience with AWS, Azure or GCP. ...

Skills & Expertise ·AWS Core Services: S3, Redshift, Glue, Athena, Lake Formation, IAM ·Data Engineering/ETL: ·Building and optimizing ETL pipelines ·Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) ·Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: ·Expertise in Apache Iceberg table format ·Schema evolution, partitioning, compaction & metadata management ·Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: ·Data modeling, distribution styles, sort keys ·Workload management (WLM) ·Performance optimization & troubleshooting ·Python: ·Automation scripts ·Data processing ...

Skills & Expertise ·AWS Core Services: S3, Redshift, Glue, Athena, Lake Formation, IAM ·Data Engineering/ETL: ·Building and optimizing ETL pipelines ·Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) ·Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: ·Expertise in Apache Iceberg table format ·Schema evolution, partitioning, compaction & metadata management ·Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: ·Data modeling, distribution styles, sort keys ·Workload management (WLM) ·Performance optimization & troubleshooting ·Python: ·Automation scripts ·Data processing ...

operations that will lay the foundations for further and sustained success. We're a multi-disciplined team, bringing together expertise in software and data engineering, full stack development, platform operations, algorithm research, and data science. Our squads focus on delivering high-impact solutions - we favour … datasets, resolve data quality issues, and optimize performance. Strong analytical and problem-solving skills. Strong knowledge of database and data lake systems Comfortable working in an Agile environment Benefits What to expect during the recruitment process: Initial recruiter screening call Interview with hiring manager Technical ...

operations that will lay the foundations for further and sustained success. We're a multi-disciplined team, bringing together expertise in software and data engineering, full stack development, platform operations, algorithm research, and data science. Our squads focus on delivering high-impact solutions - we favour … datasets, resolve data quality issues, and optimize performance. Strong analytical and problem-solving skills. Strong knowledge of database and data lake systems Comfortable working in an Agile environment Benefits What to expect during the recruitment process: Initial recruiter screening call Interview with hiring manager Technical ...

environment in the era of AI? If so, we invite you to join our team as a Cloud & AI Solution Engineer in Innovative Data Platform for ISV customers at Microsoft. Here, you'll be at the forefront of innovation, working on cutting-edge projects that leverage the latest … apps. Expert on Azure Analytics (Fabric, Azure Databricks, Purview) and competitors (BigQuery, Redshift, Snowflake) in data warehouse, data lake, big data, analytics, real-time intelligence, and reporting using integrated Data Security & Governance. Proven ability to lead technical engagements (e.g., hackathons, PoCs ...

About this position As the Data Platform Engineer in the Cyber Data Platform team, you will contribute to the development and maintenance of a robust data platform that enables users to develop advanced analytics, machine learning, and GenAI solutions to strengthen our security defences. … will collaborate closely with cross functional data teams to ensure the platform is scalable, secure, and aligned with cybersecurity goals. We know life looks a little different for each of us. That's why at Tesco, we always welcome chats about flexible working. Some people ...

Data Platform Engineer - Azure Services, ADF, Terraform, Synapse £Market Rate (Inside IR35) London/Hybrid 6 months My client is an instantly recognisable firm who urgently require a Data Platform Engineer with core strengths in Building and Operating Data Platforms, and hands-on expertise … Factory (ADF), including network configurations and integration runtime options Strong expertise in Synapse Analytics Spark, Azure Key Vault, and Data Lake Storage Accounts Ability to showcase DevOps and CI/CD capabilities Working knowledge of designing and deploying infrastructure Experience in efficient handling of large ...

Data Platform Engineer - Azure Services, ADF, Terraform, Synapse £Market Rate (Inside IR35) London/Hybrid 6 months My client is an instantly recognisable firm who urgently require a Data Platform Engineer with core strengths in Building and Operating Data Platforms, and hands-on expertise … Factory (ADF), including network configurations and integration runtime options Strong expertise in Synapse Analytics Spark, Azure Key Vault, and Data Lake Storage Accounts Ability to showcase DevOps and CI/CD capabilities Working knowledge of designing and deploying infrastructure Experience in efficient handling of large ...

Lead Data Consultant Salary: Up to £80,000 I am working with a leading Microsoft partner that is currently recruiting for a Lead Data Consultant to join their growing team. This organisation is driving digital transformation for businesses across the UK, specialising in delivering innovative solutions … Microsoft Power Platform, Azure and emerging technologies like Microsoft Fabric. Their mission is to help organisations unlock the full potential of their data through modern, cloud-first architectures. This is a hands-on leadership role where you will guide a team of technical consultants while also contributing ...

leading Asset Managers, Hedge Funds and Law Firms. What you'll work on You will be a manager of a cross functional DDEP (Data, Design, Engineering & Product) team as well as a line manager of highly skilled, passionate, dedicated and ambitious software engineers. You will be accountable … company strategy and business goals, communicating this to both your reports and the cross-functional team you manage. You will use insights and data to make informed decisions that drive effectiveness and efficiency, including driving technical innovation (eg using genAI to maximize engineer effectiveness). Every ...

leading Asset Managers, Hedge Funds and Law Firms. What you'll work on You will be a manager of a cross functional DDEP (Data, Design, Engineering & Product) team as well as a line manager of highly skilled, passionate, dedicated and ambitious software engineers. You will be accountable … company strategy and business goals, communicating this to both your reports and the cross-functional team you manage. You will use insights and data to make informed decisions that drive effectiveness and efficiency, including driving technical innovation (eg using genAI to maximize engineer effectiveness). Every ...