1 to 25 of 26 Data Lake Jobs in the South West

team also enables wider Data Science, AI and Machine Learning initiatives through our Data Warehouse and Data Lake platforms. The successful candidate would be: Working in an agile scrum team to design and build data feeds and related applications Writing, testing … Oracle ODI and Snowflake Working with business users to design and configure self-serve data environments within our snowflake data lake Analysing, developing, delivering, and managing BI reports Assisting in the design of the data processes, including data quality, reconciliation, testing ...

constantly evolving needs of our clients across a wide range of markets on a global scale. If you're an experienced and talented data engineer who pushes the boundaries and enjoys an exciting and fast paced agile environment, we can offer you the chance to continue to grow … technologies. About you Technical Skills Strong experience with: Azure Data Factory (ADF). Azure Databricks. Azure Synapse Analytics. Azure Data Lake Storage (ADLS). Azure SQL Database and SQL Server. Microsoft Fabric (preferred). Advanced SQL development and performance tuning skills. Experience with Python, PySpark ...

Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this … Overview Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this ...

Blood and Transplant (NHSBT) is a unique organisation that works to save and improve lives every day. Are you a skilled data engineering professional who thrives on transforming complex data into powerful insights that support vital services? This is an exciting opportunity to join NHS Blood … Server Tools. Experience with MS Azure technologies such as Azure Data Factory, Synapse Analytics, Databricks, Azure SQL, Azure Data Lake Storage etc. Knowledge of data modelling, architectural principles and big data tools. Experience in diagnosing and troubleshooting complex data ...

client is a geospatial and data technology company. Join the Growth Story at our client Our client operates at the heart of the UKs most sensitive and high-profile operations. Our approach is entirely mission-focused, enabling customers to see more, decide faster, and act with confidence across … cloud-native data platforms, particularly within AWS Familiarity with Docker, Kubernetes and CI/CD delivery practices Understanding of data lake, data warehouse and modern analytics architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience ...

client is a geospatial and data technology company. Is your CV ready If so, and you are confident this is the role for you, make sure to apply asap. Join the Growth Story at our client Our client operates at the heart of the UK's most sensitive … decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. We operate as small teams delivering fast value, blending deep ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business … technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions ...

Platform. From an MSB perspective the role will require the design, development, support and deployment of the AeroConnect Platform to provide connectivity and data analytic solutions for the manufacturing environments. This will focus on the integration of the latest manufacturing technologies both at the production sites and research … analysis. • Implement and manage data lakes, data warehouses, and other data storage solutions, including SQL and Cloud Lake solutions. Data Security & Compliance • Implement and enforce best architectural practices for data security, ensuring compliance with relevant data regulations ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot … with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills and experience ...

government client is looking for candidates who have at least one production AI/ML implementation, recent experience with AWS data services, Terraform, CI/CD, Python, and SQL. Candidates should have more than five years of overall experience and meet the other requirements outlined in the attached … solutions for data platform, ETL, integration and analysis solutions. Our toolset includes AWS hosted databases (postgres, S3 based data lake, MySQL, Athena), integration services (AWS API gateway, lambda functions), ETL services (AWS Glue, Step functions, AWS Batch), infrastructure a management tool such as Terraform ...

SENIOR PYTHON/DATA ENGINEER - SC CLEARED NEW PERMANENT OPPORTUNITY AVAILABLE FOR AN SC CLEARED PYTHON ENGINEER WITH DATA ENGINEERING EXPERIENCE Salary: Up to £75,000 Location: Bristol Working Pattern: Hybrid Clearance: SC Clearance required to start Type: Permanent I'm currently working with a leading … technology consultancy delivering a range of complex digital and data projects across the public sector. They're looking for a Senior Python/Data Engineer to join their growing engineering team in Bristol. This role could be a great fit for someone from a strong backend ...

client is a public sector technology consultancy. Description Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients' needs. They develop, operate, and maintain … these services. They make sure they provide maximum value to data consumers, including analysts, scientists, and business stakeholders. Your role at our client As a Senior Data Engineer, you may play one or more roles according to our clients' needs. The role is very hands ...

Principal GCP Data Engineer, you'll be a true subject matter expert in using the data processing and management capabilities of Google Cloud to develop data-driven solutions for our clients. You will typically lead a team or the solution delivery effort, demonstrating technical … software development lifecycle in line with modern best practices. As part of your responsibilities, you will be expected to: Develop robust data processing jobs using tools such as Google Cloud Dataflow, Dataproc and BigQuery Design and deliver automated data pipelines that use orchestration tools such ...

reports and dashboards. Produce weekly KPI reports for senior leadership and the CFO. Support the creation of a centralised reporting and data-lake approach. Ensure data integrity within core systems, including maintaining records and supporting reporting accuracy. Assist with ongoing reporting and systems improvement projects. … financial data. Strong problem-solving skills and the ability to learn new systems quickly. Desirable Experience Power BI. Microsoft Fabric or data lake technologies. Experience in financial reporting or finance systems environments. Relevant degree in Data Analytics, Business, Finance or similar. Ideal Candidate The client ...

looking for a Staff Software Engineer to help shape and build the shared engineering capabilities that underpin Our Future Health's data platforms. This is an opportunity to combine hands-on software engineering with Staff level technical leadership, working on large-scale data systems and reusable … biggest health research programme of its kind, and our volunteer group is also more diverse than other, similar health research programmes. Technology and data are central to our mission. Our systems power web sites, clinics across the UK, secure analytics and research systems, and pipelines that process highly ...

looking for a Staff Software Engineer to help shape and build the shared engineering capabilities that underpin Our Future Health's data platforms. This is an opportunity to combine hands-on software engineering with Staff level technical leadership, working on large-scale data systems and reusable … biggest health research programme of its kind, and our volunteer group is also more diverse than other, similar health research programmes. Technology and data are central to our mission. Our systems power web sites, clinics across the UK, secure analytics and research systems, and pipelines that process highly ...

maximise on the power of its data. The successful candidate would be: Working in an agile scrum team to design and build data feeds and related applications Writing, testing and peer review of ETL code in Oracle ODI, dbt, Snowflake and AWS. … Working with business users to design and configure self-serve data environments within our data warehouse and data lake Analysing, developing, delivering, and managing BI reports Assisting in the design of the data processes, including data quality, reconciliation, testing ...

Python Engineer/Data Engineer - SC Cleared New Permanent Opportunity for an SC Cleared Python Engineer/Data Engineer with a leading Public Sector Consultancy Location : Bristol - hybrid working model Salary : Up to £50,000 DOE Clearance : Active SC required to start Type : Permanent Experience : Python …/Azure/GCP, Git, CI/CD, SQL, ETL/Data Pipelines, IaC Role Opportunity I'm currently working with a leading public sector technology consultancy delivering digital, data and technology projects across government. They're looking for a Python Engineer/Data ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

Data Architect Up to £80k West Midlands - Hybrid - twice per week in the office Benefits: Bonus Scheme Hybrid Working Life Assurance Cycle to Work Scheme 25 days holiday, increasing with length of service Employee Assistance Program I am working with a client in the West Midlands … looking for an Enterprise level Data Architect with Databricks experience to join the team. Databricks is an absolute necessity for this role. The architecture has been outsourced up to this point, and is being brought back in house, so you should be experienced enough to take over responsibility ...

dynamic organisation that is challenging the industry and making history. Scope As a construction business analyst, you are responsible for analysing data, producing reports, designing processes, and creating systems to enhance the operational efficiency and certainty of HPC. Your role involves liaising between Function and Operational Leaders, senior … into technical solutions. You will play an active role in identifying opportunities to streamline new and existing processes through the use of technology, data and automation. Core Tasks and Duties: Data Analysis: Collect, analyse, and interpret data related to the construction project. Develop detailed ...

Teams, Co-Pilot, Power Platform (Power Apps, Power Automate, Power BI and Power Virtual Agent) and other MS365 services. Integrate and manage data sources like Dataverse, SharePoint and SQL. Act as the Technical Authority for any new enterprise-wide applications development (e.g. Dynamics 365), configuration and implementation. … SharePoint, Teams and OneDrive. Hierarchical structured data and SQL programming. Azure Integration services, especially Azure API Management. (desirable) Azure Data Lake, Azure Synapse. (desirable) Dynamics 365 (desirable). #J-18808-Ljbffr ...

Teams, Co-Pilot, Power Platform (Power Apps, Power Automate, Power BI and Power Virtual Agent) and other MS365 services. Integrate and manage data sources like Dataverse, SharePoint and SQL. Act as the Technical Authority for any new enterprise-wide applications development (e.g. Dynamics 365), configuration and implementation. … SharePoint, Teams and OneDrive. Hierarchical structured data and SQL programming. Azure Integration services, especially Azure API Management. (desirable) Azure Data Lake, Azure Synapse. (desirable) Dynamics 365 (desirable). ...

Scott Logic is a UK data engineering partner delivering bespoke software and data platforms. You will design and implement data pipelines, build data lakes/warehouses, and transform datasets for analytics, ML, and reporting. You’ll work hands-on with modern tools ...