51 to 75 of 187 Data Lake Jobs in England

Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £60,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great opportunity … to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely with … be up to?: Data Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as more »

Advanced Specialisation. Adatis is now part of Telefonica Tech as of March 2022, powering the next phase of our growth. We’re a Data Analytics Consultancy that works with our clients to deliver information solutions, to help make better informed business decisions. Our integral approach within our team … a career model that lets you take control of your development and progression. So, if you want to do some great things in data analytics (and have some fun at the same time), welcome to Adatis. OUR VISION To be the data analytics company most admired … role will vary depending on the project but will primarily focus on the delivery of enterprise-level applications in the Business Intelligence and Data Analytics arena. This is a client-facing position, so the ideal candidate must be comfortable speaking with clients and some occasional travel. Our offices more »

Role - Azure Data Engineer Rate - £600 per day inside Hybrid working - 1 day a week onsite (Centre of London) Duration - Initial 6 months My client is a large Financial services organisation based out of London and they are going through a huge data transformation that is … expected to run for at least 18 months. My client is seeking experienced Azure Data Engineers for a stakeholder-facing project. This role will have particular emphasis on Azure, Databricks and DevOps. Our client is in the consultancy sector but does not have a preference for previous experience … There is a massive emphasis on Pyspark and Databricks for this particular role. Technical Skills Required: Azure (ADF, Functions, Blob Storage, Data Lake Storage, Azure Data Bricks) Databricks Spark Delta Lake SQL Python PySpark ADLS Day To Day Responsibilities: Extensive experience in designing, developing more »

Lead Data Engineer - £70k plus benefits - hybrid 2 days in Manchester An exciting opportunity has arisen to join this leading household name, based in Manchester city centre (hybrid). The role will be critical in delivering and ensuring data quality, consistency, and reliability working closely with … other data engineers in the team as well as the analytics team, architecture team and stakeholders. You will be responsible for the development, operation and maintenance of data pipelines to extract, load and transform data sources from both internal and external/third-party … candidate will have led a team or projects and used to working in an Azure environment with a focus on Azure Data Lake, Databricks, Azure Data Factory and Power BI architectures. Working with Python, SQL, Spark and Databricks, you will build, rebuild and maintain data more »

and enables the rapid deployment of innovation and standard methodologies across the global business About the Role We are looking for an experienced Data Architect/Data & Reporting Technical Lead to join the team working on our Global Business Systems (GBS) platform. You will lead data and reporting architecture and initiatives across the GBS program, including the RX Data Lake. You will manage the engineering team throughout the development life cycle to implement functionality to cost, quality and schedule. Responsibilities Designing and developing RX's data and reporting systems which … development experience Have excellent experience of cloud data platforms (Azure or AWS) and attendant technologies and concepts such as Data Lake, Virtualization, ETL, ELT. Have substantial Powe BI hands on experience Demonstrate experience with Oracle Business Intelligence Enterprise Edition (OBIEE), Oracle Enterprise Data more »

Senior Data Engineer Manchester (Hybrid Role) £70,000 per annum Position Summary: We are seeking a talented Senior Data Engineer to spearhead the design and implementation of robust data pipelines and advanced scripts. You will play a key role in architecting dynamic data warehousing systems on the Azure platform, harnessing the power of data lakes, Databricks, and Synapse Analytics. Your contributions will significantly propel this organisation into a new era of data-driven excellence, driving innovation and delivering impactful solutions. Key Responsibilities: Collaborate closely with cross-functional … teams, including Data Scientists, Software Engineers, and Business Analysts, to deliver impactful solutions aligned with business goals. Develop and deploy scalable data pipelines for the ingestion, incremental loading, transformation, and modeling of data. Architect agile data warehousing systems on the Azure platform, utilising data more »

Python or TensorFlow ) Familiarity with natural language processing or AI technologies ( e.g LLMs such as ChatGPT or BARD , Embeddings , Prompt Engineering ) Experience with data pipelines and preferably processing of document s ( e.g using Google Cloud Fusion/Azure Data Factory ) Strong background in either Python/… Service Orientated Architecture, API-Centric Design, Twelve-Factor App, FAIR, etc.). Experience supporting digital platforms, including Integrations, Release Management, Regression Testing, Integrations, Data Obfuscation, etc. Knowledge of Azure … Data Factory/GCP Cloud Data Fusion , Microsoft Azure Machine Learning or GCP Cloud ML Engine , Azure Data Lake , Azure Databricks or GCP Cloud Dataproc . Familiarity with big data technologies and distributed computing frameworks, such as Hadoop, Spark, or Apache more »

with Architecture decisions and strategy Requirements: TypeScript/JavaScript, Node.js, and React. Strong database skills (SQL) and RESTful API design experience. Working with data pipelines and data architecture Desired Skills: Experience with Python. Familiarity with AWS and Data Platforms Knowledge of Enterprise SaaS development … data lakes like snowflake This is a role that would be great for a Software Engineer that wants to drive the architecture for a product that has the potential to make a huge impact across this particular sector. Must be eligible to work in the UK and be more »

will include… You will be able to produce a variety of reports focusing on a range of areas, including; Security, Performance, compliance audits, data collected from various IT Systems and tools. Strong ability to maintain and develop technical documentation, including system configurations, network diagrams, operating procedures to support … clients IT Environments. You will be analysing large data-sets to identify trends, patterns and anomalies, and have the ability to extract worthwhile insight to be included in the reports. Be an SME around identifying opportunities where automation report created can be used, using scripting languages and reporting … tools to enhance efficiency and scalability. What you've got… Experienced background in Report Writing, Data Analysis, or technical documentation within the IT/Tech industry. Experience on Microsoft office applications! Particularly Excel + Word, for documenting and report writing purposes. Being confident on Azure is a must more »

Are you an experienced best in class data engineer with 5-10 years' experience? Do you have experience or capability for a senior data engineering role ? If so, we want to hear from you ! We are currently recruiting for 2 experienced data engineers who … can support the data manager implementing and maintaining an effective business intelligence technical services . Support cloud platform and reporting, assisting in design and developing a data acquisition strategy, reporting to customers, and maintaining datasets. Key Responsibilities are: Monitor and maintain ETL processes , ensure accurate reporting … can best be gathered. Skills and knowledge needed: Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, extensive Power BI experience Extensive experience of working with Azure Data Factory & Databricks Extensive SQL knowledge (Microsoft more »

An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around … times per month. This organisation have invested a lot into their data function in recent years, and they are now operating on Azure, with a desire to start utilising Artificial Intelligence and Machine Learning in the future, making this is an incredibly exciting time to join the team … SQL programming Experience designing, developing and maintaining data warehouses and data lakes Knowledge of Azure technologies including Data Lake, Data Factory, and Synapse Knowledge of Agile methodology Excellent communication and problem-solving skills Benefits Salary up to £70,000 depending on more »

An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around … times per month. This organisation have invested a lot into their data function in recent years, and they are now operating on Azure, with a desire to start utilising Artificial Intelligence and Machine Learning in the future, making this is an incredibly exciting time to join the team … SQL programming Experience designing, developing and maintaining data warehouses and data lakes Knowledge of Azure technologies including Data Lake, Data Factory, and Synapse Knowledge of Agile methodology Excellent communication and problem-solving skills Benefits Salary up to £70,000 depending on more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »

Java Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services … appreciation of asset classes such as Fixed Income, equities, FX or commodities Role: Java Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services … appreciation of asset classes such as Fixed Income, equities, FX or commodities Role: Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »

Python Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager … asset classes such as Fixed Income, equities, FX or commodities Role: Python Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »

Site Reliability Engineer (SRE DevOps Infrastructure AWS Python Java Go JavaScript Big Data Lake Data Mesh Kubernetes Terraform Finance Trading Glue Athena Dremio Iceberg Snowflake DBT Arrow gRPC protobuf Airflow Ignite Asset Manager Investment Management Financial Services Hedge Fund) required by our asset management client … Good Python, JavaScript, Java or Go Terraform SRE experience in an enterprise scale environment The following is DESIRABLE, not essential: SRE for big data Glue, Athena, Dremio, Iceberg, Snowflake … DBT, Arrow, gRPC, protobuf, Airflow, Ignite Graffana, Prometheus Role: Site Reliability Engineer (SRE DevOps Infrastructure AWS Python Java Go JavaScript Big Data Lake Data Mesh Kubernetes Terraform Finance Trading Glue Athena Dremio Iceberg Snowflake DBT Arrow gRPC protobuf Airflow Ignite Asset Manager Investment Management Financial more »

Stott and May are looking for an experienced Data Architect that specialises in AWS. CONTRACT HYBRID - 3 days per week in London Start: ASAP Duration: 6-months (extensions) Your role: - Define the portfolio of enterprise data products being delivered on AWS - Deliver and maintain logical and … architectural patterns composing their data products. Technical experience required: - AWS- based data: EMR, Quicksight, Glue, MWAA, Dynamo, Kinesis, Kafka - Azure Datalake - AWS cloud data platform security and infrastructure Non-Technical skills required: - Stakeholder management, you'll be in direct contact with end client - Communication more »

have been supporting professionals from the entertainment space for the past century. Lead a team of internal and 3rd party Application, Integration and Data Engineers to deliver world-class solutions for the organisation to manage its business activities, through understanding the business requirements and translating into technical solutions. … you will excel in this role: Integration Application architecture and design Azure cloud-based infrastructure solutions Azure Integration services, Azure API management Azure Data Lakes, Azure Synapse Networking, security and storage technologies Delivering a microservices architecture Developing and implementing RESTful APIs, microservices and UIs XML, JSON, Web APIs more »

Our client within the Education sector are looking for a Senior Data Engineer to join them on a contract basis. Inside IR35 … month contract Hybrid 1 – 2 days per week onsite Technical Skills: In depth knowledge of relevant Azure services such as Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL Database, Azure Stream Analytics, etc. Strong Python or Scala with Spark … and analytics. Apache Spark: Deep understanding of Apache Spark for large-scale data processing. Azure Blob Storage and Azure Data Lake Storage: Expertise in setting up and optimizing Azure Data Lake Storage for storing and managing large volumes of data. Cloud Experience more »

Job Description Summary The Senior Data Architect is accountable for enabling the technical vision and strategy for the organisations use of data. You will be accountable for defining and maintaining the technical data architecture roadmap offering advise and guidance to business stakeholders. You will ensure that … data architect solutions align with business requirements and data policies and regulations. You will be accountable for the choice of the toolsets required to design, build, manage and maintain the data storage facility within an agreed budget. You will lead a team of people … to deliver a simplified data solution ensuring that data is secure, available, and accurate to business stakeholders. Job Description You will review the ‘as is’ solution, work closely across TalkTalk and wider teams to identify an approach that allows us to move data across more »

We are currently looking for an Azure Data Platforms Engineer on a contract basis (OSIR35) for a global retail organisation. The project will to deliver a foundational data platform to enhance data-driven decision-making and performance analytics.They will play an important role in … and data integration processes using Azure services such as Azure Data Factory, Azure Synapse Analytics and Azure Data Lake Storage. Responsibilities: Collaborate with solution/data architect to design and implement scalable, secure data infrastructure using Azure services. Develop … and support. Skills/Experience required: Proficiency in Azure services, particularly Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage. Strong understanding of data integration processes and tools. Knowledge of data security measures, including Azure Active Directory integration and more »