251 to 275 of 297 Data Lake Jobs

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the … physical implementation, and performance tuning. You will be part of a team that is supporting cloud Data Warehouse and Data Lake environments implemented on AWS or Azure for some of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage … Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration tasks including backup and recovery, troubleshooting, performance tuning and SQL optimization. Design database schema, tune more »

Principal Data Engineer Job Type: Full-Time Sector: PropTech Location: Preston, Lancashire - Predominantly Remote!! (average expectation of one site visit per month) Salary: £85,000.00+ Standard benefits + Annual Bonus My well established PropTech client is looking for an experienced Principal Data Engineer to join their … team and be instrumental in transforming the way that they consume data and transitioning from On Premise to Google Cloud. This is an exciting time to join a growing business function and gain hands on experience working with market leading technology such as BIG Query, Looker, Data … role 3+ years GCP experience Data Ingestion & Transformation BigQuery experience advantageous but not essential. Extensive experience with SQL and Data Lake/Warehouse solutions Strong proficiency in languages such as SQL, Python, Java or Scala In-depth knowledge of query optimization techniques and experience in more »

Our client is a successful financial services provider offering an exciting opportunity for a Data Engineer who will have the chance to work with new technology and delve deep into data. The Data Engineer will work closely with IT, Finance and Operations to deliver the business … reporting requirements within a timely and consistent manner. They are required to develop and provide trusted data on performance, financial positions to aid decision making across the business. They also to provide tactical information to end users to support process. The role is offered on a hybrid basis … but you should live within commutable distance of Wimborne, Dorset. Responsibilities of the Data Engineer Manage presentational reporting to support decision making Automate the collection of disparate data sources to Data Lakes and Data Warehouses Work across all functions to test and more »

Integration methodologies and tools API and Microservices architecture Structured and unstructured databases and usage patterns Data analytics architecture (e.g. Data Lake) Programming paradigms and approaches (e.g. object-oriented) Process automation approaches and tooling (e.g. DevOps, AIOps) Experience in agile engineering and tooling support An agile more »

Integration methodologies and tools API and Microservices architecture Structured and unstructured databases and usage patterns Data analytics architecture (e.g. Data Lake) Programming paradigms and approaches (e.g. object-oriented) Process automation approaches and tooling (e.g. DevOps, AIOps) Experience in agile engineering and tooling support An agile more »

Integration methodologies and tools API and Microservices architecture Structured and unstructured databases and usage patterns Data analytics architecture (e.g. Data Lake) Programming paradigms and approaches (e.g. object-oriented) Process automation approaches and tooling (e.g. DevOps, AIOps) Experience in agile engineering and tooling support An agile more »

working with companies in the finance sector highly desirable • Platform implementation experience (Apache Hadoop - Kafka - Storm and Spark, Elasticsearch and others) • Experience around data integration & migration, data governance, data mining, data visualisation, database modelling in an agile delivery-based environment. • Experience with … code reviews & performance of technical proofs of concepts • Analysis of complex IT Application landscapes, optimization of development processes and Solution Architecture • Data lake experience on AWS and Azure • General knowledge of database technologies and trade-offs • University degree with above-average academic performance in a mathematical-scientific more »

Senior Databricks Migration Consultant Remote This role demands in-depth knowledge of data engineering, cloud technologies (preferably AWS), and a successful record in enterprise level data migrations into Databricks. You will ensure the efficient and secure transition of our data assets to the Databricks … Lakehouse Platform, working closely with our external vendors. You will - Analyze data requirements, migration impacts, and project dependencies. - Develop detailed data migration strategies, including architectural plans, data quality evaluations, testing, and creating robust data pipelines and workflows for Databricks best practices. - Maintain … data integrity, security, and compliance with regulations like GDPR. - Manage data migration from legacy analytics data warehouses, data lakes, and ETL tools to Databricks within set deadlines. - Comfortable operating in all project phases, adjusting requirements, and supporting the transition from build and more »

Developer Logix Resourcing are currently partnered with a leading solutions provider in IT. Our client are looking to onboard an experienced (5+ years) Data Warehouse Developer who has strong experience with Microsoft Azure tools including SQL Azure, Azure Data Factory, Azure Databricks, and Azure Data … working directly for an offshore team in India and will be working fully remote. Responsibilities: Requirements: 5-8 years of professional experience in data engineering or a related field. Profound expertise in SQL,T-SQL, database design, and data warehousing principles. Design, build, and maintain scalable … SQL, PySpark, and PySQL to handle complex data transformation and processing tasks. Implement and manage data storage solutions in One Lake and Azure SQL, ensuring data integrity and accessibility. Proficient in Python, PySpark, and PySQL for data processing and analytics tasks. more »

Data Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established organisation within the education sector who are looking for a Data Engineer to join their established IT team. Their current project is based around the creation and implementation of a … brand new Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. This is an opportunity to join a team who are serious about the way that they use data … Excellent understanding of Azure Databricks Experience creating data pipelines using Azure Data Factory Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »

and SQL programming/development experience. Developing high-quality, maintainable Python and SQL code. Developing + implementing innovative Banking applications and systems. Developing data interfaces to connect multiple banking systems including: SQL queries, data retrieval, data manipulation, data modelling + data integration. PowerBI/Tableau Data Visualisation tools to create interactive visual reporting dashboards + integrating visualizations into … web applications. Azure Cloud: designing + implementing Azure cloud based solutions + using data tools like Snowflake and Azure Data Lake Services (ADLS). Developing solutions for Proof of Concept (POC) + Minimum Viable Products (MVP). Advantageous: active SC Security Clearance, JavaScript, HTML, CSS more »

working on a Remote first basis (once a month in the office on average). Senior Data Engineer - Remote First (offices in lake district) - Up to £65,000 + Great Benefits Purpose of Job Advise on and ensure the maximum return of value from the company's … Engineers. Providing Technical guidance to Data Engineers Knowledge, Experience and qualifications Excellent level of knowledge & experience in Azure Data, including DataLake, Data Factory, DataBricks, Azure SQL (Indicative experience = 5yrs+) Build and test processes supporting data extraction, data transformation, data structures, metadata, dependency and workload management. Knowledge on Spark architecture and modern Datawarehouse/Data-Lake/Lakehouse techniques Build transformation tables using SQL. Moderate level knowledge of Python/PySpark or equivalent programming language. PowerBI Data Gateways and DataFlows, permissions. Creation, utilisation more »

recently expanded its front office team of Quants and Traders. As a consequence, the need has arisen to increase the headcount on their data engineering and analytics team as the need has arisen to build a new real-time streaming data platform and enhance the capability … of their data lake. Our client is looking for the very best and you will be working with an exceptionally talented team with a flat management structure. This will be a business facing role where you are given the freedom to build solutions in the way you see … tools, they need to enhance profitability. In return they are offering above-market basic salary in addition to exceptional bonuses... THE ROLE: Senior Data Engineer Quantitative Trading The Data Engineering and Analytics team own all of the Data that is required for offline regression more »

Data Architect/Data/Azure/Permanent/Lincoln/Hybrid Vivo Talent are engaged with an organisation who is going through a huge transformation in how their data is used and managed. They require a Data Architect who is passionate … utilising their understanding of Azure data tools to implement and maintain an effective platform. Skills Azure Stack (SQL, Synapse, Data Lake) Power Bi Demonstrated experience in a similar position Strong stakeholder management skills both internal and external If you are interested in hearing more about … this opportunity, please get in touch. Data Architect/Data/Azure/Permanent/Lincoln/Hybrid Data Architect/Data/Azure/Permanent/Lincoln/Hybrid Data Architect/Data/Azure/Permanent more »

Their goal is to deliver maximum value for every expenditure, ensuring efficiency and effectiveness in every project. In this role, you will transform data into valuable insights and models that drive business growth. Your contributions will be essential in analysing historical performance, ensuring regulatory compliance, forecasting future trends … Partner with stakeholders to conduct thorough research into business challenges and deliver iterative solutions. Report Generation: Develop comprehensive reports from structured and unstructured data within the Data Warehouse and Data Lake. Regulatory Compliance: Support regulatory and compliance efforts through detailed data analysis … and reporting. Data Visualisation: Design, prototype, and maintain Power BI reports using SQL and DAX to meet business needs. Agile Workflow: Operate within an Agile Kanban framework, reviewing, testing, and deploying solutions with source control. Product Team Collaboration: Collaborate with product teams to prioritise requests, define requirements, and more »

SC Cleared) London (Hybrid) Permanent £70,000 - £90,000 (DOE) Software Developer needed with active SC Security Clearance and strong Python, SQL + Data Visualisation tools (PowerBI/Tableau). Working in London on a hybrid remote basis (typically 2-3 days/week in the office). … + implementing innovative banking applications and systems. Python and SQL programming/development experience. Developing high-quality, maintainable Python and SQL code. Developing data interfaces to connect multiple banking systems including: SQL queries, data retrieval, data manipulation, data modelling + data … web applications. Azure Cloud: designing + implementing Azure cloud based solutions + using data tools like Snowflake and Azure Data Lake Services (ADLS). Developing solutions for Proof of Concept (POC) + Minimum Viable Products (MVP). Advantageous: Banking, JavaScript, HTML, CSS + front-end more »

Principal Data Engineer Do you want to grow, mentor, nurture and develop a specialist team of Data Engineers in Belfast? How about leading this team to solve complex, technical challenges for businesses across multiple industries in both the private and public sectors? If you’ve answered … many more. Your team will look to you for guidance and support. You’ll get the chance to firmly establish and build the data practice within the Northern Ireland office. The sky is the limit in terms of where this role can go! Your New Company: This specialist … clients/stakeholders and manage these relationships Experience with a range of different tools and technologies, including but not limited to AWS (ETL, Data Lakes, DWH), Azure, Open Source (Redshift, Lambda, MongoDB) Proven ability to design, build and deliver enterprise-scale data solutions Big Data more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we … you can grow your career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data lakes more »