151 to 175 of 263 Data Lake Jobs

Advanced Specialisation. Adatis is now part of Telefonica Tech as of March 2022, powering the next phase of our growth. We’re a Data Analytics Consultancy that works with our clients to deliver information solutions, to help make better informed business decisions. Our integral approach within our team … a career model that lets you take control of your development and progression. So, if you want to do some great things in data analytics (and have some fun at the same time), welcome to Adatis. OUR VISION To be the data analytics company most admired … role will vary depending on the project but will primarily focus on the delivery of enterprise-level applications in the Business Intelligence and Data Analytics arena. This is a client-facing position, so the ideal candidate must be comfortable speaking with clients and some occasional travel. Our offices more »

including integration with third party systems. Architecture Development: Define the overall solution architecture for D365 CE/Power Platform projects, including system integrations, data models, security, and scalability considerations. Technical Leadership: Provide technical leadership and guidance to development teams throughout the project lifecycle, ensuring adherence to best practices … Conduct detailed requirement analysis, identify gaps, and propose appropriate d365 CE/Power Platform components and customizations to meet client needs. Integration and Data Management: Design and implement integrations between D365/Power Platform/LOB systems, leveraging connectors, APIs, and data manipulation techniques to ensure … D365/Power platform/integration. Deep understanding of relevant Azure services such as Azure logic apps, API service, Web Jobs , Data Lake, Data Factory, Synapse, and Azure Functions. Lead experience working with MS SQL Server, SSRS, SSIS, KingswaySoft and/or other prominent data more »

About the roleA Payments FinTech are currently seeking a Data Engineering Lead (Python, Hadoop & SQL) to lead and mentor a talented team of data engineers and scientists as they look to simplify the bank through developing innovative data driven solutions, allowing them to be … business-critical platforms.Desirable skills & experienceWorking to an Agile methodology and familiarity with Azure DevOpsDeep automation knowledge with PythonSkilled in Pyspark and SynapseExperience with data modelling and visualisation in … Power BI (or alternative)A strong understanding of architecting data platforms, BI, MI, or analytics solutionsStrong experience using Azure Data Lake, Azure Data FactoryDeliver the automation data pipelines and building of a scalable data architecture. more »

this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure tools and have some very exciting initiatives! They are looking for an additional Snr Data Engineer to join a well established team, this could possibly suit a mid weight Data Engineer who has mentored others. Salary is circa 75K with a 5% bonus There is no sponsorship for this role, sorry. Responsibilities: Guiding a team of developers in the creation, optimization … warehouses and data lakes. Familiarity with Azure Cloud Services. Sound understanding of T-SQL programming. Exposure to Azure Data Lake technologies, including ADF, HDFS, and Synapse. Solid knowledge of Data Governance, Data Catalog, and Master Data Management. Understanding more »

Scalexperts are partnered with a VC backed education group who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function. They are looking for a Senior Data Engineer to join them to work on building a … brand new data platform which is still in early stage development. They are looking to combine all the data into one common data platform heavily on Azure so that reporting & insight/analytics becomes much clearer and more consistent. This role will require someone … years experience in Data Engineering Azure experience ideally worked with tools such as Synapse, Azure Data Factory, Data Lake etc Experience with SQL is a must, some Python is a bonus Confident in providing technical leadership Able to gather requirements for a variety more »

Senior Data Engineer (No Sponsorship Available) I am seeking an experienced Data Engineer who has experience managing green field projects and implementing modern data platforms that connect business systems and data sources to drive insights through data analytics. The ideal … candidate will have experience using Azure Platforms for consolidating data sources and making them accessible to the wider business to support growth and business strategy. Must have strong communication skills and be comfortable liaising with key stakeholders and other business units to understand business needs and gather requirements. … designing and building data infrastructure and ETL pipelines Experience with Azure Platform including Data Factory, Synapse, and Data Lake DB development experience with SQL Software development experience in relevant languages like Python or C# Experienced with T-SQL and RESTful APIs Experience with more »

SME underwriting decisions per month. Responsibilities include: To perform data extraction , manipulation and cleansing techniques within a data lake environment. Support the delivery of strategic initiatives into Credit SME to build scale, reduce manual touchpoints and enhance the controls environment. Providing Portfolio analysis through the … use of analytical methods. Implementation and design of risk management & changes within 3rd party tools i.e. CRM/UD portal etc Utilise customer data to build risk segmentation and mitigation strategies Lead role for supporting SME commercial strategy and input into key working groups across pricing, system development … you have experience in, or comfortable with: Experience in the extraction and cleansing techniques of data held within a data lake environment Develop Credit Risk Strategies supported by Decision Engine Rules, and Scorecards (Nice to have) Working knowledge of other automating solutions (implementation and maintenance more »

Lead Data Project Manager | Data | Data Lakes | Data Warehouse | Azure Lead Data Project Manager needed on a Permanent basis. Gravitas continue their support for a leading non for profit organisation on their search for a Lead Data Project … company is rolling out a new delivery focused function, the successful candidate will need to take ownership for all things Data. Role: Lead Data Project Manager Location: London - Minimum of once a week in the office. Salary: £58,000 - £63,000 Type: Permanent. The essential skills needed for … a project manager. Ability to provide programme/project management expertise to help support the workstream delivery. Previous experience with end to end Data project. Good communication and stakeholder management. An ability to be a self-starter/autonomous worker who deep dives into detail. MSP/Prince2 more »

this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure tools and have some very exciting initiatives! They are looking for an a mid -weight Data … warehouses and data lakes. Familiarity with Azure Cloud Services. Sound understanding of T-SQL programming. Exposure to Azure Data Lake technologies, including ADF, HDFS, and Synapse. Solid knowledge of Data Governance, Data Catalog, and Master Data Management. (You more »

this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure tools and have some very exciting initiatives! They are looking for an a mid -weight Data … warehouses and data lakes. Familiarity with Azure Cloud Services. Sound understanding of T-SQL programming. Exposure to Azure Data Lake technologies, including ADF, HDFS, and Synapse. Solid knowledge of Data Governance, Data Catalog, and Master Data Management. (You more »

Senior Data Engineer (Contract/ASAP Start) Location| Workplace policy: Fully Remote (Must be based in the UK without visa/sponsorship requirements ) Day Rate: up to £500 - £525 (outside IR35) Contract Length: 6-month term initially An exciting market-leading tech-savvy organization that works directly alongside … some of the biggest brands in the retail sector is seeking a contract Senior Data Engineer with hands-on experience working directly with C-Suite execs. Technical Expertise Needed At least 3 years Databrick s (must have) Proven experience delivering scalable data pipelines PySpark SQLDevOps/… DataOps/CICD Expertise in designing, constructing, administering, and maintaining data warehouses and data lakes Data Modelling/Data Architecture Data Migration Programmes With the brand heavily data rich but without the technical expertise to fully take advantage more »

Data Migration Developer (SC Cleared) London (Hybrid) Permanent £7 0,000 - £90,000 (DOE) + Benefits A highly experienced Data Migration Developer wanted with active SC clearance.This fantastic opportunity will involve playing a dual role as a Migration Specialist and Developer. Hybrid working with the expectation … IT modernisation programmes for government clients. Key skills, experience + tasks will include: Must be an experienced Migration Specialist with strong Development capabilities. Data Migration duties including Data migration processes, data mappings and transformation rules. Data migrations from legacy systems to new … to write high-quality, maintainable code using languages such as Python, SQL Server. PC, PowerShell, Sharepoint, Azure, Desktop Support , Snowflake, Azure Data Lake services (ALA) Gen 2. Expertise in development, testing Proof of Concepts (PoCs), delivering Minimum Viable Products (MVPs) is essential for achieving project success. Develop more »

working with a leading Blockchain analytics platform, with a stellar leadership team and excellent backing. Seeking to hire an experienced senior level Backend & Data Engineer, with strong Python skills and backend architecture ability. The Role Working alongside a strong technical and engineering team, you will take ownership of … redeveloping the architecture of their entire backend systems, focusing on growth. Working with Python and extrapolating high volumes of data from the blockchain, you will be responsible for the overall vision, strategy and execution of the company’s Software products. You will take ownership of: Technical Leadership: Team … building out complex Backend services, along with high-throughput Data warehousing. Min 7yrs with Python Big Data & Data lake solutions; PostgreSQL, Clickhouse or SnowFlake etc Cloud Infrasutcurre (AWS services) Data processing pipelines using Kafka, Hadoop, Hive, Storm, or Zookeeper Hands-on more »

SC Cleared) London (Hybrid) Permanent £70,000 - £90,000 (DOE) Software Developer needed with active SC Security Clearance and strong Python, SQL + Data Visualisation tools (PowerBI/Tableau). Working in London on a hybrid remote basis (typically 2-3 days/week in the office). … + implementing innovative banking applications and systems. Python and SQL programming/development experience. Developing high-quality, maintainable Python and SQL code. Developing data interfaces to connect multiple banking systems including: SQL queries, data retrieval, data manipulation, Datamodelling + data integration. PowerBI … web applications. Azure Cloud: designing + implementing Azure cloud based solutions + using data tools like Snowflake and Azure Data Lake Services (ADLS). Developing solutions for Proof of Concept (POC) + Minimum Viable Products (MVP). Advantageous: Banking, JavaScript, HTML, CSS + Front End more »

DATA ENGINEER Location: Remote Hybrid (1 day per month in London) Job Type: Contract - 6 Months Daily Rate: £(Apply online only) per day INSIDE IR35 Concept Resourcing are currently working with one of the UK's leading IT consultancies. We are seeking an experienced Data Engineer … Key Responsibilities: Architecture, modelling and leadership skills Strong Azure data skills, including: Azure Data Factory V2, Azure Data Lake Storage V2, Azure Databricks, Azure Function Apps& Logic Apps, Azure Stream Analytics, Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell … Strong PySpark, Delta Lake, Unity Catalog and Python skills. Includes ability to write unit and integration tests in Python with unittest, pytest, etc. Strong understanding of software development practices, such as SOLID principals, structuring code, testing, IOC, etc. Strong repositories, CI/CD skills. Strong knowledge of Kimball data more »

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work … a detail-oriented innovator and team player, we’re excited to hear from you. Responsibilities Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. Integrate data management technologies and software … tools into existing structures. Create data tools to support sport data modelling, prediction and analytics. Work with data and analytics experts to strive for greater functionality in our data systems. Essential Skills Proven experience as a Data Engineer, with expertise more »

Job Title: Data Platform Administrator Location: Edinburgh (hybrid) Company: Primis is currently partnered with a leading technology company dedicated to delivering innovative solutions that empower businesses in the UK. Their team is comprised of talented individuals who thrive in fast paced environments and are passionate about pushing the … boundaries of technology and creating meaningful impact. Position Overview: We are looking for an Data Platform Administrator, someone who can deliver operational excellence and stability in our data platforms that underpin the services we deliver for our customers. As well as the day-to-day you … database administration team. Essential skills : Experienced in design, implementation and day-to-day running of enterprise level data platforms, data lake concepts and data handling Solid monitoring and tuning skills in highly available transactional or API-centric environments Working with large-scale, uptime more »

CI/CD pipelines Frontend & Backend knowledge. Data collection and data analysis eg, data warehouse, data lake Seasoned experience with SAP and/or GCP. Agile methodologies like Scrum or Kanban Strong communication skills. Seasoned experience with modules such as SAP more »

Data Architect Salary: £90,000 - £110,000 Location: Remote/Hybrid Data Idols are working with a fast-growing technology company who are disrupting the software engineering industry. They are looking for a Data Architect with strong experience in data engineering and … experience in delivering innovative solutions. The Opportunity In this role as a Data Architect, you will play a pivotal role in ensuring the efficiency of their data architecture while heading the migration from legacy systems to modern cloud solutions. You will design and build scalable database and data lake solutions, implement CICD pipelines and automate the deployment of data products into production environments. Skills and Experience Proficiency in AWS Great communication more »

to the implementation. They are looking for someone who can not only deliver on the technical aspect (having knowledge in Azure Synapse and Data Factory is essential due to the organisation being a purely Microsoft house), but they also pride themselves on building a strong close knit team … Engineers. * Work in an Agile Scrum team with the potential for occasional Waterfall project delivery. Skills & Qualifications * Strong Azure knowledge, specifically within Azure Data Factory, Azure Synapse and Azure Data Lake. * Experience delivering some aspect of leadership/mentoring whilst still working in a hands on … environment. * Good data platform development skills: ETL development, Data Warehousing, SQL database development.Benefits * Car allowance of 5,500. * Hybrid work pattern - weekly visits to the office in Banbury. * Private health and dental care + personal health assessments and critical illness cover for you and your partner. more »

The Change Partners are currently partnered with a Tier 1 Consumer Electronics brand who are hiring for a Solution Architect/Data Engineer on a 12 month FTC (up to £95K) or day rate (Up to £350) contract. You will be responsible for developing software and data … on business needs Identify opportunities for improvement in existing solutions and recommend changes to be implemented Perform system security assessments to ensure that data is safe from unauthorized access Review all customer data sources and conduct data mapping required for use cases for deeper … models and Entity Relationship Diagrams (ERD) to review & sign-off with HQ & DDMC Utilize CDP to automate all customer schema data lake & profile design setups within each sandbox environment Configure within CDP all necessary identities & privacy settings Setup BI connections and coordinate with the BI developer more »

Data Engineer £50,000 - £60,000 - Hybrid My client, industry leading EdTech organisation are currently looking to expand their Data team! become a Data Engineer with vast progression opportunities, where your work is all for a great cause! Requirements Thrive in a fast paced … and dynamic environment Exceptional SQL skills including an appreciation for performance tuning on a variety of database engines Data pipeline development experience in Python (especially using pandas, parsing API responses, posting data to API’s etc.) Excellent analytical and problem-solving skills An appreciation for the … big picture while delivering short/mid-term solutions Experience of building data warehouses, enterprise data warehouses or data lakes with ETL pipelines Experience with AWS tools including Glue, Lambda, S3, RDS, is preferred An understanding of CICD concepts including having a working knowledge more »

the future of Azure solutions with Ascent? If so, we are looking for you. We are looking for Cloud Solution Architects with a Data and AI specialism who are eager to be a part of the team—you'll be instrumental in our mission to leverage technology accelerators … and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data … experience in Azure data and AI technologies, like Fabric, Synapse, Databricks, Spark, Python, GitHub, Data Factory, Azure Data Lake, Power BI, Cognitive Services, Purview, etc. Strong data analysis and modeling skills. High-level understanding of Azure infrastructure. Experience with CI/ more »

a business who have made great strides in investing in their IT function and who have stated that being led and driven by data is one of their core business aims. You will be integral to this and will be responsible for establishing and building the Data & Analytics function from scratch - you'll design, own and implement the Data Science/Data Analytics strategy as well as selecting and implementing the tools that will enable them to improve the performance of the business. The Role: The role sits within the core … work with. The Tech stack is new and investment within the business is there to enable you to establish and build a successful Data/Analytics functions. Key responsibilities include: - Lead the development and execution of the roadmap for Data and Analytics - Work closely with key more »

Join a team of Google Cloud experts, using your knowledge of data to thrive in a fast paced and innovative environment. You’d drive out the cloud transformation, taking a lead on all things data related in a Google Premier Partner. You will actively engage with … clients, gathering requirements, creating the appropriate structure for data in ERA data warehouses and develop … robust ETL processes - thus ensuring the integrity of the data. Your role will be instrumental in the creation of a new data lake/warehouse/hub built in GCP. You are confident using the full suite of Google data products, IAC, CI/CD more »