1 to 25 of 279 Big Data Jobs

Media, Retail and CPG, and Public Services. Consolidated revenues as of $13 billion. Job Description - Job Description- We are seeking a talented and experienced Data Architect to join our team. The ideal candidate will have a strong background in designing and implementing data solutions in an AWS DevOps … microservices environment using Kafka and Snowflake. As a Data Architect, you will play a crucial role in defining and implementing the data architecture, data modeling, and data integration solutions for our organization. Responsibilities : Design and implement scalable and efficient data architecture solutions in an AWS … environment, leveraging microservices architecture and DevOps principles. Work closely with development teams to understand data requirements and design appropriate data models and schemas for various applications and services. Implement and maintain data pipelines using Kafka for real-time data streaming and processing. Design, implement, and optimize more »

Job Description Big Data Scientist - Expert - Manchester Our Client an international organisation is looking to recruit a Big Data Expert with 7 to 10 years expertise as a Big Data Scientist. You will have Natural Language Processing (NLP) knowledge and experience and understand and … analyse large data sets to discover new insights. Working in a multi-disciplinary team within a highly technical and complex environment. Well versed in scalable data mining and machine learning techniques (using computers to improve as well as develop algorithms)Kernel Methods, Deep Learning, Statistical Relational Learning, Ensemble … Methods Model using advanced statistical/mathematical models, predict and segment data to hypothesize/evolve uses cases to monetize data and generate other business value. Translate business needs to technical requirements and implementation. Experience of Big Data technologies/Big Data Analytics. C++ more »

Azure Cloud Data Architect This role defines best practices in the evaluation, selection and design of the architecture of software components and related hardware/infrastructure requirements of the applications and its data, and the development of the application, including evaluation and selection of development methods, support processes … may also be considered based on relevant experience. Job responsibilities Architecture of solutions Cert in Cloud Azure (pref)AWS/GCP DevOps, Deployments, Releases Data Models, Data Bricks, Data Lakes Visualisation (Power BI, Qlik/Tableau) Architecting Enterprise Data Platform on Cloud particularly on Azure to … technical experience managing, developing and upgrading applications, within application/solution design Strong understanding of data modeling techniques in Relational, Document, Graph, and BigData platforms servicing OLTP, OLAP and mixed model architectures Excellent documentation skills and ability to complete high quality architecture artefacts in a timely fashion to meet more »

Position: Azure Data Architect Location: Remote Type: 6 Month Contract (Outside IR35) Rate: £550 to £600 Per Day Role: This is a fantastic opportunity to work for a leading Consultancy, my client is currently looking for an experienced Senior Data Architect to act as client architecture lead for … various programmes of work. Data Architect is a multi-disciplinary role, requiring collaboration with a wide range of stakeholders, from developers to C-level executives. You will be responsible for working with customers to influence and shape the end-to-end data management and analytics workstreams, within fast … paced and complex programmes, engaging in a wide variety of data management and analytics activities. Key Responsibilities: Support and influence Data Strategy, and Data Governance Policies and Principles Promote Data Management standards and best practices Support business and data requirements gathering Input and guidance to more »

not afraid to speak our minds to help steer our customers towards understanding and achieving their key goals. We are looking for a Lead Data Consultant to help us grow and on our journey of taking OC to the next level. Your experience as a data focused technologist … strategise, and deal with the ingestion, processing, integration and ability to get insights out of their data. What you’ll spend your time on: Data Strategy & Architecture: Help customers make sense of, and understand their data in the context of what their business is trying to achieve. Create … data models and articulate the tradeoffs around different data approaches. Design and Architect complex data platforms and solutions across a variety of different scenarios. Leadership & Consulting: Provide technical leadership and guidance for our customers and your fellow team-mates in the area of data and data more »

Job Description Big Data Scientist - Docklands London Our Client an international organisation is looking to recruit a Big Data Expert with 2 to 5 years expertise as a Big Data Scientist. You will have Natural Language Processing (NLP) knowledge and experience and understand and … analyse large data sets to discover new insights. Working in a multi-disciplinary team within a highly technical and complex environment. Well versed in scalable data mining and machine learning techniques (using computers to improve as well as develop algorithms)Kernel Methods, Deep Learning, Statistical Relational Learning, Ensemble … Methods Model using advanced statistical/mathematical models, predict and segment data to hypothesize/evolve uses cases to monetize data and generate other business value. Translate business needs to technical requirements and implementation. Experience of Big Data technologies/Big Data Analytics. C++ more »

Title: Data Architect Reporting to: Head of Data Location: Hybrid - London office 2/3 days a week Job description The role of a Data Architect is a visionary who translates business requirements into technology requirements and defines data standards and principles. The data architect … is responsible for visualizing and designing the organisation's enterprise data management framework for how IT infrastructure supports our data strategy. This role aims to show the company's infrastructure how data is acquired, transported, stored, queried, and secured. The data architecture built will be the … foundation of any data strategy. Strategy Responsible for visualising and designing the organisation's enterprise data management framework of today. This framework will describe the processes used to plan, specify, enable, create, acquire, maintain, use, archive, retrieve, control, and purge data. Responsible for understanding the overall TO-BE more »

For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer … definition, effort and cost estimation, Past experience in dealing with partners, tools vendors, etc. Business Domain Knowledge More than 5 years of experience in Big Data implementation projects Experience in the definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure and GCP … Cloudera, No-sql databases (Cassandra, Mongo DB), ELK, Kafka, Snowflake, etc. Past experience in Data Engineering and data quality tools (Informatica, Talend, etc.) Previous involvement in working in a Multilanguage and multicultural environment Proactive, tech passionate and highly motivated Desirable requirements: Experience in Data analysis and visualization more »

Head of Data Engineering & Data Governance £65,000 - £75,000 34 Days Holidays + Bank Holidays Fantastic Pension & Other Great Public Sector Benefits Career Progression Hybrid Working (Mainly working from home) A Great Working Environment Excellent Sport & Leisure Facilities On-Site Training and Personnel Development Offerings Office Location … is close to A45, A46, M1, M6, M40, M42, M69 Great Public Transport Links We have an exciting opportunity for an experienced Data Engineering Lead to join a busy team as the Head of Data Engineering & Data Governance. In this critical role, you will be responsible for … building a robust and efficient data infrastructure, overseeing the development, implementation, and governance of DataVaults and Kimball-style data warehouses/data marts. As the Head of Data Engineering & Data Governance, you will be responsible for developing a data engineering strategy aligned with the more »

Locations 25 Bank Street, Canary Wharf, London, Greater London, E14 5JP, GB Job Schedule Full time Job Shift Day JOB DESCRIPTION Data Risk and Control Manager Here at JPMorgan Chase & Co., we know that people want great value combined with an excellent experience, from a bank they can trust. … diverse, inclusive community of professionals that embrace teamwork and innovation. Responsibilities: You'll support the business through insightful analysis of their risk practices all data dimensions (Data Privacy, Data Governance, Data Use Case, Data Quality, Data Protection, Data Retention and Destruction, Data Storage, Data Architecture, Data Analytics, Data Engineering, Data Insights, Individual Rights and Model Governance). Regulatory Engagements: Lead global regulatory interactions/relationships/exams with OCC, FED, PRA, FCA, BaFIN, ECB etc and subsequent Matter Requiring Actions (MRA) for International Consumer Bank Globally including more »

Senior Data Engineer Luton/Hybrid Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast paced organisation. You will join as a Senior Data Engineer providing technical leadership to the Data Engineering team. You will play a major role in adhering to big data best practices whilst building and maintaining reliable data pipelines and products across … a range of exciting projects. Bringing a wealth of technical experience in big data platforms combined with excellent skills in development. This role will support the business on the journey from a greenfield big data estate to a mature data lead organisation What you’ll more »

Job Purpose As a Data Engineer, you'll be at the forefront of enhancing our client's data capabilities, ensuring every bit is optimised for success. You will be collaborating closely with their visionary Data Scientists, crafting intricate data models and stunning visualisations that will drive … strategic decision-making to new heights. Your expertise in programming languages and data analysis tools will be the key to unlocking their data's full potential. Your contributions will be pivotal in driving strategic decision-making, fueling various impactful use cases. Harness your prowess in programming languages and … data analysis tools, while showcasing your formidable analytical and communication skills. Responsibilities Support the design and maintenance of data integrity checks across our client's various systems. Collaborate with the Data Scientists to understand data needs, representing key data insights in a meaningful way. Building more »

Lead Big Data Engineer - Hybrid - £120K My client is a leading trading platform that is looking to add a talented Senior Big Data Engineer You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives. … in design, processes, and implementation to improve operational management, scalability, and extensibility. The following skills/experience is essential: -Proven experience as a Lead Big Data Engineer with excellent knowledge of Big Data -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark … etc -Excellent experience of ETL, data warehousing and handling a variety of data types -Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes and Business Intelligence (BI) -Experience implementing data visualisation and reporting tools -Excellent communication and business-facing skills more »

Our client is seeking Azure Big Data Architect in Bristol, UK. This is a hybrid role. Must have skills: strong hands on technical Skills in Python, Pyspark, Azure Databricks, Spark, ETL, Cloud Azure Good to have knowledge on ADF CI CD Description: Extensive experience working with large data sets with hands on technology skills to design and build robust Big Data solutions using Spark PySpark framework and Industry standard frameworks like Databricks Azure DevOps and other tools technologies on Azure Cloud Platform Key Roles and Responsibilities: Understand the requirement and analyze the source system data to come up with a high performance Data Architecture Good to have the Retail functional Knowledge Must have Good Knowledge and Hands on experience in Python PySpark ADF and ADB Good to have Knowledge in ADF CI CD Experience in designing architecting and implementing large scale data more »

Big Data Architect - Hybrid - £120K My client is a leading trading platform that is looking to add a talented Big Data Architect. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives. You'll … implementation to improve operational management, scalability, and extensibility. The following skills/experience is essential: -Proven experience as an Architect and excellent knowledge of Big Data -Excellence experience across Azure -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc -Excellent experience of ETL … data warehousing and handling a variety of data types -Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes and Business Intelligence (BI) -Experience implementing data visualisation and reporting tools -Excellent communication and business-facing skills Big Data Architect more »

Senior Data Engineer Hybrid AND Flexible Up to £75,000 + 10% bonus + share scheme MBN Solutions are delighted to have been retained to secure a Data Engineer (Big Data Technologies) for our client who are firmly positioned in the "Tech For Good" space. This … is a key hire for the client during the early stages of the growth of their Data team and it is therefore essential this person is highly experienced in all the areas of skills required. Our client are a start up/scale up and we are ideally looking … for a Senior Data Engineer who has previous experience and success in this environment previously. Your Role: Building reusable data pipelines at scale with the capability of integrating data from multiple sources automatically. Work with structured and unstructured data, and curate data to provide real more »

Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business … Analysts and Data Architects with discovery and best practices. Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure. Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark. Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis. Strong analytic skills related to working with unstructured datasets. Build processes supporting data transformation, data structures, metadata, dependency more »

We are a team of passionate engineers committed to building the best-in-class petabyte-scale data infrastructure optimization platform that combines hardware acceleration with performance metering to enable real-time actionable insights for reducing data center costs. So far, we have raised a total of $3.5M in … About the role As a Senior Software Engineer for this role, you will collaborate with the founding team to expand the integration of our Big Data processing acceleration technology with Apache Spark to drive new optimizations and broader SQL operation coverage. Your contributions to our core solution will … directly impact data infrastructure processing 10s of petabytes every day where Xonai is being deployed. Join us in building a cutting edge solution for the cloud to realize cost-effective data infrastructure at scale and with unparalleled flexibility. What you will do: Implement extensible optimizations in various query more »

Contract/Permanent Opportunity Azure Cloud Data Architect Hybrid (London 2x per Week) Must have Active Security Clearance Job responsibilities Architecture of solutions Architecting Enterprise Data Platform on Cloud particularly on Azure to support regulatory financial institution Designing Functional Architectures for Service Quality Designing and maintaining Non-Functional … Requirements, e.g., Capacity planning, availability, performance, housekeeping, monitoring and foundational capabilities of the Enterprise Data Platform Designing the application solution delivery and good understanding of Cloud Infrastructure solutions Leading technical teams as appropriate in data and analytics delivery implementation and support Performing technical assessment and evaluation of Cloud … technical experience managing, developing and upgrading applications, within application/solution design Strong understanding of data modeling techniques in Relational, Document, Graph, and BigData platforms servicing OLTP, OLAP and mixed model architectures Excellent documentation skills and ability to complete high quality architecture artefacts in a timely fashion to meet more »

We are looking for Senior Data Solution Architect Below are details Data Solution Architect Proven experience as architect and engineering lead in Data & Analytics stream In-depth understanding of data structure principles and data platforms Problem-solving attitude, solution mindset with implementation expertise Working experience … on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Well-versed with the end2end data management philosophies and governance processes Has pre-sales experience and have involved in RFP/RFI/RFQ processes Creative problem-solver with strong communication skills Excellent understanding of traditional … and distributed computing paradigm Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have strong implementation experience in all more »

Data DevOps Engineer - DevOps, Big data - Permanent - Gloucestershire Location: Gloucestershire/Bristol (full-time onsite) Salary: £65 - £95K per annum Negotiable DOE Benefits: Flexible working hours, career opportunities, private medical, excellent pension, and social benefits Active DV Clearance is highly desirable. Please note that candidates will need … with a global edge-to-cloud company advancing the way people live and work. They help companies connect, protect, analyse, and act on their data and applications wherever they live, from edge to cloud, so they can turn insights into outcomes at the speed required to thrive in today … The Candidate: We are looking for a bright, driven, customer focussed professional to join our clients Hybrid Cloud Delivery team, and work alongside Enterprise Data Engineering Consultants to accelerate and drive data engineering opportunities. This is a fantastic opportunity for a dynamic individual with big ambitions, who more »

JOB TITLE: Lead Data Architect (Cloud) SALARY: The salary banding for this role is £121,023 - £142,380 LOCATION: Manchester, Leeds, Halifax, Bristol or Edinburgh HOURS: 35 hours, full time WORKING PATTERN: Our work style is hybrid, which involves spending at least two days per week, or 40% of … T' shaped): Cloud platform technologies covering IaaS, PaaS, and SaaS services on Azure, GCP and AWS. Cloud database technologies focusing on GCP Relevant prior data architecture experience; Leading or being part of transformation in Data (e.g., move to advanced analytics/machine learning, data lake, big data, data democratisation) Data modelling and how that can help accelerate reuse of data and delivery of data consumption use cases Modern data technologies understanding e.g. Machine Learning and Generative AI Experience with data management capabilities like metadata, lineage, data quality more »

service, partner with Deutsche Bank to support contingent recruitment processes. Job description - the role On behalf of Deutsche Bank, we are looking for a Data Governance Analyst for an initial 6 month contract based in the Banks London Office on a hybrid working model of 3 days per week … tasks. 'Together we're sharing new perspectives and transforming what it means to be a bank.' Purpose of the role: Transaction Monitoring & Screening Global Data Steward Office is responsible for Data Governance, Data Quality Management (DQM) & Data Programme delivery covering key functions within Transaction Monitoring and … Screening. Working as part of the DQM team the Senior Data Analyst will be responsible for supporting the Data Quality Management Framework and for contributing towards the central Data Analytics capability. Data Quality Management Framework covers Data Quality Standards, Data lineage & Controls, Exception & DQ more »

Data Engineer – Hybrid (3 days in Office) Stratford-Upon-Avon £56k + 5% bonus & benefits Do you want to grow your expertise and experience and use your skills in a vibrant environment where teamwork, creativity, diversity, inclusivity, and technical excellence are expected and enjoyed? This SaaS company are seeking … from associates to principals, applying your technical and problem-solving capabilities to scale their applications. You’ll contribute to the organisation’s high-quality data engineering practices, participating in technical design, implementation, testing, deployment, and ongoing support and maintenance of the data platform. By going above and beyond … implementing new features, the company focus on customer experience, building a high-quality, secure, and scalable data platform. You'll apply your skills effectively and continue to develop them, while benefiting from the expertise of your more experienced colleagues, including: Pair and mob-programming. Peer code reviews. Modern big more »

a talented Senior Software Engineer with expertise in orchestrating end-to-end solutions from "curb to gate" while leveraging AWS, Python, Node.js, Kafka, and Big Data technologies. Job Description: As a Senior Software Engineer specializing in _Curb to Gate_ solutions, you will play a pivotal role in designing … and deploying robust software systems that orchestrate seamless user journeys from entry point to destination. Leveraging your expertise in AWS, Python, Node.js, Kafka, and Big Data technologies, you will contribute to the creation of scalable and efficient solutions that enhance the overall user experience. Responsibilities: - Architect and develop … Develop backend services and APIs using Python and Node.js, ensuring high performance, reliability, and security. - Implement event-driven architectures using Kafka for real-time data processing and communication between microservices. - Utilize Big Data technologies (e.g., Apache Spark, Hadoop) to process and analyze large volumes of data more »