1 to 25 of 335 Big Data Jobs in the UK

Job Title: AWS Data Engineer Work Arrangement: Hybrid (London) 2 to 3 days Rate: £400 - £420/day Duration: 6 months Number of Positions: 2 Role Description: We are seeking an experienced AWS Data Engineer with a minimum of 8 years' experience in Big Data platforms. … This role will involve working with cutting-edge technology to build and maintain Big Data pipelines in the cloud. Key Responsibilities: Develop code according to given requirements. Create and execute unit test cases. Assist in backlog grooming. Key Skills/Experience: Extensive experience in developing Big Data pipelines in the cloud using technologies such as Apache Spark. Expertise in performing complex data transformations using Spark SQL queries. Experience orchestrating data pipelines using Apache Airflow. Proficiency in Git-based version control tools. Proficiency with Linux commands and Bash Scripting. Working experience with AWS Big more »

and Australia. It’s official: Bazaarvoice is a Great Place to Work in the US , Australia, India, Lithuania, France, Germany and the UK! Staff Data Engineer (P7) - Global Data Platform (Enablement) team What is the BV Data team at Bazaarvoice? Authentic data is the lifeblood of … the Bazaarvoice business. It is imperative that our data is consumable, interpretable, and instantly available to fuel insights across our brand, retailer and consumer customers. The BV Data team works closely with Product, Engineering, Business Development, and Account teams to consistently find new ways to use data across the business. Who We Want Are you ready to combine your talent for crafting solid data systems and enthusiasm for cutting-edge technology to harness the power of data at Bazaarvoice? We’re looking for a strong data engineer who thrives on building large-scale more »

Switzerland. Our 8,700 employees support our approximately 65,000 customers in their digital transformation. We are looking for a Senior Global Product Manager – Data & AI who will own the definition, delivery and go-to-market of solutions and services of the Global Data & AI Center or Excellence … CoE) and SoftwareOne Intelligence Fabric reporting into the Director, Application Services function. Combining strong expertise in the area Data & AI with profound understanding of the market they anticipate demand and innovate on behalf of customers driving clear and differentiated SoftwareOne value proposition in synergy with all SoftwareOne’s capabilities … and services. Responsibilities: Product Design & Innovation : Drive the creation of repeatable Data & AI solutions and accelerators, capitalizing on ongoing projects and partnerships with hyperscalers to package cutting-edge offerings accelerating time-to-value for SoftwareOne customers. Strategic Partnership Management : Guide the technology collaboration with including the realization of joint more »

Solid Understanding of Data Engineering Concepts and experience of Building and maintaining reliable and scalable big data platform. Experience of Integrating Azure hosted platforms within Enterprise capabilities including ServiceNow, CyberArc, Azure DevOps in an Enterprise Environment. Experience of Implementing Development lifecycle Including dependency management and DevOps and more »

team, aligning technology initiatives with business objectives and driving innovation to enhance our competitive advantage. Build and mentor a team of talented software engineers, data scientists, and technology professionals, fostering a culture of collaboration, innovation, and continuous learning. Lead the design, development, and implementation of cutting-edge technology solutions … drive results. Expertise in software development methodologies, tools, and technologies, including but not limited to Python, R, SQL, cloud computing platforms (AWS, Azure), and big data technologies. Excellent communication and interpersonal skills, with the ability to collaborate effectively with stakeholders at all levels of the organization. Experience with more »

Solutions Architect - AWS Data Platform UK Remote (very ad-hoc travel) Market Day Rate - Outside IR35 Initial 6 months (high scope for extensions) Fruition IT are looking for an experienced Solutions Architect with extensive experience working across data platforms to join a well-recognised, highly regulated software focused … Solutions Architect, you will take responsibility for the platform design and architecture ahead of a migration from legacy to a brand new AWS cloud data platform. Requirements: Experience with AWS cloud data platforms Strong understanding of the role of architecture in enterprise data projects Proven commercial experience … migrating on prem solutions to the cloud, including re-architecting Prior experience working on data focused projects e.g. data warehousing, big data, data streaming Proficiency with Apache Kafka, Apache Spark, Apache Flink etc. We are an equal opportunities employer and welcome applications from all suitably more »

are we? Planixs is the market-leading, Manchester-based FinTech that develops next-generation analytics and optimisation software designed to address the challenges around ‘Big Data’ in the Financial Services space. Established in 2011, we work with global financial institutions, in providing its award-winning product suite Realiti … only continuing to improve our core product, but also adding optional modules to enable functionality such as payment throttling, managing instruments other than cash, big data reporting and predicting payment profiles. What’s on offer? Planixs do everything to support their people and offer an extensive benefits package more »

the ideal candidate will be able to perform the following Provide expert level understanding and support of infrastructure supporting SysTrack . Extensive experience with data consumption and analytics using Big Data solutions like Elk or Splunk and SQL to create data driven decision tools and dashboards … in support of the team’s scope of work Ability to exchange complex information within team and with others Analytical thinking and experience with data analysis tools and methodologies Team oriented and collegial approach to addressing challenges Strong people process and business focus High level of proficiency with all more »

microservices architecture. Looking for a resource who has worked on sophisticated SAAS platforms or microservices products. Experience working with global teams would be a big plus. Should be able to own workstreams within the platform and be responsible for it end to end to deliver outstanding outcomes. Our clients … to meet their expectations. The Role We are looking for an enthusiastic hands-on technologist to join an exciting opportunity for building a sophisticated data/analytics/reporting platform. As the director of data engineering/analytics/reporting, you will build and evolve the next gen … data platform to process and report huge datasets across our client ecosystem. You will own end to end projects to plan, design, and execute critical features of this platform. Role Responsibilities Architect & implement a highly scalable analytics and reporting platform. and resilient EAI architecture using off the shelf middleware more »

of Surrounding systems with MDM Understanding of Customer Screening and KYC requirements from Banking perspective Conduct MVP/POC Qualifying Criteria Experience in Architecting Data & Analytics Platforms Experience in Banking MDM implementation with atleast 2 implementation experience Experience in Data Governance Solutions Must Have strong understanding of Banking … Regulations & their applicability for Data & Analytics Platforms Experience with Relational Databases like Oracle, NoSQL Databases and/or Big Data technologies (e.g. Oracle, SQL Server, Postgres, Spark, Hadoop, other Open Source). Must have experience in Data Security Solutions (Identity and Access Management and Data … Must have experience with SLCD (Agile/Waterfall). Drive the architecture of a project, including authoring functional and design specifications, scalability, testing, quality data flow, and interface. Ability to Lead and Manage team and Interact with End users clients. Worked in Onsite/Offshore model. Demonstrated excellent communication more »

Data Engineer Salary: £59,479 - £66,100 (dependant on skills and experience ) Location: London UK About Us MI5 keeps the country safe from serious threats like terrorism and attempts by states to harm the UK, its people and way of life. We carry out investigations by obtaining, analysing, and … limited and subject to business need. The Role Technology sits at the heart of everything we do at MI5. We're looking for experienced Data Engineers prepared to take on a more senior role within a multi-disciplinary product team. As a Data Engineer and working closely with … technical specialists such as Product Owners, Business Analysts, Delivery Managers, Software Engineers, Data Scientists and Machine Learning Engineers, you’ll build and run secure data applications and data products. You’ll promote Agile technical practises, using Agile methodologies to deliver digital products that are core to MI5 more »

Assignment - 6 months Dayrate :£450 Job Purpose and Primary Objectives We are seeking a highly experienced Kafka Developer with expertise in Kafka Streams and Big Data technologies (Hadoop, Hue, Hive, Impala, Spark). The ideal candidate will have strong knowledge of key-value databases and experience in developing … microservices using Spring. The role involves designing and developing cloud-based data engineering solutions using Java/Scala, OpenShift/Kubernetes, with deployments managed through Jenkins. Key Responsibilities: Participate as a team member responsible for the progress and support of a major in-house streaming product. Create scalable and … configurable streaming applications to provide real-time data services for various 24/7 applications with high-performance requirements. Key Skills/Knowledge Solid experience in Big Data technologies, specifically Hadoop, Hive, Java and Spark/Scala . Advanced SQL knowledge for testing changes and replicating code more »

and be the point of contact and a role model for advanced modelling within the company. Maintain strong domain knowledge of leading ‘omics' and ‘big data’ computational methods Drive experimental design & modelling of deep phenotyping and/or omics data in close collaboration with wet-lab scientists. … member of cross-functional teams bringing together best-in-class Drug Discovery, Drug Development, Product & Project Management capabilities. Routinely use Python/R for data analyses, in particular data wrangling, modelling and visualisation. Develop solutions to increase automation, reliability and scalability of our data processing pipelines and … code in the form of SOPs. Present research updates to project teams and to the management team. Contribute to training initiatives to foster a data-driven culture. Qualifications & Experience Required PhD in computational biology or related Experience in delivering results in a fast-paced environment (biotech/pharma industries more »

Eames Consulting are delighted to be supporting an established Investment management company that are looking for a Data engineer. Responsibilities: Develop and maintain complex SQL queries, customize reports, and optimize data usage. Create tools to address business challenges and empower users with third-party tools. Design and implement … cloud-based data platforms, ETL pipelines, and data integration. Collaborate with colleagues to ensure data integrity, quality, and security standards are met. Experience required: 3 years experience working as a Data engineer or similar Strong proficiency in SQL or Data Bricks and database development, including … complex query optimization and performance tuning. Comfortable using programming languages such as Python Strong Data Warehousing experience - building data pipelines from scratch Good understanding of open source, big data, and cloud data platforms (e.g. AWS, Azure); given a business problem, you can analyse and evaluate more »

Job Title: Data Architect Location: London (Hybrid) Contract: 6 Months Day Rate: Up to 550 (Outside) Start Date: ASAP Key Responsibilities: • Collaborate with stakeholders across various departments to understand their data needs and objectives. • Translate business requirements into technical specifications and data models using Microsoft solutions. • Document … the current state of the enterprise data architecture, identifying gaps, redundancies, and opportunities for optimization. • Develop and maintain data models, schemas, metadata, and data flow diagrams to support the enterprise architecture. • Establish and enforce data governance policies and standards to ensure data quality, security, and … compliance. • Develop a data strategy roadmap, outlining key initiatives, milestones, and performance metrics to achieve a data-driven enterprise using Microsoft solutions. • Oversee the integration of disparate data sources into a cohesive and unified data ecosystem using Microsoft Fabric and related tools. • Work closely with IT more »

which require a business decision. An interest and appreciation of technology trends and government IT strategy such as, Cloud, Internet of Things, Cyber Security, Big Data and Digital service design and delivery Experience of working with and collaborating across technical and project work streams to drive results. Experience more »

Head of Data - Manchester - £120,000 The Company: Lorien Global are working in partnership with a company based in Manchester to hire a Head of Data into their leadership team. As the business travel into a transition phase, we need someone who has a confident technical knowledge and … leadership skills to guide the team through this time. The Role: The transition phase consists of various priorities to ensure the business can use data and develop its global solutions. Firstly to ensure the unification of couple teams ensuring they collaborate and work effectively, second we need to structure … the future data strategy and how it aligns with the global ambition. Leading the Data Team we're looking for a candidate who has the knowledge of traditional data platforms and a passion and drive to push modernisation, utilising Big Data, Machine Learning, Cloud Services more »

and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … practices, e.g. Mockoon, Sonar and CI/CD principles Proven experience designing solutions for B2C/B2B applications including front-end, back-end and data storage Experience and understanding of at least one Architectural framework e.g. Togaf Ability to define architectural standards/best practices for projects/teams … s degree/master's degree in computer science, Computer Engineering, or other STEM field It would be great if you have: Experience with big data, enterprise integration patterns, micro-services Experience or understanding of agile software architecture Understanding of infrastructure and networking (including cloud) Hands on experience more »

My client is an innovative and rapidly expanding Systematic Trading firm , seeks an experienced Software Engineer/Big Data Engineer with expertise in Python to work within a dynamic Data team building - Greenfield pipelines Data Frameworks APIs to enable the capture, ingestion, storage, and provision of … both traditional and large alternate datasets. You will work very closely with Quant Research, Traditional Data Engineering, Quant Development and Trading teams firmwide (X-Asset - Equities, Fixed Income, Commodities, FX, Crypto and Derivatives). Key Skills required 3+ years of exp. as a Software Developer/Big Data more »

artifacts for complex applications while being accountable for ensuring design constraints are met by software code development · Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture · Contributes to software engineering communities of practice and events that explore … and Security Preferred qualifications, capabilities, and skills: · Skilled with Python or PySpark · Exposure to cloud technologies (Airflow, Astronomer, Kubernetes, AWS, Spark, Kafka) · Experience with Big Data solutions or Relational DB. · Experience in Financial Service Industry is a bonus. more »

product management, frontend development, and QA, to deliver superior software solutions. Skills Required: In depth experience designing & building backend applications in Python. Familiarity with Big Data and Machine Learning technologies (NumPy, PyTorch, TensorFlow, Spark). Experience developing in a highly Agile/Scrum environment. Familiarity with CICD, containerisation more »

Azure Bachelor's degree or equivalent experience in Computer Science or related field Desirable Skills or Exposure AI and Large Language Models Machine Learning Big Data The Package Salary £55-65K per annum (depending on experience). Remote & Physical Office (usually 1 day per week but not more »

and be the point of contact and a role model for advanced modelling within the company. – Maintain strong domain knowledge of leading ‘omic and ‘big data’ computational methods – Drive experimental design & modelling of phenotyping and/or omics data in close collaboration with wet-lab scientists. – Work … member of cross-functional teams bringing together best-in-class Drug Discovery, Drug Development, Product & Project Management capabilities. – Routinely use Python/R for data analyses, in particular data wrangling, modelling and visualisation. – Develop solutions to increase automation, reliability and scalability of our data processing pipelines and … code in the form of SOPs. – Present research updates to project teams and to the management team. – Contribute to training initiatives to foster a data-driven culture. Principal Computational Biologist Qualifications & Experience: Required – PhD in computational biology or related PhD – Experience delivering results in a fast-paced environment (biotech more »

such as Java, C, C++, C#, Go, or Python, with proficiency in additional languages preferred Validated understanding of operating system fundamentals Strong understanding of data models and distributed persistence technologies Thorough understanding of the latest security principles, techniques, and protocols Strong troubleshooting and performance tuning skills Proficiency in network … written communication skills Strong analytical skills, with excellent problem solving abilities Preferred Qualifications Experience in Agile/SCRUM enterprise-scale software development Experience with big data solutions Direct experience with fleet orchestration for both virtual and containerized workloads Knowledge of Machine Learning fundamentals Working familiarity with networking protocols more »

models in a production environment - ideally in a start-up or scale-up. - Machine learning libraries and frameworks (TensorFlow, PyTorch, scikit-learn). - Python - Big data processing tools (e.g., Spark). The role offers a salary range of between £70-100K depending on experience. The successful candidate more »