101 to 125 of 518 Permanent Big Data Jobs

Data Scientist | Maritime Tech | £60K Join a scaling Maritime tech business as a Data Scientist. You will play a crucial role in leveraging data analytics to enhance our products and services, optimize operations, and drive strategic decision-making. If you are passionate about applying advanced analytical techniques … to solve complex problems in the maritime industry, we want to hear from you. Responsibilities Analyze raw data: assessing quality, cleansing, structuring for downstream processing Design accurate and scalable prediction algorithms Collaborate with engineering team to bring analytical prototypes to production Generate actionable insights for business improvements Qualifications Bachelor … classification techniques, and algorithms Fluency in a programming language, ideally Python but can also be Java or C/c++ SQL expeirence Familiarity with Big Data frameworks and visualization tools (Cassandra, Hadoop, Spark, Tableau) Get in touch with Ella Alcott - Ella@engagewithus.com more »

Azure Bachelor's degree or equivalent experience in Computer Science or related field Desirable Skills or Exposure AI and Large Language Models Machine Learning Big Data The Package Salary £55-65K per annum (depending on experience). Remote & Physical Office (usually 1 day per week but not more »

apply. Python App Developer Requirements: Proficiency with Python or PySpark. Exposure to cloud technologies such as Airflow, Astronomer, Kubernetes, AWS, Spark, Kafka. Experience with Big Data solutions or Relational DB. Demonstrated knowledge of software applications and technical processes within a cloud or microservice architecture. Hands On practical experience more »

SOA architecture design. * Experience with RDS like MySQL or PostgreSQL or others, and experienced with NoSQL like Redis or MongoDB or others; * Experience with BigData technologies like Hadoop eco-system is a plus. * Excellent writing, proof-reading and editing skills. Able to create documentation that can express cloud architectures using more »

Cloud Solution Architect London Permanent Are you passionate about leveraging cloud and data technologies to drive business success? Do you thrive in a dynamic, international environment where your technical expertise can make a real impact? If so, we have an exciting opportunity for you! We are currently seeking a … cloud platforms and infrastructure-as-code technologies. Experience with containerization, serverless computing, and SOA architecture. Familiarity with relational and non-relational databases. Experience with BigData technologies is a plus. Excellent written and verbal communication skills. Ability to work well under pressure and adapt quickly to change. Strong team player with more »

To get the chance to get matched to this role and other similar roles, click on Apply to set up your free profile. Their Data Team is made up of 50+ people, covering data engineering, data science, and data architecture specialisms. The team works with a … range of public and private sector clients, building production grade cloud solutions focussed on streaming, graph, big data, and data science use cases. Job Description Due to the nature of the client engagements, every employee needs to be able to achieve Security Clearance. This means that you … backgrounds, and are proud to have an organisational culture where employees can bring their authentic selves to work. Team They are constructing the top data engineering practice in the UK, and their team build bespoke, mission critical data solutions for the UK Government as well as bluechip corporate more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture: Spearhead the design … and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable and robust … data hub. Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices. Data Integration and Storage Solutions: Implement data storage solutions and manage large-scale processing systems, overseeing the integration more »

Exciting Opportunity: Python/Spark Big Data Software Engineer – Financial Services Sector 📍 Location: Glasgow 💼 Contract: 6 Months PAYE 💷 Rate: Up to £500 per Day Are you ready to take your software engineering career to the next level? We invite you to join a leading team in the financial … services industry where innovation meets top-tier excellence. We are on the lookout for a seasoned Python/Spark Big Data Software Engineer to play a key role in our agile team. What You Will Do: Devise and implement cutting-edge software solutions, venturing beyond traditional methods to … tackle complex challenges. Develop robust architecture and design artefacts that adhere to strict design requirements. Detect patterns and underlying issues in data to refine system architecture and coding practices. Enhance our team culture by promoting diversity, equity, inclusion, and respect. Participate in software engineering communities, staying up-to-date more »

new client is looking for a ServiceNow consultant who will be accountable for enriching, managing, and ensuring the quality of organisational and product usage data, with a focus on efficient query writing. They will enforce data governance policies and best practices, as well as develop documentation on data assets. Role includes: Instrument data collection on the ServiceNow platform Writing complex queries Maintain an in-depth understanding of data flow within the business Partner across multiple data teams Identify data integrity issues and conduct root cause analyses Develop workflows, processes, SLAs, and documentation for … product usage data governance Must have experience: 2 - 3 years Writing complex queries 2 - 3 years Experience with Glide Skills: big data analytics, database management, or an equivalent analyst position 2 - 3 years + developing on the ServiceNow platform 2 - 3 years Glide experience Proficiency in PL more »

Role Are you looking for an exciting opportunity to make a difference? Join our team and contribute to the future of fusion energy. As Data Engineer , you will play a central role within hardware/software development projects spanning the Authority's programmes, helping to develop HPC (High Performance … Computing) infrastructure towards ITER and the era of Big-Data and Exascale computation. This role has a bias towards High Throughput Computing (HTC) workflows and cloud-based computing in support of experiments (e.g. MAST-U). Additional Responsibilities: Collaborate with national and international partners across universities, research labs … and industrial organisations to deliver projects focused on data delivery, data object storage, and data-centric high-performance computing. Engage in approximately 3-4 projects annually, contributing to innovation and growth of UKAEA's capabilities in this domain by leveraging external resources. Work within a small, focused more »

on some of the most modern, innovative software in finance. you will get the opportunity to build one of the most scalable and performant data platforms, not only in the finance space, but in the world. Working alongside some of the smartest people in London, you will get a … impact on a growing business. Requirements: Strong experience with Python (2+ Years) Experience working with REST Microservices Strong SQL Experience working with very large data sets. Knowledge of big data tools (Spark, Kafka etc) Experience working in finance (Preferred) Strong formal education - ideally in Computer Science If more »

Responsibilities:  Commercial acumen and a recent proven experience in a similar role (such as Commercial Insight Analyst, Data Insight analyst in Product Sales, Product Insight Analyst etc)  Success track in synthesising complex and ambiguous information in order to drive actionable insight brought to life through communication and visualisation  Proficiency … in SQL, Qlik sense and Big Data  Innate curiosity about customers, products and competitors  Cooperative and positive can-do attitude What I’ll be doing – your accountabilities Understanding business context and expectations and translating into practical approaches to data analysis Applying a broad range of techniques (A …/B hypothesis testing, multivarate test,data exploration, data preparation, big data analytics, visualisations, statisticalanalysis, business analysis) for gatheringthe insights and identifying meaningfultrends in the data Generating tactical analysis to distilthe insights, identify opportunities & make recommendations Articulating trends using tactical data visualisation techniques and more »

the UK! Who We Want We are looking for a Staff Backend Engineer to join our Insights Back-End team to help build out data pipeline, data store and API layer of Bazaarvoice data that will power our various client-facing dashboards, raw data reporting, product … performance reporting. The ideal candidate has built and operated systems that aggregate and share data sets to support new product offerings and is well experienced in evaluating the right technologies to build those data sets. Success in the role is underpinned by a strong understanding of the business … cases of the product portfolio and building relevant data sets, API layer and access methodologies that support the portfolio goals. What You’ll Be Doing Own, design, implement and support of major components of the unified back end data. Define how data should be aggregated and made available more »

The ideal candidate will use their passion for big data and analytics to provide insights to the business covering a range of topics. They will be responsible for conducting both recurring and ad hoc analysis for business users. Responsibilities Business analysis Statistical analysis, such as time series, A …/B and multivariate tests Data visualization for business presentations and dashboard design with Qlik Sense Commercial product analysis experience Delivering effective and engaging presentations to a variety of audiences Data engineering as necessary to pull the data from the databases, joining multiple sources and aggregating as … necessary for extraction (preferably using SQL, Qlik Sense, python is a plus). Because data preparation will be c.25% of the role, the candidate requires technical background and comfort with this activity. Experience GCP BigQuery and Oracle PL/SQL experiences are a plus. Cooperative and positive attitude in more »

infrastructure and applications. Responsibilities: Utilize recent AWS experience to design, implement, and manage AWS services such as EC2, ASG, RDS, and OpenSearch for streaming big data. Implement Infrastructure as Code (IAC) principles using tools like AWS CloudFormation or Terraform to automate infrastructure provisioning and management. Develop and maintain deployment more »

Machine Learning/PyTorch/High Performance Computing/HPC/GPU/TPU/Deepspeed/AI/OpenAI/Distributed Systems/Big Data/ETL Pipeline/CUDA By applying to this role, you understand that we may collect your personal data and store more »

of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About you: Our team … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion more »

Leading ecommerce client are now searching for a Senior Data Engineer to contribute towards the delivery of their data strategy. This engineer will shape our client’s data function, delivering end to end solutions for an array of customer data projects. The role: Designing data pipelines, managing data warehouses, and implementing complex ETL processes. Work closely with data scientists, analysts, and stakeholders to optimise our client’s infrastructure. Optimise data driven products, personalisation, reporting and overall business success. Manage the whole data lifecycle (End to End). Ensure the reliability … and quality of data. Key Requirements: Strong experience designing data pipelines/warehouses using AWS and Snowflake. Exposure to big data technologies such as Kafka, Spark, or Hadoop. Solid experience with Snowflake, including performance optimisation and cost management. Strong experience with SQL and Data modelling. Excellent more »

the UK! Who We Want We are looking for a Staff Backend Engineer to join our Insights Back-End team to help build out data pipeline, data store and API layer of Bazaarvoice data that will power our various client-facing dashboards, raw data reporting, product … performance reporting. The ideal candidate has built and operated systems that aggregate and share data sets to support new product offerings and is well experienced in evaluating the right technologies to build those data sets. Success in the role is underpinned by a strong understanding of the business … cases of the product portfolio and building relevant data sets, API layer and access methodologies that support the portfolio goals. What You’ll Be Doing Own, design, implement and support of major components of the unified back end data. Define how data should be aggregated and made available more »

Role: Kafka Developer Duration: 6 Months Location: Milton Keynes Key responsibilities: experience as an Kafka Developer (Ideally Kafka Streams). on experience in Big data technologies (Hadoop, Hue, Hive, Impala,Spark,.) and stronger within Kafka. and experience using Key value data bases . Experience developing microservices … using Spring. and develop cloud-based data engineering solutions Java/Scala, Openshift/Kubernetes , deployments in Jekins Candidate will be part of the team responsible for progress and support of one of the main streaming in house products . well will be responsible for creating a scalable configurable … streaming applications to provide fresh data as part of data services for different applications ,usually 24/7 applications with a big performance requirement . Key skills/knowledge/experience: Data Hadoop - Hive and Spark/Scala solid experience advance knowledge - Been able to test more »

We are currently seeking a Data Engineer to join our client, a unique scale-up business who have received significant investment, that is entering a phase of large scale growth. This role will be a pivotal role in shaping the organisation’s data operations, as the company grows … and matures. As a Data Engineer you will design and build data pipelines that will fuel our client’s groundbreaking product lines. You'll collaborate across multiple disciplines to ensure seamless data flow, and go beyond pipelines to champion data quality, governance, integration, and transformation. About … overview of what the successful candidate will require (don’t worry if you don’t tick all the boxes!): Python for building and automating data pipelines. A solid understanding of ETL processes for data extraction, transformation, and loading. Experience with relational databases ( SQL ) and database design principles and more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description Here at Version 1, we are currently looking for an experienced Big Data Java Solutions Architect to join our growing Digital, Data & Cloud Practice. You will have the opportunity to work with the latest technology and worked on projects across … with clients and internal teams to understand business requirements and translate them into HLD and LLD solutions. Defining the architecture and technical design. Designing data flows and integrations using Hadoop. Working with the product team and testers to implement throughout testing. Creating and developing comprehensive documentation, including solution architecture more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description Here at Version 1, we are currently looking for an experienced Big Data Java Solutions Architect to join our growing Digital, Data & Cloud Practice. You will have the opportunity to work with the latest technology and worked on projects across … with clients and internal teams to understand business requirements and translate them into HLD and LLD solutions. Defining the architecture and technical design. Designing data flows and integrations using Hadoop. Working with the product team and testers to implement throughout testing. Creating and developing comprehensive documentation, including solution architecture more »

it, the best way to do this in a battery. As a Lead Engineer you will drive the re-platforming efforts of their core data & AI platform powering their SaaS product. Beyond that, you'll spearhead backend & data engineering, mentor team members, and optimise software engineer practices for … long- term success. What else? They operate on the big-data side of AI, tackling the unsolved problem of distributed AI. They have some ML as a Service, tackling the ML Ops loop as a service, interesting challenge. They are going to enable edge AI, another pioneering aspect. more »

implementing 3rd-party integrations, RESTful APIs, modern authentication and encryption methods (oAuth2, SSO, LDAP, federation, HMAC) Eager to learn and implement in the future big data ETL pipelines, ML models, try custom and innovative algorithms more »