151 to 175 of 3,285 Big Data Jobs

Join to apply for the Senior Data Engineer role at Thoughtworks Join to apply for the Senior Data Engineer role at Thoughtworks Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved … in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They work on the latest big data tools, frameworks and offerings (data mesh, etc.), while also being involved in enabling … credible and collaborative problem solving to execute on a strategy. Job responsibilities You will develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions You will develop intricate data processing pipelines, addressing clients' most challenging problems You will More ❯

Experience & Domain Knowledge - 6+ years of experience in data analytics or a related field, with a substantial portion in the telecommunications industry preferably in the networking experience in data analysis/data scientist roles. Data Analysis Skills: Exceptional analytical and problem-solving skills. Advanced proficiency in … SQL for querying large databases and Python for data analysis (pandas, numpy, etc.) and scripting. You can efficiently manipulate and analyze large datasets to extract meaningful insights. AI/ML & LLM Proficiency: Experience with machine learning or advanced analytics techniques. Exposure to AI/ML frameworks (such as scikit … learn or TensorFlow) and familiarity with Large Language Models (LLMs) or natural language processing is a big plus - you're comfortable exploring new AI-driven approaches to glean insights from data (structured or unstructured). Data Visualization: Proficiency in creating clear and compelling dashboards and visualizations using More ❯

On behalf of DWP, we are looking for a Senior Data Engineer for a 12 Month (Inside IR35) contract. Hybrid 2 days per week based in London, Manchester, Newcastle or Leeds. Note: SC Clearance is an essential requirement for this role, as a minimum you must be willing & eligible … require a postholder in situ), preference may be given to candidates who meet all of the essential criteria and hold active security clearance Senior Data Engineer Data Engineers are responsible for the creation and maintenance of analytics infrastructure, providing the foundations for data needs. Data Engineers … are responsible for developing, constructing, maintenance and testing of architectures, such as databases and large-scale processing systems, implementing data flows to connect operational systems, and writing and executing ETL scripts and codes. As a Senior Data Engineer you are responsible for leading, managing and delivering all aspects More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture … that empower multiple products and capabilities to power business decisions, scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide … technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for More ❯

Social network you want to login/join with: Solutions Architect - Data Modernization, slough col-narrow-left Client: Searce Inc Location: slough, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 5 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Who we … aim to become better, everyday. What are we looking for? Searce is looking for a Solutions Architect who is passionate about helping customers with data and analytics applications at scale. Our Data and Analytics practice team has a bunch of experienced technology consultants who’ve got there by … actually building awesome architectures. They come with technical breadth to understand the entire spectrum of infra, data and application solutions and yet don't hesitate to jump deeper and troubleshoot an error on the console. Having strong interpersonal skills, a Solutions Engineer, will work directly with some of our More ❯

Overview Job Title Lead Apache Hadoop Engineer Location London Corporate Title Vice President Technology serves as the foundation of our entire organization. Our Technology, Data, and Innovation (TDI) strategy aims to enhance engineering capabilities, implement an agile delivery framework, and modernize the bank's IT infrastructure. We are committed … other teams both in your area and in different geographical locations. You will have the chance to architect, design, and implement an open-source big data platform, enabling clients to produce, access, and analyze extensive datasets through our custom components and applications. What Well Offer You A healthy … opportunity to support a wide ranging CSR programme + 2 days volunteering leave per year Your Key Responsibilities Develop robust architectures and designs for big data platform and applications within the Apache Hadoop ecosystem Implement and deploy big data platform and solutions on-premises and in More ❯

SENIOR DATA ENGINEER - Public Trust Clearance Contract to Hire CBP Public Trust clearance $130,000 to $140,000 annually plus benefits. Hybrid - 2-3 days a week onsite, Ashburn, VA ALTA IT Services has a contract to hire opening for a Senior Data Engineer to join a contract … with a federal government client in Ashburn, VA. The Senior Data Engineer will work with our data warehousing team to transform transactional data into datasets that are consumable by a variety of consumers, for reporting and analytics. The successful candidate will be flexible and forward-leaning, able … to learn new tools and skills, and able to learn new data domains as the data warehouse grows. Work is hybrid 2-3 days a week onsite in Ashburn, VA. A CBP Public Trust clearance is required. RESPONSIBILITIES • Design, build, and maintain scalable and reliable data pipelines More ❯

This post is an exciting opportunity for a Data Scientist or Informatician to work with electronic healthcare databases, and to engage in big data techniques. The post will be based within King’s Centre for Military Health Research, the leading UK centre of excellence for military health … research and the project is funded by the Economic and Social Research Council (ESRC) for a Secondary Data Analysis Initiative (Phase 2). The post holder will be required to manage and process multiple large databases, utilising skills in programming and data linkage. Primary responsibilities will be to … i) conduct data linkages and develop databases, ii) extract data from the healthcare records databases, iii) ensure data quality and validity and iv) ensure appropriated data management procedures. The post holder will link electronic healthcare records to a large UK military cohort study and extract health More ❯

Quantitative Research - CDO Data Solutions Architect - Associate Quantitative Research - CDO Data Solutions Architect - Associate JPMorgan Chase & Co. London, United Kingdom Quantitative Research - CDO Data Solutions Architect - Associate Job Description Are you passionate about data architecture and innovation? Join us as a Data Solutions Architect to … bridge our Chief Data Office and Technology teams, designing advanced tooling to support our Markets Data Strategy. Lead the development of proof-of-concept prototypes and shape the future of our data initiatives. Job summary: As an Associate Data Solutions Architect within Quantitative Research, you will … play a crucial role in designing and promoting the adoption of advanced data tooling. You will prototype technical patterns for implementing Markets Data Standards and provide expert guidance on data usage within Markets. Your work will prioritize the delivery of technology data tooling, ensuring seamless integration More ❯

Overview Role: Senior Data Engineer and Platform Lead Location: Hybrid/Remote Position: Staff Morgan Advanced Materials is a world leader in the development and production of advanced materials. We produce a wide range of specialist, high specification materials that have extraordinary attributes and properties. Despite the complexity of … our customers’ products to perform more efficiently, more reliably and for longer. Morgan is making a significant investment in establishing a world-class global data team, and we are excited to welcome new employees who will play a crucial role in this initiative. As part of this team, you … will be instrumental in building the future data platform that will drive the success of our enterprise. Your contributions will not only shape the foundation of our data capabilities but also help position Morgan as a leader in leveraging data to achieve strategic business goals. This is More ❯

Managing Director – Head of Data Platform is a senior management level position responsible for two major applications. We work with large volumes of data (Terabytes and Petabytes) to bring the data from our front end systems and ensure data quality and data reconciliations are completed. … This then allows the data to work for the downstream avenues. The data we process mainly comes from Markets, Equities, Services, TTS and Fixed Income, with our main end users being Risk and Finance. Experience of managing Data technology Upgrades, Migrations or New Functionalities would be great … bank. This person must have handled large projects with management of 300-400 people and a portfolio of at least $15m. Experience in Large Data related projects in Banking or Financial institutions will be good. Responsibilities : Manage Large Big data platform with 20PB data and 10b+ More ❯

Job Type: Contract Job Location: Wimbledon , UK Job Description : For this role, senior experience of Data Engineering and building automated data pipelines on IBM Datastage & DB2, AWS and Databricks from source to operational databases through to curation layer is expected using the latest cloud modern technologies where experience … of delivering complex pipelines will be significantly valuable to how to maintain and deliver world class data pipelines. Knowledge in the following areas essential: Databricks: Expertise in managing and scaling Databricks environments for ETL, data science, and analytics use cases. AWS Cloud: Extensive experience with AWS services such … as S3, Glue, Lambda, RDS, and IAM. IBM Skills: DB2, Datastage, Tivoli Workload Scheduler, Urban Code Programming Languages: Proficiency in Python, SQL. Data Warehousing & ETL: Experience with modern ETL frameworks and data warehousing techniques. DevOps & CI/CD: Familiarity with DevOps practices for data engineering, including infrastructure More ❯

candidates - Max Salary - £62,000 outside London and £67,000 for London (within the M25) Job Ref: J12917 The role of the Senior Azure Data Engineer is to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets … business and end user needs. The role holder will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using … a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components and products. Design, write and iterate code from prototype to production ready. Understand security, accessibility and version control. Use a range of coding More ❯

Metyis is growing! We are looking for a Data Engineering Associate with 3-4 years of experience to join our Data and Analytics team in London. Who we are Metyis is a global and forward-thinking firm operating across a wide range of industries, developing and delivering Big Data, Digital Commerce, Marketing & Design solutions and Advisory services. Our long-term partnership model aims to create lasting impact and growth for our business partners and clients through extensive execution capabilities. Join our team to experience a collaborative environment with highly skilled multidisciplinary experts, where everyone has the … We are Metyis. Partners for Impact. What we offer Interact with senior stakeholders at our clients regularly to drive impactful business change. Work with Data Scientists to manage data throughout its lifecycle - acquisition, exploration, cleaning, integration, analysis, interpretation, and visualization. Become part of a fast-growing, international, and More ❯

days pw in office) Up to £62,500 + 5% annual performance related bonus We have an exciting new opportunity for a Data Engineer to join Robert Walters as a Consultant. As an employed Consultant, you will benefit from permanent employment with Robert Walters and will be deployed on … in return we will provide you with the opportunity to develop your skills with ongoing training and professional accreditations. Reporting into the Head of Data & Analytics, this role sits in the Data & Analytics team alongside Data Developers and Data Engineers. Key Responsibilities: Development and automation of … ingestion flows, data curation and access layers Define technical solutions and take part in the development and deployment of applications in accordance with central standard and guidelines Contribute to the improvement of standards, compliance and processes to guide Data Lake evolution Design, develop, test and deploy data More ❯

Job Description - Data Technical Architect (15223) Location: Luton/Hybrid Company Overview: When it comes to innovation and achievement, there are few organisations with a better track record. Join us and you’ll be able to play a big part in the success of our highly successful, fast … in Europe, and the tenth largest in the world. Flying over 80 million passengers a year, we employ over 13,000 people. It’s big-scale stuff and we’re still growing. Job Purpose: With a large investment into our big data platform (AWS, Databricks) and a … huge amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyze, and use data in a fast-paced organisation. You will join as a Data Technical Architect providing technical leadership to a More ❯

years. Whatever your priorities - work/life balance, career progression, sustainability, volunteering - you'll find like-minded people driving change at Howden. Job Title: Data Architect Location: London/Hybrid Job Type: Full-time Job Summary Are you passionate about designing scalable, high-performance data architectures on Azure … and Databricks ? Do you thrive on solving complex data challenges, integrating modern data platforms, and defining best practices for enterprise data management? We are looking for a Data Architect to lead the design and implementation of cutting-edge data solutions in a cloud-native environment. … You will play a key role in shaping data strategy, designing high-level and low-level architectures , and ensuring the seamless integration of data management tools. If you enjoy working with big data technologies, governance frameworks, and modern analytics platforms , this role is for you! Key More ❯

Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable … for timely delivery. They work on the latest big data tools, frameworks and offerings (data mesh, etc.), while also being involved in enabling credible and collaborative problem solving to execute on a strategy. Job responsibilities You will develop and operate modern data architecture approaches to meet … key business objectives and provide end-to-end data solutions You will develop intricate data processing pipelines, addressing clients' most challenging problems You will collaborate with data scientists to design scalable implementations of their models You will write clean, iterative code using TDD and leverage various continuous More ❯

Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable … for timely delivery. They work on the latest big data tools, frameworks and offerings (data mesh, etc.), while also being involved in enabling credible and collaborative problem solving to execute on a strategy. Job responsibilities You will develop and operate modern data architecture approaches to meet … key business objectives and provide end-to-end data solutions You will develop intricate data processing pipelines, addressing clients' most challenging problems You will collaborate with data scientists to design scalable implementations of their models You will write clean, iterative code using TDD and leverage various continuous More ❯

Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable … for timely delivery. They work on the latest big data tools, frameworks and offerings (data mesh, etc.), while also being involved in enabling credible and collaborative problem solving to execute on a strategy. Job responsibilities You will develop and operate modern data architecture approaches to meet … key business objectives and provide end-to-end data solutions You will develop intricate data processing pipelines, addressing clients' most challenging problems You will collaborate with data scientists to design scalable implementations of their models You will write clean, iterative code using TDD and leverage various continuous More ❯

The Role As a Core Data Engineer, you will play a pivotal role in designing, building, and optimising data pipelines, architectures, and workflows for our diverse client base. You'll work within dynamic, multi-disciplinary project teams to implement scalable data solutions while adhering to best practices … and emerging trends in data engineering. This is an exciting and valuable opportunity for an enthusiastic, earlier-stage data engineer to advance their career across a variety of commercial sectors. At Optima, you'll work within cross-functional teams, collaborating with experts in different fields and gaining exposure … development, with a focus on continuous learning and knowledge sharing. Engineering at Optima is a fast-growing team with strong partnerships in the wider data science community. With the chance to work alongside seasoned engineers, scientists, data architects, and product specialists, you'll be contributing to our collective More ❯

solar panels and EV chargers, we’re making it cheaper and easier for our customers to reduce their carbon-footprint. Are you passionate about Data & AI and eager to make a significant impact? We are growing our Data & Analytics department to drive value and innovation within our business. … Through the development of Data & AI products, we aim to enhance decision-making, improve performance, and make a valuable difference in our business and for our customers. Why Join Us? Innovative Environment: Stay ahead in the Data & AI field through use of cutting-edge technologies and creative thinking … develop, with access to resources and support to help you grow both professionally and personally. About your role: As a vital member of the Data Engineering team, you will play a key role in designing, building, and maintaining robust and scalable data pipelines and models. Your efforts will More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £50,000 - £77,500 - depending on experience Department: Technology and Data We’re 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers … for a thrilling new career in a fast-paced, dynamic workplace? If so, today might be your lucky day! We’re seeking a Senior Data Engineer to join our cutting-edge technology and data teams. This hands-on technical role involves building data solutions for various projects … and persistent data products. You’ll design and implement complex data pipelines, manage database populations, and ensure your solutions align with technical designs and data platform standards. While this role doesn’t include direct people management, you will support, coach, and mentor data engineers and associate More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £50,000 - £77,500 - depending on experience Department: Technology and Data We’re 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers … for a thrilling new career in a fast-paced, dynamic workplace? If so, today might be your lucky day! We’re seeking a Senior Data Engineer to join our cutting-edge technology and data teams. This hands-on technical role involves building data solutions for various projects … and persistent data products. You’ll design and implement complex data pipelines, manage database populations, and ensure your solutions align with technical designs and data platform standards. While this role doesn’t include direct people management, you will support, coach, and mentor data engineers and associate More ❯

policymakers across the UK so they can hear the views of businesses and communities first-hand. Key Responsibilities: Line management of an Analyst in Data Science and three Senior Research Assistants. Work with the Technical Agent for Data Strategy to implement the Data Analytics/AI and … for the Agency Network. Lead advanced research and experimentation in AI, including Machine Learning and Generative AI, and statistical modelling Develop and implement complex data science solutions, ensuring they deliver measurable business improvements. This will include the development of AI solutions for the analysis of Agency intelligence working alongside … analytical tools, including scoping and leading projects. Work collaboratively with the PAs and other support staff in the Network to implement improvements to the data management, technology and other systems and processes they use. Provide technical leadership and mentorship to an Analyst Data Scientist and 3 Senior RA More ❯