376 to 400 of 2,763 Big Data Jobs

is currently seeking a Senior Engineer based out of our London office. As a leading, global financial information services provider, Fitch Group delivers vital credit and risk insights, robust data, and dynamic tools to champion more efficient, transparent financial markets. With over 100 years of experience and colleagues in over 30 countries, Fitch Group’s culture of credibility, independence … and transparency is embedded throughout its structure, which includes Fitch Ratings, one of the world’s top three credit ratings agencies, and Fitch Solutions, a leading provider of insights, data and analytics. With dual headquarters in London and New York, Fitch Group is owned by Hearst. Fitch's Technology & Data Team is a dynamic department where innovation meets … impact. Our team includes the Chief Data Office, Chief Software Office, Chief Technology Office, Emerging Technology, Shared Technology Services, Technology, Risk and the Executive Program Management Office (EPMO).Driven by our investment in cutting-edge technologies like AI and cloud solutions, we’re home to a diverse range of roles and backgrounds united by a shared passion for leveraging More ❯

the infrastructure required for deploying and scaling machine learning services. Implement and manage the CI/CD pipelines to ensure seamless and efficient deployment of ML models. Collaborate with data scientists, ML researchers, and language experts to understand the requirements for deploying ML models and provide necessary infrastructure support. Automate and streamline the build, test, and deployment processes to … availability, and scalability of production ML systems. Develop and maintain robust monitoring, logging, and alerting systems to proactively identify and address issues. Implement security best practices to protect sensitive data and ensure compliance with relevant regulations. Stay up-to-date with industry trends and emerging technologies related to ML Ops and DevOps, and propose innovative solutions to improve our … such as AWS, Azure, or GCP) and local cluster deployments, and experience in deploying and managing ML services on these platforms. Knowledge of distributed computing frameworks (e.g., Spark) and big data technologies (e.g., Hadoop, Kafka). Proficiency in Python, Shell, Ruby, Golang, or C++ and experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation). Hands-on experience More ❯

the infrastructure required for deploying and scaling machine learning services. Implement and manage the CI/CD pipelines to ensure seamless and efficient deployment of ML models. Collaborate with data scientists, ML researchers, and language experts to understand the requirements for deploying ML models and provide necessary infrastructure support. Automate and streamline the build, test, and deployment processes to … availability, and scalability of production ML systems. Develop and maintain robust monitoring, logging, and alerting systems to proactively identify and address issues. Implement security best practices to protect sensitive data and ensure compliance with relevant regulations. Stay up-to-date with industry trends and emerging technologies related to ML Ops and DevOps, and propose innovative solutions to improve our … such as AWS, Azure, or GCP) and local cluster deployments, and experience in deploying and managing ML services on these platforms. Knowledge of distributed computing frameworks (e.g., Spark) and big data technologies (e.g., Hadoop, Kafka). Proficiency in Python, Shell, Ruby, Golang, or C++ and experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation). Hands-on experience More ❯

the infrastructure required for deploying and scaling machine learning services. Implement and manage the CI/CD pipelines to ensure seamless and efficient deployment of ML models. Collaborate with data scientists, ML researchers, and language experts to understand the requirements for deploying ML models and provide necessary infrastructure support. Automate and streamline the build, test, and deployment processes to … availability, and scalability of production ML systems. Develop and maintain robust monitoring, logging, and alerting systems to proactively identify and address issues. Implement security best practices to protect sensitive data and ensure compliance with relevant regulations. Stay up-to-date with industry trends and emerging technologies related to ML Ops and DevOps, and propose innovative solutions to improve our … such as AWS, Azure, or GCP) and local cluster deployments, and experience in deploying and managing ML services on these platforms. Knowledge of distributed computing frameworks (e.g., Spark) and big data technologies (e.g., Hadoop, Kafka). Proficiency in Python, Shell, Ruby, Golang, or C++ and experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation). Hands-on experience More ❯

You'll work on creating scalable, efficient, and secure systems that integrate seamlessly with Amazon's existing tools and services. This role involves close collaboration with machine learning engineers, data scientists, and UX/UI designers to create a seamless and context-aware AI solution that enhances productivity across various user personas within Amazon. Technical Skills Needed: * Strong proficiency … particularly AWS services * Familiarity with containerization technologies like Docker and orchestration tools like Kubernetes * Understanding of CI/CD pipelines and DevOps practices * Knowledge of security best practices and data privacy considerations * Familiarity with big data technologies (e.g., Hadoop, Spark) is a plus * Basic understanding of machine learning concepts and their software engineering implications Key job responsibilities … Key job responsibilities 1. Design and implement robust, scalable architectures for AI-powered applications. 2. Develop high-performance backend services to support AI model integration and data processing. 3. Create and maintain RESTful APIs for seamless interaction between AI models and front-end applications. 4. Design and implement microservices architecture to ensure modularity and scalability of the system. 5. More ❯

the infrastructure required for deploying and scaling machine learning services. Implement and manage the CI/CD pipelines to ensure seamless and efficient deployment of ML models. Collaborate with data scientists, ML researchers, and language experts to understand the requirements for deploying ML models and provide necessary infrastructure support. Automate and streamline the build, test, and deployment processes to … availability, and scalability of production ML systems. Develop and maintain robust monitoring, logging, and alerting systems to proactively identify and address issues. Implement security best practices to protect sensitive data and ensure compliance with relevant regulations. Stay up-to-date with industry trends and emerging technologies related to ML Ops and DevOps, and propose innovative solutions to improve our … such as AWS, Azure, or GCP) and local cluster deployments, and experience in deploying and managing ML services on these platforms. Knowledge of distributed computing frameworks (e.g., Spark) and big data technologies (e.g., Hadoop, Kafka). Proficiency in Python, Shell, Ruby, Golang, or C++ and experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation). Hands-on experience More ❯

range is provided by Matillion. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Matillion is The Data Productivity Cloud. We are on a mission to power the data productivity of our customers and the world, by helping teams get data business ready, faster. Our … Fit: Lead workshops or trials to validate solution fit with business objectives Position competitive advantages to influence trial success criteria Guide customer teams to integrate our solutions into their data stacks during trials while driving measurable business outcomes Support technical aspects of credit sizing estimates Customer Onboarding and Growth: Document customer insights during the sales cycle to ensure a … Collect and communicate customer feedback to the Product and Engineering teams, ensuring continuous product improvements and alignment with market needs Stay informed about industry trends and best practices in data integration, cloud computing, and data transformation, sharing insights with both customers and internal teams About you What we are looking for includes: Essential Criteria 5+ years in a More ❯

tools for musicians and artists to use to promote their music. At un:hurd music, we've created a music-tech platform that uses proprietary technology to turn music data into stronger promotional campaigns for artists. We've created both mobile and web applications which act as the 'digital marketing companion' for independent artists, facilitating data-led promotional … hire responsible for the software development and technical infrastructure needed to design, train, deploy and scale machine learning models in production environments. You will harness a diverse array of data sources, from streaming services to social media, revolutionizing the way artists promote their music. Our Data Team members are full stack data professionals who independently manage projects … across the complete spectrum, from raw data ingestion to deployment, monitoring, and optimization. While this role emphasizes data engineering and ML deployment, you will have the responsibility of managing projects with autonomy across the full data lifecycle. Responsibilities📝 As an ML Engineer at Un:hurd music, you'll be: MLOps and Model Deployment : Own the deployment, maintenance More ❯

tools for musicians and artists to use to promote their music. At un:hurd music, we've created a music-tech platform that uses proprietary technology to turn music data into stronger promotional campaigns for artists. We've created both mobile and web applications which act as the 'digital marketing companion' for independent artists, facilitating data-led promotional … hire responsible for the software development and technical infrastructure needed to design, train, deploy and scale machine learning models in production environments. You will harness a diverse array of data sources, from streaming services to social media, revolutionizing the way artists promote their music. Our Data Team members are full stack data professionals who independently manage projects … across the complete spectrum, from raw data ingestion to deployment, monitoring, and optimization. While this role emphasizes data engineering and ML deployment, you will have the responsibility of managing projects with autonomy across the full data lifecycle. Responsibilities📝 As an ML Engineer at Un:hurd music, you'll be: MLOps and Model Deployment : Own the deployment, maintenance More ❯

tools for musicians and artists to use to promote their music. At un:hurd music, we've created a music-tech platform that uses proprietary technology to turn music data into stronger promotional campaigns for artists. We've created both mobile and web applications which act as the 'digital marketing companion' for independent artists, facilitating data-led promotional … hire responsible for the software development and technical infrastructure needed to design, train, deploy and scale machine learning models in production environments. You will harness a diverse array of data sources, from streaming services to social media, revolutionizing the way artists promote their music. Our Data Team members are full stack data professionals who independently manage projects … across the complete spectrum, from raw data ingestion to deployment, monitoring, and optimization. While this role emphasizes data engineering and ML deployment, you will have the responsibility of managing projects with autonomy across the full data lifecycle. Responsibilities As an ML Engineer at Un:hurd music, you'll be: MLOps and Model Deployment : Own the deployment, maintenance More ❯

Databricks' largest and most strategic customers in the Digital Native Business (DNB) segment. In this customer-facing role, you will leverage your technical expertise in Apache Spark and other data technologies to triage and resolve complex product issues and unblock our customers' most critical technical challenges. The Impact You Will Have Perform advanced Troubleshooting and Root Cause Analysis to … customer engagements and technical presentations to provide rapid solutions to production-impacting issues, demonstrating deep technical expertise and building strong customer trust. What We Look For Technical Expertise in Big Data and Spark: 8-12 years of experience designing, building, and troubleshooting distributed computing applications, with 4+ years delivering production-scale Spark/ML/AI solutions using … Python, Java, or Scala. Data Engineering Specialization: Hands-on expertise with Data Lakes, SQL-based databases, and Cloud-based Data Warehousing/ETL tools like Snowflake, Redshift, Bigquery, etc Advanced Tech Skills : Deep knowledge of Spark core internals, Delta/Iceberg, JVM optimization, and memory management, with additional proficiency in AI ecosystems like Machine Learning, Deep Learning More ❯

engagement.” SecurityScorecard is proud to be funded by world-class investors including Silver Lake Waterman, Moody’s, Sequoia Capital, GV and Riverwood Capital. About the Team: At SecurityScorecard, the Data Science organization builds AI and ML products that empower our customers to manage cybersecurity risk. We leverage massive datasets sourced by our internal Threat Intelligence teams to create the … build LLM-powered systems for automating and accelerating cybersecurity risk assessment workflows. About the Role: As an ML Engineer, you will design and optimize machine learning algorithms, build scalable data pipelines, and deploy reliable models into production environments. You'll collaborate with cross-functional teams to integrate ML solutions into products, conduct research to stay ahead of emerging technologies … while working in a dynamic, collaborative environment. Responsibilities: Technical Leadership: Establish best practices and share expertise through mentorship. Model Development: Design, train, and optimize machine learning models and algorithms. Data Pipeline Creation: Build and maintain scalable data pipelines to preprocess, clean, and transform raw data for analysis and model training. Model Deployment: Implement and manage models in More ❯

engagement.” SecurityScorecard is proud to be funded by world-class investors including Silver Lake Waterman, Moody’s, Sequoia Capital, GV and Riverwood Capital. About the Team: At SecurityScorecard, the Data Science organization builds AI and ML products that empower our customers to manage cybersecurity risk. We leverage massive datasets sourced by our internal Threat Intelligence teams to create the … build LLM-powered systems for automating and accelerating cybersecurity risk assessment workflows. About the Role: As an ML Engineer, you will design and optimize machine learning algorithms, build scalable data pipelines, and deploy reliable models into production environments. You'll collaborate with cross-functional teams to integrate ML solutions into products, conduct research to stay ahead of emerging technologies … while working in a dynamic, collaborative environment. Responsibilities: Technical Leadership: Establish best practices and share expertise through mentorship. Model Development: Design, train, and optimize machine learning models and algorithms. Data Pipeline Creation: Build and maintain scalable data pipelines to preprocess, clean, and transform raw data for analysis and model training. Model Deployment: Implement and manage models in More ❯

priorities. Create and maintain a roadmap for AI/ML development, ensuring continuous improvement and innovation. Lead the full lifecycle of AI/ML projects, from problem definition and data collection to model development, deployment, and monitoring. Oversee the design, development, and implementation of AI/ML models and algorithms using appropriate tools and techniques. Ensure the quality and … Keras. Expertise with Large Language Models/Generative AI and Prompt Engineering. Also, using LLM/GAI solutions for usage in human-machine teaming for Software Development. Proficiency in data mining, data analysis, and data visualization. Experience with cloud computing platforms such as AWS, Azure, or GCP. Experience with big data technologies such as Hadoop … with MLOps and deploying models at scale. Experience with A/B testing and other methods for evaluating the performance of AI/ML models. Experience working with sensitive data and adhering to data privacy regulations. Salary Range: $188,100.00 - $282,100.00 The above salary range represents a general guideline; however, Northrop Grumman considers a number of factors More ❯

capabilities in business applications. Design and develop API's for Omni-channel clients. Provide technical guidance to Team members Build APIs and UIs to help make use of large data sets, infrastructure and user experience. Own the full lifecycle for web software development, from ideas to production. Provide programming expertise and business analysis skills within broad business area, usually … be written, and designs, codes, tests, debugs, and documents programs. Create & review programming documentation and recommends changes in development, maintenance and application standards. Analyze and develop logical database designs, data models and relational data definitions across multiple computing environments (e.g., host based, distributed systems, client server, etc.) Comply with architectural standards and established methodologies and practices. WHAT DO … s Degree or equivalent Minimum of 10 years of software development experience Minimum of 6 years of experience: Java, .NET, Python Minimum of 6 years experience with databases and data modeling/design (SQL and NoSQL) Minimum of 5 years coordinating team efforts in a project or operations environment Minimum of 3 years in full stack development for cloud More ❯

applications (e.g., microservices, APIs), setting technical direction and ensuring code quality Solve intricate back-end architectural and performance challenges, identifying and implementing innovative solutions that enhance system efficiency and data integrity Champion Agile methodologies, leading ceremonies and driving best practices within development teams Manage project software aspects, ensuring development efforts align with overall project objectives and client needs Define … members. Requirements Professional experience in Java development Strong proficiency in Java 8+ (ideally Java 11/17+) Extensive experience with Spring Framework (Spring Boot, Spring MVC, Spring Security, Spring Data JPA).Solid understanding of relational databases (e.g., PostgreSQL, MySQL, Oracle) and ORM frameworks (e.g., Hibernate, JPA) Experience with RESTful API design and development Proficiency with version control systems, particularly … AI concepts, libraries, or frameworks (e.g., TensorFlow, PyTorch, scikit-learn, Hugging Face Transformers, Keras, etc.) Familiarity with Python for AI/ML development is a significant advantage. Experience with data engineering pipelines or big data technologies (e.g., Kafka, Spark) is a plus. The recruitment process you can expect for this role is an initial call with your More ❯

Job Description We are looking for a skilled ETL Developer with hands-on experience in Talend, Python, and Spark, to join data engineering team. The ideal candidate will be responsible for designing, building, and maintaining ETL pipelines that support data extraction, transformation, and loading from various sources into target systems. Key Responsibilities: · Design, build, and maintain ETL workflows … using the Talend ETL toolset. · Develop ETL solutions for extracting and transforming data from various sources such as Cloudera, PostgreSQL, and SQL Server. · Create and manage database schemas, tables, and constraints based on business requirements. · Collaborate with cross-functional teams to understand source systems and ensure accurate data mapping and transformation. · Write transformation logic using ETL tools or … scripting languages like SQL and Python. · Ensure data is clean, validated, and aligned with target schema and data quality standards. · Contribute to data quality improvement initiatives and proactively resolve data inconsistencies. · Participate in troubleshooting and performance tuning of ETL jobs and workflows. Required Skills & Qualifications: · Proven experience with Talend, Python, and Apache Spark. · Strong understanding of More ❯

month ago Be among the first 25 applicants As part of the Big Data Team, you will be using cutting edge technologies to work on collating data across different sources within GiG. Sources are all in real time, and you will be supporting an event driven micro service lambda architecture. Your focus is to work with the … current agile team and contribute to the platform's objectives and continue being an enabler to many other data technology stakeholders such as the Business Intelligence, Data Science and Quality Assurance teams. You will be up for a challenge, to continue maintaining and adding new features to a platform that ingests up to 5000 messages per second across … multiple products such as Lottery, Sports and Casino. Reporting to the Lead Big Data Engineer and supported by the Big Data Architect to follow best practices, you'll be guided into delivering world class product increments that support our Tier 1 Platform. You're really awesome at: Object oriented programming (Java) Data modelling using any More ❯

software developer who likes to solve business problems, Selling Partner Services (SPS) is the place for you. Our team is responsible for Case Management System. We are looking for data engineers who thrive on complex problems and solve for operating complex and mission critical systems under high loads. Our systems manage case resolution systems with hundreds of millions of … requests, and respond to millions of service requests. We have great data engineering and science opportunities. We are aimed to provide customizable and LLM based solution to our clients. Do you think you are up for this challenge? Or would you like to learn more and stretch your skills and career? The successful candidate is expected to contribute to … all parts of the data engineering and deployment lifecycle, including design, development, documentation, testing and maintenance. They must possess good verbal and written communication skills, be self-driven and deliver high quality results in a fast paced environment. You will thrive in our collaborative environment, working alongside accomplished engineers who value teamwork and technical excellence. We're looking for More ❯

Key Responsibilities: Architect scalable data processing and analytics solutions for big data storage, processing, and consumption. Clearly, articulate the pros and cons of various technologies and platforms while proposing solutions. Prior experience on cloud platform (AWS/Azure/GCP) Define architecture, blueprints/patterns, accelerators & interoperability standards. Define data security and data privacy standards … for solutions. Drive the evolution of data architecture. Lead architectural discussions and design workshops with internal stakeholders. Create technical documentation. About You: You have a bachelor's degree in STEM. You have more than 5+ years of data engineering experience, and 3+ years as a data architect. Extensive hands-on experience in leading large-scale full-cycle … enterprise data warehousing (EDW), BI reporting, and dashboard development projects. You understand the latest database and analytical technologies including data lake/lakehouse architectures and NoSQL storage. You have a strong understanding of data modelling techniques and are experienced in building domain data models. You have hands-on experience with designing and tuning ETL/ELT More ❯

Responsibilities: 16-18+ years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache … Spark, Beam or equivalent). In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. Excellent consulting experience and ability to design and build solutions, actively contribute to RfP response. Ability to be a SPOC for all technical discussions … across industry groups. Excellent design experience, with entrepreneurship skills to own and lead solutions for clients Excellent ETL skills, Data Modeling Skills Excellent communication skills Ability to define the monitoring, alerting, deployment strategies for various services. Experience providing solution for resiliency, fail over, monitoring etc. Good to have working knowledge of Jenkins, Terraform, StackDriver or any other DevOps tools. More ❯

Job Description Responsibilities: 16-18+ years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing … services (Apache Spark, Beam or equivalent). In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. Excellent consulting experience and ability to design and build solutions, actively contribute to RfP response. Ability to be a SPOC for all … technical discussions across industry groups. Excellent design experience, with entrepreneurship skills to own and lead solutions for clients Excellent ETL skills, Data Modeling Skills Excellent communication skills Ability to define the monitoring, alerting, deployment strategies for various services. Experience providing solution for resiliency, fail over, monitoring etc. Good to have working knowledge of Jenkins, Terraform, StackDriver or any other More ❯

Job Title: Solutions Architect (Data Analytics)-Pre-sales, RFP creation Location: London (3days/week onsite) Duration: Permanent Responsibilities: 16-18+ years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at … least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. Excellent consulting experience and ability … response. Ability to be a SPOC for all technical discussions across industry groups. Excellent design experience, with entrepreneurship skills to own and lead solutions for clients Excellent ETL skills, Data Modeling Skills Excellent communication skills Ability to define the monitoring, alerting, deployment strategies for various services. Experience providing solution for resiliency, fail over, monitoring etc. Good to have working More ❯

Job Title: Solutions Architect (Data Analytics)-Pre-sales, RFP creation Location: London (3days/week onsite) Duration: Permanent Responsibilities: 16-18+ years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at … least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. Excellent consulting experience and ability … response. Ability to be a SPOC for all technical discussions across industry groups. Excellent design experience, with entrepreneurship skills to own and lead solutions for clients Excellent ETL skills, Data Modeling Skills Excellent communication skills Ability to define the monitoring, alerting, deployment strategies for various services. Experience providing solution for resiliency, fail over, monitoring etc. Good to have working More ❯

Responsibilities : 16-18+ years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache … Spark, Beam or equivalent). In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. Excellent consulting experience and ability to design and build solutions, actively contribute to RfP response. Ability to be a SPOC for all technical discussions … across industry groups. Excellent design experience, with entrepreneurship skills to own and lead solutions for clients. Excellent ETL skills, Data Modeling Skills. Excellent communication skills. Ability to define the monitoring, alerting, deployment strategies for various services. Experience providing solution for resiliency, fail over, monitoring etc. Good to have working knowledge of Jenkins, Terraform, StackDriver or any other DevOps tools. More ❯