26 to 50 of 127 Hadoop Jobs

Data Lead - Artificial Intelligence & Automation (12 Month Fixed-Term Contract) Information Tec[...]

Location
United Kingdom
Experience with Microsoft Azure a plus: Azure SQL Database, Analysis Services, Databricks, Data Lake, Logic Apps and Data Factory Understanding of Big Data technologies (Hadoop, Spark) Able to create rich visualisations that appropriately represent the underlying datasets. Review and align the reporting attributes against the Enterprise and conceptual data ...

Data Engineering - Data, Lakehouse and AI Data Platform Engineer - Vice President - London Lond[...]

Location
Greater London, England, United Kingdom
comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised or Kubernetes‐based deployment approaches where relevant What We Are Looking ...

Senior Java / SQL Developer

Location
Glasgow, Scotland, United Kingdom
Gradle). Desirable skills: Scala: Hands-on experience or a strong functional programming background using Scala. Big Data: Exposure to Apache Spark, Kafka, or Hadoop ecosystems. Cloud: Experience with AWS, Azure, or Google Cloud Platform. Experience in banking or financial services industry. Soft Skills Strong problem-solving abilities. Clear ...

Lead Funds Data Architect

Location
Belfast City District, Northern Ireland, United Kingdom
Oracle, Snowflake, Databricks). Experience with data integration (ETL/ELT, APIs). Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) is a plus. Domain Knowledge Exceptional understanding of the Funds business lifecycle, financial instruments, market data, and investment operations. In-depth knowledge ...

Senior Solutions Engineer (Manufacturing, Automotive, Defence)

Location
Greater London, England, United Kingdom
solutions on at least one public cloud platform (AWS, Azure, or GCP) Working knowledge of distributed data systems: Apache SparkTM, Delta Lake, or equivalent (Hadoop, Kafka, Flink) Experience leading technical customer conversations — discovery, whiteboarding, architecture reviews Familiarity with one or more: data engineering (ETL/ELT, medallion architecture, streaming ...

Senior Solutions Engineer (Technical, Presales, Data & AI, DNB)

Location
Greater London, England, United Kingdom
solutions on at least one public cloud platform (AWS, Azure, or GCP) Working knowledge of distributed data systems: Apache SparkTM, Delta Lake, or equivalent (Hadoop, Kafka, Flink) Experience leading technical customer conversations — discovery, whiteboarding, architecture reviews Familiarity with one or more: data engineering (ETL/ELT, medallion architecture, streaming ...

Senior Data Engineer

Hiring Organisation
Hackajob Ltd
Location
South West London, London, United Kingdom
Employment Type
Permanent, Part Time
Salary
£75,000
infrastructure underpinning data systems through a DevOps approach Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop Good understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different ...

SAS Data Engineering Consultant

Location
United Kingdom
Data Warehousing concepts. Experience of Enterprise ETL tools such as Informatica, Talend, Datastage or Alteryx. Project experience using the any of the following technologies: Hadoop, Spark, Scala, Oracle, Pega, Salesforce. Cross and multi-platform experience. Team building and leading. You must be: Willing to work on client sites, potentially ...

Full Stack Developer

Hiring Organisation
Stefanini
Location
Dearborn, Michigan, United States
Employment Type
Permanent
Salary
USD Annual
Data in design and optimize data pipelines and storage architectures for large-scale, high-volume/high-velocity datasets using tools such as Spark, Hadoop, Kafka, or Dataflow; strong understanding of distributed computing, partitioning, and data lake/warehouse patterns. Expert 1+ years of experience with Artificial Intelligence & Expert ...

Senior DevOps Engineer

Location
Greater London, England, United Kingdom
such as Pulsar, Kafka, RedPanda. Must have knowledge and experience automatically provisioning and supporting multiple big data technologies; such as MongoDB, DataBricks, Big Query, Hadoop, Spark, Trino, DataLakes/Lakehouse Architectures. Infrastructure management with Terraform Experience with Github or any other source control Knowledge of Scripting/Coding languages ...

Data Scientist I - Python and SQL

Hiring Organisation
NORC at the University of Chicago
Location
Chicago, Illinois, United States
Employment Type
Permanent
Salary
USD 100,000 Annual
technical writing skills. Ability to explain technical concepts to diverse audiences. Preferred Skills: Experience with large-scale data platforms such as Databricks, Spark, Hadoop, or Hive. Experience developing, evaluating, or deploying machine learning and AI solutions, including work with large language models, and cloud environments (e.g., AWS, Azure ...

Google Cloud Platform Data Engineer

Location
Bristol, England, United Kingdom
addition to the above, we would be thrilled if you also had: Experience of working on migrations of enterprise scale data platforms including Hadoop and traditional data warehouses An understanding of machine learning model development lifecycle, feature engineering, training and testing Good understanding or hands‐on experience of Kafka ...

Data Engineer

Location
Glasgow, Scotland, United Kingdom
data warehousing concepts and dimensional modeling. Strong experience in cloud platforms such as AWS/Azure/GCP. Experience with big data technologies (Spark, Hadoop, Kafka). Knowledge of API integrations and microservices-based data ingestion. Experience working in Agile/Scrum environments. Banking Domain Experience (Mandatory) Experience working ...

Senior Application Architect

Location
Greater London, England, United Kingdom
/ML offerings. Strong programming skills (Python, Java, C++) and experience with DevOps practices (CI/CD). Knowledge of big data technologies (Hadoop, Spark, Flink). Knowledge of NoSQL databases (MongoDB, Cassandra, DynamoDB), message queueing systems (Kafka, RabbitMQ), and version control systems (Git). Preferred Skills: Hugging Face ...

Data Science Manager

Location
Greater London, England, United Kingdom
production. Strong knowledge of Python and core ML libraries (e.g., spaCy, NumPy, SciPy, Transformers). Understanding of big data and cloud technologies (Spark, Hadoop, Azure, AWS, or GCP). Deep expertise in MLOps principles, scalable model deployment, and model governance. Excellent communication and stakeholder management skills with the ability ...

Senior Backend Software Engineer

Hiring Organisation
HTC Global Services Inc
Location
Dearborn, Michigan, United States
Employment Type
Permanent
Salary
USD Annual
scale, high-volume and high-velocity datasets. Work with distributed computing, partitioning, and data lake/data warehouse patterns using technologies such as Spark, Hadoop, Kafka, or Dataflow. Build, train, and deploy machine learning models or rule-based expert systems to support decision automation. Design, build, secure, and document ...

Data Engineer

Location
Romsey, England, United Kingdom
approach. Creating code that is open by default and easy for others to reuse. Required Skills Experience with Big Data technologies, such as Apache Hadoop, Spark or Pig AWS Apache NiFi Python or Java Built on over a 70 year heritage, Roke offers specialist knowledge in sensors, communications, cyber ...

Senior AI/ML Consultant, AWS Professional Services

Location
West of England, England, United Kingdom
degree, or experience in a professional field or military Experience as technical specialist in design and architecture Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) Experience in consulting, design and implementation of serverless distributed solutions Experience in software development with object oriented language Experience in cloud based ...

Solution Architect

Location
Greater London, England, United Kingdom
Life Sciences. Experience working for a software vendor, SaaS provider, or professional services organisation. Familiarity with Ataccama or similar enterprise data platforms. Exposure to Hadoop/Spark, NoSQL, XSLT, Hive, Kafka, Snowflake, or Databricks. Python or other programming languages. Familiarity with SDLC, code management and upgrades, and Unix/ ...

Machine Learning Engineer

Hiring Organisation
TeleWorld Solutions
Location
Plano, Texas, United States
Employment Type
Permanent
Salary
USD Annual
Regression, and Times Series Modeling. Experience using data with high-volume (1TB+) & high-dimensionality (500+ variables per schema), especially within a big data framework (HaDoop, Citus, MongoDB, etc). Experience performing Data Wrangling, Exploratory Data Analysis (EDA), Correlation Analysis, Statistical Methodologies (distributions, hypothesis testing, confidence intervals) & Significance Testing ...

Data Engineer

Location
Birmingham, England, United Kingdom
Choose a partner with intimate knowledge of your industry and first-hand experience of defining its future.Your locationYour locationIndustriesChoose a partner with intimate knowledge of your industry and first-hand experience of defining its future.Birmingham ...

Principal Developer

Location
United Kingdom
Services: SOAP and Rest IT networking CI/CD The Atlassian Suite (JIRA, Confluence, Bitbucket, Bamboo) Azure Services Machine learning algorithms Big Data (Hadoop, Azure Data Lake, S3, Apache Spark) Additional programming languages – Python, Scala, Typescript, CSS 3/SASS (or other pre-processors) Other Information The successful candidate ...

data engineer for finance data

Location
Greater London, England, United Kingdom
optimizing data pipelines; Understanding of data modeling and data transformation techniques; Knowledge of maintaining high data quality and integrity; Strong software development skills with Hadoop technologies such as Hive and Spark; Experience with Workday Studio and managing code within the Workday environment; Knowledge of SaaS applications such as Salesforce ...

NLP Engineer

Location
Greater London, England, United Kingdom
Strong understanding of data structures, algorithms, and software design principles Experience working with large-scale data processing, distributed computing, or cloud-based platforms (e.g., Hadoop, Spark, AWS) is highly desirable Familiarity with ESG investing principles and market trends is a plus Excellent problem-solving, analytical, and debugging skills Strong ...

Senior Data Scientist

Location
Holywell Row, England, United Kingdom
analysis of data. Manage and integrate data across dissimilar data sets. Analyze large-scale structured and unstructured data. Use frameworks such as Spark and Hadoop to conduct large-scale data processing. Perform statistical modeling and create data visualizations using products like Tableau, Microsoft Power BI and R Shiny. Research ...