51 to 75 of 98 Hadoop Jobs in the UK

Extensive hands-on experience showcasing expertise and a strong track record in the engineering field. Technical knowledge: Extensive experience with Python, distributed processing pipelines (Hadoop, Spark, Airflow, Dask), and very large datasets – statistical analysis, data quality control, optimizing storage. Cloud proficiency: Extensive experience with cloud and infrastructure services, including ...

ML### experienceExtensive hands-on### experienceshowcasing expertise and a strong track record in the engineering field. Technical knowledge: Extensive### experiencewith Python, distributed processing pipelines (Hadoop, Spark, Airflow, Dask), and very large datasets – statistical analysis, data quality control, optimizing storage. Cloud proficiency: Extensive### experiencewith cloud and infrastructure services, including, as well ...

Have:*** Experience in the development of algorithms leveraging R, Python, or SQL/NoSQL* Experience with distributed data and computing tools, including MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL* Experience with visualization packages, including Plotly, Seaborn, or ggplot2* TS/SCI clearance with a polygraph **Clearance:**Applicants ...

architectures Advanced Python and Microsoft SQL Server development Proven experience leading engineering teams or workstreams Strong stakeholder engagement and consulting skills Working knowledge of Hadoop Experience with test-driven development and CI/CD REST APIs and Kafka experience Nice to Have Experience leading data platform migrations Experience managing ...

architectures Advanced Python and Microsoft SQL Server development Proven experience leading engineering teams or workstreams Strong stakeholder engagement and consulting skills Working knowledge of Hadoop Experience with test-driven development and CI/CD REST APIs and Kafka experience Nice to Have Hands on experience with databricks a distinct ...

moderately complex systems and improving reliability/performance Strong fundamentals: data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree ...

from kernel, networking, storage, to applications Work in Python to design and deliver open source code Architect cloud infrastructure solutions like OpenStack, Kubernetes, Ceph, Hadoop and Spark either On-Premises or in Public Cloud (AWS, Azure, Google Cloud) Coach and develop your colleagues where you have insights Grow ...

Senior Data Engineer Who we are We are an advanced data and business consultancy headquartered in Edinburgh, UK. We are a practitioner-led organisation that collaborates with top consumer brands to drive transformation and foster ...

data availability, quality, and efficiency across markets. This role is onsite in London and requires strong SQL and programming skills, plus experience with Spark, Hadoop, and cloud platforms. #J-18808-Ljbffr ...

lead the design, development, and optimization of our data infrastructure in a hybrid role based in Hounslow. You will build scalable pipelines with Spark, Hadoop, Hive, and AWS, maintain data warehouses on Oracle/SQL Server, and drive data quality and security. You will leverage Informatica and scripting ...

7+ years of experience in data science and predictive modeling. Expertise in SQL, R, or Python for data analysis. Experience with big data technologies (Hadoop, Spark). Ability to translate complex data into business strategy. Highly competitive salary and stock options. Relocation assistance if required. State ...

money doing something you are passionate about. My client is based in LondonFollow me on Twitter for more roles and news @SebFintechSytems ENgineer – Security, Hadoop, SPark, debian, SELinux, Debian, puppet, ruby , python, kerberos ...

stakeholders. Preferred qualifications, capabilities, and skills Experience designing/implementing pipelines using DAGs (e.g. Kubeflow, DVC, Ray) Experience of big data technologies (e.g. Spark, Hadoop) Have constructed batch and streaming microservices exposed as REST/gRPC endpoints Familiarity with GraphQL #CIBAppliedAI #J-18808-Ljbffr ...

Preferred skills Kubernetes or other orchestration tools Azure API management or similar NewRelic scripted monitors Experience with security tools (including CheckPoint) and best practices Hadoop, Kafka, Presto (or similar BI/Big Data tech) #LI-Remote #LI-TB1 This job description is intended to convey information essential to understanding ...

Data, Data Warehousing, Business Intelligence, Machine Learning). Data Ecosystems: Familiarity with modern data architectures and tools, such as Big Data frameworks (Hadoop, Spark, Hive, BigQuery), Data Warehouses, and Machine Learning. Role Qualifications Industry Experience: 10+ years of experience in the Manufacturing and broader industrial supply chain environment. Sales ...

following middleware technologies (Kafka preferrable, Nats, Solace, TiBCo, RabbitMQ etc.) Experience working with SQL and databases such as Oracle, SQL Server, Hadoop etc. Experience with Java Multithreading/Concurrency, Web Services (SOAP/REST), DB2 Database, JMS, MQ, NDM, SFTP Acquainted with industry best practices and standards, software development ...

developing data engineering solutions using Python and PySpark. Practical experience with Apache Kafka and Apache NiFi for streaming, ingestion and orchestration. Experience working with Hadoop, Hive or comparable enterprise data-lake technologies. Solid knowledge of SQL, data transformation, data modelling and large-scale data processing. Experience integrating REST APIs … Apache NiFi. Integrate vendor platforms and enterprise systems through REST APIs and secure authentication mechanisms. Build data processing and storage solutions using Spark, Hadoop and Hive. Develop automated reconciliation, data quality and compliance controls to identify missing, duplicate or inconsistent records. Implement robust data flows with retry mechanisms, error ...

As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data‐lead, by equipping them with robust data platforms. You'll also ...

Technopals Pte.Ltd. is seeking a data engineering professional to design and build scalable real-time data systems on the Hadoop ecosystem, collaborating with data scientists to operationalize ML models using CML. The role spans data ingestion, transformation, and full-stack tooling with Java, Spark, Python, Flask, and React, emphasizing ...

experience with modeling tools such as Python, PyTorch, TensorFlow, scikit-learn etc. Hands-on experience building large-scale distributed machine learning systems such as Hadoop, Spark etc. Effective communication skills in Chinese. At JD.com, we’re committed to building a diverse and inclusive workplace where everyone can thrive. ...

Data, Data Warehousing, Business Intelligence, Machine Learning). Data Ecosystems: Familiarity with modern data architectures and tools, such as Big Data frameworks (Hadoop, Spark, Hive, BigQuery), Data Warehouses, and Machine Learning. Role Qualifications Industry Experience: 10+ years of experience in the Manufacturing and broader industrial supply chain environment. Sales ...

delivery. What We’re Looking For Strong proficiency in Python, Scala, or Java with hands‐on experience in Big Data technologies including Spark, Hadoop, or similar distributed processing frameworks. Practical experience building real-time event streaming pipelines using technologies such as Kafka, Spark Streaming, or Amazon Kinesis within … client environments. Bonus Points For Expertise in data modelling, schema design, and working with structured and semi‐structured datasets. Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation. Knowledge of automating cloud-based ingestion and transformation frameworks. Experience delivering data engineering solutions within highly ...

delivery. What We’re Looking For Strong proficiency in Python, Scala, or Java, with hands-on experience of Big Data technologies including Spark, Hadoop, or similar distributed processing frameworks. Experience building real-time event streaming solutions using technologies such as Kafka, Spark Streaming, or Amazon Kinesis within AWS environments. … technical solutions. Bonus Points For Expertise in data modelling, schema design, and working with structured and semi-structured datasets. Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation. Knowledge of automating ingestion and transformation frameworks within cloud-native data platforms. Experience delivering solutions within ...

will own data lifecycle, building scalable pipelines and ensuring governance in a regulated financial environment. You'll work with Python, Spark, Kafka, NiFi, Hadoop, Hive, and modern data-platform technologies, delivering production-grade controls and observability. #J-18808-Ljbffr ...

week and delivering high-quality, consultative outcomes. Ideal candidates will have strong communication skills and a track record in Big Data technologies (Spark, Hadoop, EMR, MapR) and NoSQL/MPP databases, with a passion for #J-18808-Ljbffr ...