22 of 22 Permanent Hadoop Jobs in the UK excluding London

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

analysis, modelling, and visualization to identify patterns and insights.Ensure data quality, reliability, and security across systems. Work with distributed computing frameworks (e.g., Spark, Hive, Hadoop) to process and analyse large datasets. Stay up to date with the latest trends and technologies in big data, analytics, and cloud platforms.Required Skills ...

phases of the system development life cycle Experience with major database and big data platforms (e.g. RDS, Aurora, Redshift, Data bricks, MySQL, Oracle, PostgresSQL, Hadoop, Snowflake, etc.) Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.) Understanding of modern data warehouse capabilities and technologies such ...

Server, Oracle, Snowflake, Databricks).Experience with data integration (ETL/ELT, APIs).Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) a plus.Domain Knowledge:Exceptional understanding of the Funds business lifecycle, financial instruments, market data, and investment operations.In-depth knowledge of regulatory reporting ...

infrastructure underpinning data systems through a DevOps approach Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop Good understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different ...

business needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache ...

business needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache ...

methodologies.In addition to the above, we would be thrilled if you also had:Experience of working on migrations of enterprise scale data platforms including Hadoop and traditional data warehousesAn understanding of machine learning model development lifecycle, feature engineering, training and testingGood understanding or hands-on experience of KafkaExperience ...

Pipeline Builder or AIP, or similar platforms for application development and data integrationExperience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the ICExperience with geospatial analysis tools, such as ArcGIS or ArcPro, and GEOINT collection ...

Python data science ecosystem (e.g. NumPy, Pandas, scikit-learn, PyTorch, TensorFlow). Experience with big data and distributed analytics platforms (e.g. Spark, Hadoop). Hands-on experience with Natural Language Processing, graph analytics and advanced analytical methods. Experience using cloud analytics platforms, with strong AWS and native tooling expertise. ...

Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Experience : Minimum 10+ Years Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Specialization in designing and implementing large-scale data pipelines, ETL processes, and distributed systems Should be able to work independenty with minimal help ...

building distributed systems.Experience building data processing pipelines and large scale machine learning systems with experience in big data technologies like Spark, SQL, Snowflake/Hadoop, etc.Skilled in communication, problem solving, critical thinking Attention to detail, data accuracy and quality of output.Preferred QualificationsPhD or Graduate degree with research/work ...

scalable distributed systemsHands-on experience with building data processing pipelines, large scale machine learning systems, and big data technologies (eg: Spark, SQL, Snowflake/Hadoop, etc)Bachelors in a quantitative field, such as Computer Science, Applied Mathematics, Statistics, or Bachelors degree in quantitative field with a focus ...

Have: Experience in the development of algorithms leveraging R, Python, or SQL/NoSQL Experience with distributed data and computing tools, including MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL Experience with visualization packages, including Plotly, Seaborn, or ggplot2 TS/SCI clearance with a polygraph Clearance:Applicants ...

language, with demonstrable experience of working in rapidly changing client environments. Needs to be a practitioner and proponent of Agile and Dev OpsProficiency in Hadoop, Spark, Scala, Python, or a programming language associated with data engineeringExpertise in building and deploying production level data solutions maintained by application support teamsKnowledge ...

components, microservices, and data integration layers to support high-throughput regulatory reporting.Big Data Processing: Develop and optimize distributed data processing jobs using Apache Spark, Hadoop, and Hive to aggregate and transform large-scale financial datasets.Real-Time Streaming: Build and maintain real-time data ingestion and streaming pipelines using Apache … APIs using Spring Boot, Spring Cloud, Spring Data, and Spring Security.Big Data Technologies: Strong, hands-on experience with distributed computing frameworks, specifically Apache Spark, Hadoop, and Hive. Proven ability to write and optimize complex Spark jobs.Real-Time Streaming: Practical experience designing and implementing event-driven systems using Apache Kafka ...

teams Strong Background and experience in Data Ingestions, Transformation, Modeling and Performance tuning. Should have experience in designing and developing dashboards Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Should have experience in creating roadmap to improve platform Observability Experience in leading mid-scale teams with strong communication skills ...

developing data engineering solutions using Python and PySpark. Practical experience with Apache Kafka and Apache NiFi for streaming, ingestion and orchestration. Experience working with Hadoop, Hive or comparable enterprise data-lake technologies. Solid knowledge of SQL, data transformation, data modelling and large-scale data processing. Experience integrating REST APIs … Apache NiFi. Integrate vendor platforms and enterprise systems through REST APIs and secure authentication mechanisms. Build data processing and storage solutions using Spark, Hadoop and Hive. Develop automated reconciliation, data quality and compliance controls to identify missing, duplicate or inconsistent records. Implement robust data flows with retry mechanisms, error ...

expertise in intelligence gathering, monitoring, and investigative reporting. Experience conducting complex investigations across digital platforms. Proficiency with data analysis tools and systems (e.g., SQL, Hadoop, or similar). Experience with link analysis methodologies and tools. Familiarity with legal, regulatory, and compliance considerations related to investigations. Background in threat intelligence ...

Software Engineer - Space Domain Awareness | Job DetailsAre you looking for an innovative and consolidated place for your professional development? GMV is an experienced technology group and we are looking for a highly motivated Software Engineer ...

Software Engineer - Space Domain Awareness | Job DetailsAre you looking for an innovative and consolidated place for your professional development? GMV is an experienced technology group and we are looking for a highly motivated Software Engineer ...

Software Engineer - Space Domain Awareness | Job DetailsAre you looking for an innovative and consolidated place for your professional development? GMV is an experienced technology group and we are looking for a highly motivated Software Engineer ...