13 of 13 Hadoop Jobs in the North of England

phases of the system development life cycle Experience with major database and big data platforms (e.g. RDS, Aurora, Redshift, Data bricks, MySQL, Oracle, PostgresSQL, Hadoop, Snowflake, etc.) Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.) Understanding of modern data warehouse capabilities and technologies such ...

decisions and the trade‐offs behind them. Demonstrable experience leading data estate modernisation, such as moving from legacy data warehouses, on‐premises databases or Hadoop to modern cloud or hybrid data platforms. Deep expertise in at least one modern data platform (Databricks, Snowflake or Microsoft Fabric), plus a working ...

solutions on platforms such as Amazon Bedrock. Experience developing data-based apps in Streamlit/Shiny Skills in ‘Big Data’ technology tools like Hadoop/Spark Knowledge of Infrastructure as Code tools like CloudFormation/Terraform If you can bring some of these skills and experiences, along with transferable ...

Information Nice to have: Proven experience leading projects and managing teams, Experience in presales, client workshops, or building Proof-of-Concepts (PoCs), Familiarity with Hadoop, Spark, Research or R&D background. Soft Skills Ability to structure projects teams, make technical decisions, and own outcomes, Ability to manage multiple projects ...

Python data science ecosystem (e.g. NumPy, Pandas, scikit‐learn, PyTorch, TensorFlow). Experience with big data and distributed analytics platforms (e.g. Spark, Hadoop). Hands‐on experience with Natural Language Processing, graph analytics and advanced analytical methods. Experience using cloud analytics platforms, with strong AWS and native tooling expertise. ...

with demonstrable experience of working in rapidly changing client environments. Needs to be a practitioner and proponent of Agile and Dev Ops Proficiency in Hadoop, Spark, Scala, Python, or a programming language associated with data engineering Expertise in building and deploying production level data solutions maintained by application support ...

developing data engineering solutions using Python and PySpark. Practical experience with Apache Kafka and Apache NiFi for streaming, ingestion and orchestration. Experience working with Hadoop, Hive or comparable enterprise data-lake technologies. Solid knowledge of SQL, data transformation, data modelling and large-scale data processing. Experience integrating REST APIs … Apache NiFi. Integrate vendor platforms and enterprise systems through REST APIs and secure authentication mechanisms. Build data processing and storage solutions using Spark, Hadoop and Hive. Develop automated reconciliation, data quality and compliance controls to identify missing, duplicate or inconsistent records. Implement robust data flows with retry mechanisms, error ...

Technopals Pte.Ltd. is seeking a data engineering professional to design and build scalable real-time data systems on the Hadoop ecosystem, collaborating with data scientists to operationalize ML models using CML. The role spans data ingestion, transformation, and full-stack tooling with Java, Spark, Python, Flask, and React, emphasizing ...

will own data lifecycle, building scalable pipelines and ensuring governance in a regulated financial environment. You'll work with Python, Spark, Kafka, NiFi, Hadoop, Hive, and modern data-platform technologies, delivering production-grade controls and observability. #J-18808-Ljbffr ...

enhance operational telemetry, monitoring and platform observability Streaming & Distributed Data Processing Build and optimise solutions using:Apache Kafka Apache NiFi Apache Spark/PySpark Hadoop ecosystem technologies Hive and large-scale data storage platforms Develop scalable matching, enrichment and reconciliation services Create canonical data models spanning multiple source systems … strong expertise across several of the following areas: Core Technical Skills Python development in enterprise environments Apache Spark/PySpark Apache Kafka Apache NiFi Hadoop and Hive Advanced SQL REST API integration and development Data modelling and data lineage Distributed systems engineering CI/CD and modern software delivery ...

least one relational database familiarity with other relational databases (e.g. MS Access) knowledge of data modelling, data cleansing, and data enrichment techniques Hadoop open-source data analytics Google Analytics, SEO, keyword analysis and web analytics aptitude, for marketing analyst roles the capacity to develop and document procedures and workflows ...

products in a Continuous Delivery DevOps environment Revolutionise our online customer experience through a great website and mobile app Data driven decisions using Kibana, Hadoop, monitoring, Big Data, MI and MVT testing Continuous improvement, keeping it simple and developing the team Great engineering practices with a focus ...

with ML platforms such as CML, SparkMLlib, and Python ML libraries (scikit‐learn, XGBoost), including modeldeployment. Design and develop highly scalable, Real time systemsusing Hadoop ecosystem components(Iceberg, Spark, Ozone, Trino, Hive,Ranger, Kafka, Flink and Nifi) Build robust data ingestion and transformationframeworks using Java, Spark, Python, and shell … . Collaborate closely with data scientists tooperationalize machine learning models using Cloudera Machine Learning(CML). Perform performance tuning and optimization of dataapplications on Hadoop to ensure optimal resource utilization. Technopals Pte.Ltd. is an Equal Opportunity Employer and does not discriminate on the basis of race or ethnicity, religion ...