26 to 50 of 89 Apache Jobs

effectively with technical teams including Data Scientists and MLOps Engineers. Desirable Skills Experience working with Data Science and/or MLOps environments. Experience with Apache Spark. Experience with Scala. Experience working with S3 and cloud storage technologies. Experience with graph databases. Experience with Elasticsearch. Experience with vector databases/ ...

build elegant solutions Understanding of system administration tasks on some of the following; Operating systems (e.g. Linux, CoreOS and Windows) Application stacks (e.g. nginx, Apache, Tomcat, JBoss, Websphere, Hybris, IIS, .Net, Node.js, Solr) RDBMS (e.g. PostgreSQL, MySQL, Oracle, MS SQL) NoSQL (e.g. MongoDB, Cassandra, Riak) Containerisation and microservices (e.g. ...

focus on production reliability. Essential skills and experience Strong hands-on experience developing data engineering solutions using Python and PySpark. Practical experience with Apache Kafka and Apache NiFi for streaming, ingestion and orchestration. Experience working with Hadoop, Hive or comparable enterprise data-lake technologies. Solid knowledge … software development tools. Exposure to agentic AI, workflow orchestration or retrieval-augmented generation. Key responsibilities Design and develop scalable data pipelines using Python, PySpark, Apache Kafka and Apache NiFi. Integrate vendor platforms and enterprise systems through REST APIs and secure authentication mechanisms. Build data processing and storage solutions ...

have skills: RabbitMQ Java/Microservices MongoDB/MySQL Kubernetes Grafana/Prometheus Gitlab Job Scheduling tooling (e.g. Berlin/JS7 Job Scheduler, TWS, Apache Airflow). Reporting and visualisation tooling (from Pentaho BA, Power BI, SAP Business Objects). Nice to have: Experience with databases/data platforms ...

technical stakeholders. Desirable Experience AWS services, including RDS, S3 and CloudWatch. CI/CD pipelines using GitHub Actions, GitLab CI or similar. Nginx or Apache administration. Experience within eCommerce, financial or operational business environments. Leading technical projects or workstreams. If you're an experienced PHP Developer who enjoys solving ...

experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team lead experience ...

with cloud platforms (AWS, Azure, GCP) Well versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team lead experience ...

with cloud platforms (AWS, Azure, GCP) Well versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team lead experience ...

experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team lead experience ...

with cloud platforms (AWS, Azure, GCP) Well-versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have external client ...

with cloud platforms (AWS, Azure, GCP) Well-versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have external client ...

with cloud platforms (AWS, Azure, GCP) Well versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team lead experience ...

with cloud platforms (AWS, Azure, GCP) Well-versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have external client ...

Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

kubernetes) Experience with Key value stores Experience in git and basic Unix Commands You might also have (Desirable) Experience with large data processing technologies (Apache Spark) Other helpful information Hybrid Working: At EMBL-EBI we are pleased to offer hybrid working options for all our employees. A dedicated desk ...

performance database environments Excellent communication and cross-functional collaboration skills A passion for continuous learning and innovation Desirable skill: Databricks Azure Fabric Confluent/Apache Flink Knowledge Grow with Acorn At Acorn Insurance, we're proud of our Liverpool roots - and even prouder of how far we've come. ...

Title: Senior Apache Spark Developer Location: Jersey city ,NJ (Only Local candidates who can come for in person interview ) Work Arrangement: Hybrid Client Industry: Banking Duration: 12 Months Contract Key Focus Area Spark SQL, Structured Streaming , Apache Kafka, AMPS About the Role We are hiring an Senior Apache Spark Developer Required Qualifications 5+ years of hands-on development experience with Apache Spark. Strong expertise in: Spark SQL Structured Streaming DataFrames/Datasets Performance tuning and optimization Experience integrating Spark with Apache Kafka. Strong development skills in: Java Python Experience designing and supporting large-scale distributed ...

working within large and complex technical programmes. Understanding of ITIL/service management principles . Current SC or DV clearance. Desirable Experience with IIS, Apache, Tomcat or other middleware/application servers . PowerShell, Bash or other scripting/automation experience. Knowledge of CI/CD and DevOps practices ...

year of IT experience including SQL, Snowflake, Oracle, Azure Cloud Platform and tools including Azure Data Factory, Azure Databricks; Cosmos DB, Python, Apache Spark, Tableau, Spotfire, Power BI, SSRS, Postman, Swagger, Azure DevOps, MS Visio, XMind, Hackolade, Jira, and Confluence. Position requires travel/relocation to various unanticipated ...

hands-on experience in building, developing, and optimizing scalable data pipelines and distributed data processing solutions. The ideal candidate will have strong expertise in Apache Spark, PySpark, Python/Scala, Hadoop, Hive, Kafka, SQL, and cloud-based data platforms. Key Skills Required Apache Spark & PySpark Python and/… Scala Hadoop, HDFS, Hive & MapReduce Apache Kafka & Spark Streaming SQL & Relational Databases ETL/ELT Pipeline Development Batch & Real-Time Data Processing Data Lakes & Data Warehousing Git, CI/CD & Performance Optimization Cloud & Modern Data Technologies Experience with any of the following is highly preferred: AWS: S3, EMR, Glue ...

Python development Experience in git and basic Unix Commands You may also have You may also have experience with large data processing technologies (Apache Spark) Contract length: 3 years grant based contract Salary: Grade 5 Monthly salary starting at £3,452 after tax, plus generous benefits and financial allowances ...

automated deployments, infrastructure management, monitoring, and scaling Coaching and mentoring junior engineers and promoting engineering best practices Skills & Experience: Understanding of data processing using Apache Spark and Apache Airflow for task orchestration Use of Python, SQL, and familiarity with PySpark Understanding of EMR and reviewing output logs ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full time on site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that ...

Science or related field or equivalent practical experience Strong foundation in algorithms and data structures Experience with distributed systems, databases, and big data tools (Apache Spark, Hadoop) customer-focused results-oriented ability to navigate multi-year roadmaps with incremental deliverables Java Scala C++ ...