6 of 6 Apache Spark Jobs in Hampshire

common technical standards and ways of working, and presenting these to the community Here's a snapshot of the technologies that we use: Scala Apache Spark Databricks Apache Parquet Azure Cloud Platform Azure DevOps (Test plans, Backlogs, Pipelines) GIT What we're looking for We'd love ...

What we’re looking for: Strong Python development and software engineering experience Experience building scalable data pipelines and distributed data platforms Knowledge of Kafka, Spark and modern data processing technologies Experience with orchestration tools such as Airflow, Dagster or Prefect Hands-on experience with Docker, Kubernetes and containerised deployments ...

platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable ...

Limited (DDIL) communications environments, supporting local processing at the edge Building streaming ingestion, event pipelines, and batch/stream processing workloads using technologies like Apache Flink and/or Apache Spark Implementing metadata, lineage, and catalogue capabilities along with policy-based security and governance Job Requirements: Extensive ...

following a test-driven approach.Creating code that is open by default and easy for others to reuse.Required SkillsExperience with Big Data technologies, such as Apache Hadoop, Spark or PigAWSApache NiFiPython or JavaBuilt on over a 70 year heritage, Roke offers specialist knowledge in sensors, communications, cyber ...

test-driven approach. Creating code that is open by default and easy for others to reuse. Required SkillsExperience with Big Data technologies, such as Apache Hadoop, Spark or PigAWSApache NiFiPython or JavaBuilt on over a 70 year heritage, Roke offers specialist knowledge in sensors, communications, cyber ...