6 of 6 Remote Apache Spark Jobs in Cambridgeshire

practices Familiarity with Agile collaboration tools such as Jira and Confluence Comfort working with distributed teams Effective team communication skills Knowledge of Data Engineering practices and technologies, especially Kafka, Spark, and AWS in Java or Python Experience with BDD, TDD, and CI/CD practices Knowledge of GoCD, Jenkins, and Github is preferred Strong SQL skills and familiarity with More ❯

of talented and fun group of people. What you will be involved in: Development and Maintenance of Real-Time Data Processing Applications by using frameworks and libraries such as: Spark Streaming, Spark Structured Streaming, Kafka Streams and Kafka Connect. Manipulation of Streaming Data: Ingestion, Transformation and Aggregation. Keeping up to date on Research and Development of new Technologies … well processes and perform Knowledge Sharing sessions with the rest of the team. You're good with: Have strong knowledge in Scala. Knowledge or familiarity of Distributed Computing like Spark/KStreams/Kafka. Connect and Streaming Frameworks such as Kafka. Knowledge on Monolithic versus Microservice Architecture concepts for building large-scale applications. Familiar with the Apache suite … including Hadoop modules such as HDFS, Yarn, HBase, Hive, Spark as well as Apache NiFi. Familiar with containerization and orchestration technologies such as Docker, Kubernetes. Familiar with Time-series or Analytics Databases such as Elasticsearch. Experience with Amazon Web Services using services such as S3, EC2, EMR, Redshift. Familiar with Data Monitoring and Visualisation tools such as Prometheus More ❯

architecture, and processing skills with varied unstructured data representations · Processing unstructured data, such as 3D geometric data · Large scale, data-intensive systems in production · Distributed computing frameworks, such as Spark, Dask, Ray Data etc. · Cloud platforms such as AWS, Azure, or GCP · Docker · Documenting code, architectures, and experiments · Linux systems and bash terminals Preferred Qualifications o Databases and/… or data warehousing technologies, such as Apache Hive, Iceberg etc. o Data transformation via SQL and DBT. o Orchestration platforms such as Apache Airflow, Argo Workflows, etc. o Data catalogs and metadata management tools o Vector databases o Relational and object databases o Kubernetes o computational geometry such as mesh or boundary representation data processing o analyzing data More ❯

Engineering (open to professionals from various data eng. backgrounds — data pipelines, ML Eng, data warehousing, analytics engineering, big data, cloud etc.) Technical Exposure: Experience with tools like SQL, Python, Apache Spark, Kafka, Cloud platforms (AWS/GCP/Azure), and modern data stack technologies Formal or Informal Coaching Experience: Any previous coaching, mentoring, or training experience — formal or More ❯

Engineering (open to professionals from various data eng. backgrounds — data pipelines, ML Eng, data warehousing, analytics engineering, big data, cloud etc.) Technical Exposure: Experience with tools like SQL, Python, Apache Spark, Kafka, Cloud platforms (AWS/GCP/Azure), and modern data stack technologies Formal or Informal Coaching Experience: Any previous coaching, mentoring, or training experience — formal or More ❯

and running hybrids. Container orchestration deployment, configuration, and administration. (e.g. Docker Swarm, Kubernetes). Automation and configuration management (e.g., Ansible, Puppet, Chef). Analytics infrastructure and tooling (e.g. Databricks, Apache Spark). Technical leadership, championing standard methodologies, and leading technical product transformations. In Return: We are proud to have a set of behaviours that reflect our culture and More ❯