10 of 10 Apache Spark Jobs in Cambridge

of talented and fun group of people. What you will be involved in: Development and Maintenance of Real-Time Data Processing Applications by using frameworks and libraries such as: Spark Streaming, Spark Structured Streaming, Kafka Streams and Kafka Connect. Manipulation of Streaming Data: Ingestion, Transformation and Aggregation. Keeping up to date on Research and Development of new Technologies … well processes and perform Knowledge Sharing sessions with the rest of the team. You're good with: Have strong knowledge in Scala. Knowledge or familiarity of Distributed Computing like Spark/KStreams/Kafka. Connect and Streaming Frameworks such as Kafka. Knowledge on Monolithic versus Microservice Architecture concepts for building large-scale applications. Familiar with the Apache suite … including Hadoop modules such as HDFS, Yarn, HBase, Hive, Spark as well as Apache NiFi. Familiar with containerization and orchestration technologies such as Docker, Kubernetes. Familiar with Time-series or Analytics Databases such as Elasticsearch. Experience with Amazon Web Services using services such as S3, EC2, EMR, Redshift. Familiar with Data Monitoring and Visualisation tools such as Prometheus More ❯

architecture, and processing skills with varied unstructured data representations · Processing unstructured data, such as 3D geometric data · Large scale, data-intensive systems in production · Distributed computing frameworks, such as Spark, Dask, Ray Data etc. · Cloud platforms such as AWS, Azure, or GCP · Docker · Documenting code, architectures, and experiments · Linux systems and bash terminals Preferred Qualifications o Databases and/… or data warehousing technologies, such as Apache Hive, Iceberg etc. o Data transformation via SQL and DBT. o Orchestration platforms such as Apache Airflow, Argo Workflows, etc. o Data catalogs and metadata management tools o Vector databases o Relational and object databases o Kubernetes o computational geometry such as mesh or boundary representation data processing o analyzing data More ❯

Engineering (open to professionals from various data eng. backgrounds — data pipelines, ML Eng, data warehousing, analytics engineering, big data, cloud etc.) Technical Exposure: Experience with tools like SQL, Python, Apache Spark, Kafka, Cloud platforms (AWS/GCP/Azure), and modern data stack technologies Formal or Informal Coaching Experience: Any previous coaching, mentoring, or training experience — formal or More ❯

and running hybrids. Container orchestration deployment, configuration, and administration. (e.g. Docker Swarm, Kubernetes). Automation and configuration management (e.g., Ansible, Puppet, Chef). Analytics infrastructure and tooling (e.g. Databricks, Apache Spark). Technical leadership, championing standard methodologies, and leading technical product transformations. In Return: We are proud to have a set of behaviours that reflect our culture and More ❯

Python, Bash), VCS (git), and Linux Proven experience in cross-functional teams and able to communicate effectively about technical and operational challenges. Preferred Qualifications: Proficiency with scalable data frameworks (Spark, Kafka, Flink) Proven Expertise with Infrastructure as Code and Cloud best practices Proficiency with monitoring and logging tools (e.g., Prometheus, Grafana) Working at Lila Sciences, you would have access More ❯

Science or a related field. Experience working on and shipping live service games. Experience working on Spring Boot projects. Experience deploying software/services on Kubernetes. Experience working with Apache Spark and Iceberg. More ❯

QUALIFICATIONS - 3+ years of experience in cloud architecture and implementation - Bachelor's degree in Computer Science, Engineering, related field, or equivalent experience - Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - Experience in consulting, design and implementation of serverless distributed solutions - Experience in software development with object oriented language PREFERRED QUALIFICATIONS - AWS experience preferred, with proficiency in a More ❯

similar languages Knowledge of monitoring tools and alerting frameworks SQL experience including queries/updates/table creation/basic database maintenance Exposure to data technologies such as Kafka, Spark or Delta Lake is useful but not mandat Bachelor's degree in Computer Science, Engineering, or related technical field This role offers competitive compensation and the opportunity to work More ❯

software. - Ph.D. degree in in Statistics, CS, Machine Learning, Operations Research or in a highly quantitative field. - Knowledge of distributed computing and experience with advanced machine learning libraries like Spark MLLib, Tensorflow, MxNet, etc. - Strong publication record in international conferences on machine learning and artificial intelligence Our inclusive culture empowers Amazonians to deliver the best results for our customers. More ❯

learning methods and machine learning - Experience in building machine learning models for business application - Experience in applied research PREFERRED QUALIFICATIONS - Experience with modeling tools such as R, scikit-learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy etc. - Experience with large scale distributed systems such as Hadoop, Spark etc. Amazon is an equal opportunities employer. We believe passionately that employing More ❯

unique opportunity to design and innovate solutions for this scale, delivering robust and scalable microservices built over Java and AWS as well as innovate with big data technologies like Spark, EMR, Athena and more. You will create value that materially impacts the speed and quality of decision making across the organization resulting in tangible business growth. Key job responsibilities More ❯