126 to 139 of 139 Remote Apache Spark Jobs

adoption of modern data mesh principles across complex enterprise environments. What You'll Be Doing Architect and deliver modern data solutions using Databricks, Spark, PySpark and SQL Design scalable batch and real-time data pipelines that ingest data from legacy and modern platforms Lead the development of cloud-based … decision making Provide technical leadership and architectural direction on large-scale transformation programmes Essential Experience Strong hands-on expertise with Databricks Extensive experience using Spark, PySpark and SQL Proven track record designing and implementing data lake architectures Experience building both batch and streaming data pipelines Strong knowledge of Kafka ...

strategy and promote best practices amongst engineers and data scientists. How to make an Impact Architect and Implement: Own the technical roadmap for our Spark-based data processes to ensure our Airflow pipelines are performant, cost-effective, and scalable. You will enhance our existing services through hands-on development … deployment. Expert-level Python and its data ecosystem (Numpy, Pandas), including designing frameworks for data tasks. Deep understanding of distributed data processing engines like Apache Spark. Ability to reason about the full data lifecycle from ingestion through to real-time serving - your system designs will need to meet downstream ...

this role leads the engineering of cloud-native data services for the firm’s strategic platform, driving the migration to Databricks and delivering scalable Spark/Scala solutions on AWS.The overall objective of this role is to lead applications systems analysis and programming activities. Proven leadership in building … matching engines, AI/GenAI services and large-scale data platforms. This role will drive transformation of enterprise data capabilities using Databricks, scala/spark and cloud native architectures, ensuring platform is stable, scalable, resilient, secure and AI enabled.As platform landscape evolved towards cloud-native, AI enabled and highly ...

address business use cases and/or to improve product/system performance, quality and accuracy.Near Real-Time and Batch Inferencing: Use infrastructure like Spark and Ray to stand up inferencing services that integrate with operational/analytics workloads.ML Infrastructure: Help build a first-class machine learning platform from … machine learning on real recommendations use cases (brownie points for productionised sequential learning use cases!).Experience with ML/distributed ML frameworks like Ray, Spark-MLlib, TensorFlow etc.Experience with real-time scoring/evaluation of models with low latency constraints.Great coding skills and strong software development experience ...

generative AI inference and agentic applications. Your depth of expertise in technologies including Golang and Python programming languages, popular distributed compute frameworks including Spark/Dask/Ray/Flink, container (e.g., Kubernetes) and serverless (e.g., AWS Lambda) runtime environments, and ML+AI workload patterns will provide an amplifying technical … control and data plane implementations required to realize a highly available, multi-tenant, large scale and a secure machine learning platform Develop Ray and Spark distributed compute engine solutions to accelerate diverse workloads from LLM pre-training and reinforcement learning to large-scale data processing, while maximizing compute unit ...

generative AI inference and agentic applications. Your depth of expertise in technologies including Golang and Python programming languages, popular distributed compute frameworks including Spark/Dask/Ray/Flink, container (e.g., Kubernetes) and serverless (e.g., AWS Lambda) runtime environments, and ML+AI workload patterns will provide an amplifying technical … control and data plane implementations required to realize a highly available, multi-tenant, large scale and a secure machine learning platform Develop Ray and Spark distributed compute engine solutions to accelerate diverse workloads from LLM pre-training and reinforcement learning to large-scale data processing, while maximizing compute unit ...

generative AI inference and agentic applications. Your depth of expertise in technologies including Golang and Python programming languages, popular distributed compute frameworks including Spark/Dask/Ray/Flink, container (e.g., Kubernetes) and serverless (e.g., AWS Lambda) runtime environments, and ML+AI workload patterns will provide an amplifying technical … control and data plane implementations required to realize a highly available, multi-tenant, large scale and a secure machine learning platform Develop Ray and Spark distributed compute engine solutions to accelerate diverse workloads from LLM pre-training and reinforcement learning to large-scale data processing, while maximizing compute unit ...

business use cases and/or to improve product/system performance, quality and accuracy. Near Real-Time and Batch Inferencing: Use infrastructure like Spark and Ray to stand up inferencing services that integrate with operational/analytics workloads. ML Infrastructure: Help build a first-class machine learning platform … learning on real recommendations use cases (brownie points for productionised sequential learning use cases!). Experience with ML/distributed ML frameworks like Ray, Spark-MLlib, TensorFlow etc. Experience with real-time scoring/evaluation of models with low latency constraints. Great coding skills and strong software development experience ...

senior level with interests, experience and willingness to learn around Big Data technologies, such as distributed event-stores (Kafka) and parallel computing frameworks (Spark). Engineers who thrive at Canonical are mindful of open-source community dynamics and equally aware of the needs of large, innovative organisations. Location: This … looking for in you Proven hands-on experience in software development using Python Proven hands-on experience in distributed systems, such as Kafka and Spark Have a Bachelor’s or equivalent in Computer Science, STEM, or a similar degree Willingness to travel up to 4 times a year ...

Software Engineer - Space Domain Awareness | Job DetailsAre you looking for an innovative and consolidated place for your professional development? GMV is an experienced technology group and we are looking for a highly motivated Software Engineer ...

Software Engineer - Space Domain Awareness | Job DetailsAre you looking for an innovative and consolidated place for your professional development? GMV is an experienced technology group and we are looking for a highly motivated Software Engineer ...

engineering role spanning modelling, large-scale training, and production infrastructure — you’ll take models from idea through to serving at scale, working in Spark, Python, and Java. You’ll work closely with Praveen and the wider Ad Performance ML team. Based in the UK (Manchester-anchored).How will … ship ML models for ad relevance and bid/yield optimizationBuild and maintain production ML infrastructure for real-time, low-latency servingWork across Spark, Python, and Java to move models from research to productionApply sound feature engineering, validation, and evaluation practices throughout the modelling lifecycleDiagnose production ML issues such ...

business use cases and/or to improve product/system performance, quality and accuracy. Near Real‐Time and Batch Inferencing: Use infrastructure like Spark and Ray to stand up inferencing services that integrate with operational/analytics workloads. ML Infrastructure: Help build a first‐class machine learning platform … learning on real recommendations use cases (brownie points for productionised sequential learning use cases). Experience with ML/distributed ML frameworks like Ray, Spark‐MLlib, TensorFlow etc. Experience with real‐time scoring/evaluation of models with low latency constraints. Great coding skills and strong software development experience ...

Privacy Legal Advisor - 12 Month Contract Location: UK London Employment Type: Employee - Fixed Term Contract Work Arrangement: Hybrid At Bumble, the Love Company, trust is the heart of every connection we help spark. As a ...