176 to 195 of 195 Remote/Hybrid Apache Spark Jobs

hybrid cloud environments, including Redshift, Glue, EMR and S3 Implement real-time and batch processing pipelines using modern data engineering frameworks including Spark, Kafka and dbt Create data flow diagrams, integration patterns and canonical models to support consistent, scalable data delivery Define and enforce data governance standards including metadata … scale Deep practical knowledge of AWS data services including Redshift, Glue, EMR, Kinesis and S3 Experience with modern data engineering tools such as dbt, Spark or Flink Proven experience with SQL and NoSQL databases including PostgreSQL, MySQL and DynamoDB Knowledge of data governance frameworks and tools including metadata management ...

loyalty and commerce media technology scaleup recognised in the E2ETech100 fastest growing tech companies in the UK Enterprise data architecture, AWS and GCP, Kafka, Spark, Flink and real time and batch processing pipelines Work with some of the world's largest banking and retail brands Hybrid working from Belfast … depth of the domain. You will be working across AWS and GCP, real time streaming with Kafka and Confluent, batch and stream processing with Spark and Flink, data governance frameworks including GDPR and HIPAA compliance, and multi cloud cost optimisation. That combination of enterprise scale, regulated domain experience ...

spans a wide range of technologies, including Java and Python-based MicroServices, AWS/GCP cloud backend systems, Big Data technologies like Hive and Spark, and modern Web applications. With a globally distributed presence across the US, India and Europe, the team thrives on collaboration, bringing together diverse perspectives … needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache, LambdaWorking ...

spans a wide range of technologies, including Java and Python-based MicroServices, AWS/GCP cloud backend systems, Big Data technologies like Hive and Spark, and modern Web applications. With a globally distributed presence across the US, India and Europe, the team thrives on collaboration, bringing together diverse perspectives … needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache, LambdaWorking ...

Azure PaaS components, including Azure DevOps, Vault, and other security and configuration services (AKS experience is beneficial) Integrate and optimize data processing frameworks with Spark, Databricks, or Cloudera platform (Hue, Hive, HDFS) Support ETL pipelines built for master data management, customer profiles, and consent management workflows Ensure environments … release cycles Exposure to Azure Cloud and PaaS services, including Azure DevOps and Vault Familiarity with data engineering and big data ecosystems, including Spark and Cloudera stacks (hue, hive, HDFS) Excellent problem‐solving skills and ability to communicate technical solutions effectively Previous experience working on data‐driven projects ...

DynamoDB. Work with large volumes of structured and unstructured data, integrating information from multiple sources. Develop data solutions using technologies including Python, Java, Scala, Spark and SQL. Write scripts, develop APIs and SQL queries, and contribute to the design and deployment of scalable cloud-based data platforms. Work closely … data environment. Strong experience with AWS cloud technologies and data engineering services. Hands-on experience with one or more of Python, Java, Scala, Spark and SQL. Experience working with large-scale structured and unstructured datasets. Understanding of data ingestion, processing, transformation and integration. Strong analytical and problem-solving skills. ...

DynamoDB. Work with large volumes of structured and unstructured data, integrating information from multiple sources. Develop data solutions using technologies including Python, Java, Scala, Spark and SQL. Write scripts, develop APIs and SQL queries, and contribute to the design and deployment of scalable cloud-based data platforms. Work closely … data environment. Strong experience with AWS cloud technologies and data engineering services. Hands-on experience with one or more of Python, Java, Scala, Spark and SQL. Experience working with large-scale structured and unstructured datasets. Understanding of data ingestion, processing, transformation and integration. Strong analytical and problem-solving skills. ...

DynamoDB. Work with large volumes of structured and unstructured data, integrating information from multiple sources. Develop data solutions using technologies including Python, Java, Scala, Spark and SQL. Write scripts, develop APIs and SQL queries, and contribute to the design and deployment of scalable cloud-based data platforms. Work closely … data environment. Strong experience with AWS cloud technologies and data engineering services. Hands-on experience with one or more of Python, Java, Scala, Spark and SQL. Experience working with large-scale structured and unstructured datasets. Understanding of data ingestion, processing, transformation and integration. Strong analytical and problem-solving skills. ...

iterative delivery—making pragmatic trade‐offs and documenting them clearly. Technology Stack Languages: Predominantly Python and Node.js Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and cloud services Storage/search: MongoDB, OpenSearch Orchestration: Airflow, Dagster, NiFi Tooling: GitHub, GitHub Actions, Rundeck, Jira, Confluence Deployment … plus) Experience debugging moderately complex systems and improving reliability/performance Strong fundamentals: data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure ...

technologies and innovative approaches, including AI. The environment includes: C#/.NET Core Python SQL Server Microsoft Azure Azure Kubernetes Service (AKS) Kubernetes Redis Apache Kafka Spark HBase/HDFS REST APIs Microservices and distributed architectures We're particularly interested in individuals with: Extensive experience within Credit Risk ...

generative AI inference and agentic applications. Your depth of expertise in technologies including Golang and Python programming languages, popular distributed compute frameworks including Spark/Dask/Ray/Flink, container (e.g., Kubernetes) and serverless (e.g., AWS Lambda) runtime environments, and ML+AI workload patterns will provide an amplifying technical … control and data plane implementations required to realize a highly available, multi-tenant, large scale and a secure machine learning platform Develop Ray and Spark distributed compute engine solutions to accelerate diverse workloads from LLM pre-training and reinforcement learning to large-scale data processing, while maximizing compute unit ...

generative AI inference and agentic applications. Your depth of expertise in technologies including Golang and Python programming languages, popular distributed compute frameworks including Spark/Dask/Ray/Flink, container (e.g., Kubernetes) and serverless (e.g., AWS Lambda) runtime environments, and ML+AI workload patterns will provide an amplifying technical … control and data plane implementations required to realize a highly available, multi-tenant, large scale and a secure machine learning platform Develop Ray and Spark distributed compute engine solutions to accelerate diverse workloads from LLM pre-training and reinforcement learning to large-scale data processing, while maximizing compute unit ...

senior level with interests, experience and willingness to learn around Big Data technologies, such as distributed event-stores (Kafka) and parallel computing frameworks (Spark). Engineers who thrive at Canonical are mindful of open-source community dynamics and equally aware of the needs of large, innovative organisations. Location: This … looking for in you Proven hands-on experience in software development using Python Proven hands-on experience in distributed systems, such as Kafka and Spark Have a Bachelor’s or equivalent in Computer Science, STEM, or a similar degree Willingness to travel up to 4 times a year ...

across devices and platforms to surface key metrics. The role emphasizes coding in Python, strong SQL, and experience with large data ecosystems (HDFS, Hive, Spark, Airflow). You will influence architecture and own initiatives from concept to delivery. Hybrid work from Cambridge Office. #J-18808-Ljbffr ...

matter – packed with personal touches and delivered with care. We’re not just about selling cards or gifts – we’re here to spread joy, spark smiles and make every celebration feel extra special. And with values that guide how we work and support one another, we’ve built … place where people (and ideas) can truly thrive. If you’re looking to make an impact, bring your spark and be part of something meaningful – we’d love to have you on the team. Software Engineering Manager – Reminders | London or Manchester – Hybrid (1–2 days per week ...

Software Engineer - Space Domain Awareness | Job DetailsAre you looking for an innovative and consolidated place for your professional development? GMV is an experienced technology group and we are looking for a highly motivated Software Engineer ...

Software Engineer - Space Domain Awareness | Job DetailsAre you looking for an innovative and consolidated place for your professional development? GMV is an experienced technology group and we are looking for a highly motivated Software Engineer ...

build these systems with industry standard frameworks and tools, such as React and Angular on the front end with Java, Spring Boot and Apache Kafka on the back end. All of this runs on our cutting edge cloud delivery platform, facilitating over 60k releases to production a year. … while delivering high-impact projects. Although not a requirement, helpful experience includes: An interest in working with data at scale using tools like dbt, Spark, and AI/ML frameworks (e.g. PyTorch, TensorFlow, scikit-learn)Experience with Kafka or other event-driven architectures. During our application process, you will ...

engineering role spanning modelling, large-scale training, and production infrastructure — you'll take models from idea through to serving at scale, working in Spark, Python, and Java. You'll work closely with Praveen and the wider Ad Performance ML team. Based in the UK (Manchester-anchored).How will … ship ML models for ad relevance and bid/yield optimizationBuild and maintain production ML infrastructure for real-time, low-latency servingWork across Spark, Python, and Java to move models from research to productionApply sound feature engineering, validation, and evaluation practices throughout the modelling lifecycleDiagnose production ML issues such ...

Privacy Legal Advisor - 12 Month Contract Location: UK London Employment Type: Employee - Fixed Term Contract Work Arrangement: Hybrid At Bumble, the Love Company, trust is the heart of every connection we help spark. As a ...