151 to 175 of 195 Remote Apache Spark Jobs

build and enhance our Databricks platform, ensuring it remains secure, scalable and reliable. Develop and maintain batch and real-time data pipelines using Databricks, Spark and Delta Lake. Contribute to platform architecture, engineering standards and best practices across the data estate. Collaborate with Product, Analytics and Data Science teams … improvement across the engineering team. Our ideal candidate Proven experience building and supporting scalable, production-grade data platforms. Strong hands-on expertise with Databricks, Spark, Delta Lake, Python and SQL. Good understanding of cloud-based data engineering, ideally within Azure environments. Experience working with Infrastructure as Code tools such ...

changed how you work, not just how fast. We expect you to enjoy leveraging AI and agentic systems to operate more effectively. Tech environmentScala | Spark | Databricks | AWS | Claude | Airflow | Kubernetes | Terraform | Functional ProgrammingYou will thrive here if youEnjoy end-to-end ownership, from writing the code to architecture design … Python. Ability to design, build, and maintain distributed data systems in a cloud-based environment. Hands-on experience with big data frameworks such as Spark or Databricks. Knowledge of cloud infrastructure (AWS, GCP, or Azure).Judgement to balance scalability, performance, and maintainability. Experience with data modelling and workflow orchestration. ...

Python is required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including the design, implementation ...

Python is required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including the design, implementation ...

will lead requirements for the Treasury Analytics Group, support FIS Quantum & TBSM, and work on a new risk/analytics platform using Hadoop, Spark, and NoSQL tools. The role reqs 5+ years of experience, Linux/Oracle/MS SQL, ITIL, and scripting with Java/Python. Collaboration with ...

depth actually gets used. • AWS across the board, including S3, Glue, Redshift, Lake Formation and Kinesis • Databricks and Snowflake running on top of AWS • Spark and distributed processing frameworks for large-scale data • Streaming technologies such as Kinesis or Kafka You're expected to pick the right tools ...

Elasticsearch, Kafka, and more across different environments Technologies We Use Different backend languages, including Java, Rust, and Go Open-source technologies like Cassandra, ElasticSearch, Spark, Kafka, Kubernetes, Flink Industry-standard build tooling, including Gradle and GitHub What We Value Demonstrated ability to collaborate and empathise with a variety ...

Elasticsearch, Kafka, and more across different environments Technologies We Use Different backend languages, including Java, Rust, and Go Open-source technologies like Cassandra, ElasticSearch, Spark, Kafka, Kubernetes, Flink Industry-standard build tooling, including Gradle and GitHub What We Value Demonstrated ability to collaborate and empathise with a variety ...

team. What We’re Looking For Proficient in one of Python, Scala or Java with strong experience in Big Data technologies such as: Spark, Hadoop etc. Practical knowledge of building real-time event streaming pipelines (e.g., Kafka, Spark Streaming, Kinesis). Proficiency in AWS cloud environments. Proven experience … Bonus Points For Expertise in Data Modelling, schema design, and handling both structured and semi-structured data. Familiarity with distributed systems such as Hadoop, Spark, HDFS, Hive, Databricks. Exposure to AWS Lake Formation and automation of ingestion and transformation layers. Background in delivering solutions for highly regulated industries. Passion ...

building and managing real-time data pipelines across a track record of multiple initiatives. Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.). Experience working with cloud platforms such as AWS, GCP, or Azure for real-time data ingestion and storage. Programming skills … similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written and verbal English skills Last ...

Help shape the technical roadmap for data engineering across Elliptic. Leverage and deploy AI and agentic systems to operate more effectively. Tech environment Scala | Spark | Databricks | AWS | Airflow | Kubernetes | Terraform | Functional Programming You will thrive here if you Enjoy end‐to‐end ownership, from writing the code to architecture … programming. Ability to design, build, and maintain distributed data systems in a cloud‐based environment. Hands‐on experience with big data frameworks such as Spark or Databricks. Knowledge of cloud infrastructure (AWS, GCP, or Azure). Judgement to balance scalability, performance, and maintainability. Experience with data modelling and workflow ...

shared platform capabilities for data ingestion, transformation, orchestration, and processing across batch and real-time workloads. Own the integration strategy across tools such asdbt, Spark and Beam Lead the implementation and adoption of data quality, observability, security, testing and deployment including creating and sharing standards Partner closely with Analytics … excellence, and supporting others Hands on experience transitioning to an AI-native Data Engineering landscape A strong Python and SQL engineer with experience usingdbt, Spark and Terraform Strong experience working with GCP (or a comparable cloud platform), Infrastructure as Code, and CI/CD practices. Deep understanding of data ...

software development lifecycleSolid background in Java/Scala and a scripting language like Python. Experience building large scale data pipelinesStrong familiarity with the Apache Hadoop ecosystem including : Spark, Kafka, Flink, Iceberg/Delta Lake/Hive, Apache Presto/Trino, etc. Experience with relational SQL and NoSQL ...

Citi is hiring a Big Data Applications Support Analyst to monitor and troubleshoot a large-scale data platform built on Hadoop, Hive, Spark, and Kafka. You will work with global teams to ensure 24/7 availability and data integrity for business reporting. Ideal candidates have strong Linux ...

ideal candidate will have more than 10 years of experience in backend development and data platform engineering, with strong expertise in Java and Apache Spark. The role offers competitive compensation and benefits, reflecting the company's commitment to employee well-being. #J-18808-Ljbffr ...

society's experience with software. Come join one of the fastest‐growing startups, supported by best‐in‐class institutions like Battery Ventures, Salesforce Ventures, Spark Capital and Meritech. Pendo Core Values: Bias to Act, Hone Your Craft, The Team is Pendo, and Maniacal Focus. Location: Pendo is a hybrid ...

society's experience with software. Come join one of the fastest-growing startups, supported by best-in-class institutions like Battery Ventures, Salesforce Ventures, Spark Capital and Meritech. Pendo Core Values: Bias to Act, Hone Your Craft, The Team is Pendo, and Maniacal Focus. Location: Pendo is a hybrid ...

matter - packed with personal touches and delivered with care. We're not just about selling cards or gifts - we're here to spread joy, spark smiles and make every celebration feel extra special. And with values that guide how we work and support one another, we've built … place where people (and ideas) can truly thrive. If you're looking to make an impact, bring your spark and be part of something meaningful - we'd love to have you on the team. Lead Analytics Engineer | London - Hybrid (1-2 days per week) | Competitive Salary + Benefits About ...

information across our organization.**The Platform:** You'll be supporting a modern Big Data platform built on industry-standard technologies including Hadoop, Hive, Impala, Spark, Kafka, and other open-source tools. This platform handles massive volumes of data daily, supporting analytics, reporting, and business-critical operations.**The Team … issues, and hand over to teams in other regions to maintain 24/7 coverage• Troubleshoot problems - Investigate and resolve issues with Hadoop, Spark, databases, and data processing jobs, working with other teams when needed• Manage scheduled jobs - Monitor thousands of automated jobs running daily, investigate failures, and coordinate ...

enhance solution quality while applying sound engineering judgement and responsible AI practices. What You'll DoDesign and develop robust data pipelines using Delta Lake, Spark Structured Streaming, Unity Catalog, and Azure-native services. Build real-time, event-driven solutions using technologies such as Kafka and Azure Event Hubs, applying … improve productivity while maintaining appropriate human oversight, governance, and solution quality. Bonus Points ForDevelopment experience using Scala or Java. Familiarity with Cloudera, Hadoop, Hive, Spark, and related distributed data ecosystems. Experience working with sensitive data and applying data privacy regulations, including GDPR.Curiosity to explore new technologies, including responsible ...

Senior Data Engineer 6 Month contract with extension Full-time Inside IR35 Hybrid 1 day every two weeks in the office Nottingham - NG1 4BX Join our client in embarking on an ambitious data transformation journey ...

home affairs is highly desirable. Technical expertise in data storage, processing, and containerization technologies such as Cloud or On‐prem Distributed File Systems, Spark, Kubernetes, and Elasticsearch. Our perks and quirks. What makes you Q will help you to realize your full potential, flourish and enjoy what ...

simple: to empower the next generation of short-term rental creators by providing flexible, user-friendly, and technology-driven tools that remove friction and spark innovation. Whether someone is managing their first property or scaling a portfolio, we’re here to help turn ambition into sustainable success. ...

bringing strong opinions, updating them when better ideas emerge, and communicating decisions clearly to technical and non-technical stakeholders alikeQualificationsDeep proficiency in Python and Spark for building and optimizing large-scale data pipelines, with a strong grasp of data structuring for performance and efficiencyHands-on experience with Airflow … orchestrating complex data workflows, and Apache Iceberg for table format management at scaleExtensive AWS experience including EKS, Docker, and Kubernetes; comfortable owning infrastructure deployment and scaling decisionsCI/CD fluency—ArgoCD, automated testing pipelines, and monitoring via Prometheus—treating deployment reliability as a first-class concernFamiliarity with analytical warehousing ...

spans a wide range of technologies, including Java and Python-based MicroServices, AWS/GCP cloud backend systems, Big Data technologies like Hive and Spark, and modern web applications. With a globally distributed presence across the US, India, and Europe, the team thrives on collaboration, bringing together diverse perspectives … Computer Science or equivalent practical experience Experience developing finance applications is a plus Working experience with Terraform is a plus Experience creating workflows for Apache Airflow is a plus What's Roku's approach to hybrid working? Roku fosters an inclusive and collaborative environment where teams generally work ...