51 to 75 of 80 Remote Apache Spark Jobs

Desirable SC clearance alongside NPPV3 Functional/typed Scala — Cats, Cats Effect, FS2, http4s, Circe — a strong plus Streaming/big-data frameworks (Kafka, Spark, Flink) for integrating with partner pipelines Government, policing or law-enforcement data experience Data lineage, provenance, audit or integrity/verification tooling Secure ...

Experience establishing reliability programs that deliver meaningful, measurable business outcomes. Experience with Kubernetes, cloud infrastructure, and large-scale distributed systems. Familiarity with Kafka, ClickHouse, Spark, Flink, BigQuery, or similar large-scale data platforms. Experience partnering with Product, Data Science, and Ads Engineering organizations. Experience supporting machine learning inference ...

with product stakeholders to align technical strategy with business goals and resolve blockers across the team. Apply efficient data transformations using distributed computing (e.g., Spark, Dask) and ensure robust test coverage for production systems. Mentor junior team members and utilise model explainability methods to drive feature performance improvements. About ...

good fit Strong hands‐on experience of developing production‐grade solutions involving: Building Microservices (including scalable data pipelines using frameworks like Spark) Data technologies (Python, SQL) Large language models, fine tuning (closed & open source, OpenAI API) Solution design (mainly data applications using Python, SQL and other allied tech stack ...

system efficiency at scale Familiarity with a range of tools and technologies including: Development: Kotlin, Java Data storage/processing: DynamoDB, MySQL, Snowflake, Databricks, Spark Infrastructure as code and CI/CD: Terraform, GitLab CI/CD//You don't need to have experience in every area ...

data platforms (AWS, Azure, GCP). • Develop & Optimise robust data models, warehouses and 'big data' architectures. • Integrate & Transform data using tools such as Databricks, Spark, Kafka, Talend, Informatica, AWS Glue or Azure Data Factory. • Collaborate & Influence with cross-functional agile teams and client stakeholders. • Automate & Secure CI/… role. Essential qualifications: • You should have hands-on experience with cloud platforms such as AWS, Azure or GCP. • Strong proficiency in Python, SQL, Scala, Spark-SQL, JavaScript or PowerShell. • Proven ability to design and build data pipelines and workflow solutions. • Experience with data tools such as Databricks, Spark ...

will lead requirements for the Treasury Analytics Group, support FIS Quantum & TBSM, and work on a new risk/analytics platform using Hadoop, Spark, and NoSQL tools. The role reqs 5+ years of experience, Linux/Oracle/MS SQL, ITIL, and scripting with Java/Python. Collaboration with ...

technical challenges and unfamiliar technologies where required Technical Skills: Must-Have Skills: Python Kubernetes Docker CI/CD fundamentals (GitLab Pipelines) Highly Desirable Skills: Spark Scala S3 Storage Graph Databases Elasticsearch Vector Stores OIDC/OAuth NodeJS React To apply for Analytics Platform Engineer contract or permanent job, please ...

ideal candidate will have more than 10 years of experience in backend development and data platform engineering, with strong expertise in Java and Apache Spark. The role offers competitive compensation and benefits, reflecting the company's commitment to employee well-being. #J-18808-Ljbffr ...

conducted for several leading frontier model developers and national safety institutes, and has been featured in OpenAI’s o1 system card and Meta Muse Spark’s Safety & Preparedness Report. About the role As a Senior Research Scientist at the company, you will join our high-impact R&D team ...

will play a key role in advancing our data capabilities and driving innovation. Job Responsibilities: Develop workflows and ELT data pipelines using Python, Spark/PySpark, and Databricks Onboard enterprise datasets into Palmos, including ingestion, transformation, and validation of data assets Build, test, and maintain scalable data pipelines … secure coding standards; contribute learnings and reusable patterns to improve broader team effectiveness Required Qualifications, Capabilities, and Skills: Hands-on experience with Databricks, Spark/PySpark, Python, and SQL Experience developing and maintaining data pipelines and data processing systems Understanding of the data lifecycle, including ingestion, transformation, storage ...

Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals Familiarity with CI/CD for production deployments Working knowledge of MLOps, ML/AI models … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

scale. The position sits in a team delivering high-impact ML across marketing and advertising, working on both real-time and batch workloads with Spark, Python, Java, and #J-18808-Ljbffr ...

matter – packed with personal touches and delivered with care. We’re not just about selling cards or gifts – we’re here to spread joy, spark smiles and make every celebration feel extra special. And with values that guide how we work and support one another, we’ve built ...

society's experience with software. Come join one of the fastest‐growing startups, supported by best‐in‐class institutions like Battery Ventures, Salesforce Ventures, Spark Capital and Meritech. Pendo Core Values: Bias to Act, Hone Your Craft, The Team is Pendo, and Maniacal Focus. Location: Pendo is a hybrid ...

society’s experience with software. Come join one of the fastest‐growing startups, supported by best‐in‐class institutions like Battery Ventures, Salesforce Ventures, Spark Capital and Meritech. Pendo Core Values: Bias to Act, Hone Your Craft, The Team is Pendo, and Maniacal Focus. Location: Pendo is a hybrid ...

Help shape the technical roadmap for data engineering across Elliptic. Leverage and deploy AI and agentic systems to operate more effectively. Tech environment Scala | Spark | Databricks | AWS | Airflow | Kubernetes | Terraform | Functional Programming You will thrive here if you Enjoy end‐to‐end ownership, from writing the code to architecture … programming. Ability to design, build, and maintain distributed data systems in a cloud‐based environment. Hands‐on experience with big data frameworks such as Spark or Databricks. Knowledge of cloud infrastructure (AWS, GCP, or Azure). Judgement to balance scalability, performance, and maintainability. Experience with data modelling and workflow ...

Hybrid/Remote) Full-time Staff-level ownership of large-scale, distributed data pipelines, not just execution Modern open-source stack: Airflow/Dagster, Spark, dbt, Kafka, AWS Flexible Hybrid working out of Belfast Join a platform already moving billions of consumer interactions a year, still scaling About … standards across the team Essential: 7 years designing and building robust, scalable, distributed data systems and pipelines Strong experience with orchestration tools such as Apache Airflow or Dagster Experience with dbt, Spark, SQL, Athena/Trino, Redshift, Snowflake, PostgreSQL/MySQL Experience with public cloud ...

hybrid cloud environments, including Redshift, Glue, EMR and S3 Implement real-time and batch processing pipelines using modern data engineering frameworks including Spark, Kafka and dbt Create data flow diagrams, integration patterns and canonical models to support consistent, scalable data delivery Define and enforce data governance standards including metadata … scale Deep practical knowledge of AWS data services including Redshift, Glue, EMR, Kinesis and S3 Experience with modern data engineering tools such as dbt, Spark or Flink Proven experience with SQL and NoSQL databases including PostgreSQL, MySQL and DynamoDB Knowledge of data governance frameworks and tools including metadata management ...

services such as Pub/Sub and BigQuery Experience with streaming technologies such as Kafka and real time processing engines such as Spark or Flink Strong understanding of performance optimisation, including indexing, partitioning, caching and query tuning Experience working across multi cloud and hybrid cloud environments, including cost optimisation … Have: Relevant certifications such as AWS Certified Data Analytics or Google Professional Data Engineer Knowledge of data governance tools such as Collibra or Apache Atlas Familiarity with encryption standards and key management, such as AES256, TLS, KMS or Vault Why Apply? Competitive salary and a strong benefits package Hybrid ...

looking for Extensive experience using python, especially using libraries such as Pandas, scikit-learn and NumPy. Strong programming skills in SQL or Spark SQL Experience in Natural language processing and working and developing LLMs Full ML model lifecycle experience Relevant experience with Power BI or similar tools such … experienced data professional who will bring strong technical expertise in data science, machine learning and advanced analytics, with extensive experience using Python, SQL or Spark SQL, statistical modelling, natural language processing and large language models. You will have experience across the full machine learning lifecycle, including data cleaning, quality ...

Overview At Aztec, we are committed to building a diverse and inclusive workforce where everyone is valued, respected, and able to grow. We welcome applications from all individuals and encourage candidates who are excited about ...

must have demonstrable experience designing, deploying, and operating big data platforms at scale. You will have hands-on experience with OSS data ecosystems (e.g., Spark, Trino, Airflow, Apache Superset, and similar technologies). You will have knowledge of cloud platforms and traditional on-premise hosting; hands-on experience ...

processing, including vector databases, fine-tuning LLMs, and deploying LLMs with tools such as HuggingFace, Langchain, and OpenAI Hands-on experience working with Distributed Spark based systems. Graduate degree in a quantitative discipline (Computer Science, Engineering, Statistics, Operations Research, etc.) or equivalent practical experience Experience communicating and teaching technical … driving our values through ML [Preferred] 2+ years customer-facing experience in a pre-sales or post-sales role [Preferred] Experience working with Apache SparkTM to process large-scale distributed datasets Can meet expectations for technical training and role-specific outcomes within 3 months of hire Can travel ...

adoption of modern data mesh principles across complex enterprise environments. What You'll Be Doing Architect and deliver modern data solutions using Databricks, Spark, PySpark and SQL Design scalable batch and real-time data pipelines that ingest data from legacy and modern platforms Lead the development of cloud-based … decision making Provide technical leadership and architectural direction on large-scale transformation programmes Essential Experience Strong hands-on expertise with Databricks Extensive experience using Spark, PySpark and SQL Proven track record designing and implementing data lake architectures Experience building both batch and streaming data pipelines Strong knowledge of Kafka ...