151 to 175 of 626 Remote Apache Spark Jobs

efficient and performant queries. • Skilled in optimizing data ingestion and query performance for MSSQL or other RDBMS. • Familiar with data processing frameworks such as Apache Spark. • Highly analytical and tenacious in solving complex problems. Seniority level Seniority level Not Applicable Employment type Employment type Full-time Job function Job More ❯

science tools like scikit-learn, pandas, R, or Weka. Good understanding of SQL and NoSQL databases; familiarity with big data technologies like Hadoop and Spark is a plus. Solid knowledge of statistics, including hypothesis testing, confidence intervals, and A/B testing. Understanding of statistical models and machine learning More ❯

AWS). 6+ years of hands-on technical leadership in building large-scale, distributed data pipelines and reporting tools using big data technologies (e.g. Spark, Kafka, Hadoop), ensuring quality, scalability, and governance. Strong expertise in balancing trade-offs within complex distributed systems, focusing on data quality, performance, reliability, availability More ❯

Synapse Analytics, Azure Storage, and Azure ML. Proficiency in managing and optimizing cloud resources for performance and cost-efficiency. Extensive experience with Databricks, including Spark SQL, Delta Lake, and Databricks clusters. Experience in deploying, monitoring, and optimizing machine learning models in a production environment. Proficiency in programming such as More ❯

from home time to time. Flexibility is essential to accommodate any changes in the schedule. Preferred Requirements Experience with big data technologies like: Hadoop, Spark, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with containers EKS, Diode, CI/CD, and Terraform are a plus Work could possibly More ❯

challenges or competitions. Highly desirable skills: Familiarity with Agile practices in a collaborative team environment. Exposure to big data tools, such as Hadoop and Spark for handling large-scale datasets. Experience with cloud platforms like Microsoft Azure. Benefits: Comprehensive, payments industry training by in-house and industry experts. Excellent More ❯

Excellent communication skills to translate data insights into business value Preferred Qualifications Experience with serverless architectures on AWS. Familiarity with big data technologies (e.g. Spark, Hadoop). Knowledge of data governance and compliance best practices. Background in software development or experience with APIs for data integration About You Excellent More ❯

Familiarity with Infrastructure as Code (IaC) tools such as Terraform or CloudFormation. Knowledge of data engineering and experience with big data technologies like Hadoop, Spark, or Kafka. Experience with CI/CD pipelines and automation, such as using Jenkins, GitLab, or CircleCI. Seniority level Seniority level Mid-Senior level More ❯

. Familiarity with Python for AI/ML development is a significant advantage. Experience with data engineering pipelines or big data technologies (e.g., Kafka, Spark) is a plus. The recruitment process you can expect for this role is an initial call with your dedicated Talent Acquisition Partner who will More ❯

and unstructured data from various sources. Optimize ETL/ELT processes for data ingestion, transformation, and storage. Work with big data technologies (e.g., Databricks, Spark, Hadoop) and cloud platforms (Azure). Exercises independent judgment in developing, approving and maintaining a data hub as a central repository, managing data flow More ❯

with cloud platforms (AWS, Azure, Google Cloud) and microservices architecture. Nice-to-Have Requirements Experience with data modeling, containerization (Docker, Kubernetes), and distributed computing (Spark, Scala). Familiarity with GraphDB, MongoDB, SQL/NoSQL, and other DBMS technologies. Understanding of system automation, protection, and diagnostics in relevant sectors. Experience More ❯

Microsoft Azure, Databricks, Snowflake. Architectural and/or feature knowledge of one or more of the following Programming Languages/Packages: Python, Java, Scala, Spark, SQL, NoSQL databases. Experience working within Agile delivery methodologies. Proven ability to be successful in a matrixed organisation, and to enlist support and commitment More ❯

concepts to non-technical stakeholders. Preferred Skills: Experience with insurance platforms such as Guidewire, Duck Creek, or legacy PAS systems. Knowledge of Delta Lake, Apache Spark, and data pipeline orchestration tools. Exposure to Agile delivery methodologies and tools like JIRA, Confluence, or Azure DevOps. Understanding of regulatory data More ❯

concepts to non-technical stakeholders. Preferred Skills: Experience with insurance platforms such as Guidewire, Duck Creek, or legacy PAS systems. Knowledge of Delta Lake, Apache Spark, and data pipeline orchestration tools. Exposure to Agile delivery methodologies and tools like JIRA, Confluence, or Azure DevOps. Understanding of regulatory data More ❯

concepts to non-technical stakeholders. Preferred Skills: Experience with insurance platforms such as Guidewire, Duck Creek, or legacy PAS systems. Knowledge of Delta Lake, Apache Spark, and data pipeline orchestration tools. Exposure to Agile delivery methodologies and tools like JIRA, Confluence, or Azure DevOps. Understanding of regulatory data More ❯

concepts to non-technical stakeholders. Preferred Skills: Experience with insurance platforms such as Guidewire, Duck Creek, or legacy PAS systems. Knowledge of Delta Lake, Apache Spark, and data pipeline orchestration tools. Exposure to Agile delivery methodologies and tools like JIRA, Confluence, or Azure DevOps. Understanding of regulatory data More ❯

concepts to non-technical stakeholders. Preferred Skills: Experience with insurance platforms such as Guidewire, Duck Creek, or legacy PAS systems. Knowledge of Delta Lake, Apache Spark, and data pipeline orchestration tools. Exposure to Agile delivery methodologies and tools like JIRA, Confluence, or Azure DevOps. Understanding of regulatory data More ❯

concepts to non-technical stakeholders. Preferred Skills: Experience with insurance platforms such as Guidewire, Duck Creek, or legacy PAS systems. Knowledge of Delta Lake, Apache Spark, and data pipeline orchestration tools. Exposure to Agile delivery methodologies and tools like JIRA, Confluence, or Azure DevOps. Understanding of regulatory data More ❯

concepts to non-technical stakeholders. Preferred Skills: Experience with insurance platforms such as Guidewire, Duck Creek, or legacy PAS systems. Knowledge of Delta Lake, Apache Spark, and data pipeline orchestration tools. Exposure to Agile delivery methodologies and tools like JIRA, Confluence, or Azure DevOps. Understanding of regulatory data More ❯

in a data-focused role, with a strong passion for working with data and delivering value to stakeholders. Strong proficiency in SQL, Python, and Apache Spark , with hands-on experience using these technologies in a production environment. Experience with Databricks and Microsoft Azure is highly desirable. Financial Services More ❯

Kibana/Grafana/Prometheus). Write software using either Java/Scala/Python. The following are nice to have, but not required - Apache Spark jobs and pipelines. Experience with any functional programming language. Writing and analysing SQL queries. Application overVIOOH Our recruitment team will work hard More ❯

Purview or equivalent for data governance and lineage tracking Experience with data integration, MDM, governance, and data quality tools . Hands-on experience with Apache Spark, Python, SQL, and Scala for data processing. Strong understanding of Azure networking, security, and IAM , including Azure Private Link, VNETs, Managed Identities More ❯

Purview or equivalent for data governance and lineage tracking Experience with data integration, MDM, governance, and data quality tools . Hands-on experience with Apache Spark, Python, SQL, and Scala for data processing. Strong understanding of Azure networking, security, and IAM , including Azure Private Link, VNETs, Managed Identities More ❯

Significant experience of programming using Scala and Python Experience of using Terraform to provision and deploy cloud services and components Experience of developing on Apache Spark Experience of developing with AWS cloud services including (but not limited to) AWS Glue, S3, Step Functions, Lambdas, EventBridge and SQS BDD More ❯

responsible for developing information systems to support the Medical Director's Office, with a strong focus on Microsoft SQL Server development and/or Apache Spark big data processing environments. Your work will involve creating algorithms and pipelines to transform and process data, delivering powerful solutions that address More ❯