126 to 150 of 184 Remote/Hybrid Apache Spark Jobs

hybrid Data Engineer role based in Belfast, offering the opportunity to work with modern cloud technologies including Databricks, AWS Glue, Delta Lake and Spark, while contributing to a wider programme of data transformation and continuous improvement. Key requirements include 2+ years' Data Engineering experience, strong Python/PySpark … maintain data models for BI and analytics Work with Delta Lake and modern data warehousing technologies Maintain Databricks notebooks, jobs and workflows Optimise Spark jobs and data workflows for performance and scalability Monitor, troubleshoot and improve data pipeline performance Ensure data quality, integrity, security and compliance Support wider analytics ...

Roku in Manchester is looking for a Senior Data Engineer to join the Viewer Product Device & Themed Experiences team. You will design data models and build scalable pipelines across Roku devices, apps, and web/ ...

stakeholders. Architecture design informed through the use of principles, patterns, technical radars, practices and standards. AWS Solution expertise and relevant certification - EMR/Spark (Hadoop)/AWS/Data Modelling-Mapping/GitHub/GitLab Technologies Azure AWS Power BI #J-18808-Ljbffr ...

depth actually gets used. AWS across the board, including S3, Glue, Redshift, Lake Formation and Kinesis Databricks and Snowflake running on top of AWS Spark and distributed processing frameworks for large-scale data Streaming technologies such as Kinesis or Kafka You're expected to pick the right tools ...

Desirable Experience with cloud-based risk platforms and pricing engines Azure Kubernetes Service (AKS) Azure Data Lake Microservices and event-driven architectures Kafka, Redis, Spark, HBase, and HDFS Market Risk platforms covering VaR, Stress Testing, and FRTB Risk exposure reconciliation and reporting platforms Enterprise scheduling tools such as Control ...

translate complex AI capabilities into clear business use cases and recommendationsExperience in at least one programming language such as Python, R, SQL, SAS, Spark, Java, etc., with practical applications in AI or ML projectsFamiliarity with AI techniques and machine learning algorithms, including supervised and unsupervised learningStrong communication skills with ...

networking, storage, to applications Work in Python to design and deliver open source code Architect cloud infrastructure solutions like OpenStack, Kubernetes, Ceph, Hadoop and Spark either On-Premises or in Public Cloud (AWS, Azure, Google Cloud) Coach and develop your colleagues where you have insights Grow a healthy, collaborative ...

with product stakeholders to align technical strategy with business goals and resolve blockers across the team. Apply efficient data transformations using distributed computing (e.g., Spark, Dask) and ensure robust test coverage for production systems. Mentor junior team members and utilise model explainability methods to drive feature performance improvements. About ...

with product stakeholders to align technical strategy with business goals and resolve blockers across the team. Apply efficient data transformations using distributed computing (e.g., Spark, Dask) and ensure robust test coverage for production systems. Mentor junior team members and utilise model explainability methods to drive feature performance improvements. About ...

large generative models. AV/robotics/simulation; multi-sensor driving data (video, telemetry; LiDAR a plus). Productionising research: Flyte/Ray/Spark-style jobs, dataset lineage, training mix configuration. Reward models, offline RL, or closed-loop evaluation of driving policies. Cloud GPU fleets (Azure/ ...

/column-level security, lineage and audit Build reusable Terraform modules for Databricks and automate platform changes through CI/CD pipelines Tune Spark, Delta and Photon workloads to improve performance and reduce DBU and cloud spend Manage identity, SSO/SCIM, service principals, secret scopes and network isolation … experience as a Data Platform Engineer, Cloud Engineeror Data Engineer, with hands-on Databricks production experience Strong knowledge of the Databricks Lakehouse, Delta Lake, ApacheSpark and Unity Catalog Production experience administering Databricks on at least onemajor cloud (AWS, Azure or GCP), including networking, IAM and storage Proficiency with Terraform (ideally ...

role you should have the following skills: Experience implementingdata processes for Data Warehouse and production systems. Strong experience withBig Data technologies(e.g.,Hadoop/Spark). Programming in modern languages (e.g.,ScalaandPython). Strong delivery engineering tooling:Git/GitHub,Jenkins,Ansible, andJIRAfor requirement/backlog management. Strong understanding ...

roles. Prior experience using causal inference/econometric techniques and bayesian methodologies for hypothesis testing. Prior experience using large datasets with distributed computing (e.g. spark, hadoop or other map-reduce tech)Experience working in a fast-moving tech company or startup. This role is a full-time role based ...

roles. Prior experience using causal inference/econometric techniques and bayesian methodologies for hypothesis testing. Prior experience using large datasets with distributed computing (e.g. spark, hadoop or other map-reduce tech)Experience working in a fast-moving tech company or startup. This role is a full-time role based ...

insights that drive the AI product roadmap forward. Tech Stack Includes: AWS: EC2, Athena, S3, Kinesis, Lambda, Step Functions, RDS, QuickSight Languages & Frameworks: Python, Spark, TensorFlow, LLMs & LLM coding tools Databases & Search: MySQL, PostgreSQL, SOLR Experience: Minimum 3 years of post-degree commercial experience in a data science ...

systems like Cassandra, Elasticsearch, Kafka, and more across different environmentsTechnologies We UseDifferent backend languages, including Java, Rust, and GoOpen-source technologies like Cassandra, ElasticSearch, Spark, Kafka, Kubernetes, FlinkIndustry-standard build tooling, including Gradle and GitHubWhat We ValueDemonstrated ability to collaborate and empathise with a variety of individuals. Able ...

build and enhance our Databricks platform, ensuring it remains secure, scalable and reliable. Develop and maintain batch and real-time data pipelines using Databricks, Spark and Delta Lake. Contribute to platform architecture, engineering standards and best practices across the data estate. Collaborate with Product, Analytics and Data Science teams … improvement across the engineering team. Our ideal candidate Proven experience building and supporting scalable, production-grade data platforms. Strong hands-on expertise with Databricks, Spark, Delta Lake, Python and SQL. Good understanding of cloud-based data engineering, ideally within Azure environments. Experience working with Infrastructure as Code tools such ...

changed how you work, not just how fast. We expect you to enjoy leveraging AI and agentic systems to operate more effectively. Tech environmentScala | Spark | Databricks | AWS | Claude | Airflow | Kubernetes | Terraform | Functional ProgrammingYou will thrive here if youEnjoy end-to-end ownership, from writing the code to architecture design … Python. Ability to design, build, and maintain distributed data systems in a cloud-based environment. Hands-on experience with big data frameworks such as Spark or Databricks. Knowledge of cloud infrastructure (AWS, GCP, or Azure).Judgement to balance scalability, performance, and maintainability. Experience with data modelling and workflow orchestration. ...

Python is required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including the design, implementation ...

Python is required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including the design, implementation ...

will lead requirements for the Treasury Analytics Group, support FIS Quantum & TBSM, and work on a new risk/analytics platform using Hadoop, Spark, and NoSQL tools. The role reqs 5+ years of experience, Linux/Oracle/MS SQL, ITIL, and scripting with Java/Python. Collaboration with ...

depth actually gets used. • AWS across the board, including S3, Glue, Redshift, Lake Formation and Kinesis • Databricks and Snowflake running on top of AWS • Spark and distributed processing frameworks for large-scale data • Streaming technologies such as Kinesis or Kafka You're expected to pick the right tools ...

Elasticsearch, Kafka, and more across different environments Technologies We Use Different backend languages, including Java, Rust, and Go Open-source technologies like Cassandra, ElasticSearch, Spark, Kafka, Kubernetes, Flink Industry-standard build tooling, including Gradle and GitHub What We Value Demonstrated ability to collaborate and empathise with a variety ...

Elasticsearch, Kafka, and more across different environments Technologies We Use Different backend languages, including Java, Rust, and Go Open-source technologies like Cassandra, ElasticSearch, Spark, Kafka, Kubernetes, Flink Industry-standard build tooling, including Gradle and GitHub What We Value Demonstrated ability to collaborate and empathise with a variety ...

team. What We’re Looking For Proficient in one of Python, Scala or Java with strong experience in Big Data technologies such as: Spark, Hadoop etc. Practical knowledge of building real-time event streaming pipelines (e.g., Kafka, Spark Streaming, Kinesis). Proficiency in AWS cloud environments. Proven experience … Bonus Points For Expertise in Data Modelling, schema design, and handling both structured and semi-structured data. Familiarity with distributed systems such as Hadoop, Spark, HDFS, Hive, Databricks. Exposure to AWS Lake Formation and automation of ingestion and transformation layers. Background in delivering solutions for highly regulated industries. Passion ...