251 to 275 of 632 Apache Spark Jobs in London

Background in top-tier financial or analytics-driven companies is a plus. Tech Environment TypeScript (React.js/Node.js) Python & Java AWS Cloud Infrastructure Modular Monolith Architecture Big Data Tools (Spark, EMR, Lambda) Roles and Responsibilities Evolution of the company's data platform as it scales beyond MVP Building and maintaining scalable data pipelines using Python, Java, Spark, SQL … moving or finance-oriented environments Qualifications Proficiency in Python (preferred), with experience in other languages like Java, Scala, or TypeScript Strong knowledge of cloud-based big data tools (AWS, Spark, EMR, Lambda, etc.) Excellent communication and problem-solving skills Data Engineer High-Growth Tech Scale-Up Strategic + Hands-On Role An exciting opportunity has opened up with a More ❯

comprehensive data platform? At AEE, you will: Design, implement, and support analytical data infrastructure for both business intelligence and machine learning applications Manage AWS resources including EC2, Redshift, EMR-Spark, etc. Collaborate with applied scientists to build data pipelines for training machine learning models Work with Product Managers, Financial, and Business analysts to improve reporting practices: data integrity, testing More ❯

Familiarity with Machine Learning and Data Science tooling, such as Jupyter Notebooks, Tensorflow, Scikit-learn, and PyTorch Knowledge of JIRA, Github, or Gitlab Experience with data platforms such as Spark, Snowflake, or BigQuery. Experience with AWS, GC,P and Kubernetes Serve as internal and external point of contact on customer matters and ensure customer issues are resolved as expediently … Past experience working in a customer-facing role (IT Support, HelpDesk, Retail, and similar) Experience with AWS, GCP, and Kubernetes Distributed file system Experience with data platforms such as Spark, Databricks, EMR, Snowflake, or BigQuery. Knowledge of JIRA, Github, or Gitlab Familiarity with Machine Learning and Data Science tooling, such as Jupyter Notebooks, Tensorflow, Scikit-learn, and PyTorch Nice More ❯

disseminate significant amounts of information with attention to detail and accuracy. Adept at queries, report writing, and presenting findings. Experience working with large datasets and distributed computing tools (Hadoop, Spark, etc.) Knowledge of advanced statistical techniques and concepts (regression, properties of distributions, statistical tests, etc.). Experience with data profiling tools and processes. Knowledge of Microsoft Fabric is desirable. More ❯

disseminate significant amounts of information with attention to detail and accuracy. Adept at queries, report writing, and presenting findings. Experience working with large datasets and distributed computing tools (Hadoop, Spark, etc.) Knowledge of advanced statistical techniques and concepts (regression, properties of distributions, statistical tests, etc.). Experience with data profiling tools and processes. Knowledge of Microsoft Fabric is desirable. More ❯

in designing and implementing systematic trading systems Experience in developing and deploying RESTful APIs and microservices for model serving Familiarity with Big Data technologies such as Ray, Dask, and Spark Experience with data visualization and reporting tools Familiarity with databases and query languages for data extraction and transformation Understanding of and experience with modern software development practices and tools More ❯

as Java, TypeScript, Python, and Go Web libraries and frameworks such as React and Angular Designing, building, and maintaining CI/CD pipelines Big data technologies like NiFi, Hadoop, Spark Cloud and containerization technologies such as AWS, OpenShift, Kubernetes, Docker DevOps methodologies, including infrastructure as code and GitOps Database technologies, e.g., relational databases, Elasticsearch, MongoDB Why join Gemba? Gemba More ❯

IT, STEM, Maths, Computer Science) or equivalent experience Good data modelling, software engineering knowledge, and strong knowledge of ML packages and frameworks Skilful in writing well-engineered code using Spark, and advanced SQL and Python coding skills Experienced in working with Azure Databricks Proven experience working with Data Scientists to deliver best in-class solutions for model deployment and More ❯

PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala) - Experience with one or more scripting language (e.g., Python, KornShell) PREFERRED QUALIFICATIONS - Experience with big data technologies such as: Hadoop, Hive, Spark, EMR - Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc. - Knowledge of cloud services such as AWS or equivalent Our inclusive culture empowers Amazonians to deliver More ❯

detection domains creating graph analyses and graph connection modelling creating usable datasets for explorative analysis and turn clues into leads and insights for ML modelling Data Engineering using SQL, Spark or Python for explorative analysis and feature engineering in a heavy tabular data environment building new and supporting existing Erlang based microservices that enable product features data engineering and More ❯

How did you hear about this job? Select Have you worked with Python/Java/Scala/Go? Select Do you have experience with Big Data Technologies like Spark, Databricks,andAirflow? Do you have any experience with Microservices architecture and API development? If yes, please describe briefly. What are you salary expectations? Do you require visa sponsorship to More ❯

Experience in data modeling, architecture, and processing unstructured data. Experience with processing 3D geometric data. Experience with large-scale, data-intensive systems in production. Knowledge of distributed computing frameworks (Spark, Dask, Ray). Experience with cloud platforms (AWS, Azure, GCP). Proficiency with Docker, Linux, and bash. Ability to document code, architectures, and experiments. Preferred Qualifications Experience with databases More ❯

between the data warehouse and other systems. Create deployable data pipelines that are tested and robust using a variety of technologies and techniques depending on the available technologies (Nifi, Spark) Build analytics tools that utilise the data pipeline to provide actionable insights into client requirements, operational efficiency, and other key business performance metrics. Complete onsite client visits and provide More ❯

between the data warehouse and other systems. Create deployable data pipelines that are tested and robust using a variety of technologies and techniques depending on the available technologies (Nifi, Spark) Build analytics tools that utilise the data pipeline to provide actionable insights into client requirements, operational efficiency, and other key business performance metrics. Complete onsite client visits and provide More ❯

in US or UK Preferred Experience: Data orchestration tools (e.g. , Airflow, Prefect)Experience deploying, monitoring, and maintaining ML models in production environments (MLOps)Familiarity with big data technologies ( e.g. , Spark, Hadoop)Background in time-series analysis and forecastingExperience with data governance and security best practicesReal-time data streaming is a plus (Kafka, Beam, Flink)Experience with Kubernetes is a More ❯

IT, STEM, Maths, Computer Science) or equivalent experience Good data modelling, software engineering knowledge, and strong knowledge of ML packages and frameworks Skilful in writing well-engineered code using Spark, and advanced SQL and Python coding skills Experienced in working with Azure Databricks Proven experience working with Data Scientists to deliver best in-class solutions for model deployment and More ❯

warehouses like Snowflake) and SQL Ability to read and write Python or R code What will make you stand out Experience with big data technologies, such as Hadoop or Spark Experience with authentication and authorization systems such as LDAP, SAML, and Kerberos Experience with ML models and LLMs What does the hiring process look like? #LI-Remote #LI-AN1 More ❯

Engineering using a high level language like Go, Java, JavaScript, Python Distributed Software Architecture exposure in high volume production scenarios Working with Data Mesh, BigData technologies such as EMR, Spark, Databricks Designing, tracking and testing to SLOs and Chaos Engineering to Error Budgets Implementing Business Continuity (BCP) and Disaster Recovery (DRP) plans including tracking RTO and RPO CryptoCurrency domain More ❯

Requirements: 5+ years of experience in cloud architecture and implementation Bachelor's degree in Computer Science, Engineering, related field, or equivalent experience Experience in database (e.g., SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) Experience in consulting, design and implementation of serverless distributed solutions Experience in software development with object-oriented language AWS experience preferred, with proficiency in a wide range More ❯

Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of cloud security, networking, and cost optimization as it relates to data platforms. Experience in total cost of ownership estimation and managing More ❯

monitoring tools such as New Relic or Grafana Understand the use of feature stores and related data technologies for operational machine learning products Are proficient with Python and have Spark knowledge. Have leadership experience either through previous management or mentorship. Have good communication skills. Nice to have Experience deploying LLMs and agent-based systems Our technology stack Python and More ❯

members. Advanced knowledge of machine learning algorithms and general statistical methodologies and theory. Advanced knowledge of AB testing and design of experiment. Advanced Python and SQL skills, experience using Spark for processing large datasets. Understanding of software product development processes and governance, including CI/CD processes and release and change management. Familiarity with cloud computing platforms, ideally experience More ❯

the latest tech, serious brain power, and deep knowledge of just about every industry. We believe a mix of data, analytics, automation, and responsible AI can do almost anything—spark digital metamorphoses, widen the range of what humans can do, and breathe life into smart products and services. Want to join our crew of sharp analytical minds? You'll More ❯

the latest tech, serious brain power, and deep knowledge of just about every industry. We believe a mix of data, analytics, automation, and responsible AI can do almost anything—spark digital metamorphoses, widen the range of what humans can do, and breathe life into smart products and services. Want to join our crew of sharp analytical minds? You'll More ❯

deep learning, GenAI, LLM, etc. as well as hands-on experience on AWS services like SageMaker and Bedrock, and programming skills such as Python, R, SQL, Java, Julia, Scala, Spark/Numpy/Pandas/scikit, JavaScript. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace More ❯