126 to 150 of 188 Apache Spark Jobs in England

with stakeholders. Preferred qualifications, capabilities, and skills Experience designing/implementing pipelines using DAGs (e.g. Kubeflow, DVC, Ray) Experience of big data technologies (e.g. Spark, Hadoop) Have constructed batch and streaming microservices exposed as REST/gRPC endpoints Familiarity with GraphQL We recognize that our people are our strength ...

engineer first. Deep proficiency in Python/C++, experience with low-latency inference systems, and familiarity with distributed computing frameworks (Ray, Spark, Flink). You write code that survives in production, not just notebooks. The Full ML Lifecycle: Expertise in end-to‐end system design: from feature stores ...

business value in collaboration with an Account Executive and a Senior Solutions Architect. Gain excitement from clients about Databricks through hands‐on evaluation and Spark programming, integrating with the wider cloud ecosystem and 3rd party applications. Contribute to building the Databricks technical community through engagement at workshops, seminars … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

Data Engineer Location: London (Hybrid) Salary: Up to £75,000 + Bonus + Benefits Technology: SQL, Python, Spark - Azure, AWS, GCP - ETL/ELT - Data Governance The Opportunity Are you a Data Engineer looking for an opportunity to work on large-scale data transformation programmes whilst helping shape enterprise … data lineage. Support Data Governance initiatives, ensuring data security, privacy and compliance standards are maintained. Work with large and complex datasets using SQL, Python, Spark, Hadoop and modern data technologies. Collaborate with technical and business stakeholders within Agile delivery environments. Support data architecture and data modelling activities across enterprise ...

ideal candidate will have more than 10 years of experience in backend development and data platform engineering, with strong expertise in Java and Apache Spark. The role offers competitive compensation and benefits, reflecting the company's commitment to employee well-being. #J-18808-Ljbffr ...

streamline operations. At Chainalysis, we are at the forefront of this development. Technologies in Use Technologies we use include: AWS serverless architectures Kubernetes PostgreSQL Spark Typescript Terraform Kafka Github (including Github Actions) Java Data Platform Development We are building the data platform for blockchain, cryptocurrency, and web3. The Protocol ...

with modeling tools such as Python, PyTorch, TensorFlow, scikit‐learn, etc. Hands‐on experience building large‐scale distributed machine learning systems such as Hadoop, Spark, etc. Effective communication skills in Chinese. Equal Opportunity Employment At JD.com, we’re committed to building a diverse and inclusive workplace where everyone ...

experience with modeling tools such as Python, PyTorch, TensorFlow, scikit-learn etc.Hands-on experience building large-scale distributed machine learning systems such as Hadoop, Spark etc.Effective communication skills in Chinese.At JD.com, we’re committed to building a diverse and inclusive workplace where everyone can thrive. We’re proud ...

Building streaming data pipelines and event-driven systems Kafka, Pulsar, NATS, RabbitMQ, or similar messaging platforms Designing distributed schedulers, queues, and asynchronous processing systems Spark, Flink, Beam, or MapReduce Ad tech, social networks, search engines, or other large-scale content platforms We conduct coding interviews as part ...

conducted for several leading frontier model developers and national safety institutes, and has been featured in OpenAI’s o1 system card and Meta Muse Spark’s Safety & Preparedness Report. About the role As a Senior Research Scientist at the company, you will join our high-impact R&D team ...

compute cluster capabilities Advanced proficiency in Python, with extensive professional experience in building production applications and services Experience of modern cluster compute - Kubernetes, Spark, Hadoop Yarn, Ray, Airflow are some of the technologies we use Experience leading work in a formal software development environment alongside other engineers ...

code reviews Contributing to, proposing and reviewing technical standards Improving operational processes Mentoring more junior colleagues Java Vert.x Spring Rest APIs MySQL Microservices Kafka Spark NodeJS React AWS Terraform AngularJS Benefits Competitive compensation, variable bonus and performance‐based reward opportunities, and retirement programs Medical, dental, and vision insurance Generous ...

London --------------------------------------- JOB DETAILS Role Title: Data Engineer (Python Enterprise Developer) Must have skills: -Python, Postgres SQL, Azure Databricks, AWS(S3), Git, Azure DevOps CICD, Apache Airflow -Preferred Domain: Energy trading Minimum number of relevant years of experience: 8+ Detailed Job Description: JD: • 8+ years of experience in python scripting. … building native python ETL pipelines for scraping/processing. • Good to have experience in processing big data. • Proficient in SQL programming, Postgres SQL. Spark knowledge is a good to have • Knowledge on DevOps CI/CD like Azure Pipelines, Jenkins, Git. • Experience working with AWS services(S3, lambda ...

market data normalisation. Experience handling time-series challenges such as timestamp precision, sequence gaps, duplicate and out-of-order events. Experience with distributed processing (Spark, Polars, Dask, Ray or similar). Experience with Kafka or similar streaming technologies. Familiarity with PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar. Docker, Linux … market data engineering with proven experience building reliable, scalable data platforms. Our non-negotiable requirements are: Expert Python Strong SQL Scalable data pipeline development Apache Parquet Market data normalisation Automated data quality controls Deep tick and market data expertise Experience in MLOps is advantageous but not essential. We welcome ...

appropriate technologies for scalable analytics, trading strategy development, tick or time-series data, workflow automation and AI/ML-enabled use cases.• Prefer Databricks, Spark and modern lakehouse patterns for scalable analytics where suitable, while recognising transferable experience with Snowflake and other enterprise data platforms.• Ensure delivery choices balance … define OKRs, shape roadmaps and deliver enterprise data or analytics products.• Hands-on understanding of data technologies and modern analytics platforms, preferably Databricks/Spark and lakehouse patterns; Snowflake experience is relevant and transferable but Databricks experience is preferred.• Experience with Python, SQL and production analytics workflows; familiarity with ...

Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals Familiarity with CI/CD for production deployments Working knowledge of MLOps, ML/AI models … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

scale. The position sits in a team delivering high-impact ML across marketing and advertising, working on both real-time and batch workloads with Spark, Python, Java, and #J-18808-Ljbffr ...

streamline operations. At Chainalysis, we are at the forefront of this development. Technologies in Use Technologies we use include: AWS serverless architectures Kubernetes PostgreSQL Spark Typescript Terraform Kafka Github (including Github Actions) Java Data Platform Development We are building the data platform for blockchain, cryptocurrency, and web3. The Protocol ...

focusing on backend systems for large‐scale data storage, streaming, and warehousing. Experience with database technologies (MongoDB, Postgres), streaming/processing solutions (Kinesis, Flink, Spark), indexing/caching (ElasticSearch, Redis), and query engines (Trino, Presto, Snowflake). Track record of mentoring and leading teams in successful projects. Excellent communication ...

Java, data structures and concurrency, not just framework knowledge Hands-on experience with Kafka and event-streaming frameworks such as Flink, Kafka Streams or Spark Practical Kubernetes experience, including troubleshooting production issues Experience tuning JVM performance - garbage collection, CPU hotspots and heap dump analysis Why you'll love this ...

Java, data structures and concurrency, not just framework knowledge Hands-on experience with Kafka and event-streaming frameworks such as Flink, Kafka Streams or Spark Practical Kubernetes experience, including troubleshooting production issues Experience tuning JVM performance - garbage collection, CPU hotspots and heap dump analysis Why you'll love this ...

related to building large-scale data storage, streaming, and warehousing systems. Experience in various database technologies (MongoDB, Postgres), streaming/processing solutions (Kinesis, Flink, Spark), indexing/caching (ElasticSearch, Redis), and various data query engines (Trino, Presto, Snowflake, etc.). Show a track record of mentoring and leading teams ...

related to building large‐scale data storage, streaming, and warehousing systems. Experience in various database technologies (MongoDB, Postgres), streaming/processing solutions (Kinesis, Flink, Spark), indexing/caching (ElasticSearch, Redis), and various data query engines (Trino, Presto, Snowflake, etc.). Show a track record of mentoring and leading teams ...

matter – packed with personal touches and delivered with care. We’re not just about selling cards or gifts – we’re here to spread joy, spark smiles and make every celebration feel extra special. And with values that guide how we work and support one another, we’ve built ...

society's experience with software. Come join one of the fastest‐growing startups, supported by best‐in‐class institutions like Battery Ventures, Salesforce Ventures, Spark Capital and Meritech. Pendo Core Values: Bias to Act, Hone Your Craft, The Team is Pendo, and Maniacal Focus. Location: Pendo is a hybrid ...