201 to 225 of 297 Apache Spark Jobs in England

background)Testing and deployment pipelines, software and productivity tools, monitoring and middleware, data infrastructure. Integrating best-of-breed tools and technologies such as Spark, Kafka, Zookeeper, Mesos, Docker, ElasticsearchAssembling platforms and frameworks to automate business processesCollaborating with internal technology, research and portfolio management teamsPython Developers MUST have: A bachelor ...

depth actually gets used. AWS across the board, including S3, Glue, Redshift, Lake Formation and Kinesis Databricks and Snowflake running on top of AWS Spark and distributed processing frameworks for large-scale data Streaming technologies such as Kinesis or Kafka You're expected to pick the right tools ...

data mining, information retrieval, and statistics Understanding of machine learning frameworks: Tensorflow, Pytorch, pyG, Keras, MXNet, Scikit-Learn Strong programming knowledge of Python and Spark; proficiency in vector operations using numpy, scipy; experience with distributed computation using multithreading, multi GPUs, Dask, Ray, Polars Familiarity with AWS Cloud services such ...

experience with additional cloud providers is a plus. Demonstrated success leading initiatives involving complex data pipelines and analytics platforms utilizing technologies such as Hive, Spark, Presto, Cassandra, Hadoop, and ML/NLP capabilities. IQVIA is a leading global provider of clinical research services, commercial insights and healthcare intelligence ...

looking for a mixture of the following skills: Python Kubernetes Docker CI/CD basics (Gitlab pipelines) Data science and MLOps knowledge (highly desirable) Spark (highly desirable) Scala (highly desirable) S3 (highly desirable) Graph databases (highly desirable) Elasticsearch (highly desirable) Vector stores (highly desirable) OIDC/OAuth (highly desirable ...

looking for a mixture of the following skills: Python Kubernetes Docker CI/CD basics (Gitlab pipelines) Data science and MLOps knowledge (highly desirable) Spark (highly desirable) Scala (highly desirable) S3 (highly desirable) Graph databases (highly desirable) Elasticsearch (highly desirable) Vector stores (highly desirable) OIDC/OAuth (highly desirable ...

Desirable Experience with cloud-based risk platforms and pricing engines Azure Kubernetes Service (AKS) Azure Data Lake Microservices and event-driven architectures Kafka, Redis, Spark, HBase, and HDFS Market Risk platforms covering VaR, Stress Testing, and FRTB Risk exposure reconciliation and reporting platforms Enterprise scheduling tools such as Control ...

networking, storage, to applications Work in Python to design and deliver open source code Architect cloud infrastructure solutions like OpenStack, Kubernetes, Ceph, Hadoop and Spark either On-Premises or in Public Cloud (AWS, Azure, Google Cloud) Coach and develop your colleagues where you have insights Grow a healthy, collaborative ...

with product stakeholders to align technical strategy with business goals and resolve blockers across the team. Apply efficient data transformations using distributed computing (e.g., Spark, Dask) and ensure robust test coverage for production systems. Mentor junior team members and utilise model explainability methods to drive feature performance improvements. About ...

record of building AI solutions that solve real business problems and of taking them from prototype to production. Practical experience with Databricks, MLflow and Spark based data processing. Working knowledge of responsible AI methods, including bias and fairness testing, explainability techniques, and model risk. The ability to explain complex ...

large generative models. AV/robotics/simulation; multi-sensor driving data (video, telemetry; LiDAR a plus). Productionising research: Flyte/Ray/Spark-style jobs, dataset lineage, training mix configuration. Reward models, offline RL, or closed-loop evaluation of driving policies. Cloud GPU fleets (Azure/ ...

field, or experience in a professional field or military - Experience as technical specialist in design and architecture - Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - Experience in software development with object oriented language - Experience in cloud based solution (AWS or equivalent), system, network and operating system - Experience ...

secure and scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with ...

scaling patterns and reuse. Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with ...

/column-level security, lineage and audit Build reusable Terraform modules for Databricks and automate platform changes through CI/CD pipelines Tune Spark, Delta and Photon workloads to improve performance and reduce DBU and cloud spend Manage identity, SSO/SCIM, service principals, secret scopes and network isolation … experience as a Data Platform Engineer, Cloud Engineeror Data Engineer, with hands-on Databricks production experience Strong knowledge of the Databricks Lakehouse, Delta Lake, ApacheSpark and Unity Catalog Production experience administering Databricks on at least onemajor cloud (AWS, Azure or GCP), including networking, IAM and storage Proficiency with Terraform (ideally ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. Benefits We strive to provide comprehensive benefits and perks that meet the needs of all our employees. ...

lead embedded data science teams, partnering effectively with senior stakeholders across multiple domains Hands‐on technical expertise with tools such as Databricks, Python, Spark, and GCP/BigQuery Engineering mindset, with experience moving teams toward machine learning engineering best practice Credibility to lead long‐tenured individual contributors while providing ...

with stakeholders. Preferred qualifications, capabilities, and skills Experience designing/implementing pipelines using DAGs (e.g. Kubeflow, DVC, Ray) Experience of big data technologies (e.g. Spark, Hadoop) Have constructed batch and streaming microservices exposed as REST/gRPC endpoints Familiarity with GraphQL #CIBAppliedAI #J-18808-Ljbffr ...

role you should have the following skills: Experience implementingdata processes for Data Warehouse and production systems. Strong experience withBig Data technologies(e.g.,Hadoop/Spark). Programming in modern languages (e.g.,ScalaandPython). Strong delivery engineering tooling:Git/GitHub,Jenkins,Ansible, andJIRAfor requirement/backlog management. Strong understanding ...

leadership teams. Minimum Qualifications Masters in Statistics, Mathematics, Data Science, Machine Learning, Physics, Engineering, Computer Science or equivalent Proficiency in data querying using SQL, Spark, or equivalent technologies Proficiency in scripting languages for data processing and analysis (ex: Python, R, or Scala) Excellent communication and multi-functional collaboration skills ...

roles. Prior experience using causal inference/econometric techniques and bayesian methodologies for hypothesis testing. Prior experience using large datasets with distributed computing (e.g. spark, hadoop or other map-reduce tech)Experience working in a fast-moving tech company or startup. This role is a full-time role based ...

insights that drive the AI product roadmap forward. Tech Stack Includes: AWS: EC2, Athena, S3, Kinesis, Lambda, Step Functions, RDS, QuickSight Languages & Frameworks: Python, Spark, TensorFlow, LLMs & LLM coding tools Databases & Search: MySQL, PostgreSQL, SOLR Experience: Minimum 3 years of post-degree commercial experience in a data science ...

systems like Cassandra, Elasticsearch, Kafka, and more across different environmentsTechnologies We UseDifferent backend languages, including Java, Rust, and GoOpen-source technologies like Cassandra, ElasticSearch, Spark, Kafka, Kubernetes, FlinkIndustry-standard build tooling, including Gradle and GitHubWhat We ValueDemonstrated ability to collaborate and empathise with a variety of individuals. Able ...

bachelor's degree in a relevant field or equivalent practical experience.Useful, but not required• Event streaming or real-time processing with Kafka, Kinesis, Flink, Spark Structured Streaming, or similar technologies.• Distributed processing with Spark and familiarity with Parquet, Avro, JSON, and open table formats.• Search or retrieval systems ...

driven technologies such as Kafka, Flink, Kinesis, and Pub/Sub Orchestrate workflows using Airflow, Dataflow, and Glue Process and transform large datasets using Spark and Flink Design production-ready systems Work across relational, NoSQL, and analytical data stores Optimise storage formats and access patterns Implement secure, compliant data … code, providing technical direction and mentorship Improve data quality, testing, observability, and operational excellence Требования Strong Python and SQL skills Deep experience with Spark and modern data platforms such as Databricks and Snowflake Solid understanding of cloud data services in AWS or GCP Demonstrated ownership of large-scale data ...