stack is not essential, but it would make things easier. The main technologies we use include: Elixir, Erlang, Python, Terraform, Ansible, Packer, EMR/Spark, ApacheSpark, Apache Druid, BigQuery and Redis Familiarity with cloud technologies. Ideally AWS and technologies such as EC2, ECS, EMR, AWS … Lambda, DynamoDB, S3, Kinesis, SQS, SES, Cloudwatch.... Knowledge or experience with big data technologies such as Spark, Hadoop, Redshift, Snowflake, Kafka, Flink, Druid, Clickhouse... is highly desirable. Benefits Flexible work arrangements to support a healthy work-life balance 25 vacation days (excluding bank holidays) and 5 days of carers more »
ML libraries (TensorFlow, pytorch, scikit-learn, transformers, XGBoost, ResNet), geospatial libraries (shapely, geopandas, rasterio), CV libraries (scikit-image, OpenCV, yolo, Detectron2). AWS, Postgres, Apache Airflow, Apache kafka, ApacheSpark Mandatory requirements: You have at least 5 years of experience in the DS role, deploying models … You have expertise on applications focusing on geospatial data and mobility analytics (highly desirable). You have proven experience with big data technologies, specifically Spark and Kafka. You have experience working with state-of-art ML pipeline technologies (such as MLflow, Sagemaker...) or building a ML pipeline by yourself more »
development (ideally AWS) Knowledge and ideally hands-on experience with data streaming, event-based architectures and Kafka Strong communication and interpersonal skills Experience with ApacheSpark or Apache Flink would be ideal, but not essential Please note, this role is unable to provide sponsorship. If this role more »
business value in collaboration with an Account Executive and a Senior Solutions Architect. Gain excitement from clients about Databricks through hands-on evaluation and Spark programming, integrating with the wider cloud ecosystem and 3rd party applications. Contribute to building the Databricks technical through engagement at workshops, seminars, and meet … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, ApacheSpark, Delta Lake and MLflow. To learn more, follow Databricks on Twitter ,LinkedIn and Facebook . Our Commitment to Diversity and Inclusion At more »
Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as ApacheSpark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands more »
Data mining, Data warehousing, ETL Experience in handling large volumes of data on SQL, NoSQL and Big Data databases Experience in Hadoop ecosystem: Hadoop, Spark, Hive, and/or Scala Experience in programming languages: PHP, Python, C++/Java Experience in Web development in Laravel MVC Framework Comfortable working more »
Comfort with rapid prototyping and disciplined software development processes Experience with Python, ML libraries (e.g. spaCy, NumPy, SciPy, Transformers, etc.)data tools and technologies (Spark, Hadoop, Hive, Redshift, SQL), and toolkits for ML and deep learning (SparkML, Tensorflow, Keras) Demonstrated ability to work on multi-disciplinary teams with diverse more »
ADF, SSIS) Data governance (Purview, Unity Catalogue) Databricks Delta Lake Storage Azure Dev OPS DESIRED SKILLS Advanced Analytics Data Technologies Databricks, Delta Lake, Synapse Spark SQL, Pyspark Azure Data Explorer Logic Apps, Key Vault Semi structured data processing Integration Runtime Coding experience: Python, C#, Java for Data analysis purpose more »
data from a wide variety of corporate structured and unstructured sources, 3rd party providers and publicly available data. Leverage cloud data processing frameworks like ApacheSpark, Databricks, or similar for handling, processing and analysing complex, high-volume data both structured and unstructured. Ability to script repetitive data tasks more »
environment. Experience in log management tools to troubleshoot issues as well as identify useful analytics data. Preferred Experience in Microsoft Azure services and Databricks Spark, Redshift, Hadoop Map-Reduce or other Big Data frameworks Code management tools (Git, Sbt, Maven) Pyspark, Scala or other functional programming languages Analytics tools more »
the financial services or hedge fund industry.Technical Skills:Proficiency in Python and SQL.Experience with relational and NoSQL databases.Knowledge of big data frameworks (e.g., Hadoop, Spark, Kafka).Understanding of financial markets and trading systems.Strong analytical, problem-solving, and communication skills.Familiarity with DevOps tools and practices.This is an exciting opportunity for more »
or hedge fund industry. Technical Skills: Proficiency in Python and SQL. Experience with relational and NoSQL databases. Knowledge of big data frameworks (e.g., Hadoop, Spark, Kafka). Understanding of financial markets and trading systems. Strong analytical, problem-solving, and communication skills. Familiarity with DevOps tools and practices. This is more »
or similar, with 6+ years of professional experience. A good understanding of modern lakehouse architectures and corresponding technologies, such as Dremio, Snowflake, Iceberg, (Py)Spark/Glue/EMR, dbt and Airflow/Dagster. Experience with Cloud providers. Familiarity with AWS S3, ECS and EC2/Fargate would be more »
Solid experience with programming languages like Python and proficiency in SQL Experience working with cloud platforms (e.g., Azure, GCP) and big data technologies like Spark Working knowledge of ETL and ELT frameworks and tools like dbt Working knowledge of Version Control and CICD pipelines Hiring, developing, and retaining cyber more »
C++, Java, or similar. Experience using SQL, Python (Pandas, NumPy, Scikit-Learn, etc.)/R or equivalent. Experience with Data Storage, Ingestion, and Transformation (Spark, Kafka or similar tools). Experience developing cloud infrastructure services, preferably with Kubernetes. You are passionate about solving data problems at Scale. Expertise with more »
SQL Data Warehouse, Azure Data Lake, Azure Databricks Azure Cosmos DB, Azure Data Factory, Azure Search, Azure Stream Analytics Delta Lake and Data Lakes ApacheSpark Pools, SQL Pools (dpools and spools) Experience in Python, C# coding, Spark, PySpark, Unix shell/Perl scripting experience. Experience in more »
tools such as Informatica MDM, Informatica AXON, Informatica EDC, and Collibra MySQL, SQL Server, Oracle, Snowflake, PostgreSQL and NoSQL databases Programming languages such as Spark or Python Amazon Web Services, Microsoft Azure or Google Cloud and distributed processing technologies such as Hadoop Benefits : Base Salary more »
machine learning or more general statistical analysis Strong software development skills with proficiency in Python or C++ Experience with analytics frameworks such as Pandas, ApacheSpark, Dask, or Flink Experience with machine learning frameworks such as TensorFlow, JAX, PyTorch, Spark MLlib, Keras, or scikit-learn Experience in … cloud-based infrastructures such as AWS or GCP Exposure to orchestration platforms such as Apache Airflow or Kubeflow Proven attention to detail, critical thinking, and the ability to work independently within a cross-functional team What benefits do we offer ? Cond Nast Learning Hub where you ll find you more »
Platforms Must have 8 years Experience with Relational Databases like Oracle NoSQL Databases and or Big Data technologies e g Oracle SQL Server Postgres Spark Hadoop other Open Source Must have experience in Data Security Solutions Identity and Access Management and Data Security Access Management Must have 3 years more »
C++, Java, or similar. Experience using SQL, Python (Pandas, NumPy, Scikit-Learn, etc.)/R or equivalent. Experience with Data Storage, Ingestion, and Transformation (Spark, Kafka or similar tools). Experience developing cloud infrastructure services, preferably with Kubernetes. You are passionate about solving data problems at Scale. Expertise with more »
API design, MLOps) Building machine learning models and pipelines in Python, using common libraries and frameworks (e.g., PyTorch, MLFlow, JAX) Distributed computing frameworks (e.g., Spark, Dask) Cloud platforms (e.g., AWS, Azure, GCP) and HP computing Containerization and orchestration (Docker, Kubernetes) Ability to scope and effectively deliver projects Strong problem more »
ML libraries (TensorFlow, pytorch, scikit-learn, transformers, XGBoost, ResNet), geospatial libraries (shapely, geopandas, rasterio), CV libraries (scikit-image, OpenCV, yolo, Detectron2). AWS, Postgres, Apache Airflow, Apache kafka, Apache Spark. Mandatory requirements: You have at least 5 years of experience in DS role, deploying models into production … You have proven experience delivering end-to-end ML solutions that produced business value. You have proven experience with big data technologies, specifically Spark and Kafka You are proficient in Python. You have expert knowledge of at least one cloud computing platform (preferably aws). You are fluent in more »
quality of data. Key Requirements: Strong experience designing data pipelines/warehouses using AWS and Snowflake. Exposure to big data technologies such as Kafka, Spark, or Hadoop. Solid experience with Snowflake, including performance optimisation and cost management. Strong experience with SQL and Data modelling. Excellent understanding of AWS architecture more »
tasks, both for oneself and others, ensuring progress aligns with project goals. Nice to have: Previous experience in startup environments. Proficiency or experience with Apache Spark. Familiarity or background in working with Azure. Experience orchestrating workflows, particularly within distributed system environments. Knowledge of MLOps principles and practices, especially in more »
and partners Preferred Requirements Experience or strong interest in blockchain and other Web 3.0 technologies Experience with OLAP technologies, such as, Presto/Trino, Spark, Hadoop, Athena, or BigQuery is a plus Experience in Golang or any other strongly-typed programming language Experience mentoring and supporting fellow engineers Our more »
