5 Apache Spark Jobs in the Midlands

CD, and model monitoring. Proficiency in Python and relevant data manipulation and analysis libraries (e.g., pandas, NumPy). Experience with distributed computing frameworks like Apache Spark is a plus. Apache Spark and Airflow would be a bonus. Role overview: If you're looking to work with more »

team has strong appetite to embrace latest tech stacks offered in the industry. We need passionate software engineers who use Java, JavaScript, Python, React, Apache Spark and open source data science toolkits to build solutions that offer best in class experience to our risk managers and analysts. Our … solving and analytical skills Preferred Qualifications Strong programming experience in at least one language Comfortable with working with multiple languages Technologies: Scala, Java, Python, Spark, Linux and shell scripting, TDD (JUnit), build tools (Maven/Gradle/Ant) Experience with continuous delivery and deployment Proficient at working with large more »

Azure Synapse SQL Pool (data warehouse) facilitating operational and analytics data use cases (In lieu of specific Azure Databricks experience a working knowledge of Spark, python, SQL, or big data platforms will be considered.) • work within multidisciplinary project teams o collectively gather and refine project requirements o agree best more »

APIs, infrastructure design load balancing, VMs, PostgreSQL, vector dbs. Senior ML Learning Engineer desirable skills: Version control (Git), computer vision libraries, Big Data (Hadoop, Spark), Cloud AWS, Google Cloud, Azure, and a knowledge of secure coding techniques PCI-DSS, PA-DSS, ISO27001. This is a fantastic opportunity to join more »

comprehensions. You will have a good understanding of SQL and database design. You will need some experience with Big Data concepts, and Databricks or Spark experience is a plus, but otherwise you should be willing to learn. You will be familiar with concepts of data governance, data cataloguing, and … data quality principles. You will have experience of data extraction, joining, and aggregation tasks. Any experience using Spark is a bonus, but otherwise you will be expected to learn Spark/Databricks. You will be able to perform data cleansing operations to prepare data for analysis, including transforming more »