9 of 9 Spark SQL Jobs

MBI is Required (badging could take 1-6 months without) 5+ years of Data Engineer/Software Development experience 5+ years Python and Java 5+ years with Apache Spark (Spark SQL, Spark Streaming, data transformations, performance optimization, and tuning) 5+ years experience with cloud-based data platforms (Databricks or AWS EMR) Proficiency … with Git and version control best practices Experience building and maintaining high-volume data pipelines Knowledge of data modeling and ETL best practices Familiarity with SQL and NoSQL databases Understanding of data warehouse concepts and dimensional modeling Bachelor's degree in Computer Science, Engineering, or related technical field DUTIES: As a Data Engineer, you will: Design and implement More ❯

Salary: 50.000 - 60.000 € per year Requirements: • 3+ years of hands-on experience as a Data Engineer working with Databricks and Apache Spark • Strong programming skills in Python, with experience in data manipulation libraries (e.g., PySpark, Spark SQL) • Experience with core components of the Databricks ecosystem: Databricks Workflows, Unity Catalog, and Delta Live Tables • Solid … data warehousing principles, ETL/ELT processes, data modeling and techniques, and database systems • Proven experience with at least one major cloud platform (Azure, AWS, or GCP) • Excellent SQL skills for data querying, transformation, and analysis • Excellent communication and collaboration skills in English and German (min. B2 levels) • Ability to work independently as well as part of a … growing Data & AI team and work hands-on with the Databricks platform, supporting clients in solving complex data challenges. • Designing, developing, and maintaining robust data pipelines using Databricks, Spark, and Python • Building efficient and scalable ETL processes to ingest, transform, and load data from various sources (databases, APIs, streaming platforms) into cloud-based data lakes and warehouses • Leveraging More ❯

and data analytics/ML technologies to production Mastery in developing software code in one or more programming languages (Python, JavaScript, Java, Matlab, etc.) Expert knowledge in databases (SQL, NoSQL, Graph, etc.) and data architecture (Data Lake, Lakehouse) Experience with AWS solutions (Kubernetes, DataLakes, Open AI Services). Experience with PostgreSQL, ElasticSearch, MongoDB, and graph databases. Experience with … GenAI enabled daily workflows (coding, testing, analytics). Experience with one or more SQL-on-Hadoop technology (Spark SQL, Hive, Impala, Presto, etc.) Experience with short-release cycles and the full software lifecycle Experience with Agile development methodology (e.g., Scrum) Current Security+ certification (or must obtain within 30 days) Bachelor's degree in Computer More ❯

that they are able to use our internal tools effectively and reliably. Responsibilities: Leverage client's unique data used to power innovative tools to address business challenges. Write SQL/Presto/Trino/Spark queries to extract the necessary data and leverage data visualization tools such as Tableau to present the information. Take existing queries … customers. Requirements: 2+ years of experience with data analysis, data storytelling, turning data into insights and presenting to internal and/or external stakeholders. 2+ years working with SQL and data visualization tools to query large data-sets (e.g. Presto/Trino, Spark SQL, Tableau, etc.). Only candidates available and ready to work … and the ability to influence without authority. Experience with project management. Strong business acumen, creative problem-solving skills, intellectual curiosity, and desire & ability to learn. Expert knowledge of SQL - excited about opportunities to optimize/tune queries joining datasets with billions of rows and optimize performance. Knowledge of Hadoop (Presto/Spark), git, & Tableau. Ability to More ❯

Contribute to pre-sales, proposals, and thought leadership activities. Requirements Strong experience designing and maintaining data platforms and ETL/ELT solutions. Solid knowledge of Databricks, Python, PySpark, Spark SQL, Azure and/or AWS. Data modelling expertise (Inmon, Kimball, Data Vault). Familiar with DataOps practices and pipeline monitoring. Experience with sensitive data and applying More ❯

in both traditional as well as columnar databases. Experience in data integration with ETL techniques and frameworks Experience in Big Data querying tools, such as Hive, Impala and Spark SQL Work Schedule: MULTIPLE SHIFTS AVAILABLE Work Type: Full Time More ❯

Strong understanding of data models and analytics; exposure to predictive modelling and machine learning is a plus. Proficient in SQL and Python, with bonus points for PySpark, SparkSQL, and Git. Skilled in data visualisation with tools such as Tableau or Power BI. Confident writing efficient code and troubleshooting sophisticated queries. Clear and adaptable communicator, able to explain technical More ❯

Senior Data Engineer Edinburgh 3 days per week on-site 6 months (likely extension) £550 - £615 per day outside IR35 Primus is partnering with a leading Financial Services client who are embarking on a greenfield data transformation programme. Their current More ❯

if you had Experience working with relational and experience with NoSQL databases (such as tuning and optimising complex queries for highly scalable systems) and query languages (specifically Hive/SparkSQL and ANSI SQL).Experience building large scale Spark 3.x applications & data pipelines, ideally with Batch processing running on Hadoop clusters. If you had experience with messaging More ❯