Permanent Spark SQL Job Vacancies

14 of 14 Permanent Spark SQL Jobs

Developer - AWS Data Engineer

Sterling, Virginia, United States
Hybrid / WFH Options
Progression Inc
MBI is Required (badging could take 1-6 months without) 5+ years of Data Engineer/Software Development experience 5+ years Python and Java 5+ years with Apache Spark (Spark SQL, Spark Streaming, data transformations, performance optimization, and tuning) 5+ years experience with cloud-based data platforms (Databricks or AWS EMR) Proficiency … with Git and version control best practices Experience building and maintaining high-volume data pipelines Knowledge of data modeling and ETL best practices Familiarity with SQL and NoSQL databases Understanding of data warehouse concepts and dimensional modeling Bachelor's degree in Computer Science, Engineering, or related technical field DUTIES: As a Data Engineer, you will: Design and implement More ❯
Employment Type: Permanent
Salary: USD Annual
Posted:

Data Engineer (f/m/x) Dortmund - Hybrid

Dortmund, Nordrhein-Westfalen, Germany
Hybrid / WFH Options
NETCONOMY
Salary: 50.000 - 60.000 € per year Requirements: • 3+ years of hands-on experience as a Data Engineer working with Databricks and Apache Spark • Strong programming skills in Python, with experience in data manipulation libraries (e.g., PySpark, Spark SQL) • Experience with core components of the Databricks ecosystem: Databricks Workflows, Unity Catalog, and Delta Live Tables • Solid … data warehousing principles, ETL/ELT processes, data modeling and techniques, and database systems • Proven experience with at least one major cloud platform (Azure, AWS, or GCP) • Excellent SQL skills for data querying, transformation, and analysis • Excellent communication and collaboration skills in English and German (min. B2 levels) • Ability to work independently as well as part of a … growing Data & AI team and work hands-on with the Databricks platform, supporting clients in solving complex data challenges. • Designing, developing, and maintaining robust data pipelines using Databricks, Spark, and Python • Building efficient and scalable ETL processes to ingest, transform, and load data from various sources (databases, APIs, streaming platforms) into cloud-based data lakes and warehouses • Leveraging More ❯
Employment Type: Permanent
Salary: EUR 50,000 - 60,000 Annual
Posted:

Data - Data Engineer

Washington, Washington DC, United States
Progression Inc
and data analytics/ML technologies to production Mastery in developing software code in one or more programming languages (Python, JavaScript, Java, Matlab, etc.) Expert knowledge in databases (SQL, NoSQL, Graph, etc.) and data architecture (Data Lake, Lakehouse) Experience with AWS solutions (Kubernetes, DataLakes, Open AI Services). Experience with PostgreSQL, ElasticSearch, MongoDB, and graph databases. Experience with … GenAI enabled daily workflows (coding, testing, analytics). Experience with one or more SQL-on-Hadoop technology (Spark SQL, Hive, Impala, Presto, etc.) Experience with short-release cycles and the full software lifecycle Experience with Agile development methodology (e.g., Scrum) Current Security+ certification (or must obtain within 30 days) Bachelor's degree in Computer More ❯
Employment Type: Permanent
Salary: USD Annual
Posted:

Azure Databricks Architect - San Diego, CA

San Diego, California, United States
BluPeak Credit Union
data architecture using Azure Databricks, including data ingestion pipelines, data transformation logic, and data warehousing strategies. Building and optimizing ETL pipelines, particularly in Databricks using PySpark, Scala, or Spark SQL. Ability to create and manage … Databricks notebooks for data exploration, pipeline development, and data visualization. Familiarity with scheduling and automating Databricks jobs. Big Data Processing : Design and optimize ETL/ELT pipelines using Apache Spark, Python, Scala, or SQL. Experience building ETL/ELT pipelines, data cleansing, and data transformation processes. Data Technologies: Proficiency in setting up, configuring, and managing Azure Databricks clusters … big data architecture and cloud solutions, preferably on Azure Experience using Databricks and expertise in Azure services such as Azure Data Factory, Azure Data Lake, Azure Synapse, Azure SQL, Azure Functions, and Apache Spark. Dax Programming for Power BI, CSharp.net preferred. Experience in a financial institution is highly preferred. Experience using Correlation Keystone is preferred, but not necessary. More ❯
Employment Type: Permanent
Salary: USD 72 Hourly
Posted:

Azure Databricks Architect - San Diego, CA

Bonita, California, United States
BluPeak Credit Union
data architecture using Azure Databricks, including data ingestion pipelines, data transformation logic, and data warehousing strategies. Building and optimizing ETL pipelines, particularly in Databricks using PySpark, Scala, or Spark SQL. Ability to create and manage … Databricks notebooks for data exploration, pipeline development, and data visualization. Familiarity with scheduling and automating Databricks jobs. Big Data Processing : Design and optimize ETL/ELT pipelines using Apache Spark, Python, Scala, or SQL. Experience building ETL/ELT pipelines, data cleansing, and data transformation processes. Data Technologies: Proficiency in setting up, configuring, and managing Azure Databricks clusters … big data architecture and cloud solutions, preferably on Azure Experience using Databricks and expertise in Azure services such as Azure Data Factory, Azure Data Lake, Azure Synapse, Azure SQL, Azure Functions, and Apache Spark. Dax Programming for Power BI, CSharp.net preferred. Experience in a financial institution is highly preferred. Experience using Correlation Keystone is preferred, but not necessary. More ❯
Employment Type: Permanent
Salary: USD 72 Hourly
Posted:

Azure Databricks Architect - San Diego, CA

Coronado, California, United States
BluPeak Credit Union
data architecture using Azure Databricks, including data ingestion pipelines, data transformation logic, and data warehousing strategies. Building and optimizing ETL pipelines, particularly in Databricks using PySpark, Scala, or Spark SQL. Ability to create and manage … Databricks notebooks for data exploration, pipeline development, and data visualization. Familiarity with scheduling and automating Databricks jobs. Big Data Processing : Design and optimize ETL/ELT pipelines using Apache Spark, Python, Scala, or SQL. Experience building ETL/ELT pipelines, data cleansing, and data transformation processes. Data Technologies: Proficiency in setting up, configuring, and managing Azure Databricks clusters … big data architecture and cloud solutions, preferably on Azure Experience using Databricks and expertise in Azure services such as Azure Data Factory, Azure Data Lake, Azure Synapse, Azure SQL, Azure Functions, and Apache Spark. Dax Programming for Power BI, CSharp.net preferred. Experience in a financial institution is highly preferred. Experience using Correlation Keystone is preferred, but not necessary. More ❯
Employment Type: Permanent
Salary: USD 72 Hourly
Posted:

Azure Databricks Architect - San Diego, CA

Lemon Grove, California, United States
BluPeak Credit Union
data architecture using Azure Databricks, including data ingestion pipelines, data transformation logic, and data warehousing strategies. Building and optimizing ETL pipelines, particularly in Databricks using PySpark, Scala, or Spark SQL. Ability to create and manage … Databricks notebooks for data exploration, pipeline development, and data visualization. Familiarity with scheduling and automating Databricks jobs. Big Data Processing : Design and optimize ETL/ELT pipelines using Apache Spark, Python, Scala, or SQL. Experience building ETL/ELT pipelines, data cleansing, and data transformation processes. Data Technologies: Proficiency in setting up, configuring, and managing Azure Databricks clusters … big data architecture and cloud solutions, preferably on Azure Experience using Databricks and expertise in Azure services such as Azure Data Factory, Azure Data Lake, Azure Synapse, Azure SQL, Azure Functions, and Apache Spark. Dax Programming for Power BI, CSharp.net preferred. Experience in a financial institution is highly preferred. Experience using Correlation Keystone is preferred, but not necessary. More ❯
Employment Type: Permanent
Salary: USD 72 Hourly
Posted:

Azure Databricks Architect - San Diego, CA

La Mesa, California, United States
BluPeak Credit Union
data architecture using Azure Databricks, including data ingestion pipelines, data transformation logic, and data warehousing strategies. Building and optimizing ETL pipelines, particularly in Databricks using PySpark, Scala, or Spark SQL. Ability to create and manage … Databricks notebooks for data exploration, pipeline development, and data visualization. Familiarity with scheduling and automating Databricks jobs. Big Data Processing : Design and optimize ETL/ELT pipelines using Apache Spark, Python, Scala, or SQL. Experience building ETL/ELT pipelines, data cleansing, and data transformation processes. Data Technologies: Proficiency in setting up, configuring, and managing Azure Databricks clusters … big data architecture and cloud solutions, preferably on Azure Experience using Databricks and expertise in Azure services such as Azure Data Factory, Azure Data Lake, Azure Synapse, Azure SQL, Azure Functions, and Apache Spark. Dax Programming for Power BI, CSharp.net preferred. Experience in a financial institution is highly preferred. Experience using Correlation Keystone is preferred, but not necessary. More ❯
Employment Type: Permanent
Salary: USD 72 Hourly
Posted:

Azure Databricks Architect - San Diego, CA

Lincoln Acres, California, United States
BluPeak Credit Union
data architecture using Azure Databricks, including data ingestion pipelines, data transformation logic, and data warehousing strategies. Building and optimizing ETL pipelines, particularly in Databricks using PySpark, Scala, or Spark SQL. Ability to create and manage … Databricks notebooks for data exploration, pipeline development, and data visualization. Familiarity with scheduling and automating Databricks jobs. Big Data Processing : Design and optimize ETL/ELT pipelines using Apache Spark, Python, Scala, or SQL. Experience building ETL/ELT pipelines, data cleansing, and data transformation processes. Data Technologies: Proficiency in setting up, configuring, and managing Azure Databricks clusters … big data architecture and cloud solutions, preferably on Azure Experience using Databricks and expertise in Azure services such as Azure Data Factory, Azure Data Lake, Azure Synapse, Azure SQL, Azure Functions, and Apache Spark. Dax Programming for Power BI, CSharp.net preferred. Experience in a financial institution is highly preferred. Experience using Correlation Keystone is preferred, but not necessary. More ❯
Employment Type: Permanent
Salary: USD 72 Hourly
Posted:

Insights Associate Program Manager

Sunnyvale, California, United States
Hybrid / WFH Options
Genesis10
that they are able to use our internal tools effectively and reliably. Responsibilities: Leverage client's unique data used to power innovative tools to address business challenges. Write SQL/Presto/Trino/Spark queries to extract the necessary data and leverage data visualization tools such as Tableau to present the information. Take existing queries … customers. Requirements: 2+ years of experience with data analysis, data storytelling, turning data into insights and presenting to internal and/or external stakeholders. 2+ years working with SQL and data visualization tools to query large data-sets (e.g. Presto/Trino, Spark SQL, Tableau, etc.). Only candidates available and ready to work … and the ability to influence without authority. Experience with project management. Strong business acumen, creative problem-solving skills, intellectual curiosity, and desire & ability to learn. Expert knowledge of SQL - excited about opportunities to optimize/tune queries joining datasets with billions of rows and optimize performance. Knowledge of Hadoop (Presto/Spark), git, & Tableau. Ability to More ❯
Employment Type: Permanent
Salary: USD 5,086 Hourly
Posted:

Azure Data Engineer

Newcastle Upon Tyne, Tyne and Wear, England, United Kingdom
Hybrid / WFH Options
True North Group
Contribute to pre-sales, proposals, and thought leadership activities. Requirements Strong experience designing and maintaining data platforms and ETL/ELT solutions. Solid knowledge of Databricks, Python, PySpark, Spark SQL, Azure and/or AWS. Data modelling expertise (Inmon, Kimball, Data Vault). Familiar with DataOps practices and pipeline monitoring. Experience with sensitive data and applying More ❯
Employment Type: Full-Time
Salary: Salary negotiable
Posted:

Information Technology Architect Ii-Im Application Development

Irving, Texas, United States
Christus Health
in both traditional as well as columnar databases. Experience in data integration with ETL techniques and frameworks Experience in Big Data querying tools, such as Hive, Impala and Spark SQL Work Schedule: MULTIPLE SHIFTS AVAILABLE Work Type: Full Time More ❯
Employment Type: Permanent
Salary: USD Annual
Posted:

Information Technology Architect II-IM Application Development TX

Dallas, Texas, United States
CHRISTUS Health
in both traditional as well as columnar databases. Experience in data integration with ETL techniques and frameworks Experience in Big Data querying tools, such as Hive, Impala and Spark SQL Work Schedule: MULTIPLE SHIFTS AVAILABLE Work Type: Full Time More ❯
Employment Type: Permanent
Salary: USD Annual
Posted:

Data Analyst

Reigate, Surrey, England, United Kingdom
Hybrid / WFH Options
esure Group
Strong understanding of data models and analytics; exposure to predictive modelling and machine learning is a plus. Proficient in SQL and Python, with bonus points for PySpark, SparkSQL, and Git. Skilled in data visualisation with tools such as Tableau or Power BI. Confident writing efficient code and troubleshooting sophisticated queries. Clear and adaptable communicator, able to explain technical More ❯
Employment Type: Full-Time
Salary: Salary negotiable
Posted:
Spark SQL
10th Percentile
£40,125
25th Percentile
£45,313
Median
£55,000
75th Percentile
£76,500
90th Percentile
£96,750