4 of 4 Apache Spark Jobs in Midlothian

sectors. Strong knowledge of data fabric architectures, metadata management, and data governance principles. Experience with SQL, ETL tools, and big data technologies (e.g., Hadoop, Spark, Kafka). Familiarity with cloud platforms (AWS, Azure, or Google Cloud) and data integration frameworks. Strong problem-solving skills and ability to work ...

Oracle, SQL Server, PostgreSQL, MySQL Solid understanding of data warehouse and lakehouse architectures Experience with ETL/ELT and orchestration tools (eg Informatica, Talend, Apache Airflow) Proven experience designing data models Strong understanding of data governance and data security requirements Excellent communication, documentation, and problem-solving skills Exposure …/ML data pipelines and analytics platforms Desirable Experience Cloud data platforms ( AWS, Azure, Google Cloud ) Big data technologies ( Hadoop, Spark, Kafka ) UML/SysML API integration and microservices data flows ...

modern development practices (including test-driven development). Extensive experience designing data architecture, data models, integrations, and migrations. Hands-on experience with Apache Spark or similar distributed processing frameworks. Understanding and practical use of CI/CD in data engineering workflows. Ideally with leadership experience managing and developing ...

Requirements: Technical expertise in designing, building, and maintaining data pipelines and warehouses Experience with ETL/ELT frameworks and Big Data Processing Tools (e.g., Spark, Airflow, Hive) Knowledge of programming languages (e.g., Python, SQL) Hands-on experience with SQL/NoSQL database design Degree in a STEM field ...