4 of 4 Remote Apache Spark Jobs in West Yorkshire

Terraform, Flask, Pandas, FastAPI, Dagster, GraphQL, SQLAlchemy, GitLab, Athena. Your Trusted Companions : Docker, Snowflake, MongoDB, Relational Databases (eg MySQL, PostgreSQL), Dagster, Airflow/Luigi, Spark, Kubernetes. Your AWS Kingdom : Lambda, Redshift, EC2, ELB, IAM, RDS, Route53, S3-the building blocks of cloud mastery. Your Philosophy : Continuous integration/deployments More ❯

and compliance. Collaborate with stakeholders and external partners. Skills & Experience: Strong experience with AWS data technologies (e.g., S3, Redshift, Lambda). Proficient in Python, Apache Spark, and SQL. Experience in data warehouse design and data migration projects. Cloud data platform development and deployment. Expertise across data warehouse and More ❯

design principles for usability, maintainability and extensibility Experience working with Git in a version-controlled environment Good knowledge of parallel computing techniques (Python multiprocessing, Apache Spark), and performance profiling and optimisation Good understanding of data structures and algorithms An enthusiastic problem-solving mindset with a desire to solve More ❯

Data Architect Location: Leeds/Halifax( Hybrid) Job Type: Contract Job description: GCP, Data Products, Data Mesh, ETL, EDW Composer, Big Query, DataProc, DBT Spark, Hive, Kafka, Pub-Sub, Jira, GCP Dataflow, BigTable, Python, Kafka, Cloud DataProc, Cloud Data Flow, Cloud Data Fusion, GCS, Cloud Pub/Sub, Cloud … functions, BigTable, Python, Scala, Java, .NET, ANSI SQL, Spark, Airflow, ShellScripts, Control-M, Git, CI & CD, HDFS, Unix File System, RDBMS, Azure Devops, Harness More about the role: Able to define Data Product Definition, Architecture and Roadmap. Define Target Model backlog in collaboration with client stakeholders. Lead deliver a More ❯