IAM, S3, RDS, EMR, ECS and more Advanced experience working and understanding the tradeoffs of at least one of the following Data Lake table/file formats: Delta Lake, Parquet, Iceberg, Hudi Previous h ands-on expertise with Spark Experience working with containerisation technologies - Docker, Kubernetes Streaming Knowledge: Experience with Kafka/Flink or other streaming ecosystems, with a More ❯
self-teach new tools and technologies; an ability to educate others Familiarity with the Linux command line and shell scripting Understanding of basic data concepts - file formats (e.g. CSV, Parquet), data pipelines, and storage layers Exposure to containers and Podman or Docker Comfortable using Git; an awareness of CI/CD practices and tools such as GitHub Actions or More ❯
Birmingham, West Midlands, United Kingdom Hybrid / WFH Options
Amtis Professional Ltd
continuously improve data infrastructure Explore AI-driven enhancements to boost data accuracy and productivity Requirements: Strong experience with: Azure Databricks, Data Factory, Blob Storage Python/PySpark SQL Server, Parquet, Delta Lake Deep understanding of: ETL/ELT, CDC, stream processing Lakehouse architecture and data warehousing Scalable pipeline design and database optimisation A proactive mindset, strong problem-solving skills More ❯
Birmingham, West Midlands, United Kingdom Hybrid / WFH Options
MYO Talent
role Large and complex datasets Azure, Azure Databricks Microsoft SQL Server Lakehouse, Delta Lake Data Warehousing ETL CDC Stream Processing Database Design ML Python/PySpark Azure Blob Storage Parquet Azure Data Factory Desirable: Any exposure working in a software house, consultancy, retail or retail automotive sector would be beneficial but not essential. More ❯
EMR. Experience with RDBMS. Experience with Jenkins CI/CD pipeline. Bachelor's degree in a technical discipline. Plus: Knowledge of Hadoop/Spark and various data formats like Parquet, CSV, etc. Additional Information Benefits/Perks: Great compensation package and bonus plan Core benefits including medical, dental, vision, and matching 401K Flexible work environment, ability to work remote More ❯
and Unix skills. Highly proficient working with cloud environments (ideally Azure), distributed computing and optimising workflows and pipelines. Experience working with common data transformation and storage formats, e.g. ApacheParquet, Delta tables. Strong experience working with containerisation (e.g. Docker) and deployment (e.g. Kubernetes). Experience with Spark, Databricks, data lakes. Highly proficient in working with version control and Git More ❯
Python & C# Developer - Front Office Risk (VP) Commodities Tech Overview CITIGROUP is one of the largest players in the financial industry, employing more than 200,000 people across the globe. What We do/The Team The Commodities trading business More ❯