processes using AWS services such as AWS Glue, AWS Lambda, and AWS Data Pipeline. Data Storage Management : Manage and optimize data storage solutions, including Amazon S3, AmazonRedshift, and AWS RDS. Data Quality and Validation : Ensure data quality and integrity through validation and cleansing techniques. Collaboration : Work … focus on AWS and cloud technologies. Technical Skills : Proficiency in programming languages such as Python, Java, or Scala. Experience with AWS services including S3, Redshift, Glue, Lambda, and RDS. Strong SQL skills for data manipulation and querying. Familiarity with ETL tools and processes. Understanding of data modeling and database more »
cloud hosting provider (AWS (preferred), Google Cloud, Azure or similar). Experience using modern build tools such as Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL and more »
and insights to stakeholders; experience with BI tools such as Looker is highly advantageous Experience working with cloud data warehouses, ideally with AWS/Redshift, Azure, GCP, or Snowflake Experience with dbt is highly advantageous Responsibilities Analyze, organize, and prepare raw data for modeling and data analytics Architect and more »
Rust is a plus). Familiarity with ETL principles in contemporary data applications (Dagster, Airflow, Perfect). Familiarity with AWS services such as Glue, Redshift, Athena, and S3. Proficiency with Terraform, Kubernetes, and ArgoCD (expertise not required; cloud team support available). Thorough understanding of software engineering techniques, including more »
build relationships based on trust and value. The Lead Data Architect will design and implement solutions using a range of AWS infrastructure, including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, RDS, Athena, Kinesis, Quicksight. We also widely use other tech such as Snowflake, DBT, Databricks, Informatica, Matillion, Airflow … aligned to the functional and non-functional requirements Work closely with other members of agile deployment team Selection & configuration of appropriate, base technologies (eg AmazonRedshift, RDS) Selection & application of appropriate standards & principles Capture & implementation of functional & non-functional requirements Expert in data modelling and latest data trends more »
London, Liverpool, Merseyside, United Kingdom Hybrid / WFH Options
Opus Recruitment Solutions
years of experience as a Data Engineer or in a similar role. Strong proficiency in AWS services related to data engineering (e.g., S3, Redshift, Glue). Hands-on experience with Databricks for data processing and analytics. Proficient in Python programming for data manipulation and automation. Solid understanding of Apache more »
Greater London, England, United Kingdom Hybrid / WFH Options
Anson McCade
Data Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and batch processing. more »
Data Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and batch processing. more »
platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). • In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. • Excellent consulting experience and ability more »
and reporting. • Specialised in AWS cloud technologies for ETL, data warehouse, and data lake design. • Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. • Capable of processing large volumes of structured and unstructured data on AWS. • Familiarity with AWS best practices in data engineering, data more »
solutions. Strong software engineering experience with Python. Experience working on production-level microservices (Docker/Kubernetes) and cloud infrastructure. Experience working with Databases, Postgres, Redshift, Neo4j would be a plus. Skills Computer Science or Software Engineering degree/BSc or higher Experience leading a Machine Learning/MLOps team more »
and improve existing data designs and data models, including relational table structures, using Unix Shell Scripting, Oracle, SQL Server, Azure SQL Data Warehouse, or AmazonRedshift Support and learn the associated scheduling logic for data pipelines using scheduling tool such as Autosys or Airflow Read and translate logical more »
data scientists and architects on several projects EXPERIENCE: Proven track record of success in Data Engineering teams Experience with relational and MPP databases (Snowflake, Redshift, Big Query etc). Experience with data modelling techniques (Kimball/Star, Datavault, etc). Experience with SQL and query design on large, complex more »
5+ years of experience in data engineering, with a strong background in ETL processes. Proficiency in AWS services, including but not limited to S3, Redshift, Lambda, and Glue. Strong programming skills in Python. Experience with data modeling, database design, and data warehousing. Excellent problem-solving skills and attention to more »
Gateway CI/CD: GitHub Actions, AWS CodePipeline, Jenkins, and tools such as Trivy, Bandit, Sonarqube, Dependabot, etc. Big data: AWS services like S3, Redshift, Glue, Kinesis The role is mostly remote but there is a requirement to head to either their London or North office once a week more »
Experience in log management tools to troubleshoot issues as well as identify useful analytics data. Preferred Experience in Microsoft Azure services and Databricks Spark, Redshift, Hadoop Map-Reduce or other Big Data frameworks Code management tools (Git, Sbt, Maven) Pyspark, Scala or other functional programming languages Analytics tools such more »
and experience with relevant libraries (e.g., pandas, numpy). Extensive experience with ETL tools and processes. Familiarity with data warehousing concepts and technologies (e.g., Redshift, BigQuery, Snowflake). Proficient in SQL and experience with relational databases (e.g., PostgreSQL, MySQL). Exposure to cloud platforms (e.g., AWS, GCP, Azure) and more »
and experience with relevant libraries (e.g., pandas, numpy). • Extensive experience with ETL tools and processes. • Familiarity with data warehousing concepts and technologies (e.g., Redshift, BigQuery, Snowflake). • Proficient in SQL and experience with relational databases (e.g., PostgreSQL, MySQL). • Exposure to cloud platforms (e.g., AWS, GCP, Azure) and more »
knowledge of relational databases (e.g., SQL Server, Oracle, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra, Couchbase). Experience with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery). Excellent scripting skills (e.g., Python, SQL). Strong analytical and problem-solving skills. Excellent communication and interpersonal skills, with the ability to more »
and experience with relevant libraries (e.g., pandas, numpy). Extensive experience with ETL tools and processes. Familiarity with data warehousing concepts and technologies (e.g., Redshift, BigQuery, Snowflake). Proficient in SQL and experience with relational databases (e.g., PostgreSQL, MySQL). Exposure to cloud platforms (e.g., AWS, GCP, Azure) and more »
experience in shaping and designing data solutions (data analytics, data integration, data platform) using cloud-based hyperscales, with emphasis on AWS services including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, RDS, Athena, Kinesis, Quicksight. Hands on experience on design solutions using Snowflake and DBT. Familiarity with Databricks or more »
Greater London, England, United Kingdom Hybrid / WFH Options
BJSS
involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient more »
current Centre of Excellence. Main duties include: Managing and developing the Looker platform/LookML Maintaining and managing the BI platform - Looker, Dbt, AWS, Redshift etc Ultimately own the long term BI roadmap. Create a self-serve data culture across the business Skills & Experience If this sounds like an more »
projects using relevant Data Architectural paradigms such as Kimball, Data Vault, Data Mesh, Lakehouse Demonstrable knowledge of key AWS services such as S3, EMR, Redshift, Athena, Lambda Excellent stakeholder management skills To be successfully appointed to this role, it is a requirement to obtain Security Check (SC) clearance. To more »
a related field. 10+ years of experience in data engineering, with a focus on ETL processes. Deep expertise in AWS services such as S3, Redshift, Lambda, and Glue. Advanced programming skills in Python. Proven track record of leading successful data engineering projects. Strong business acumen and experience in client more »