backend focus, based in our offices in Croydon. You will be joining our team as an experienced software engineer and will be working with AWS cloud, OpenSearch and graph technologies. How you will contribute to Janes Architect and develop solutions to ingest, transform, and serve data, both for internal … and developing ETL pipelines solutions for the ingestion, transformation, and serving of data, as well as solutions for the orchestration of pipeline components (e.g. AWSStepFunctions, Apache Airflow). Good understanding of data modelling, algorithm, and data transformation techniques to work with data platforms. Working knowledge … of cloud development practices (AWS/GCP/Azure) and API development (e.g. usage of Express on EKS/ECS), as well as common cloud data engineering solutions and databases (e.g. AWS Lambda functions, AWS Athena, AWS Glue, AWSStepFunctions etc. more »
suitability, and estimate the financial impact of adopting them. Previous experience in financial services (preferred) or a similar regulated environment. Technologies they use: Cloud: AWS with a preference for native and serverless services (e.g., API Gateway, AWS Lambda, AWSStepFunctions, Kinesis, DynamoDB) Programming languages … Python for software engineering, Terraform, AWS SAM, and Cloud Formation for IaC Database: SQL (Postgres) and NoSQL (DynamoDB) APIs: Primarily RESTful APIs with AWS API Gateway CI/CD: GitHub Actions, AWS CodePipeline, Jenkins, and tools such as Trivy, Bandit, Sonarqube, Dependabot, etc. Big data: AWSmore »
of 3+ years experience in Data Engineering, including data integration, modelling, optimisation and data quality Exceptional understanding of Python Experience developing in the cloud (AWS preferred) Solid understanding of libraries like Pandas and NumPy Experience in data warehousing tools like Snowflake, Databricks, BigQuery Familiar with AWSStepFunctions, Airflow, Dagster, or other workflow orchestration tools Commercial experience with performant database programming in SQL Capability to solve complex technical issues, comprehending risks prior to the circumstance Comfortable working in an agile environment, where features may change and evolve quickly Prior experience in financial services, specifically capital more »
customers and employees and build relationships based on trust and value. The Lead Data Architect will design and implement solutions using a range of AWS infrastructure, including S3, Redshift, Lambda, StepFunctions, DynamoDB, AWS Glue, RDS, Athena, Kinesis, Quicksight. We also widely use other tech such more »
Role Profile Enter role description, key responsibilities, and job description: Hands on Senior Engineer with experience of working within high performance development teams Significant AWS Engineering experience implementing Amazon well architected frameworks, serverless solutions and improving existing platforms using AWS technologies with Agile delivery methods Demonstrable experience of … Python 3, Python data management/manipulation libraries and usage of Python with AWS components Demonstrable experience working in the Data domain, covering the full data pipeline from ingestion, mastering, management and consumption/distribution of large datasets Financial Services expertise preferred working with Equity and Fixed Income asset … databases and data analysis using SQL. Enter key behaviours and skills required to be successful in the role: Education & Work experience: 7+ years of AWS and Python development engineer experience within the Financial Services and Data domains Bachelor’s Degree in MIS, Computer Science, or IT related field or more »
Data Engineer - AWS Join a prominent blue-chip company at the forefront of the Media industry. As an AWS Data Engineer, you'll spearhead the design, implementation, and upkeep of our AWS Redshift data warehouse, ensuring it operates at peak performance, scalability, and reliability. Technical Skills required … RedShift Glue (inc. Glue Studio, Glue Data Quality, Glue DataBrew) StepFunctions Athena Lambda Kinesis Python, Spark, Pyspark, SQL Your contributions as a Data Engineer will directly impact the organization's operations and revenue. In addition to a competitive annual salary, we offer an enticing benefits package, including more »
Our client are a renowned name in the Property Sector, they are on the lookout for 2 AWS Data Engineers to come in on a contract basis. Key Skills/Requirements: Must have Python & Spark experience Must have strong AWS experience Must have Terraform experience SQL & NoSQL experience … Have built out Data Warehouses & built Data Pipelines Strong Databricks & Snowflake experience Docker, ECS, Kubernetes & Orchestration tools like Airflow or StepFunctions are nice to have Contracts are running for 6 months initially, paying up to £450p/day (Outside IR35) and will be mostly remote but ideally more »
