201 to 225 of 318 Amazon S3 Jobs

implementing data lake architectures Experience building both batch and streaming data pipelines Strong knowledge of Kafka Good understanding of AWS data services, particularly S3 Knowledge of modern data architectures including Data Mesh and data product ownership models Ability to engage with technical and non-technical stakeholders across all levels ...

designing and implementing modern data lake or lakehouse architectures Hands-on experience with Kafka Strong understanding of AWS data services, particularly Amazon S3 Experience integrating data from complex enterprise and legacy data environments Strong understanding of data governance, security and data quality frameworks Experience delivering large-scale ...

experience with dbt or similar ELT tools. Experience building and optimising scalable data pipelines and data warehouses. Knowledge of AWS technologies such as Redshift, S3 and Athena. Experience with Airflow, Fivetran or similar orchestration and integration tools. Strong Linux/Unix and Bash scripting skills. A solid understanding ...

StrategyTechnical audit: Work with stakeholders across the organization to conduct a survey of existing APIs (RPC over HTTP, JSON, XML Query, REST, WebSocket, S3, Pub-Sub, etc) across the business, to identify fragmentation, authentication gaps, and areas for consolidation. Survey peers and partners to identify best-practice ...

stakeholders as well as present complex findings clearly to both technical and non-technical audiencesProficient in using Tech Stack such as Amazon S3, Lambda function, Kafka, Apache Airflow or Bloomberg Teck Stack in production environmentExceptional problem-solving skills, numerical proficiency and high attention to detailAbility to work ...

e.g. deep learning methods), models, and their mathematical underpinnings Experience deploying and maintaining pipelines and in engineering big-data solutions using technologies like Databricks, S3, and Spark Ability to gauge the complexity of machine learning problems and a willingness to execute simple approaches for quick, effective solutions as appropriate ...

e.g. deep learning methods), models, and their mathematical underpinnings Experience deploying and maintaining pipelines and in engineering big-data solutions using technologies like Databricks, S3, and Spark Ability to gauge the complexity of machine learning problems and a willingness to execute simple approaches for quick, effective solutions as appropriate ...

automation skills in Python, Go, or Bash, and use Infrastructure as Code (Terraform) to build repeatable, low-risk systemsHave experience with AWS (EKS, RDS, S3, CloudFront), or equivalent platforms on GCP or AzureAre comfortable working close to the system with solid Linux and networking fundamentals (TCP/ ...

RDBMS systems (we mostly use Postgres),Practical knowledge of commonly used protocols and tools used to transfer data (e.g. FTP, SFTP, HTTP APIs, AWS S3),Excellent communication skills.Nice to havesExperience with big data frameworks, databases, distributed systems, or Cloud development.Experience with any of these: C++, kdb+/q, Rust. ...

websites. You should be proficient in JavaScript, jQuery, HTML, CSS/SCSS, Shopify (working with liquid files), and related technologies. Experience in AWS (Lambda, S3, API Gateway), Node/NPM, and with SQL and/or NoSQL databases is also desirable. A working knowledge of CMS implementation and server ...

with both technical and business audiencesWe'd also love to see (you don't need all of these)Working knowledge of cloud, ideally AWS (S3, SQS, Lambda, Fargate) or equivalents Experience with distributed, microservices-based applicationsSolutions architecture and system design experienceStrong database and data modelling skillsExperience with agentic ...

Strong capability using Python and SQL for profiling, reconciliation, validation, and data engineeringAWS analytics foundations: Experience working with AWS-based data environments (e.g., S3 and common query/processing servicesClear communication and documentation: Ability to document “what the data means,” not only “what the code does ...

degree or above in Statistics, Computer Science, Quantitative Finance or other STEM related field or degree-equivalent qualifications - Experience working with object stores (e.g., S3), relational databases (e.g., Postgres), data modeling, and pipeline orchestration in production or near-production environments- Experience building data validation, monitoring, or observability solutions ...

below) is advantageous: Kotlin Cloud Technologies (Kubernetes, Open Shift) Messaging Technologies (Kafka, Solace, TIBCO) Database/Data Store/Data Query Technologies (SQL Server, S3) Observability Technologies (OpenTelemetry, Elastic Stack/ELK, Grafana) Qualifications:Proven experience in an App Dev role.Demonstrated execution capabilities.Education:Bachelor’s/University degree ...

high-quality AI and data solutionsFamiliarity with cloud data platforms providers (e.g., AWS, Azure, GCP, Snowflake, Databricks) and their data and AI services (e.g., S3, Azure Data Lake, BigQuery, Azure ML, Vertex AI)Connect to your business - Technology and TransformationDistinctive thinking, deep expertise, innovation and collaborative working. That ...

Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of Amazon’s products and services. We offer talented security professionals the chance to accelerate their careers with … with full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations- Experience with AWS services including S3, Redshift, Sagemaker, EMR, Kinesis, Lambda, and EC2- Experience developing, deploying and managing AI products at scaleAmazon is an equal opportunities employer. We believe passionately ...

Framework Advanced experience with Angular 16+ (Angular 18 preferred) and Node.js 18+ (Node.js 20 preferred) Advanced experience with AWS services: Lambda, DynamoDB, Aurora DB, S3, ECS, CloudWatch Advanced experience with Docker containerization and CI/CD pipelines (Jenkins, GitHub Actions, Harness) Advanced experience with microservices architecture, RESTful APIs … cloud-native design patterns Must have proficiency with AI-assisted development tools (e.g., GitHub Copilot, Cursor, Amazon Q) and experience using them in development workflows Experience with or strong interest in applying AI/ML to fraud detection, anomaly detection, or payment optimization use cases Strong understanding ...

ensure trusted and reliable data deliverySupport the performance tuning and optimisation of data pipelines, SQL workloads and integration servicesWork with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic AppsContribute to documentation … need AWS Glue, Lambda, Step Functions or Azure Data Factory, Synapse Pipelines, Azure Functions and Logic AppsPySparkSQL (Athena, Redshift, Azure Synapse SQL)AWS S3 or Azure Data Lake Storage Gen2Python and/or JavaETL/ELT data pipeline developmentData quality, validation and monitoringGit, CI/CD and Agile delivery ...

ensure trusted and reliable data deliverySupport the performance tuning and optimisation of data pipelines, SQL workloads and integration servicesWork with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic AppsContribute to documentation … need AWS Glue, Lambda, Step Functions or Azure Data Factory, Synapse Pipelines, Azure Functions and Logic AppsPySparkSQL (Athena, Redshift, Azure Synapse SQL)AWS S3 or Azure Data Lake Storage Gen2Python and/or JavaETL/ELT data pipeline developmentData quality, validation and monitoringGit, CI/CD and Agile delivery ...

tested code for backend logic and data services.Build and optimise data pipelines on AWS to collect, transform, and serve large datasets. Work extensively with S3 (Hive-partitioned Parquet data lake), Athena for SQL querying and analysis, DynamoDB for low-latency caching, and Kinesis/SQS for streaming and queue … Software Engineer on large, production software applications.Strong Python engineering skills, including dependency and environment management with Poetry.Hands-on experience with AWS, particularly S3, Athena, DynamoDB, Kinesis, SQS, ECS, and CloudWatch.Experience building RESTful APIs and services with FastAPI.Hands-on experience with Infrastructure as code with Terraform.Containerisation with Docker.Data-engineering fundamentals ...

teams. Cloud & Containers Kubernetes or other container orchestration platforms. AWS EKS is a plus. Hands-on AWS and hybrid cloud experience, including EC2, ALB, S3, RDS/Aurora, and EFS. Experience with cloud or hybrid hosting environments; Azure is a plus. Domain Experience Experience supporting financial systems, trading platforms … Solutions Architect, Certified Kubernetes Administrator, Terraform Associate, RHCE, PSM, CSM, or ITIL are a plus. Technology EnvironmentCloud and Infrastructure: AWS, Azure, EKS, EC2, ALB, S3, RDS/Aurora, EFS, hybrid hostingAutomation and Infrastructure as Code: Terraform, Chef, Ansible, Bash, PythonContainers and Orchestration: Docker and other container platforms; Kubernetes ...

life—from massive GenAI models to fine-tuned, specialized classifiers.Develop our custom-built, content-addressable storage abstraction layer over cloud object stores (GCS, S3, Azure Blob), complete with its own garbage collection and sharding logic.Enhance our asynchronous job-queueing system, built from the ground up on the storage layer ...

such as CircleCI) to streamline and automate development workflows.Familiarity with infrastructure as code tools such as Terraform, and cloud platforms like AWS (Vercel, CloudFront, S3, etc.).Experience with A/B testing and familiarity with analytics tools to drive data-informed design and development decisions.Knowledge of performance optimization techniques ...

someone started in the next couple of weeks, as this is an urgent requirement for them. Essential Skills & Experience AWS, Amazon S3, AWS Glue Apache Airflow. Tableau development and dashboard support JupyterHub and/or RStudio Advanced SQL, including PostgreSQL and SQL Server Working with JSON ...

unfamiliar technologies where required Technical Skills: Must-Have Skills: Python Kubernetes Docker CI/CD fundamentals (GitLab Pipelines) Highly Desirable Skills: Spark Scala S3 Storage Graph Databases Elasticsearch Vector Stores OIDC/OAuth NodeJS React To apply for Analytics Platform Engineer contract or permanent job, please click the button ...