Development Notes
  • Introduction
  • Programming Langauges
    • Java
      • Cache
      • Java Fundamentals
      • Multithreading & Concurrency
      • Spring Boot
        • Spring Security
        • Development tips
      • ORM
        • Mybatis
      • Implementation & Testing
    • Node.js
      • Asynchronous Execution
      • Node.js Notes
    • Python
      • Memo
  • Data Structure & Algorithm
  • Database
  • Design Pattern
  • AWS Notes
    • Services
      • API Gateway
      • CloudHSM
      • Compute & Load Balancing
        • Auto Scaling Group
        • EC2
        • ECS
        • ELB
        • Lambda
      • Data Engineering
        • Athena
        • Batch
        • EMR
        • IoT
        • Kinesis
        • Video Streaming
        • Quicksight
      • Deployment
        • CloudFormation
        • Code Deploy
        • Elastic Beanstalk
        • OpsWorks
        • SAM
        • SSM
      • ElasticSearch
      • Identity & Federation
        • Directory Service
        • IAM
        • Organizations
        • Resource Access Manager (RAM)
        • SSO
        • STS
      • KMS
      • Management Tools
        • Catalog
        • CloudTrail
        • CloudWatch
        • Config
        • Cost Allocation Tags
        • GuardDuty
        • Savings Plans
        • Trusted Advisor
        • X-Ray
      • Migration
        • Cloud Migration: The 6R
        • Disaster Recovery
        • DMS
        • VM Migrations
      • Networking
        • ACM
        • CloudFront
        • Direct Connect
        • EIP & ENI
        • Network Security
        • PrivateLink
        • Route53
        • VPC
        • VPN
      • Service Commnucation
        • Amazon MQ
        • SNS
        • SQS
        • Step Functions
        • SWF
      • Storage
        • Aurora
        • DynamoDB
        • EBS
        • EFS
        • ElastiCache
        • RDS
        • Redshift
        • S3
        • Storage Gateway
      • Other Services
        • Alexa for Business, Lex, Connect
        • AppStream 2.0
        • CloudSearch
        • Comprehend
        • Data Tools
        • Elastic Transcoder
        • Mechanical Turk
        • Rekognition
        • WorkDocs
        • WorkSpaces
    • Well Architect Framework
      • Security
      • Reliability
      • Performance Effeciency
      • Cost Optimization
      • Operational Excellence
    • Labs
      • Webserver Implementation
      • ELB Implementation
      • Auto-scaling Implementation
      • A 3-tier Architecture In VPC
  • Architecture
    • Security
  • Spark
    • Memo
  • Conference Notes
    • Notes of JCConf 2017
  • AI Notes
Powered by GitBook
On this page

Was this helpful?

  1. AWS Notes
  2. Services
  3. Storage

Storage Gateway

PreviousS3NextOther Services

Last updated 4 years ago

Was this helpful?

Introduction

  • Connects on-premises data to connect to AWS S3 for backup or caching purpose

Feature

  • Storage Gateway's software appliance is available for download as a virtual machine image for client's data center

  • Types:

    • File Gateway (NFS -> File Gateway -> S3)

      • File Gateway appliance is a virtual machine to bridge between your NFS and S3

      • Metadata and directory structures are preserved

      • Configured S3 buckets are accessible using the NFS and SMB protocol

      • Each File Gateway should have an IAM role to access S3

      • Most recently used data is cached in the File Gateway

      • Scenario

        • work with S3 lifecycle policy

        • work with S3 object versioning

          • Must use the "RefreshCache" API on File Gateway to be notified of restore

        • work with S3 object lock

          • Enables to have the File Gateway for Write Once Read Many (WORM) data

          • If there are file modifications or renames in the file share clients, the File Gateway creates a new version of the object without affecting prior versions, and the original locked version will remain unchanged

    • Volume Gateway (Block storage using iSCSI protocol backed by S3)

      • Data written to volumes can be asynchronously backed up as point-in-time snashots, stored in the cloud as EBS snashots. Snapshots are incremental and also comporessed. (accessing data from S3 through EBS, not to S3 directly)

      • Sub types:

        • Stored Volume

          • Full data is stored on site, low-latency access, scheduled backups to S3

          • 1Gb ~ 512TB with 32 volumes

        • Cache Volume

          • Full data is on S3, most frequent accessed data is cached on site

          • 1Gb ~ 1024TB with 32 volumes

      • Can configure to against playback attacks

    • Tape Gateway (or called Gateway Virtual Tape Library (VTL) for archiving)

      • Ingest data into Glacier

        • If needs further processing after ingestion, use other types of Storage Gateway.

      • Can't asscess single file within tapes, must restore the tape entirely.

Architectures

CHAP Authentication
Extensions with File Gateway