Amazon AWS
Comprehensive cloud platform with global reach
Last reviewed Mar 14, 2026
AWS provides a comprehensive suite of cloud computing services, including compute, storage, and GPU solutions for diverse workloads.
Available GPUs
Hourly on-demand pricing. Click column headers to sort.
Prices last updated: September 29, 2026
Amazon AWS pricing by GPU
Configurations, price rank, and alternatives for one GPU at a time.
LLM API Pricing
Pay-per-token pricing. Prices shown per 1M tokens.
Prices last updated: September 29, 2026
| Model | Input/1M | Output/1M | |||
|---|---|---|---|---|---|
| $0.035 | $0.140 | ||||
| $0.040 | $0.080 | ||||
| $0.060 | $0.230 | ||||
| $0.060 | $0.240 | ||||
| $0.060 | $0.240 | ||||
| $0.070 | $0.200 | ||||
| $0.070 | $0.400 | ||||
| $0.090 | $0.290 | ||||
| $0.100 | $0.100 | ||||
| $0.100 | $0.300 | ||||
Amazon AWS pricing by model
Input, output, and batch rates, plus alternatives, for one model at a time.
Pros & Cons
Advantages
- Broad range of compute options including GPUs
- Highly scalable and reliable infrastructure
- Pay-as-you-go pricing with cost optimization tools
- Extensive global network of data centers
- Rich ecosystem of integrated services and tools
Limitations
- Complex pricing structure
- Steep learning curve for new users
- Potential for unexpected costs without proper management
Key Features
Global Infrastructure
Extensive network of data centers across multiple regions worldwide
Pay-as-you-go Pricing
Flexible pricing model with no upfront commitments required
Advanced Security
Comprehensive security tools and compliance certifications
Auto Scaling
Automatically adjust resources based on demand
Integrated Services
Extensive ecosystem of services that work seamlessly together
Developer Tools
Comprehensive suite of tools for development, deployment, and management
AWS Free Tier
Sign-up credits and no-cost usage limits for evaluating services before committing spend
Compute Services
Amazon EC2
Virtual servers in the cloud with a wide range of instance types.
Amazon ECS
Fully managed container orchestration service.
- Support for Docker containers
- Integration with other AWS services
- Automated cluster management and scheduling
Amazon EKS
Managed Kubernetes service for container orchestration.
- Certified Kubernetes conformant
- Integrates with AWS networking and security services
- Supports both EC2 and Fargate launch types
AWS Lambda
Serverless compute service for running code without managing servers.
- Automatic scaling and high availability
- Pay only for compute time consumed
- Supports multiple programming languages
Inference Services
Amazon Bedrock
Fully managed service providing access to foundation models from AI21 Labs, Anthropic, Cohere, Meta, Mistral, Stability AI, and Amazon through a unified API.
- Multi-Provider Access: Access models from multiple AI providers through a single API
- Model Customization: Fine-tune models on your own data with continued pretraining
- Guardrails: Built-in safety controls and content filtering
- AgentCore: Platform for running production AI agents built with any framework or model, with managed authentication, access control, and tracing
Pricing Models
- On-Demand: Pay per input/output token with no minimum commitment
- Provisioned Throughput: Reserved model units for consistent performance
Pricing Options
| Option | Details |
|---|---|
| On-Demand Instances | Pay for compute capacity by the second with no long-term commitments. |
| Spot Instances | Use spare EC2 capacity at up to 90% off the On-Demand price. |
| Reserved Instances | Save up to 72% compared to On-Demand pricing with a 1 or 3-year commitment. |
| Savings Plans | Save up to 72% on compute usage with a 1 or 3-year commitment to a consistent amount of usage. |
| EC2 Capacity Blocks for ML | Reserve accelerated compute capacity for a future start date and a defined duration; billed as an upfront reservation fee plus an operating system fee. |
Availability & Support
Regions
39 geographic regions and 123 availability zones worldwide.
Support
Basic (free), Developer, Business, Enterprise support plans with varying response times and features. Extensive documentation, forums, and training resources.
Getting Started
- 1
Sign up for AWS
Create an AWS account to access the cloud platform.
- 2
Choose a compute service
Select from EC2, Lambda, or container services based on your workload needs.
- 3
Launch an instance
Configure and launch your first compute instance or container.
- 4
Set up security
Configure security groups and access controls for your resources.
- 5
Monitor and optimize
Use AWS CloudWatch and Compute Optimizer to monitor performance and reduce costs.
Frequently Asked Questions
What GPU types does Amazon AWS offer?
Amazon AWS offers various GPU types including Tesla T4, Tesla T4, Tesla T4, A100 SXM, H100 SXM, H200, A10, A10, A10, L40S, L40S, L40S, L4, L4, L4. Check the pricing table above for current availability and pricing.
How do I get started with Amazon AWS?
Sign up for AWS, Choose a compute service, Launch an instance, Set up security, Monitor and optimize
What are Amazon AWS's main advantages?
Amazon AWS's main advantages include: Broad range of compute options including GPUs, Highly scalable and reliable infrastructure, Pay-as-you-go pricing with cost optimization tools, Extensive global network of data centers, Rich ecosystem of integrated services and tools.
What are Amazon AWS's limitations?
Amazon AWS's main limitations include: Complex pricing structure, Steep learning curve for new users, Potential for unexpected costs without proper management.
Compare Providers
Find the best prices for the same GPUs and models from other providers
