16GB Serverless prices

16GB cards

Prices for true serverless GPUs

16GB is a category of cards in Runpod. Since Runpod does not offer the more standard T4 card, other cards with 16GB GPU memoery is used for benchmarks with Runpod.

16GB Serverless GPU Prices

Show shared


Mystic.ai	Nvidia T4	16			0.000111/s 0.3996/h -42%
Beam.cloud	T4 GPU	16			0.00015/s 0.54/h -21%
Modal	Nvidia T4				0.000164/s 0.5904/h -14%
Inferless	T4	16	20	3	0.000185/s 0.666/h -3%
Runpod	A4000	16			0.0002/s 0.72/h 0
Replicate	T4	16	8	4	0.000225/s 0.81/h +18%
ModelZ.ai	T4 GPU	16	16	4	0.00031/s 1.116/h +62%

16GB Serverless GPU Vendors

Vendor	Free Tier	True Serverless	Pricing Page	Deployment	Webhooks
Replicate	Unspecified	true	https://replicate.com/pricing	Cog SDK	Supported
Inferless	30 USD	true	https://www.inferless.com/pricing	Inferless CLI	Not supported
Runpod	Unknown	true	https://www.runpod.io/serverless-gpu	Docker	Supported
Modal	30 USD per month	true	https://modal.com/pricing	Modal SDK	Not supported
ModelZ.ai	1.41 USD	true	https://modelz.ai/pricing	Docker	Not supported
Beam.cloud	10 hours	true	https://www.beam.cloud/pricing	Beam SDK	Supported
Mystic.ai	20 USD	true	https://www.mystic.ai/pricing/serverless	Mystic SDK	Not supported

Recent benchmarks for 16GB

hello_gpu by replicate on t4

Median14.38s

Average25.29s

Failures18

0.99s 12:00:57 AM

0.44s 12:00:58 AM

0.53s 12:00:58 AM

0.49s 12:00:58 AM

0.37s 12:00:58 AM

0.36s 12:00:58 AM

0.49s 12:00:58 AM

0.54s 12:00:07 AM

0.51s 12:00:07 AM

0.35s 12:00:50 AM

0.32s 12:00:50 AM

0.28s 12:00:50 AM

0.3s 12:00:50 AM

0.3s 12:00:52 AM

0.34s 12:00:51 AM

0.28s 12:00:50 AM

0.57s 12:00:08 AM

0.43s 12:00:08 AM

14.04s 12:02:08 AM

105.98s 12:03:12 AM

16.03s 12:03:20 AM

13.13s 12:01:36 AM

11.5s 12:02:23 AM

16.1s 12:01:50 AM

13.63s 12:02:15 AM

11.17s 12:02:32 AM

12.29s 12:05:47 AM

12.95s 12:05:13 AM

29.15s 12:05:46 AM

68.23s 12:05:27 AM

15.13s 12:01:53 AM

14.73s 12:03:57 AM

hello_torch by replicate on t4

Median120.38s

Average150.01s

Failures18

0.81s 12:00:57 AM

0.38s 12:00:58 AM

0.49s 12:00:58 AM

0.38s 12:00:58 AM

0.49s 12:00:58 AM

0.37s 12:00:07 AM

0.48s 12:00:07 AM

0.34s 12:00:50 AM

0.31s 12:00:50 AM

0.28s 12:00:50 AM

0.3s 12:00:50 AM

0.27s 12:00:52 AM

0.28s 12:00:51 AM

0.32s 12:00:50 AM

0.6s 12:00:08 AM

0.42s 12:00:08 AM

92.93s 12:02:08 AM

142.32s 12:03:12 AM

164.9s 12:03:20 AM

81.48s 12:01:36 AM

142.46s 12:02:23 AM

98.45s 12:01:50 AM

78.77s 12:02:15 AM

96.77s 12:02:32 AM

296.68s 12:05:47 AM

269.82s 12:05:13 AM

58.57s 12:05:46 AM

294.94s 12:05:27 AM

80.73s 12:01:53 AM

201.34s 12:03:57 AM