16GB Serverless prices

16GB cards

Prices for true serverless GPUs

16GB is a category of cards in Runpod. Since Runpod does not offer the more standard T4 card, other cards with 16GB GPU memoery is used for benchmarks with Runpod.

16GB Serverless GPU Prices

Show shared


Mystic.ai	Nvidia T4	16			0.000111/s 0.3996/h -42%
Beam.cloud	T4 GPU	16			0.00015/s 0.54/h -21%
Modal	Nvidia T4				0.000164/s 0.5904/h -14%
Inferless	T4	16	20	3	0.000185/s 0.666/h -3%
Runpod	A4000	16			0.0002/s 0.72/h 0
Replicate	T4	16	8	4	0.000225/s 0.81/h +18%
ModelZ.ai	T4 GPU	16	16	4	0.00031/s 1.116/h +62%

16GB Serverless GPU Vendors

Vendor	Free Tier	True Serverless	Pricing Page	Deployment	Webhooks
Replicate	Unspecified	true	https://replicate.com/pricing	Cog SDK	Supported
Inferless	30 USD	true	https://www.inferless.com/pricing	Inferless CLI	Not supported
Runpod	Unknown	true	https://www.runpod.io/serverless-gpu	Docker	Supported
Modal	30 USD per month	true	https://modal.com/pricing	Modal SDK	Not supported
ModelZ.ai	1.41 USD	true	https://modelz.ai/pricing	Docker	Not supported
Beam.cloud	10 hours	true	https://www.beam.cloud/pricing	Beam SDK	Supported
Mystic.ai	20 USD	true	https://www.mystic.ai/pricing/serverless	Mystic SDK	Not supported

Recent benchmarks for 16GB

hello_gpu by replicate on t4

Median14.81s

Average27.03s

Failures0

14.04s 12:02:08 AM

105.98s 12:03:12 AM

16.03s 12:03:20 AM

13.13s 12:01:36 AM

11.5s 12:02:23 AM

16.1s 12:01:50 AM

13.63s 12:02:15 AM

11.17s 12:02:32 AM

12.29s 12:05:47 AM

12.95s 12:05:13 AM

29.15s 12:05:46 AM

68.23s 12:05:27 AM

15.13s 12:01:53 AM

14.73s 12:03:57 AM

94.01s 12:05:21 AM

13.8s 12:01:26 AM

12.97s 12:01:21 AM

14.81s 12:01:22 AM

18.4s 12:01:34 AM

28.58s 12:02:05 AM

21.91s 12:01:29 AM

16.72s 12:01:37 AM

19.43s 12:02:09 AM

27.27s 12:02:40 AM

144.54s 12:03:12 AM

11.56s 12:02:05 AM

14.29s 12:02:06 AM

17.63s 12:01:53 AM

14.34s 12:01:27 AM

14.8s 12:03:22 AM

11.19s 12:02:37 AM

14.76s 12:01:55 AM

hello_torch by replicate on t4

Median92.89s

Average125.92s

Failures0

92.93s 12:02:08 AM

142.32s 12:03:12 AM

164.9s 12:03:20 AM

81.48s 12:01:36 AM

142.46s 12:02:23 AM

98.45s 12:01:50 AM

78.77s 12:02:15 AM

96.77s 12:02:32 AM

296.68s 12:05:47 AM

269.82s 12:05:13 AM

58.57s 12:05:46 AM

294.94s 12:05:27 AM

80.73s 12:01:53 AM

201.34s 12:03:57 AM

275.8s 12:05:21 AM

85.29s 12:01:26 AM

79.32s 12:01:21 AM

79.23s 12:01:22 AM

82.83s 12:01:34 AM

92.85s 12:02:05 AM

88.39s 12:01:29 AM

81.64s 12:01:37 AM

84.34s 12:02:09 AM

147.23s 12:02:40 AM

118.57s 12:03:12 AM

82.26s 12:02:05 AM

87.08s 12:02:06 AM

82.01s 12:01:53 AM

84.28s 12:01:27 AM

144.06s 12:03:22 AM

135.36s 12:02:37 AM

98.84s 12:01:55 AM