T4 Serverless prices

T4 is a low-tier modern processor. It has 16GB of GPU RAM and is a good economic choice for inference on small and medium models.

T4 Serverless GPU Prices

Show shared


Mystic.ai	Nvidia T4	16			0.000111/s 0.3996/h -42%
Beam.cloud	T4 GPU	16			0.00015/s 0.54/h -21%
Modal	Nvidia T4				0.000164/s 0.5904/h -14%
Inferless	T4	16	20	3	0.000185/s 0.666/h -3%
Replicate	T4	16	8	4	0.000225/s 0.81/h +18%
ModelZ.ai	T4 GPU	16	16	4	0.00031/s 1.116/h +62%

T4 Serverless GPU Vendors

Vendor	Free Tier	True Serverless	Pricing Page	Deployment	Webhooks
Replicate	Unspecified	true	https://replicate.com/pricing	Cog SDK	Supported
Inferless	30 USD	true	https://www.inferless.com/pricing	Inferless CLI	Not supported
Modal	30 USD per month	true	https://modal.com/pricing	Modal SDK	Not supported
ModelZ.ai	1.41 USD	true	https://modelz.ai/pricing	Docker	Not supported
Beam.cloud	10 hours	true	https://www.beam.cloud/pricing	Beam SDK	Supported
Mystic.ai	20 USD	true	https://www.mystic.ai/pricing/serverless	Mystic SDK	Not supported

Recent benchmarks for T4

hello_gpu by replicate on t4

Median14.81s

Average27.03s

Failures0

14.04s 12:02:08 AM

105.98s 12:03:12 AM

16.03s 12:03:20 AM

13.13s 12:01:36 AM

11.5s 12:02:23 AM

16.1s 12:01:50 AM

13.63s 12:02:15 AM

11.17s 12:02:32 AM

12.29s 12:05:47 AM

12.95s 12:05:13 AM

29.15s 12:05:46 AM

68.23s 12:05:27 AM

15.13s 12:01:53 AM

14.73s 12:03:57 AM

94.01s 12:05:21 AM

13.8s 12:01:26 AM

12.97s 12:01:21 AM

14.81s 12:01:22 AM

18.4s 12:01:34 AM

28.58s 12:02:05 AM

21.91s 12:01:29 AM

16.72s 12:01:37 AM

19.43s 12:02:09 AM

27.27s 12:02:40 AM

144.54s 12:03:12 AM

11.56s 12:02:05 AM

14.29s 12:02:06 AM

17.63s 12:01:53 AM

14.34s 12:01:27 AM

14.8s 12:03:22 AM

11.19s 12:02:37 AM

14.76s 12:01:55 AM

hello_torch by replicate on t4

Median92.89s

Average125.92s

Failures0

92.93s 12:02:08 AM

142.32s 12:03:12 AM

164.9s 12:03:20 AM

81.48s 12:01:36 AM

142.46s 12:02:23 AM

98.45s 12:01:50 AM

78.77s 12:02:15 AM

96.77s 12:02:32 AM

296.68s 12:05:47 AM

269.82s 12:05:13 AM

58.57s 12:05:46 AM

294.94s 12:05:27 AM

80.73s 12:01:53 AM

201.34s 12:03:57 AM

275.8s 12:05:21 AM

85.29s 12:01:26 AM

79.32s 12:01:21 AM

79.23s 12:01:22 AM

82.83s 12:01:34 AM

92.85s 12:02:05 AM

88.39s 12:01:29 AM

81.64s 12:01:37 AM

84.34s 12:02:09 AM

147.23s 12:02:40 AM

118.57s 12:03:12 AM

82.26s 12:02:05 AM

87.08s 12:02:06 AM

82.01s 12:01:53 AM

84.28s 12:01:27 AM

144.06s 12:03:22 AM

135.36s 12:02:37 AM

98.84s 12:01:55 AM