Functions used for testing
Benchmarks for similar workloads among the cloud providers
Hero Image

Hello GPU

Hello GPU is a basic test with no dependencies. It simply boots a machine with a GPU and returns a string.

hello_gpu by replicate on t4
Median14.56s
Average23.06s
Failures0
14.04s 12:02:08 AM
105.98s 12:03:12 AM
16.03s 12:03:20 AM
13.13s 12:01:36 AM
11.5s 12:02:23 AM
16.1s 12:01:50 AM
13.63s 12:02:15 AM
11.17s 12:02:32 AM
12.29s 12:05:47 AM
12.95s 12:05:13 AM
29.15s 12:05:46 AM
68.23s 12:05:27 AM
15.13s 12:01:53 AM
14.73s 12:03:57 AM
94.01s 12:05:21 AM
13.8s 12:01:26 AM
12.97s 12:01:21 AM
14.81s 12:01:22 AM
18.4s 12:01:34 AM
28.58s 12:02:05 AM
21.91s 12:01:29 AM
16.72s 12:01:37 AM
19.43s 12:02:09 AM
27.27s 12:02:40 AM
144.54s 12:03:12 AM
11.56s 12:02:05 AM
14.29s 12:02:06 AM
17.63s 12:01:53 AM
14.34s 12:01:27 AM
14.8s 12:03:22 AM
11.19s 12:02:37 AM
14.76s 12:01:55 AM
15.04s 12:02:24 AM
12.41s 12:02:03 AM
13.31s 12:02:35 AM
17.29s 12:01:51 AM
11.17s 12:01:48 AM
36.99s 12:03:32 AM
25.1s 12:02:00 AM
16.68s 12:01:49 AM
11.1s 12:01:58 AM
9.89s 12:02:25 AM
11.24s 12:02:22 AM
11.19s 12:01:54 AM
12.5s 12:02:10 AM
14.39s 12:01:26 AM
62.32s 12:02:00 AM
11.21s 12:02:05 AM
12.32s 12:01:34 AM
11.31s 12:01:28 AM
13.41s 12:01:51 AM
22.09s 12:09:10 AM
52.99s 12:05:53 AM
30.46s 12:02:23 AM
29.34s 12:05:22 AM
29.21s 12:06:23 AM
10.54s 12:01:36 AM
10.84s 12:06:34 AM
22.89s 12:04:24 AM
10.85s 12:04:52 AM
26.46s 12:06:10 AM
11.66s 12:01:59 AM
13.13s 12:02:10 AM
11.35s 12:01:29 AM

Hello Torch

Hello Torch is a basic test with Torch as a dependency. It loads Torch and runs some simple matrix multiplications on the GPU.

hello_torch by replicate on t4
Median87.44s
Average137.03s
Failures0
92.93s 12:02:08 AM
142.32s 12:03:12 AM
164.9s 12:03:20 AM
81.48s 12:01:36 AM
142.46s 12:02:23 AM
98.45s 12:01:50 AM
78.77s 12:02:15 AM
96.77s 12:02:32 AM
296.68s 12:05:47 AM
269.82s 12:05:13 AM
58.57s 12:05:46 AM
294.94s 12:05:27 AM
80.73s 12:01:53 AM
201.34s 12:03:57 AM
275.8s 12:05:21 AM
85.29s 12:01:26 AM
79.32s 12:01:21 AM
79.23s 12:01:22 AM
82.83s 12:01:34 AM
92.85s 12:02:05 AM
88.39s 12:01:29 AM
81.64s 12:01:37 AM
84.34s 12:02:09 AM
147.23s 12:02:40 AM
118.57s 12:03:12 AM
82.26s 12:02:05 AM
87.08s 12:02:06 AM
82.01s 12:01:53 AM
84.28s 12:01:27 AM
144.06s 12:03:22 AM
135.36s 12:02:37 AM
98.84s 12:01:55 AM
84.92s 12:02:24 AM
77.03s 12:02:03 AM
102.24s 12:02:35 AM
106.62s 12:01:51 AM
77.72s 12:01:48 AM
180.28s 12:03:32 AM
87.06s 12:02:00 AM
75.3s 12:01:49 AM
82.07s 12:01:58 AM
85.41s 12:02:25 AM
96.89s 12:02:22 AM
83.3s 12:01:54 AM
79.48s 12:02:10 AM
80s 12:01:26 AM
76.67s 12:02:00 AM
83.19s 12:02:05 AM
76.78s 12:01:34 AM
80.19s 12:01:28 AM
101.82s 12:01:51 AM
549.35s 12:09:10 AM
346.65s 12:05:53 AM
82.39s 12:02:23 AM
259.53s 12:05:22 AM
341.26s 12:06:23 AM
84.42s 12:01:36 AM
338.19s 12:06:34 AM
220.04s 12:04:24 AM
238.92s 12:04:52 AM
310.97s 12:06:10 AM
87.8s 12:01:59 AM
85.95s 12:02:10 AM
77.65s 12:01:29 AM

Hello TTS

Hello TTS is a test that runs the bark text-to-speech model on a single sentence. This test is small, but it's for a real use case that includes loading a big model into memory and running inference.

hello_tts by modal on a10g
Median138.09s
Average145.46s
Failures0
183.84s 7:49:42 PM
126.36s 7:48:54 PM
132.27s 7:48:52 PM
129.93s 7:48:51 PM
126.74s 7:48:45 PM
126.75s 7:48:49 PM
129.68s 7:49:08 PM
127.9s 7:48:48 PM
121.74s 7:48:37 PM
114.29s 7:48:42 PM
125.28s 7:48:45 PM
125.1s 7:48:43 PM
144.21s 7:49:11 PM
127.04s 7:48:51 PM
147.87s 7:49:12 PM
139.28s 7:49:00 PM
179.15s 7:49:37 PM
149.43s 7:49:16 PM
146.72s 7:49:19 PM
132.9s 7:49:00 PM
136.9s 7:49:03 PM
144.65s 7:49:09 PM
195.48s 7:49:58 PM
190.15s 7:49:49 PM
190.53s 7:49:53 PM
154.23s 7:52:52 PM
185.45s 7:49:44 PM
129.86s 7:48:47 PM
145.11s 7:49:05 PM
160.83s 7:49:29 PM
135.72s 7:48:57 PM
149.47s 7:49:09 PM
hello_tts by beam on a10g
MedianNaNs
AverageNaNs
Failures32
142.82s 7:49:42 PM
91.8s 7:48:54 PM
106.81s 7:48:52 PM
95.66s 7:48:51 PM
96.42s 7:48:45 PM
85.77s 7:48:49 PM
95.23s 7:49:08 PM
89.42s 7:48:48 PM
95.59s 7:48:37 PM
90.32s 7:48:42 PM
97.87s 7:48:45 PM
96.87s 7:48:43 PM
97.57s 7:49:11 PM
94.3s 7:48:51 PM
112.14s 7:49:12 PM
100.53s 7:49:00 PM
113.31s 7:49:37 PM
109.38s 7:49:16 PM
111.03s 7:49:19 PM
99.56s 7:49:00 PM
91.32s 7:49:03 PM
103.19s 7:49:09 PM
96.88s 7:49:58 PM
148.43s 7:49:49 PM
155.27s 7:49:53 PM
127.58s 7:52:52 PM
154.18s 7:49:44 PM
95.5s 7:48:47 PM
108.04s 7:49:05 PM
119.06s 7:49:29 PM
105.24s 7:48:57 PM
107.18s 7:49:09 PM

About

See the code used at github.com/viktorfa/serverless-gpu-samples