700-concurrent test

by infinitewarp 5 years ago

macOS • xterm-256color • bash 372 views

Make concurrent API fast again: ConcurrentUsage object redux

This demo attempts to reproduce the conditions of the larger “laska” account (~45000 instances active through the previous month) and uses the same process as that previous demo to populate the initial data. Because populating the data also takes a very long time, I captured a separate recording of only the data generation and simply reused its DB dump for this recording.

Note: At 2:28, the comment at the top of the screen incorrect says “old code”; it is actually using the new code at this point.

Before reintroducing ConcurrentUsage

Requests to concurrent API with no arguments:

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.0      0       0
Processing: 16073 16503 510.5  16253   17442
Waiting:    16073 16502 510.5  16252   17442
Total:      16073 16503 510.5  16253   17442

Requests to concurrent API with start_date of yesterday:

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.0      0       0
Processing: 34559 35188 1132.3  34672   37391
Waiting:    34558 35188 1132.3  34672   37391
Total:      34559 35188 1132.3  34672   37391

Requests to concurrent API with start_date of 15 days ago:

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.0      0       0
Processing: 191448 191760 186.9 191771  192021
Waiting:    191447 191760 186.9 191770  192020
Total:      191448 191760 186.9 191771  192021

After reintroducing ConcurrentUsage

Requests to concurrent API with no arguments:

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.0      0       0
Processing:    10 1595 5010.4     11   15855
Waiting:        9 1595 5010.4     10   15855
Total:         10 1595 5010.4     11   15855

Requests to concurrent API with start_date of yesterday:

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.0      0       0
Processing:    10 1904 5988.3     11   18947
Waiting:       10 1904 5988.2     10   18947
Total:         10 1905 5988.3     11   18948

Requests to concurrent API with start_date of 15 days ago:

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.0      0       0
Processing:    18 19226 60733.8     21  192078
Waiting:       18 19226 60733.8     20  192077
Total:         18 19226 60733.8     21  192078

Conclusions

One can infer from this demo that the first request is still just as slow as before, which is exactly what we expected, but all subsequent requests return on the order of 10 ms.

Additional captured output is here:

http://file.rdu.redhat.com/~brasmith/concurrent-bench-20200706/

More recordings by infinitewarp

Browse all

848-longevity verify runs in stage 0:36

by infinitewarp 4 years ago

719-delete-async (new http behavior) 0:51

by infinitewarp 4 years ago

579-pilot-rename-periodic-tasks 1:04

by infinitewarp 6 years ago

296-celery-amazon-sqs 3:17

by infinitewarp 7 years ago

https://asciinema.org/a/345776

Copied!

Append ?t=30 to start the playback at 30s, ?t=3:20 to start the playback at 3m 20s.

See sharing docs for more link customization options.

Embed as image link

Use snippets below to display a preview image linking to this recording.
Ideal for places where scripts are not allowed, such as project README files.

HTML:

<a href="https://asciinema.org/a/345776" target="_blank"><img src="https://asciinema.org/a/345776.svg" /></a>

Copied!

Markdown:

[![asciicast](https://asciinema.org/a/345776.svg)](https://asciinema.org/a/345776)

Copied!

Embed the player

If you're embedding on your own page or on a site which permits script tags, you can use the full player widget:

<script src="https://asciinema.org/a/345776.js" id="asciicast-345776" async="true"></script>

Copied!

Paste the above script tag where you want the player to be displayed on your page.

See embedding docs for more player customization options.

You can download this recording in asciicast v2 format, as a .cast file.

Download

Replay in terminal

You can replay the downloaded recording in your terminal using the asciinema play command:

asciinema play 345776.cast

Copied!

If you don't have asciinema CLI installed then see installation instructions.

Use with stand-alone player on your website

Download asciinema player from the releases page (you only need .js and .css file), then use it like this:

<!DOCTYPE html>
<html>
<head>
  <link rel="stylesheet" type="text/css" href="/assets/asciinema-player.css" />
</head>
<body>
  <div id="player"></div>
  <script src="/assets/asciinema-player.min.js"></script>
  <script>
    AsciinemaPlayer.create(
      '/assets/345776.cast',
      document.getElementById('player'),
      { cols: 128, rows: 38 }
    );
  </script>
</body>
</html>

See asciinema player quick-start guide for full usage instructions.

While this site doesn't provide GIF conversion at the moment, you can still do it yourself with the help of asciinema GIF generator utility - agg.

Once you have it installed, generate a GIF with the following command:

agg https://asciinema.org/a/345776 demo.gif

Copied!

Or, if you already downloaded the recording file:

agg demo.cast demo.gif

Copied!

Check agg --help for all available options. You can change font family and size, select color theme, adjust speed and more.

See agg manual for full usage instructions.