Async/await

In computer programming, the async/await pattern is a syntactic feature of many programming languages that allows an asynchronous, non-blocking function to be structured in a way similar to an ordinary synchronous function. It is semantically related to the concept of a coroutine and is often implemented using similar techniques, and is primarily intended to provide opportunities for the program to execute other code while waiting for a long-running, asynchronous task to complete, usually represented by promises or similar data structures. The feature is found in C#,^[1]: 10 C++, Python, F#, Hack, Julia, Dart, Kotlin, Rust,^[2] Nim,^[3] JavaScript, and Swift.^[4]

History

F# added asynchronous workflows with await points in version 2.0 in 2007.^[5] This influenced the async/await mechanism added to C#.^[6]

Microsoft first released a version of C# with async/await in the Async CTP (2011). It was later officially released in C# 5 (2012).^[7][1]: 10

Haskell lead developer Simon Marlow created the async package in 2012.^[8]

Python added support for async/await with version 3.5 in 2015^[9] adding 2 new keywords, async and await.

TypeScript added support for async/await with version 1.7 in 2015.^[10]

Javascript added support for async/await in 2017 as part of ECMAScript 2017 JavaScript edition.

Rust added support for async/await with version 1.39.0 in 2019 using the async keyword and the .await postfix operator, both introduced in the 2018 edition of the language.^[11]

C++ added support for async/await with version 20 in 2020 with 3 new keywords co_return, co_await, co_yield.

Swift added support for async/await with version 5.5 in 2021, adding 2 new keywords async and await. This was released alongside a concrete implementation of the Actor model with the actor keyword^[12] which uses async/await to mediate access to each actor from outside.

Example C#

The C# function below, which downloads a resource from a URI and returns the resource's length, uses this async/await pattern:

public async Task<int> FindSizeOfPageAsync(Uri uri) 
{
    var client = new HttpClient();
    byte[] data = await client.GetByteArrayAsync(uri);
    return data.Length;
}

• First, the async keyword indicates to C# that the method is asynchronous, meaning that it may use an arbitrary number of await expressions and will bind the result to a promise.^{[1]: 165–168}
• The return type, Task<T>, is C#'s analogue to the concept of a promise, and here is indicated to have a result value of type int.
• The first expression to execute when this method is called will be new HttpClient().GetByteArrayAsync(uri),^{[13]: 189–190, 344 [1]: 882} which is another asynchronous method returning a Task<byte[]>. Because this method is asynchronous, it will not download the entire batch of data before returning. Instead, it will begin the download process using a non-blocking mechanism (such as a background thread), and immediately return an unresolved, unrejected Task<byte[]> to this function.
• With the await keyword attached to the Task, this function will immediately proceed to return a Task<int> to its caller, who may then continue on with other processing as needed.
• Once GetByteArrayAsync() finishes its download, it will resolve the Task it returned with the downloaded data. This will trigger a callback and cause FindPageSizeAsync() to continue execution by assigning that value to data.
• Finally, the method returns data.Length, a simple integer indicating the length of the array. The compiler re-interprets this as resolving the Task it returned earlier, triggering a callback in the method's caller to do something with that length value.

A function using async/await can use as many await expressions as it wants, and each will be handled in the same way (though a promise will only be returned to the caller for the first await, while every other await will utilize internal callbacks). A function can also hold a promise object directly and do other processing first (including starting other asynchronous tasks), delaying awaiting the promise until its result is needed. Functions with promises also have promise aggregation methods that allow the program to await multiple promises at once or in some special pattern (such as C#'s Task.WhenAll(),^{[1]: 174–175 [13]: 664–665} which returns a valueless Task that resolves when all of the tasks in the arguments have resolved). Many promise types also have additional features beyond what the async/await pattern normally uses, such as being able to set up more than one result callback or inspect the progress of an especially long-running task.

In the particular case of C#, and in many other languages with this language feature, the async/await pattern is not a core part of the language's runtime, but is instead implemented with lambdas or continuations at compile time. For instance, the C# compiler would likely translate the above code to something like the following before translating it to its IL bytecode format:

public Task<int> FindSizeOfPageAsync(Uri uri) 
{
    var client = new HttpClient();
    Task<byte[]> dataTask = client.GetByteArrayAsync(uri);
    Task<int> afterDataTask = dataTask.ContinueWith((originalTask) => {
        return originalTask.Result.Length;
    });
    return afterDataTask;
}

Because of this, if an interface method needs to return a promise object, but itself does not require await in the body to wait on any asynchronous tasks, it does not need the async modifier either and can instead return a promise object directly. For instance, a function might be able to provide a promise that immediately resolves to some result value (such as C#'s Task.FromResult()^[13]: 656), or it may simply return another method's promise that happens to be the exact promise needed (such as when deferring to an overload).

One important caveat of this functionality, however, is that while the code resembles traditional blocking code, the code is actually non-blocking and potentially multithreaded, meaning that many intervening events may occur while waiting for the promise targeted by an await to resolve. For instance, the following code, while always succeeding in a blocking model without await, may experience intervening events during the await and may thus find shared state changed out from under it:

var a = state.a;
var client = new HttpClient();
var data = await client.GetByteArrayAsync(uri);
Debug.Assert(a == state.a); // Potential failure, as value of state.a may have been changed
                            // by the handler of potentially intervening event.
return data.Length;

Implementations

In F#

In 2007, F# added asynchronous workflows with version 2.0.^[14] The asynchronous workflows are implemented as CE (computation expressions). They can be defined without specifying any special context (like async in C#). F# asynchronous workflows append a bang (!) to keywords to start asynchronous tasks.

The following async function downloads data from an URL using an asynchronous workflow:

let asyncSumPageSizes (uris: #seq<Uri>) : Async<int> = async {
    use httpClient = new HttpClient()
    let! pages = 
        uris
        |> Seq.map(httpClient.GetStringAsync >> Async.AwaitTask)
        |> Async.Parallel
    return pages |> Seq.fold (fun accumulator current -> current.Length + accumulator) 0
}

In C#

In 2012, C# added the async/await pattern in C# with version 5.0, which Microsoft refers to as the task-based asynchronous pattern (TAP).^[15] Async methods usually return either void, Task, Task<T>,^{[13]: 35 [16]: 546–547 [1]: 22, 182} ValueTask or ValueTask<T>.^{[13]: 651–652 [1]: 182–184} User code can define custom types that async methods can return through custom async method builders but this is an advanced and rare scenario.^[17] Async methods that return void are intended for event handlers; in most cases where a synchronous method would return void, returning Task instead is recommended, as it allows for more intuitive exception handling.^[18]

Methods that make use of await must be declared with the async keyword. In methods that have a return value of type Task<T>, methods declared with async must have a return statement of type assignable to T instead of Task<T>; the compiler wraps the value in the Task<T> generic. It is also possible to await methods that have a return type of Task or Task<T> that are declared without async.

The following async method downloads data from a URL using await. Because this method issues a task for each uri before requiring completion with the await keyword, the resources can load at the same time instead of waiting for the last resource to finish before starting to load the next.

public async Task<int> SumPageSizesAsync(IEnumerable<Uri> uris) 
{
    var client = new HttpClient();
    int total = 0;
    var loadUriTasks = new List<Task<byte[]>>();

    foreach (var uri in uris)
    {
        var loadUriTask = client.GetByteArrayAsync(uri);
        loadUriTasks.Add(loadUriTask );
    }

    foreach (var loadUriTask in loadUriTasks)
    {
        statusText.Text = $"Found {total} bytes ...";
        var resourceAsBytes = await loadUriTask;
        total += resourceAsBytes.Length;
    }

    statusText.Text = $"Found {total} bytes total";

    return total;
}

In Python

Python 3.5 (2015)^[19] has added support for async/await as described in PEP 492 (written and implemented by Yury Selivanov).^[20]

import asyncio

async def main():
    print("hello")
    await asyncio.sleep(1)
    print("world")

asyncio.run(main())

In JavaScript

The await operator in JavaScript can only be used from inside an async function or at the top level of a module. If the parameter is a promise, execution of the async function will resume when the promise is resolved (unless the promise is rejected, in which case an error will be thrown that can be handled with normal JavaScript exception handling). If the parameter is not a promise, the parameter itself will be returned immediately.^[21]

Many libraries provide promise objects that can also be used with await, as long as they match the specification for native JavaScript promises. However, promises from the jQuery library were not Promises/A+ compatible until jQuery 3.0.^[22]

Here's an example (modified from this^[23] article):

async function createNewDoc() {
  let response = await db.post({}); // post a new doc
  return db.get(response.id); // find by id
}

async function main() {
  try {
    let doc = await createNewDoc();
    console.log(doc);
  } catch (err) {
    console.log(err);
  }
}
main();

Node.js version 8 includes a utility that enables using the standard library callback-based methods as promises.^[24]

In C++

In C++, await (named co_await in C++) has been officially merged into version 20.^[25] Support for it, coroutines, and the keywords such as co_await are available in GCC and MSVC compilers while Clang has partial support.

It is worth noting that std::promise and std::future, although it would seem that they would be awaitable objects, implement none of the machinery required to be returned from coroutines and be awaited using co_await. Programmers must implement a number of public member functions, such as await_ready, await_suspend, and await_resume on the return type in order for the type to be awaited on. Details can be found on cppreference.^[26]

#include <iostream>
#include "CustomAwaitableTask.h"

using namespace std;

CustomAwaitableTask<int> add(int a, int b)
{
    int c = a + b;
    co_return c;
}

CustomAwaitableTask<int> test()
{
    int ret = co_await add(1, 2);
    cout << "return " << ret << endl;
    co_return ret;
}

int main()
{
    auto task = test();

    return 0;
}

In C

The C language does not support await/async. Some coroutine libraries such as s_task^[27] simulate the keywords await/async with macros.

#include <stdio.h>
#include "s_task.h"

// define stack memory for tasks
int g_stack_main[64 * 1024 / sizeof(int)];
int g_stack0[64 * 1024 / sizeof(int)];
int g_stack1[64 * 1024 / sizeof(int)];

void sub_task(__async__, void* arg) {
    int i;
    int n = (int)(size_t)arg;
    for (i = 0; i < 5; ++i) {
        printf("task %d, delay seconds = %d, i = %d\n", n, n, i);
        s_task_msleep(__await__, n * 1000);
        //s_task_yield(__await__);
    }
}

void main_task(__async__, void* arg) {
    int i;

    // create two sub-tasks
    s_task_create(g_stack0, sizeof(g_stack0), sub_task, (void*)1);
    s_task_create(g_stack1, sizeof(g_stack1), sub_task, (void*)2);

    for (i = 0; i < 4; ++i) {
        printf("task_main arg = %p, i = %d\n", arg, i);
        s_task_yield(__await__);
    }

    // wait for the sub-tasks for exit
    s_task_join(__await__, g_stack0);
    s_task_join(__await__, g_stack1);
}

int main(int argc, char* argv) {

    s_task_init_system();

    //create the main task
    s_task_create(g_stack_main, sizeof(g_stack_main), main_task, (void*)(size_t)argc);
    s_task_join(__await__, g_stack_main);
    printf("all task is over\n");
    return 0;
}

In Perl 5

The Future::AsyncAwait^[28] module was the subject of a Perl Foundation grant in September 2018.^[29]

In Rust

On November 7, 2019, async/await was released on the stable version of Rust.^[30] Async functions in Rust desugar to plain functions that return values that implement the Future trait. Currently they are implemented with a finite state machine.^[31]

// In the crate's Cargo.toml, we need `futures = "0.3.0"` in the dependencies section,
// so we can use the futures crate

extern crate futures; // There is no executor currently in the `std` library.

// This desugars to something like
// `fn async_add_one(num: u32) -> impl Future<Output = u32>`
async fn async_add_one(num: u32) -> u32 {
    num + 1
}

async fn example_task() {
    let number = async_add_one(5).await;
    println!("5 + 1 = {}", number);
}

fn main() {
    // Creating the Future does not start the execution.
    let future = example_task();

    // The `Future` only executes when we actually poll it, unlike Javascript.
    futures::executor::block_on(future);
}

In Swift

Swift 5.5 (2021)^[32] added support for async/await as described in SE-0296.^[33]

func getNumber() async throws -> Int {
    try await Task.sleep(nanoseconds: 1_000_000_000)
    return 42
}

Task {
    let first = try await getNumber()
    let second = try await getNumber()
    print(first + second)
}

Benefits and criticisms

The async/await pattern is especially attractive to language designers of languages that do not have or control their own runtime, as async/await can be implemented solely as a transformation to a state machine in the compiler.^[34]

Supporters claim that asynchronous, non-blocking code can be written with async/await that looks almost like traditional synchronous, blocking code. In particular, it has been argued that await is the best way of writing asynchronous code in message-passing programs; in particular, being close to blocking code, readability and the minimal amount of boilerplate code were cited as await benefits.^[35] As a result, async/await makes it easier for most programmers to reason about their programs, and await tends to promote better, more robust non-blocking code in applications that require it.^{[dubious – discuss]}

Critics of async/await note that the pattern tends to cause surrounding code to be asynchronous too; and that its contagious nature splits languages' library ecosystems between synchronous and asynchronous libraries and APIs, an issue often referred to as "function coloring".^[36] Alternatives to async/await that do not suffer from this issue are called "colorless". Examples of colorless designs include Go's goroutines and Java's virtual threads.^[37]

See also

• Coroutines
• Continuation-passing style
• Direct style
• Cooperative multitasking

References

1. Skeet, Jon (23 March 2019). C# in Depth. Manning. ISBN 978-1617294532.
2. "Announcing Rust 1.39.0". Retrieved 2019-11-07.
3. "Version 0.9.4 released - Nim blog". Retrieved 2020-01-19.
4. "Concurrency — The Swift Programming Language (Swift 5.5)". docs.swift.org. Retrieved 2021-09-28.
5. Syme, Don; Petricek, Tomas; Lomov, Dmitry (2011). "The F# Asynchronous Programming Model". Practical Aspects of Declarative Languages. Lecture Notes in Computer Science. Vol. 6539. Springer Link. pp. 175–189. doi:10.1007/978-3-642-18378-2_15. ISBN 978-3-642-18377-5. Retrieved 2021-04-29.
6. "The Early History of F#, HOPL IV". ACM Digital Library. Retrieved 2021-04-29.
7. Hejlsberg, Anders. "Anders Hejlsberg: Introducing Async – Simplifying Asynchronous Programming". Channel 9 MSDN. Microsoft. Retrieved 5 January 2021.
8. "async: Run IO operations asynchronously and wait for their results". Hackage.
9. "What's New In Python 3.5 — Python 3.9.1 documentation". docs.python.org. Retrieved 5 January 2021.
10. Gaurav, Seth (30 November 2015). "Announcing TypeScript 1.7". TypeScript. Microsoft. Retrieved 5 January 2021.
11. Matsakis, Niko. "Async-await on stable Rust! | Rust Blog". blog.rust-lang.org. Rust Blog. Retrieved 5 January 2021.
12. "Concurrency — the Swift Programming Language (Swift 5.6)".
13. Albahari, Joseph (2022). C# 10 in a Nutshell. O'Reilly. ISBN 978-1-098-12195-2.
14. "Introducing F# Asynchronous Workflows". 10 October 2007.
15. "Task-based asynchronous pattern". Microsoft. Retrieved 28 September 2020.
16. Price, Mark J. (2022). C# 8.0 and .NET Core 3.0 – Modern Cross-Platform Development: Build Applications with C#, .NET Core, Entity Framework Core, ASP.NET Core, and ML.NET Using Visual Studio Code. Packt. ISBN 978-1-098-12195-2.
17. Tepliakov, Sergey (2018-01-11). "Extending the async methods in C#". Developer Support. Retrieved 2022-10-30.
18. Stephen Cleary, Async/Await - Best Practices in Asynchronous Programming
19. "Python Release Python 3.5.0".
20. "PEP 492 – Coroutines with async and await syntax".
21. "await - JavaScript (MDN)". Retrieved 2 May 2017.
22. "jQuery Core 3.0 Upgrade Guide". Retrieved 2 May 2017.
23. "Taming the asynchronous beast with ES7". Retrieved 12 November 2015.
24. Foundation, Node.js (30 May 2017). "Node v8.0.0 (Current) - Node.js". Node.js.
25. "ISO C++ Committee announces that C++20 design is now feature complete". 25 February 2019.
26. "Coroutines (C++20)".
27. "s_task - awaitable coroutine library for C". GitHub.
28. "Future::AsyncAwait - deferred subroutine syntax for futures".
29. "September 2018 Grant Votes - The Perl Foundation". news.perlfoundation.org. Retrieved 2019-03-26.
30. Matsakis, Niko. "Async-await on stable Rust!". Rust Blog. Retrieved 7 November 2019.
31. Oppermann, Philipp. "Async/Await". Retrieved 28 October 2020.
32. "Archived copy". Archived from the original on 2022-01-23. Retrieved 2021-12-20.
33. "SE-0296". GitHub.
34. "Async Part 3 - How the C# compiler implements async functions".
35. 'No Bugs' Hare. Eight ways to handle non-blocking returns in message-passing programs CPPCON, 2018
36. "What Color is Your Function?".
37. "Virtual Threads".