let_async_scope
Date: 22nd May 2024
Author: Anthony Williams anthony@justsoftwaresolutions.co.uk
Audience: SG1, LEWG
This is intended to address concerns raised in LEWG about ensuring that a counting_scope
is joined: the scope provided by let_async_scope
is always joined, irrespective of how the nested work completes, and whether or not the provided function throws an exception after spawning work.
Code with explicit counting_scope
:
some_data_type scoped_data = make_scoped_data();
counting_scope scope;
scope.nest(on(exec, [&] {
scope.nest(on(exec, [&] {if (need_more_work(scoped_data)) {
scope.nest(on(exec, [&] { do_more_work(scoped_data); }));
scope.nest(on(exec, [&] { do_more_other_work(scoped_data); }));
}
}));
scope.nest(on(exec, [&] { do_something_else_with(scoped_data); }));
}));
maybe_throw();
this_thread::sync_wait(scope.join());
Here, if maybe_throw
throws an exception, then the scope is not joined, and the nested tasks can continue executing asynchronously, potentially accessing both the scope
and scoped_data
objects out of lifetime.
Using let_async_scope
addresses this by encapsulating the scope object and the result of the previous sender. The returned sender does not complete until all tasks nested on the scope complete, even if the function passed to let_async_scope
exits via an exception:
auto scope_sender = just(make_scoped_data()) | let_async_scope([](auto scope_token,
auto& scoped_data) {
scope_token.nest(on(exec, [scope_token, &scoped_data] {
scope_token.nest(on(exec, [scope_token, &scoped_data] {if (need_more_work(scoped_data)) {
scope_token.nest(on(exec, [&scoped_data] { do_more_work(scoped_data); }));
scope_token.nest(on(exec, [&scoped_data] { do_more_other_work(scoped_data); }));
}
}));
scope_token.nest(on(exec, [&scoped_data] { do_something_else_with(scoped_data); }));
}));
maybe_throw();
});
this_thread::sync_wait(scope_sender);
Here, even if maybe_throw
throws an exception, then scope_sender
doesn’t complete until all the nested tasks have completed. This prevents out-of-lifetime access to the scoped_data
or the scope itself, unless references to the data or scope_token
are stored outside the sender tree.
Stop requests are propagated to all senders nested in the async scope, but does not prevent those senders adding additional work to the scope. This allows senders to respond to stop requests by scheduling additional work to perform the necessary cleanup for cancellation.
let_async_scope
provides a means of creating an async scope, which is associated with a set of tasks, and ensuring that they are all complete before the async scope sender completes.The previous sender’s result is passed to a user-specified invocable, along with an async scope token, which returns a new sender that is connected and started.
The sender returned by let_async_scope
completes with the result of the completion of the sender returned from the supplied invocable. It does not complete until all tasks nested on the scope_token
passed to the invocable have completed. Additional tasks may be nested on copies of the scope_token
, even if the initial sender returned from the invocable has completed. The returned scope_sender
will not complete while there are any nested tasks that have not completed.
Stop requests are propagated to all senders nested in the async scope.
execution::let_async_scope
let_async_scope
transforms a sender’s value completions into a new child asynchronous operation associated with an async scope, by passing the sender’s result datums to a user-specified callable, which returns a new sender that is connected and started.
For a subexpression sndr
, let let-async-scope-env(sndr)
be expression-equivalent to the first well-formed expression below:
SCHED-ENV(get_completion_scheduler<decayed-typeof<set_value>>(get_env(sndr)))
MAKE-ENV(get_domain, get_domain(get_env(sndr)))
empty_env{}
The expression let_async_scope(sndr, f)
is expression-equivalent to:
transform_sender(
get-domain-early(sndr), make-sender(let_async_scope, f, sndr));
The exposition-only class template impls-for
([exec.snd.general]) is specialized for let_async_scope
as follows:
namespace std::execution {
template<class State, class Rcvr, class... Args>
void let-async-scope-bind(State& state, Rcvr& rcvr, Args&&... args); // exposition only
template<>
struct impls-for<decayed-typeof<let_async_scope>> : default-impls {
static constexpr auto get-state = see below;
static constexpr auto complete = see below;
}; }
Let receiver2
denote the following exposition-only class template:
namespace std::execution {
template<class Rcvr, class Env>
struct receiver2 : Rcvr {
explicit receiver2(Rcvr rcvr, Env env)
std::move(rcvr)), env(std::move(env)) {}
: Rcvr(
auto get_env() const noexcept {
const Rcvr& rcvr = *this;
return JOIN-ENV(env, FWD-ENV(execution::get_env(rcvr)));
}
// exposition only
Env env;
}; }
impls-for<decayed-typeof<let_async_scope>>::get-state
is is initialized with a callable object equivalent to the following:
class Sndr, class Rcvr>(Sndr&& sndr, Rcvr& rcvr) requires see below {
[]<auto&& [tag, data, child] = std::forward<Sndr>(sndr);
return [&]<class Fn, class Env>(Fn fn, Env env) {
using args-variant-type = see below;
using ops2-variant-type = see below;
using scope-type = see below;
struct state-type {
Fn fn;
Env env;
scope-type scope;
args-variant-type args;
ops2-variant-type ops2;
};return state-type{std::move(fn), std::move(env), {}, {}};
std::forward_like<Sndr>(data), let-async-scope-env(child));
}( }
scope-type
is a type that satisfies the asynchronous-scope
concept.
scope-type
maintains a count of the number of active senders passed to nest
on that scope object or an async-scope-token
obtained from that scope object.nest
completes.join()
on an instance of the scope type will complete when the number of senders reaches zero.scope-token-type
is the type of the async-scope-token
returned from scope-type::get_token
.
Let Sigs
be a pack of the arguments to the completion_signatures
specialization named by completion_signatures_of_t<child-type<Sndr>, env_of_t<Rcvr>>
. Let LetSigs
be a pack of those types in Sigs
with a return type of decayed-typeof<set_value>
. Let as-tuple
be an alias template such that as-tuple<Tag(Args...)>
denotes the type decayed-tuple<Args...>
. Then args-variant-type
denotes the type variant<monostate, as-tuple<LetSigs>...>
.
Let as-sndr2
be an alias template such that as-sndr2<Tag(Args...)>
denotes the type call-result-t<Fn, scope-token-type, decay_t<Args>&...>
. Then ops2-variant-type
denotes the type variant<monostate, connect_result_t<as-sndr2<LetSigs>, receiver2<Rcvr, Env>>...>
.
The requires-clause constraining the above lambda is satisfied if and only if the types args-variant-type
and ops2-variant-type
are well-formed.
The exposition-only function template let-async-scope-bind
is equal to:
auto& args = state.args.emplace<decayed - tuple<scope - token - type, Args...>>(
std::forward<Args>(args)...);
state.scope.get_token(), try {
auto sndr2 = state.scope.nest(apply(std::move(state.fn), args));
auto join_sender = state.scope.join();
auto result_sender = when_all_with_variant(std::move(sndr2), std::move(join_sender)) |
auto& result, auto&) { return result; });
then([](auto rcvr2 = receiver2{std::move(rcvr), std::move(state.env)};
auto mkop2 = [&] { return connect(std::move(result_sender), std::move(rcvr2)); };
auto& op2 = state.ops2.emplace<decltype(mkop2())>(emplace-from{mkop2});
start(op2);catch (...) {
} auto result_sender = when_all(just_error(std::current_exception()), state.scope.join());
auto rcvr2 = receiver2{std::move(rcvr), std::move(state.env)};
auto mkop2 = [&] { return connect(std::move(result_sender), std::move(rcvr2)); };
auto& op2 = state.ops2.emplace<decltype(mkop2())>(emplace-from{mkop2});
start(op2); }
impls-for<decayed-typeof<let_async_scope>>::complete
is is initialized with a callable object equivalent to the following:
class Tag, class... Args>
[]<auto, auto& state, auto& rcvr, Tag, Args&&... args) noexcept -> void {
(if constexpr (same_as<Tag, decayed-typeof<set_value>>) {
std::move(rcvr), let-async-scope-bind(state, rcvr, std::forward<Args>(args)...));
TRY-EVAL(else {
} std::move(rcvr), std::forward<Args>(args)...);
Tag()(
} }
Let sndr
and env
be subexpressions, and let Sndr
be decltype((sndr))
. If sender-for<Sndr, decayed-typeof<let_async_scope>>
is false
, then the expression let_async_scope.transform_env(sndr, env)
is ill-formed. Otherwise, it is equal to JOIN-ENV(let-env(sndr), FWD-ENV(env))
.
Let the subexpression out_sndr
denote the result of the invocation let_async_scope(sndr, f)
or an object copied or moved from such, and let the subexpression rcvr
denote a receiver such that the expression connect(out_sndr, rcvr)
is well-formed. The expression connect(out_sndr, rcvr)
has undefined behavior unless it creates an asynchronous operation ([async.ops]) that, when started:
invokes f
when set_value
is called with sndr
’s result datums,
makes its completion dependent on the completion of a sender returned by f
, and
propagates the other completion operations sent by sndr
.
Thanks to Ian Petersen, Lewis Baker, Inbal Levi, Kirk Shoop, Eric Niebler, Ruslan Arutyunyan, Maikel Nadolski, Lucian Radu Teodorescu, and everyone else who contributed to discussions leading to this paper, and commented on early drafts.