Skip to content

Commit

Permalink
add batching params to Function
Browse files Browse the repository at this point in the history
  • Loading branch information
cathyzbn committed Jul 11, 2024
1 parent 44e164b commit 78e62bf
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions modal_proto/api.proto
Original file line number Diff line number Diff line change
Expand Up @@ -986,6 +986,9 @@ message Function {
ClassParameterInfo class_parameter_info = 56;

repeated Resources _experimental_resources = 57; // overrides `resources` field above

int32 batch_max_size = 58; // Maximum number of inputs to fetch at once
float batch_linger_secs = 59; // Seconds to block before a response is needed
}

message FunctionBindParamsRequest {
Expand Down

0 comments on commit 78e62bf

Please sign in to comment.