Skip to content

Commit

Permalink
Enables scheduler to send multiple executions in local mode (hydro-pr…
Browse files Browse the repository at this point in the history
…oject#37)

By default, in cluster mode, schedulers only send one function execution request to an executor and wait to hear back before sending another. This can cause timing issues in local mode, so we don't wait for a response after every request.
  • Loading branch information
alicelyy authored Apr 8, 2020
1 parent ecada2a commit 5849896
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion cloudburst/server/scheduler/policy/default_policy.py
Original file line number Diff line number Diff line change
Expand Up @@ -155,7 +155,7 @@ def pick_executor(self, references, function_name=None):

# Remove this IP/tid pair from the system's metadata until it notifies
# us that it is available again, but only do this for non-DAG requests.
if not function_name:
if not self.local and not function_name:
self.unpinned_executors.discard(max_ip)

self.unique_executors.add(max_ip)
Expand Down

0 comments on commit 5849896

Please sign in to comment.