DB connection gives Quepool limit exceeded when run with TaskIQ #369
Unanswered
SifatHasnain
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I am using ListQueueBroker from taskiq-redis. The task I am running handles database queries with Python SqlAlchemy (Postgresql).
The same task when running in the background for even 1000 times, the system does not break. But with TaskIQ I am getting this timeout error saying QueuePool limit is exceeded. The configuration I am using for the DB connection is
engine = create_async_engine(
DB_URI,
poolclass=AsyncAdaptedQueuePool,
pool_size=int(os.environ.get("DB_POOL_SIZE", 10)),
max_overflow=int(os.environ.get("DB_MAX_OVERFLOW", 10)),
pool_pre_ping=True,
pool_recycle=3600,
pool_timeout=20,
)
I have tried increasing the values but even with 30 tasks the system breaks.
Beta Was this translation helpful? Give feedback.
All reactions