New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug]: Dragonfly wont add children jobs #2440
Comments
Sorry I dont know if this would be a bug in BullMQ's Flow implementation that should be addressed here or Dragonfly repo. |
@ivnnv we can look into the issue. The first thing I would like to ask is if you could clean up the code, you are using some patterns that are not what we recommend when using flows, such as creating job instances first and then using them in the flow producer. You could just follow the example here: https://docs.bullmq.io/guide/flows |
I know little (read: nothing) about BullMQ, so without actually knowing which operations are misbehaving in Dragonfly I can be of little help.. |
Thanks! Yes @manast, Ive tried several versions of this code to discard it was a code thing. |
hey @manast just a friendly ping wondering if you were able to have a look at this (Redis feels super slow after trying Dragonfly 😄) |
Hi, we are heavily using parent-child relations and running on Dragonfly without any issues. Dragonfly's docs states that you have to set |
hey @tomkuehl, thanks for joining the convo. I had a second look at that and yeah it seems they say that this is required (thought it was optional). So Im hesitant now if ALL OF THESE FLAGS are required to run BullMQ with Dragonfly, and if so, I think this should be state more clearly in every doc, is this true @manast and if so, is there any plans to support parent-child relations to work without this flag? And then the question is: if we need to put all of those flags to run Dragonfly, would we get any performance benefit after all? |
That's actually not what we (try to?) say :)
Running with |
Version
5.3.0
Platform
NodeJS
What happened?
It seems Dragonfly wont add child jobs on a FlowProcess if
--default_lua_flags=allow-undeclared-keys
flag is NOT set.How to reproduce.
Run two Dragonfly instances, both with recommended
--cluster_mode=emulated --lock_on_hashtags
.Instance A) runs with
--default_lua_flags=allow-undeclared-keys
Instance B) runs with just the bullmq recommended
Create a
flowProducer
with a parent job withchildrens
(in my case, the parent job belongs to a different queue than the childs).On instance A), the child jobs are added and processed.
On instance B) Just the parent is created, no childs are created.
Relevant log output
Code of Conduct
The text was updated successfully, but these errors were encountered: