Feature request: documentation for worker implementations in other languages

[tcwalther]

It would be fantastic if a documentation page existed that explained exactly the steps that a third-party library would have to implement to produce a compatible worker.

Use Case

Most ML or scientific code is written in Python. It would be phenomenal if I could trigger Python jobs using SolidQueue in Rails. The Python library would only need to implement a small subset of SolidQueue, enough to pick up a job and process it.

[pyrat]

+1 for this. @tcwalther I would be keen to collaborate on writing a Python worker implementation.

[rosa]

Hey @tcwalther, @pyrat, sorry for the delay commenting here! I wasn't sure about what exactly you'd need from here because Solid Queue works and conforms to Active Job, so it sounds like you're asking about writing a queue system compatible with Active Job?

[tcwalther]

Hi Rosa,

My understanding is that ActiveJob specifies the high-level Ruby interface, whereas every queue implementation manages its own internal structure.

When using other languages than Ruby, one obviously cannot use ActiveJob. Instead, I'd need to tie directly into the underlying implementation.