feat: generate taps and targets programatically

[peterclemenko]

Feature scope

Taps (catalog, state, tests, etc.)

Description

the ability to call meltano from python to make a skeleton tap or target would be very useful for generating taps and targets programmatically using an llm in an automated fashion.

[edgarrmondragon]

Hi @peterclemenko!

This is something I would definitely like to explore!

Do you have an example of a project that does something like this? Maybe a web app generator or similar?

Or perhaps you have an idea of what's needed, or what it would look like in practice?

[peterclemenko]

Not at the moment, I'm cooking something up it would be useful for in private, plan is to open it when ready. Currently in the process of making it work. The theory though is to take an output from an api or a command line app, run it through an llm, create a tap, test it, and if it works, use it instead of the llm for input processing. essentially this cuts the processing time per command execution on the llm, and frees compute for other workloads.