Operations · Intermediate
Scaffolding and testing modular data pipelines
Turn raw analysis scripts into modular data pipelines with automated dependency checks and tests
- When you askReceive pipeline code
- ThenRun tests and dependency checks
- ResultDraft modular pull request
Restructure exploratory analysis scripts and notebooks into maintainable, modular pipeline nodes. Validate input-output data catalogs, verify task dependency resolution, run test suites, and package pipelines for deployment across distributed execution environments.
Prompt to start with
BotBentoRecommended
Inspect newly submitted data processing scripts or pipeline configurations. Map dataset dependencies, verify graph integrity, and execute linting and test suites via the terminal. When refactoring is complete, prepare the modular code and catalog definitions, but always wait for user approval before creating pull requests, merging changes, or sending notifications.