Replies: 2 comments 5 replies
-
@4h6h Have you looked into Hooks already? I think this is very relevant. |
Beta Was this translation helpful? Give feedback.
-
@noklam That was indeed a good hint, not necessarily I have left the actual datasets as they are. I then solved my particular use-case by programmatically extending the parameters intended for the function, which can be found in As far as I am concerned, this question has been answered. Thanks. |
Beta Was this translation helpful? Give feedback.
-
Kedro version: 0.18.2
Is there an easy way to derive the respective paths or filenames from catalog datasets?
Background:
I am using kedro to do some experiments with yolov5. Since yolov5 is a framework in itself with its own assumptions/conditions, sometimes you need the paths to the (in this case) images rather than the images themselves directly.
Example:
Yolov5 expects a file data.yaml containing the paths to the images for train/val/test. I create the content of this file in a node of one pipeline.
To get the paths to the respective folders of the datasets, I help myself by specifying the respective catalog entries in the configuration and using the following:
Of course, this is not optimal and has some pitfalls.
What I would like to have is something like:
However, as I understand it, this is not possible nowadays, because
images
itself is adict
of<bound method AbstractVersionedDataSet.load of <kedro.extras.datasets.pillow.image_dataset.ImageDataSet object at ...>>
.Beta Was this translation helpful? Give feedback.
All reactions