Prepare Data

Download the data sets for DeepOBS and preprocess them so they are ready to be used with DeepOBS.

Note

Currently there is no data downloading and preprocessing mechanic implemented for ImageNet. Downloading the ImageNet data set requires an account and can take a lot of time to download. Additonally, it requires quite a large amount of memory. The best way currently is to download and preprocess the ImageNet data set separately if needed and move it into the DeepOBS data folder.

usage: deepobs_prepare_data.sh [--data_dir=DIR] [--skip SKIP] [--only ONLY]

Named Arguments

-d --data_dir	Path where the data sets should be saved. Defaults to the current folder.
-s --skip	Defines which data sets should be skipped. Argument needs to be one of the following mnist, fmnist, cifar10, cifar100, svhn, imagenet, tolstoi. You can use the --skip argument multiple times.
-o --only	Specify if only a single data set should be downloaded. Argument needs to be one of the following mnist, fmnist, cifar10, cifar100, svhn, imagenet, tolstoi. This overwrites the --skip argument and should can only be used once.