Skip to content

Latest commit

 

History

History

grad_norm_exp

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 

grad_norms.py

Script for the gradient norms experiments. Script will train a model sequentially for 5 tasks, and calculate the gradients on the memory and test set after 1, 2 and 5 tasks. This is stored at ./results/[DATA]/grad_norms _[RANDOM_IDX].npy as a numpy array with dimensions (iters x 6). The first three elements are on the testset, the next three on the memory. Upon running the plot script, all files with random indices will be merged to the file grad_norms_merged.npy. This file contains all stored runs.

Note: uncomment the necessary lines in the plot line to obtain the desired plots.

Options:

  • --iter ITER : How many iterations should be done (same as running script multiple times)
  • --data DATA: Which dataset to use (mnist, cifar, min)