Skip to content
View Brokttv's full-sized avatar
5 followers · 2 following

Block or report Brokttv

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don't include any personal information such as legal names or email addresses. Markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Brokttv/README.md

I'm Adam. If you don't know who I am, then my work is still at least one order of magnitude away from echoing my name --- which soon it will:)

Pinned Loading

  1. Vit-on-small-data Vit-on-small-data Public

    The Lightest Vision Transformer (ViT) trained from scratch out there to achieve 93.37 ± 0.07%” top-1 accuracy on CIFAR-10 within just 50 epochs.

    Python 4

  2. training_models_from_scratch training_models_from_scratch Public

    Training tiny models from scratch using NumPy in code and linear algebra on a piece of paper.

    Python 11

  3. optimizers-from-scratch optimizers-from-scratch Public

    training models with different optimizers using NumPy only. Featuring SGD, Adam, Adagrad, NAG, RMSProp, and Momentum. This repo also includes a benchmark against Pytorch developed optims.

    Jupyter Notebook 11 1

  4. BatchNorm-Interactive-Playground BatchNorm-Interactive-Playground Public

    Interactive visualization simulating how Gamma and Beta control ICS (Internal Covariate Shift) for faster convergence in BatchNorm.

    5

  5. COCO-CONVERTER COCO-CONVERTER Public

    A CLI that converts CSV files and folders with image data to a JSON file with COCO annotations and builds a custom dataset off of it ready to train with pytorch.

    Python 5

  6. Transformer-from-scratch Transformer-from-scratch Public

    elaborate transformer implementation + detailed explanation

    Python 1