Skip to content

@HazyResearch HazyResearch

Change the repository type filter

All

    Repositories list

    116 repositories

    • ThunderKittens

      Public
      Tile primitives for speedy kernels
      Cuda
      •
      MIT License
      •75•1.7k•17•2•Updated Nov 27, 2024Nov 27, 2024

    • based

      Public
      Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"
      Python
      •
      Apache License 2.0
      •14•215•4•0•Updated Nov 21, 2024Nov 21, 2024

    • aioli

      Public
      Aioli: A unified optimization framework for language model data mixing
      Jupyter Notebook
      •
      Apache License 2.0
      •2•15•0•0•Updated Nov 12, 2024Nov 12, 2024

    • train-tk

      Public
      train with kittens!
      Python
      •6k•50•0•0•Updated Oct 25, 2024Oct 25, 2024

    • wonderbread

      Public
      WONDERBREAD benchmark + dataset for BPM tasks
      Jupyter Notebook
      •5•19•0•0•Updated Oct 20, 2024Oct 20, 2024

    • lolcats

      Public
      Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"
      Python
      •
      Apache License 2.0
      •19•185•5•1•Updated Oct 16, 2024Oct 16, 2024

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •4.7k•0•0•0•Updated Oct 14, 2024Oct 14, 2024

    • eclair-agents

      Public
      Automating enterprise workflows with multimodal agents
      Jupyter Notebook
      •
      Apache License 2.0
      •14•95•0•0•Updated Oct 9, 2024Oct 9, 2024

    • flash-fft-conv

      Public
      FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores
      C++
      •
      Apache License 2.0
      •27•281•16•3•Updated Oct 4, 2024Oct 4, 2024

    • legalbench

      Public
      An open science effort to benchmark legal reasoning in foundation models
      Python
      •49•357•8•4•Updated Aug 25, 2024Aug 25, 2024

    • hgcn

      Public
      Hyperbolic Graph Convolutional Networks in PyTorch.
      Python
      •109•602•18•3•Updated Jul 25, 2024Jul 25, 2024

    • manifest

      Public
      Prompt programming with FMs.
      Python
      •
      Apache License 2.0
      •46•440•5•2•Updated Jul 22, 2024Jul 22, 2024

    • prefix-linear-attention

      Public
      Python
      •1•45•0•0•Updated Jul 9, 2024Jul 9, 2024

    • hyena-dna

      Public
      Official implementation for HyenaDNA, a long-range genomic foundation model built with Hyena
      genomicslanguage-modelsfoundation-models
      Assembly
      •
      Apache License 2.0
      •82•603•29•6•Updated Jun 15, 2024Jun 15, 2024

    • safari

      Public
      Convolutions for Sequence Modeling
      Assembly
      •
      Apache License 2.0
      •71•869•23•1•Updated Jun 13, 2024Jun 13, 2024

    • based-evaluation-harness

      Public
      A framework for few-shot evaluation of language models.
      Python
      •
      MIT License
      •1.9k•8•0•0•Updated Jun 8, 2024Jun 8, 2024

    • olive-evaluation-harness

      Public
      A framework for few-shot evaluation of language models.
      Python
      •
      MIT License
      •1.9k•7•0•0•Updated Jun 3, 2024Jun 3, 2024

    • axolive

      Public
      Go ahead and axolotl questions
      Python
      •
      Apache License 2.0
      •884•0•0•0•Updated Jun 3, 2024Jun 3, 2024

    • olive-recipes

      Public
      Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.
      Jupyter Notebook
      •2.2k•0•0•0•Updated Jun 3, 2024Jun 3, 2024

    • hippo-code

      Public
      Python
      •
      Apache License 2.0
      •30•168•2•0•Updated May 27, 2024May 27, 2024

    • m2

      Public
      Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
      Assembly
      •
      Apache License 2.0
      •44•538•24•1•Updated May 20, 2024May 20, 2024

    • zoology

      Public
      Understand and test language model architectures on synthetic tasks.
      Python
      •
      Apache License 2.0
      •28•163•7•2•Updated May 1, 2024May 1, 2024

    • evaporate

      Public
      This repo contains data and code for the paper "Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakes"
      Python
      •46•483•10•2•Updated Mar 26, 2024Mar 26, 2024

    • meerkat

      Public
      Creative interactive views of any dataset.
      data-sciencemlpandasfoundation-modelsmachine-learning
      Python
      •
      Apache License 2.0
      •43•829•9•2•Updated Feb 25, 2024Feb 25, 2024

    • aisys-building-blocks

      Public
      Building blocks for foundation models.
      16•404•0•0•Updated Jan 3, 2024Jan 3, 2024

    • data-centric-ai

      Public
      Resources for Data Centric AI
      machine-learningaiartificial-intelligencedata-centric-ai
      TeX
      •
      Apache License 2.0
      •117•1.1k•6•6•Updated Dec 13, 2023Dec 13, 2023

    • skill-it

      Public
      Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
      Jupyter Notebook
      •
      Apache License 2.0
      •7•41•0•0•Updated Oct 31, 2023Oct 31, 2023

    • domino

      Public
      Python
      •
      Apache License 2.0
      •24•134•4•0•Updated Oct 30, 2023Oct 30, 2023

    • structured-nets

      Public
      Structured matrices for compressing neural networks
      Python
      •
      Apache License 2.0
      •21•67•5•1•Updated Oct 5, 2023Oct 5, 2023

    • butterfly

      Public
      Butterfly matrix multiplication in PyTorch
      Python
      •
      Apache License 2.0
      •31•164•16•3•Updated Oct 5, 2023Oct 5, 2023