Skip to content

@octoml OctoAI

Change the repository type filter

All

    Repositories list

    100 repositories

    • fern-config

      Public
      Configuration for generating SDKs and Documentation.
      markdownopenapisdk-generatordocumentation-generatorbuilt-with-fern
      MDX
      •4•3•0•7•Updated Oct 7, 2024Oct 7, 2024

    • homebrew-tap

      Public
      Homebrew Tap of OctoML products and tools.
      Ruby
      •
      Apache License 2.0
      •0•0•0•0•Updated Sep 26, 2024Sep 26, 2024

    • EAGLE

      Public
      OctoML Implementation of EAGLE-1 and EAGLE-2
      Python
      •
      Apache License 2.0
      •91•1•0•0•Updated Sep 12, 2024Sep 12, 2024

    • octoai-solutions

      Public
      A collection of reference solutions built on top of OctoAI SaaS
      Python
      •
      MIT License
      •0•0•0•0•Updated Sep 11, 2024Sep 11, 2024

    • octoai-textgen-cookbook

      Public
      Simple getting-started code examples for LLM applications powered by OctoAI
      Python
      •
      MIT License
      •16•43•1•0•Updated Sep 10, 2024Sep 10, 2024

    • mlc-llm

      Public
      Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.
      Python
      •
      Apache License 2.0
      •1.6k•5•12•1•Updated Sep 10, 2024Sep 10, 2024

    • flashinfer

      Public
      FlashInfer: Kernel Library for LLM Serving
      Cuda
      •
      Apache License 2.0
      •161•2•0•0•Updated Sep 9, 2024Sep 9, 2024

    • sagemaker-examples

      Public
      Jupyter Notebook
      •0•0•0•0•Updated Sep 8, 2024Sep 8, 2024

    • multicloud-asset-code-review-example

      Public
      Multicloud Asset Code Review Public Repo example.
      Python
      •
      MIT License
      •0•0•0•1•Updated Sep 5, 2024Sep 5, 2024

    • llama-recipes

      Public
      Examples and recipes for Llama 2 model
      Jupyter Notebook
      •2.3k•1•0•0•Updated Sep 3, 2024Sep 3, 2024

    • unstructured

      Public
      Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
      HTML
      •
      Apache License 2.0
      •804•0•0•1•Updated Aug 21, 2024Aug 21, 2024

    • msi-fe

      Public
      Python
      •0•0•0•0•Updated Aug 14, 2024Aug 14, 2024

    • lm-evaluation-harness

      Public
      A framework for few-shot evaluation of autoregressive language models.
      Python
      •
      MIT License
      •2k•0•0•0•Updated Aug 12, 2024Aug 12, 2024

    • .github

      Public
      0•1•0•1•Updated Aug 2, 2024Aug 2, 2024

    • octo-bots-mirror

      Public
      Python
      •0•0•0•0•Updated Jul 31, 2024Jul 31, 2024

    • RULER

      Public
      This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?
      Python
      •
      Apache License 2.0
      •53•0•0•0•Updated Jul 25, 2024Jul 25, 2024

    • photobooth-bg-gen

      Public
      TypeScript
      •0•0•0•0•Updated Jun 21, 2024Jun 21, 2024

    • langchain

      Public
      ⚡ Building applications with LLMs through composability ⚡
      Python
      •
      MIT License
      •16k•0•0•0•Updated May 17, 2024May 17, 2024

    • macho-dyld

      Public
      Custom dyld version inherited from original Apple dyld implementation
      C++
      •
      Other
      •1•11•0•0•Updated Apr 27, 2024Apr 27, 2024

    • demo-design-system

      Public
      TypeScript
      •0•0•0•0•Updated Mar 8, 2024Mar 8, 2024

    • octoai-apps

      Public
      A collection of OctoAI-based demos.
      TypeScript
      •0•5•1•1•Updated Mar 5, 2024Mar 5, 2024

    • tflint-ruleset-google

      Public
      TFLint ruleset for terraform-provider-google
      Go
      •
      Mozilla Public License 2.0
      •19•0•0•0•Updated Feb 23, 2024Feb 23, 2024

    • docker_auth

      Public
      Authentication server for Docker Registry 2
      Go
      •
      Apache License 2.0
      •305•0•0•0•Updated Feb 5, 2024Feb 5, 2024

    • go-jose

      Public
      An implementation of JOSE standards (JWE, JWS, JWT) in Go
      Go
      •
      Apache License 2.0
      •79•0•0•0•Updated Feb 5, 2024Feb 5, 2024

    • pinecone-rag-demo

      Public
      Pinecone + Vercel RAG application, showcasing a comparison between chat with no context and using a Pinecone index for context
      HTML
      •21•0•0•0•Updated Jan 25, 2024Jan 25, 2024

    • octoai-model-examples

      Public
      A set of models you can build and deploy on octoai
      Python
      •
      MIT License
      •0•0•0•0•Updated Jan 19, 2024Jan 19, 2024

    • pre-commit-kustomize

      Public
      pre-commit hook which runs kustomize docker image (use with https://github.com/pre-commit/pre-commit)
      Dockerfile
      •18•1•0•0•Updated Jan 4, 2024Jan 4, 2024

    • TensorRT-LLM-release

      Public
      TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
      C++
      •
      Apache License 2.0
      •1k•0•0•0•Updated Jan 3, 2024Jan 3, 2024

    • go-oidc

      Public
      A Go OpenID Connect client.
      Go
      •
      Apache License 2.0
      •400•0•0•0•Updated Dec 27, 2023Dec 27, 2023

    • vllm-project

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •5k•0•0•0•Updated Dec 14, 2023Dec 14, 2023