Skip to content

FP8 Compressed KV cache #3943

FP8 Compressed KV cache

FP8 Compressed KV cache #3943

Triggered via pull request October 13, 2024 01:08
Status Failure
Total duration 2m 42s
Artifacts

ci.yml

on: pull_request
Matrix: Check
Matrix: Test Suite
Fit to window
Zoom out
Zoom in

Annotations

57 errors and 52 warnings
Check (macOS-latest, stable): mistralrs-core/src/models/gemma.rs#L582
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (macOS-latest, stable): mistralrs-core/src/models/gemma2.rs#L645
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (macOS-latest, stable): mistralrs-core/src/models/llama.rs#L435
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (macOS-latest, stable): mistralrs-core/src/models/mistral.rs#L625
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (macOS-latest, stable): mistralrs-core/src/models/mixtral.rs#L632
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (macOS-latest, stable): mistralrs-core/src/models/phi2.rs#L558
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (macOS-latest, stable): mistralrs-core/src/models/phi3.rs#L566
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (macOS-latest, stable): mistralrs-core/src/models/phi3_5_moe.rs#L685
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (macOS-latest, stable): mistralrs-core/src/models/quantized_llama.rs#L678
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (macOS-latest, stable): mistralrs-core/src/models/quantized_phi2.rs#L363
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (ubuntu-latest, stable)
The job was canceled because "macOS-latest_stable" failed.
Check (ubuntu-latest, stable): mistralrs-core/src/models/gemma.rs#L582
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (ubuntu-latest, stable): mistralrs-core/src/models/gemma2.rs#L645
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (ubuntu-latest, stable): mistralrs-core/src/models/llama.rs#L435
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (ubuntu-latest, stable): mistralrs-core/src/models/mistral.rs#L625
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (ubuntu-latest, stable): mistralrs-core/src/models/mixtral.rs#L632
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (ubuntu-latest, stable): mistralrs-core/src/models/phi2.rs#L558
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (ubuntu-latest, stable): mistralrs-core/src/models/phi3.rs#L566
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (ubuntu-latest, stable): mistralrs-core/src/models/phi3_5_moe.rs#L685
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (ubuntu-latest, stable): mistralrs-core/src/models/quantized_llama.rs#L678
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (ubuntu-latest, stable): mistralrs-core/src/models/quantized_phi2.rs#L363
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Check (windows-latest, stable)
The job was canceled because "macOS-latest_stable" failed.
Check (windows-latest, stable)
The operation was canceled.
Clippy: mistralrs-core/src/models/gemma.rs#L582
no method named `clone` found for struct `dummy_paged_attention::cache_engine::PagedAttentionKVCache` in the current scope
Clippy: mistralrs-core/src/models/gemma2.rs#L645
no method named `clone` found for struct `dummy_paged_attention::cache_engine::PagedAttentionKVCache` in the current scope
Clippy: mistralrs-core/src/models/llama.rs#L435
no method named `clone` found for struct `dummy_paged_attention::cache_engine::PagedAttentionKVCache` in the current scope
Clippy: mistralrs-core/src/models/mistral.rs#L625
no method named `clone` found for struct `dummy_paged_attention::cache_engine::PagedAttentionKVCache` in the current scope
Clippy: mistralrs-core/src/models/mixtral.rs#L632
no method named `clone` found for struct `dummy_paged_attention::cache_engine::PagedAttentionKVCache` in the current scope
Clippy: mistralrs-core/src/models/phi2.rs#L558
no method named `clone` found for struct `dummy_paged_attention::cache_engine::PagedAttentionKVCache` in the current scope
Clippy: mistralrs-core/src/models/phi3.rs#L566
no method named `clone` found for struct `dummy_paged_attention::cache_engine::PagedAttentionKVCache` in the current scope
Clippy: mistralrs-core/src/models/phi3_5_moe.rs#L685
no method named `clone` found for struct `dummy_paged_attention::cache_engine::PagedAttentionKVCache` in the current scope
Clippy: mistralrs-core/src/models/quantized_llama.rs#L678
no method named `clone` found for struct `dummy_paged_attention::cache_engine::PagedAttentionKVCache` in the current scope
Clippy: mistralrs-core/src/models/quantized_phi2.rs#L363
no method named `clone` found for struct `dummy_paged_attention::cache_engine::PagedAttentionKVCache` in the current scope
Test Suite (macOS-latest, stable): mistralrs-core/src/models/gemma.rs#L582
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Test Suite (macOS-latest, stable): mistralrs-core/src/models/gemma2.rs#L645
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Test Suite (macOS-latest, stable): mistralrs-core/src/models/llama.rs#L435
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Test Suite (macOS-latest, stable): mistralrs-core/src/models/mistral.rs#L625
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Test Suite (macOS-latest, stable): mistralrs-core/src/models/mixtral.rs#L632
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Test Suite (macOS-latest, stable): mistralrs-core/src/models/phi2.rs#L558
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Test Suite (macOS-latest, stable): mistralrs-core/src/models/phi3.rs#L566
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Test Suite (macOS-latest, stable): mistralrs-core/src/models/phi3_5_moe.rs#L685
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Test Suite (macOS-latest, stable): mistralrs-core/src/models/quantized_llama.rs#L678
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Test Suite (macOS-latest, stable): mistralrs-core/src/models/quantized_phi2.rs#L363
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Test Suite (windows-latest, stable)
The job was canceled because "macOS-latest_stable" failed.
Test Suite (windows-latest, stable)
The operation was canceled.
Test Suite (ubuntu-latest, stable)
The job was canceled because "macOS-latest_stable" failed.
Test Suite (ubuntu-latest, stable)
The operation was canceled.
Docs: mistralrs-core/src/models/gemma.rs#L582
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Docs: mistralrs-core/src/models/gemma2.rs#L645
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Docs: mistralrs-core/src/models/llama.rs#L435
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Docs: mistralrs-core/src/models/mistral.rs#L625
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Docs: mistralrs-core/src/models/mixtral.rs#L632
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Docs: mistralrs-core/src/models/phi2.rs#L558
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Docs: mistralrs-core/src/models/phi3.rs#L566
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Docs: mistralrs-core/src/models/phi3_5_moe.rs#L685
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Docs: mistralrs-core/src/models/quantized_llama.rs#L678
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Docs: mistralrs-core/src/models/quantized_phi2.rs#L363
no method named `clone` found for struct `PagedAttentionKVCache` in the current scope
Typos
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Typos
The following actions use a deprecated Node.js version and will be forced to run on node20: actions-rs/toolchain@v1. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Typos
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Typos
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Typos
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Typos
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Rustfmt
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Rustfmt
The following actions use a deprecated Node.js version and will be forced to run on node20: actions-rs/toolchain@v1, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Rustfmt
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Rustfmt
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Rustfmt
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Rustfmt
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (macOS-latest, stable)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Check (macOS-latest, stable)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions-rs/toolchain@v1, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Check (macOS-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (macOS-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (macOS-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (macOS-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (ubuntu-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (ubuntu-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (ubuntu-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (ubuntu-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (windows-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (windows-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (windows-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check (windows-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Clippy
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Clippy
The following actions use a deprecated Node.js version and will be forced to run on node20: actions-rs/toolchain@v1, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Clippy
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Clippy
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Clippy
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Clippy
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (macOS-latest, stable)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Test Suite (macOS-latest, stable)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions-rs/toolchain@v1, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Test Suite (macOS-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (macOS-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (macOS-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (macOS-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (windows-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (windows-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (windows-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (windows-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (ubuntu-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (ubuntu-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (ubuntu-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Test Suite (ubuntu-latest, stable)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Docs
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Docs
The following actions use a deprecated Node.js version and will be forced to run on node20: actions-rs/toolchain@v1, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Docs
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Docs
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Docs
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Docs
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/