File tree 1 file changed +9
-4
lines changed
1 file changed +9
-4
lines changed Original file line number Diff line number Diff line change 1
- # llama.swiftui
1
+ # llama.cpp/examples/llama. swiftui
2
2
3
- Local inference of llama.cpp on an iPhone.
4
- So far I only tested with starcoder 1B model, but it can most likely handle 7B models as well .
3
+ Local inference of llama.cpp on an iPhone. This is a sample app that can be used as a starting
4
+ point for more advanced projects .
5
5
6
- https://github.com/bachittle/llama.cpp/assets/39804642/e290827a-4edb-4093-9642-2a5e399ec545
6
+ For usage instructions and performance stats, check the following discussion: https://github.com/ggerganov/llama.cpp/discussions/4508
7
+
8
+ ![ image] ( https://github.com/ggerganov/llama.cpp/assets/1991296/2b40284f-8421-47a2-b634-74eece09a299 )
7
9
10
+ Video demonstration:
11
+
12
+ https://github.com/bachittle/llama.cpp/assets/39804642/e290827a-4edb-4093-9642-2a5e399ec545
You can’t perform that action at this time.
0 commit comments