new doc

Author: digoal

202403/20240323_01.md

@@ -0,0 +1,56 @@
+## 好消息, Mac Studio 可以跑马斯克开源的 Grok-1 开源大语言模型   
+                                                                                
+### 作者                                                                                
+digoal                                                                                
+                                                                                
+### 日期                                                                                
+2024-03-23                                                                         
+                                                                                
+### 标签                                                                                
+PostgreSQL , PolarDB , DuckDB , Grok-1 , llama , Mac Studio                  
+                                                                                
+----                                                                                
+                                                                                
+## 背景     
+  
+好消息, Mac Studio 可以跑马斯克开源的 Grok-1 开源大语言模型  
+  
+机器: Mac Studio with an M2 Ultra and 192GB of unified ram.  
+  
+Mac Studio 会不会卖疯了?   
+  
+参考:  https://github.com/ggerganov/llama.cpp/pull/6204    
+  
+Best Mac For Large Language Models, 这里还对比了x86+GPU vs Mac Studio的各种跑大语言模型的指标:  https://www.hardware-corner.net/guides/mac-for-large-language-models/  
+  
+https://github.com/ggerganov/llama.cpp/discussions/3026    
+  
+128 GB M2 Ultra (60 core) 跑70b参数大语言模型性能:  Around 5 tok/s. Definitely fast enough for interactive use. (How fast did it run for you? If the 70B LLaMA 2 model was 8t/s I can't imagine the 180B Falcon model being very usable.)    
+  
+In my opinion, the Apple M-series is definitely the best, most stable, quiet, and low-electricity LLM machine for testing LLM locally. Of course, it cannot be expanded as freely as nvidia, but at least it is very stable for developers who use Mac as their main weapon.  
+  
+  
+  
+#### [期望 PostgreSQL|开源PolarDB 增加什么功能?](https://github.com/digoal/blog/issues/76 "269ac3d1c492e938c0191101c7238216")
+  
+  
+#### [PolarDB 开源数据库](https://openpolardb.com/home "57258f76c37864c6e6d23383d05714ea")
+  
+  
+#### [PolarDB 学习图谱](https://www.aliyun.com/database/openpolardb/activity "8642f60e04ed0c814bf9cb9677976bd4")
+  
+  
+#### [购买PolarDB云服务折扣活动进行中, 55元起](https://www.aliyun.com/activity/new/polardb-yunparter?userCode=bsb3t4al "e0495c413bedacabb75ff1e880be465a")
+  
+  
+#### [PostgreSQL 解决方案集合](../201706/20170601_02.md "40cff096e9ed7122c512b35d8561d9c8")
+  
+  
+#### [德哥 / digoal's Github - 公益是一辈子的事.](https://github.com/digoal/blog/blob/master/README.md "22709685feb7cab07d30f30387f0a9ae")
+  
+  
+#### [About 德哥](https://github.com/digoal/blog/blob/master/me/readme.md "a37735981e7704886ffd590565582dd0")
+  
+  
+![digoal's wechat](../pic/digoal_weixin.jpg "f7ad92eeba24523fd47a6e1a0e691b59")
+  

202403/readme.md

@@ -2,6 +2,7 @@
 
 ### 文章列表  
 ----  
+##### 20240323_01.md   [《好消息, Mac Studio 可以跑马斯克开源的 Grok-1 开源大语言模型》](20240323_01.md)  
 ##### 20240319_02.md   [《PostgreSQL 17 preview - 增加uuid功能函数: 提取UUID值里面的时间戳 和 生成UUID值的函数版本》](20240319_02.md)  
 ##### 20240319_01.md   [《PostgreSQL neon(开源替代AWS Aurora存算分离PG数据库) 编译和使用测试》](20240319_01.md)  
 ##### 20240318_02.md   [《PostgreSQL 17 preview - Add RETURNING support to MERGE》](20240318_02.md)  

README.md

@@ -98,6 +98,7 @@ digoal's|PostgreSQL|文章|归类
 
 ### 所有文档如下  
 ----  
+##### 202403/20240323_01.md   [《好消息, Mac Studio 可以跑马斯克开源的 Grok-1 开源大语言模型》](202403/20240323_01.md)  
 ##### 202403/20240319_02.md   [《PostgreSQL 17 preview - 增加uuid功能函数: 提取UUID值里面的时间戳 和 生成UUID值的函数版本》](202403/20240319_02.md)  
 ##### 202403/20240319_01.md   [《PostgreSQL neon(开源替代AWS Aurora存算分离PG数据库) 编译和使用测试》](202403/20240319_01.md)  
 ##### 202403/20240318_02.md   [《PostgreSQL 17 preview - Add RETURNING support to MERGE》](202403/20240318_02.md)