获取到文章列表为空，不知何故

[seadropx]

测试了一下，走到第二步，要抓取第1页文章列表的时候不知为何失败了。不知现在这方法是否已经失效。下面是app log：

2025-08-01 21:12:58,781 - ERROR - 发生异常: ProxyError: HTTPSConnectionPool(host='mp.weixin.qq.com', port=443): Max retries exceeded with url: /mp/profile_ext?action=getmsg&__biz=MzA3MDE1MjcwNg==&f=json&offset=0&count=10&is_ok=1&scene=124&uin=MTQ5NTI2MjUxOA%3D%3D&key=daf9bdc5abc4e8d07a7873b82799ea0f77bf5ad00ab703d8a4a66e7108fd4085f89ef1b654c7d7e0eb8df1925b8e69827260c92c8eea348395523b7ee55da9abff7e205843ffe9571ee1925560ce5632187a8e953ead14d2df869f116c959fd16197ac0340816c73077896ba1332ed74734bf85315ec02f62313c8fe7d6cdb79&pass_ticket=cg3CjkabzJ%2BEYiei%2FGC%2BoN7cC1AHUZFCVASxyKVa2XK7I4pkhGfgS0%2FsaGB4PlA4&wxtoken=&appmsg_token=&x5=0&f=json (Caused by ProxyError('Unable to connect to proxy', ReadTimeoutError("HTTPSConnectionPool(host='mp.weixin.qq.com', port=443): Read timed out. (read timeout=10)")))
Traceback (most recent call last):
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\access_wechat\lib\site-packages\urllib3\connectionpool.py", line 773, in urlopen
self._prepare_proxy(conn)
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\access_wechat\lib\site-packages\urllib3\connectionpool.py", line 1042, in _prepare_proxy
conn.connect()
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\access_wechat\lib\site-packages\urllib3\connection.py", line 713, in connect
self.sock = sock = self._connect_tls_proxy(self.host, sock)
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\access_wechat\lib\site-packages\urllib3\connection.py", line 813, in _connect_tls_proxy
sock_and_verified = _ssl_wrap_socket_and_match_hostname(
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\access_wechat\lib\site-packages\urllib3\connection.py", line 920, in ssl_wrap_socket_and_match_hostname
ssl_sock = ssl_wrap_socket(
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\access_wechat\lib\site-packages\urllib3\util\ssl.py", line 460, in ssl_wrap_socket
ssl_sock = ssl_wrap_socket_impl(sock, context, tls_in_tls, server_hostname)
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\access_wechat\lib\site-packages\urllib3\util\ssl.py", line 504, in _ssl_wrap_socket_impl
return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
File "D:\Tools\Basics\python\lib\ssl.py", line 512, in wrap_socket
return self.sslsocket_class._create(
File "D:\Tools\Basics\python\lib\ssl.py", line 1070, in _create
self.do_handshake()
File "D:\Tools\Basics\python\lib\ssl.py", line 1341, in do_handshake
self._sslobj.do_handshake()
TimeoutError: _ssl.c:980: The handshake operation timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\access_wechat\lib\site-packages\urllib3\connectionpool.py", line 775, in urlopen
self._raise_timeout(
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\access_wechat\lib\site-packages\urllib3\connectionpool.py", line 367, in _raise_timeout
raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='mp.weixin.qq.com', port=443): Read timed out. (read timeout=10)

The above exception was the direct cause of the following exception:

urllib3.exceptions.ProxyError: ('Unable to connect to proxy', ReadTimeoutError("HTTPSConnectionPool(host='mp.weixin.qq.com', port=443): Read timed out. (read timeout=10)"))

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\access_wechat\lib\site-packages\requests\adapters.py", line 667, in send
resp = conn.urlopen(
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\access_wechat\lib\site-packages\urllib3\connectionpool.py", line 841, in urlopen
retries = retries.increment(
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\access_wechat\lib\site-packages\urllib3\util\retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='mp.weixin.qq.com', port=443): Max retries exceeded with url: /mp/profile_ext?action=getmsg&__biz=MzA3MDE1MjcwNg==&f=json&offset=0&count=10&is_ok=1&scene=124&uin=MTQ5NTI2MjUxOA%3D%3D&key=daf9bdc5abc4e8d07a7873b82799ea0f77bf5ad00ab703d8a4a66e7108fd4085f89ef1b654c7d7e0eb8df1925b8e69827260c92c8eea348395523b7ee55da9abff7e205843ffe9571ee1925560ce5632187a8e953ead14d2df869f116c959fd16197ac0340816c73077896ba1332ed74734bf85315ec02f62313c8fe7d6cdb79&pass_ticket=cg3CjkabzJ%2BEYiei%2FGC%2BoN7cC1AHUZFCVASxyKVa2XK7I4pkhGfgS0%2FsaGB4PlA4&wxtoken=&appmsg_token=&x5=0&f=json (Caused by ProxyError('Unable to connect to proxy', ReadTimeoutError("HTTPSConnectionPool(host='mp.weixin.qq.com', port=443): Read timed out. (read timeout=10)")))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\Access_articles.py", line 416, in get_next_list
res = requests.get(url=url, headers=self.headers, timeout=10, verify=False)
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\access_wechat\lib\site-packages\requests\api.py", line 73, in get
return request("get", url, params=params, **kwargs)
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\access_wechat\lib\site-packages\requests\api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\access_wechat\lib\site-packages\requests\sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\access_wechat\lib\site-packages\requests\sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\access_wechat\lib\site-packages\requests\adapters.py", line 694, in send
raise ProxyError(e, request=request)
requests.exceptions.ProxyError: HTTPSConnectionPool(host='mp.weixin.qq.com', port=443): Max retries exceeded with url: /mp/profile_ext?action=getmsg&__biz=MzA3MDE1MjcwNg==&f=json&offset=0&count=10&is_ok=1&scene=124&uin=MTQ5NTI2MjUxOA%3D%3D&key=daf9bdc5abc4e8d07a7873b82799ea0f77bf5ad00ab703d8a4a66e7108fd4085f89ef1b654c7d7e0eb8df1925b8e69827260c92c8eea348395523b7ee55da9abff7e205843ffe9571ee1925560ce5632187a8e953ead14d2df869f116c959fd16197ac0340816c73077896ba1332ed74734bf85315ec02f62313c8fe7d6cdb79&pass_ticket=cg3CjkabzJ%2BEYiei%2FGC%2BoN7cC1AHUZFCVASxyKVa2XK7I4pkhGfgS0%2FsaGB4PlA4&wxtoken=&appmsg_token=&x5=0&f=json (Caused by ProxyError('Unable to connect to proxy', ReadTimeoutError("HTTPSConnectionPool(host='mp.weixin.qq.com', port=443): Read timed out. (read timeout=10)")))
2025-08-01 21:32:33,669 - ERROR - 发生异常: ProxyError: HTTPSConnectionPool(host='mp.weixin.qq.com', port=443): Max retries exceeded with url: /mp/profile_ext?action=getmsg&__biz=MzA3MDE1MjcwNg==&f=json&offset=0&count=10&is_ok=1&scene=124&uin=MTQ5NTI2MjUxOA%3D%3D&key=daf9bdc5abc4e8d03e12ecf3a8c8bd982f27e2c1cd7f92470c65ff70319c0ad24e47a9100150e7d02c37f2c68a2478b483cf7edd1336acc7e03c2be01ec8cae87d502d3009fd410148c16b2f6de83ea7ed791a52fac287149e57250bb4123d9de53a71c24137ac7f9f2d24c4ec570b60fa5a6e0d0f475069e068ff18f48190ed&pass_ticket=dv%2Br5VNElPwu%2F96qUMIymeWgXaP1wIj1%2BdYOzHVy96pvUTMGhskMhhvhDTRpBzxB&wxtoken=&appmsg_token=&x5=0&f=json (Caused by ProxyError('Unable to connect to proxy', ReadTimeoutError("HTTPSConnectionPool(host='mp.weixin.qq.com', port=443): Read timed out. (read timeout=10)")))
Traceback (most recent call last):
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\venv\lib\site-packages\urllib3\connectionpool.py", line 773, in urlopen
self._prepare_proxy(conn)
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\venv\lib\site-packages\urllib3\connectionpool.py", line 1042, in _prepare_proxy
conn.connect()
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\venv\lib\site-packages\urllib3\connection.py", line 713, in connect
self.sock = sock = self._connect_tls_proxy(self.host, sock)
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\venv\lib\site-packages\urllib3\connection.py", line 813, in _connect_tls_proxy
sock_and_verified = _ssl_wrap_socket_and_match_hostname(
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\venv\lib\site-packages\urllib3\connection.py", line 920, in ssl_wrap_socket_and_match_hostname
ssl_sock = ssl_wrap_socket(
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\venv\lib\site-packages\urllib3\util\ssl.py", line 460, in ssl_wrap_socket
ssl_sock = ssl_wrap_socket_impl(sock, context, tls_in_tls, server_hostname)
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\venv\lib\site-packages\urllib3\util\ssl.py", line 504, in _ssl_wrap_socket_impl
return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
File "D:\Tools\Basics\python\lib\ssl.py", line 512, in wrap_socket
return self.sslsocket_class._create(
File "D:\Tools\Basics\python\lib\ssl.py", line 1070, in _create
self.do_handshake()
File "D:\Tools\Basics\python\lib\ssl.py", line 1341, in do_handshake
self._sslobj.do_handshake()
TimeoutError: _ssl.c:980: The handshake operation timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\venv\lib\site-packages\urllib3\connectionpool.py", line 775, in urlopen
self._raise_timeout(
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\venv\lib\site-packages\urllib3\connectionpool.py", line 367, in _raise_timeout
raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='mp.weixin.qq.com', port=443): Read timed out. (read timeout=10)

The above exception was the direct cause of the following exception:

urllib3.exceptions.ProxyError: ('Unable to connect to proxy', ReadTimeoutError("HTTPSConnectionPool(host='mp.weixin.qq.com', port=443): Read timed out. (read timeout=10)"))

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\venv\lib\site-packages\requests\adapters.py", line 667, in send
resp = conn.urlopen(
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\venv\lib\site-packages\urllib3\connectionpool.py", line 841, in urlopen
retries = retries.increment(
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\venv\lib\site-packages\urllib3\util\retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='mp.weixin.qq.com', port=443): Max retries exceeded with url: /mp/profile_ext?action=getmsg&__biz=MzA3MDE1MjcwNg==&f=json&offset=0&count=10&is_ok=1&scene=124&uin=MTQ5NTI2MjUxOA%3D%3D&key=daf9bdc5abc4e8d03e12ecf3a8c8bd982f27e2c1cd7f92470c65ff70319c0ad24e47a9100150e7d02c37f2c68a2478b483cf7edd1336acc7e03c2be01ec8cae87d502d3009fd410148c16b2f6de83ea7ed791a52fac287149e57250bb4123d9de53a71c24137ac7f9f2d24c4ec570b60fa5a6e0d0f475069e068ff18f48190ed&pass_ticket=dv%2Br5VNElPwu%2F96qUMIymeWgXaP1wIj1%2BdYOzHVy96pvUTMGhskMhhvhDTRpBzxB&wxtoken=&appmsg_token=&x5=0&f=json (Caused by ProxyError('Unable to connect to proxy', ReadTimeoutError("HTTPSConnectionPool(host='mp.weixin.qq.com', port=443): Read timed out. (read timeout=10)")))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\Access_articles.py", line 416, in get_next_list
res = requests.get(url=url, headers=self.headers, timeout=10, verify=False)
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\venv\lib\site-packages\requests\api.py", line 73, in get
return request("get", url, params=params, **kwargs)
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\venv\lib\site-packages\requests\api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\venv\lib\site-packages\requests\sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\venv\lib\site-packages\requests\sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "C:\Users\DELL\Downloads\Access_wechat_article-1.0.2\venv\lib\site-packages\requests\adapters.py", line 694, in send
raise ProxyError(e, request=request)
requests.exceptions.ProxyError: HTTPSConnectionPool(host='mp.weixin.qq.com', port=443): Max retries exceeded with url: /mp/profile_ext?action=getmsg&__biz=MzA3MDE1MjcwNg==&f=json&offset=0&count=10&is_ok=1&scene=124&uin=MTQ5NTI2MjUxOA%3D%3D&key=daf9bdc5abc4e8d03e12ecf3a8c8bd982f27e2c1cd7f92470c65ff70319c0ad24e47a9100150e7d02c37f2c68a2478b483cf7edd1336acc7e03c2be01ec8cae87d502d3009fd410148c16b2f6de83ea7ed791a52fac287149e57250bb4123d9de53a71c24137ac7f9f2d24c4ec570b60fa5a6e0d0f475069e068ff18f48190ed&pass_ticket=dv%2Br5VNElPwu%2F96qUMIymeWgXaP1wIj1%2BdYOzHVy96pvUTMGhskMhhvhDTRpBzxB&wxtoken=&appmsg_token=&x5=0&f=json (Caused by ProxyError('Unable to connect to proxy', ReadTimeoutError("HTTPSConnectionPool(host='mp.weixin.qq.com', port=443): Read timed out. (read timeout=10)")))

[yeximm]

当前问题已优化调整，请查看最新版本的releases

[seadropx]

当前问题已优化调整，请查看最新版本的releases

非常感谢优化和反馈！不过我下载了最新版本1.0.3后，测试后仍然无法保存，截图如下：

另外有个问题，如果能成功抓取的话，能否顺利实现自动抓取某公众号的比如说500篇内容？ 或者有个上限，最好不超过某个值或抓取页数？

[yeximm]

当前问题已优化调整，请查看最新版本的releases

非常感谢优化和反馈！不过我下载了最新版本1.0.3后，测试后仍然无法保存，截图如下：

另外有个问题，如果能成功抓取的话，能否顺利实现自动抓取某公众号的比如说500篇内容？ 或者有个上限，最好不超过某个值或抓取页数？

我又测试了一遍，代码没有问题。
注意一下你的报错提示，发生位置是requests请求部分，你需要检查一下电脑的网络设置，网络代理是否关闭（fiddler设置不当也会对网络有影响）。
至于自动化抓取内容，主要数据来源依靠公众号的文章列表，一般以抓取到的列表页数为准，一页一般有15篇左右。
如果想对文章数量做限制，可以从获取页数的角度入手去修改代码，抓取文章总数 ≈ 文章列表页数 x 15
如果想抓取最新的500篇文章数据，即 15篇/页 x 34页 = 510篇
如果公众号下没有这么多篇文章，则有多少就抓取下来多少

[seadropx]

我又测试了一遍，代码没有问题。 注意一下你的报错提示，发生位置是requests请求部分，你需要检查一下电脑的网络设置，网络代理是否关闭（fiddler设置不当也会对网络有影响）。 至于自动化抓取内容，主要数据来源依靠公众号的文章列表，一般以抓取到的列表页数为准，一页一般有15篇左右。 如果想对文章数量做限制，可以从获取页数的角度入手去修改代码，抓取文章总数 ≈ 文章列表页数 x 15 如果想抓取最新的500篇文章数据，即 15篇/页 x 34页 = 510篇 如果公众号下没有这么多篇文章，则有多少就抓取下来多少

感谢这么及时的反馈和解释！

估计是我这边电脑网络配置或电脑环境有问题。不过作为技术小白，确定关闭了其他代理软件，而且fiddler能正常获取 “ https://mp.weixin.qq.com/mp/profile_ext?action=home…… ” 连接，仍没法解决报错中出现的跟请求https连接有关的问题，我只能暂且放弃了。

[yeximm]

我又测试了一遍，代码没有问题。 注意一下你的报错提示，发生位置是requests请求部分，你需要检查一下电脑的网络设置，网络代理是否关闭（fiddler设置不当也会对网络有影响）。 至于自动化抓取内容，主要数据来源依靠公众号的文章列表，一般以抓取到的列表页数为准，一页一般有15篇左右。 如果想对文章数量做限制，可以从获取页数的角度入手去修改代码，抓取文章总数 ≈ 文章列表页数 x 15 如果想抓取最新的500篇文章数据，即 15篇/页 x 34页 = 510篇 如果公众号下没有这么多篇文章，则有多少就抓取下来多少

感谢这么及时的反馈和解释！

估计是我这边电脑网络配置或电脑环境有问题。不过作为技术小白，确定关闭了其他代理软件，而且fiddler能正常获取 “ https://mp.weixin.qq.com/mp/profile_ext?action=home…… ” 连接，仍没法解决报错中出现的跟请求https连接有关的问题，我只能暂且放弃了。

参照你最近的截图，可以看到程序已经正常获取到了公众号下的文章列表，说明网络应该是没问题的。
后续报错的情况有一种可能，就是这个公众号最新的那篇文章有问题。
你可以在Access_articles.py中280行后添加print(new_url)，查看此链接是否能访问。

• 也可以试试其他公众号，看是否存在同类问题。

本项目是一个开源的项目，程序主要偏向应用实现层面，仅用于辅助记录微信公众号文章信息。
如果需要在本项目功能上再添加一些其他应用，可以改写main.py中的函数调用方式，以此实现所需要求。

[seadropx]

谢谢回复与建议。试了几个其他公众号，仍有同样问题。我最后尝试了其他替代方案，结果能爬取了：https://github.com/AriaMei/wechat_spider