yjj_crawl_log_20260130_155119.txt 19 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153
  1. [2026-01-30 15:51:20] [INFO ] [PID:28220] [main:1691]
  2. ==================================================
  3. [2026-01-30 15:51:20] [INFO ] [PID:28220] [main:1692] 🚀 药九九采集程序启动
  4. [2026-01-30 15:51:20] [INFO ] [PID:28220] [main:1693] ⏰ 启动时间:2026-01-30 15:51:20
  5. [2026-01-30 15:51:20] [INFO ] [PID:28220] [main:1694] ==================================================
  6. [2026-01-30 15:51:20] [INFO ] [PID:28220] [main:143] ✅ 已从yjj_cookies.json加载Cookie
  7. [2026-01-30 15:51:24] [INFO ] [PID:28220] [main:166] Cookie有效,已保持登录状态
  8. [2026-01-30 15:51:24] [INFO ] [PID:28220] [main:1787]
  9. =====================================
  10. [2026-01-30 15:51:24] [INFO ] [PID:28220] [main:1788] 🔍 开始处理第1/1个关键词:999 感冒灵颗粒
  11. [2026-01-30 15:51:24] [INFO ] [PID:28220] [main:1789] =====================================
  12. [2026-01-30 15:51:24] [INFO ] [PID:28220] [main:616] 杀除弹窗成功
  13. [2026-01-30 15:51:27] [INFO ] [PID:28220] [main:465] 📝 已输入搜索关键词:999 感冒灵颗粒
  14. [2026-01-30 15:51:28] [INFO ] [PID:28220] [main:478] ✅ 已触发搜索
  15. [2026-01-30 15:51:30] [INFO ] [PID:28220] [main:616] 杀除弹窗成功
  16. [2026-01-30 15:51:30] [INFO ] [PID:28220] [main:1157] 📊 开始采集「999 感冒灵颗粒」的商品数据
  17. [2026-01-30 15:51:30] [INFO ] [PID:28220] [main:1164]
  18. 📄 「999 感冒灵颗粒」开始采集第 1 页
  19. [2026-01-30 15:51:30] [INFO ] [PID:28220] [main:1168] 📌 已记录商品列表页URL:https://www.yyjzt.com/search?keyword=999%20%E6%84%9F%E5%86%92%E7%81%B5%E9%A2%97%E7%B2%92
  20. [2026-01-30 15:51:30] [INFO ] [PID:28220] [main:1173] 📌 「999 感冒灵颗粒」第1页 初始商品个数(count):60
  21. [2026-01-30 15:51:32] [INFO ] [PID:28220] [main:1197] 📌 「999 感冒灵颗粒」第1页 第1/60个商品 - 等待2.49秒后采集(反爬)
  22. [2026-01-30 15:51:32] [INFO ] [PID:28220] [main:1231] ==========「999 感冒灵颗粒」第1个商品 - 列表页标题:999 三九 华润三九 感冒灵颗粒 10g*9袋==========
  23. [2026-01-30 15:51:32] [INFO ] [PID:28220] [main:1253] ==========999 感冒灵颗粒」第1个商品 - 列表页采购价格:13.5==========
  24. [2026-01-30 15:51:32] [INFO ] [PID:28220] [main:1263] ==========「999 感冒灵颗粒」第1个商品 - 列表页公司名:惠州市九惠制药股份有限公司==========
  25. [2026-01-30 15:51:32] [INFO ] [PID:28220] [main:1274] ==========「999 感冒灵颗粒」第1个商品 - 列表页店名:湖北药九九==========
  26. [2026-01-30 15:51:32] [WARNING ] [PID:28220] [main:1293] 「999 感冒灵颗粒」第1个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」- 折扣价元素未找到,使用采购价兜底:13.5
  27. [2026-01-30 15:51:32] [INFO ] [PID:28220] [main:1300] 📌 「999 感冒灵颗粒」第1页 第1个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」- 模拟鼠标移动并点击
  28. [2026-01-30 15:51:39] [INFO ] [PID:28220] [main:1331] 📌 「999 感冒灵颗粒」第1页 第1个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」- 详情页加载完成,等待3.54秒(反爬)
  29. [2026-01-30 15:51:39] [INFO ] [PID:28220] [main:1344] ==========「999 感冒灵颗粒」第1个商品 - 详情页链接:https://www.yyjzt.com/goodDetail?ladderNum&itemStoreId=125005841&sourceProdetail=%2Fsearch&is_store=0==========
  30. [2026-01-30 15:51:39] [INFO ] [PID:28220] [main:1385] ==========「999 感冒灵颗粒」第1个商品 - 详情页有效期:20270331==========
  31. [2026-01-30 15:51:39] [INFO ] [PID:28220] [main:1398] ==========「999 感冒灵颗粒」第1个商品 - 详情页生产日期:20250409==========
  32. [2026-01-30 15:51:39] [INFO ] [PID:28220] [main:1408] ==========「999 感冒灵颗粒」第1个商品 - 详情页批准文号:国药准字Z44021940==========
  33. [2026-01-30 15:51:39] [INFO ] [PID:28220] [main:1419] ==========「999 感冒灵颗粒」第1个商品 - 详情页规格:10g*9袋==========
  34. [2026-01-30 15:51:39] [INFO ] [PID:28220] [main:1432] ==========「999 感冒灵颗粒」第1个商品 - 详情页规格:库存 27062盒==========
  35. [2026-01-30 15:51:39] [INFO ] [PID:28220] [main:1444] ==========「999 感冒灵颗粒」第1个商品 - 详情页销量:已拼1.9万+盒==========
  36. [2026-01-30 15:52:49] [INFO ] [PID:28220] [main:726] 【店铺存在校验】店铺已存在 | 店铺名:'湖北药九九' | 结果:存在(True)不要执行采集店铺
  37. [2026-01-30 15:52:49] [INFO ] [PID:28220] [main:1542] 数据库有该店名,在数据库拿取对应字段填充yjj_drug_middle表
  38. [2026-01-30 15:52:49] [INFO ] [PID:28220] [main:1560] 📌 「999 感冒灵颗粒」第1个商品 - 已关闭详情页标签页
  39. [2026-01-30 15:52:52] [INFO ] [PID:28220] [main:1567] 「999 感冒灵颗粒」第1个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」- 已切回列表页
  40. [2026-01-30 15:52:52] [INFO ] [PID:28220] [main:886] 单条数据插入成功:...
  41. [2026-01-30 15:52:52] [INFO ] [PID:28220] [main:1606] 「999 感冒灵颗粒」第1个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」采集完成
  42. [2026-01-30 15:52:54] [INFO ] [PID:28220] [main:1197] 📌 「999 感冒灵颗粒」第1页 第2/60个商品 - 等待2.30秒后采集(反爬)
  43. [2026-01-30 15:52:54] [INFO ] [PID:28220] [main:1231] ==========「999 感冒灵颗粒」第2个商品 - 列表页标题:999 三九 华润三九 感冒灵颗粒 10g*9袋==========
  44. [2026-01-30 15:52:54] [INFO ] [PID:28220] [main:1253] ==========999 感冒灵颗粒」第2个商品 - 列表页采购价格:13.35==========
  45. [2026-01-30 15:52:54] [INFO ] [PID:28220] [main:1263] ==========「999 感冒灵颗粒」第2个商品 - 列表页公司名:惠州市九惠制药股份有限公司==========
  46. [2026-01-30 15:52:54] [INFO ] [PID:28220] [main:1274] ==========「999 感冒灵颗粒」第2个商品 - 列表页店名:药品预约中心==========
  47. [2026-01-30 15:52:54] [WARNING ] [PID:28220] [main:1293] 「999 感冒灵颗粒」第2个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」- 折扣价元素未找到,使用采购价兜底:13.35
  48. [2026-01-30 15:52:54] [INFO ] [PID:28220] [main:1300] 📌 「999 感冒灵颗粒」第1页 第2个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」- 模拟鼠标移动并点击
  49. [2026-01-30 15:53:00] [INFO ] [PID:28220] [main:1331] 📌 「999 感冒灵颗粒」第1页 第2个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」- 详情页加载完成,等待2.92秒(反爬)
  50. [2026-01-30 15:53:00] [INFO ] [PID:28220] [main:1344] ==========「999 感冒灵颗粒」第2个商品 - 详情页链接:https://www.yyjzt.com/goodDetail?ladderNum&itemStoreId=126243058&sourceProdetail=%2Fsearch&is_store=0==========
  51. [2026-01-30 15:53:00] [INFO ] [PID:28220] [main:1385] ==========「999 感冒灵颗粒」第2个商品 - 详情页有效期:20270331==========
  52. [2026-01-30 15:53:00] [INFO ] [PID:28220] [main:1398] ==========「999 感冒灵颗粒」第2个商品 - 详情页生产日期:20250403==========
  53. [2026-01-30 15:53:00] [INFO ] [PID:28220] [main:1408] ==========「999 感冒灵颗粒」第2个商品 - 详情页批准文号:国药准字Z44021940==========
  54. [2026-01-30 15:53:00] [INFO ] [PID:28220] [main:1419] ==========「999 感冒灵颗粒」第2个商品 - 详情页规格:10g*9袋==========
  55. [2026-01-30 15:53:00] [INFO ] [PID:28220] [main:1432] ==========「999 感冒灵颗粒」第2个商品 - 详情页规格:库存 5692盒==========
  56. [2026-01-30 15:53:00] [INFO ] [PID:28220] [main:1444] ==========「999 感冒灵颗粒」第2个商品 - 详情页销量:已拼1449盒==========
  57. [2026-01-30 15:53:08] [INFO ] [PID:28220] [main:728] 【店铺存在校验】店铺不存在 | 店铺名:'药品预约中心' | 结果:不存在(False)
  58. [2026-01-30 15:53:08] [INFO ] [PID:28220] [main:1542] 数据库有该店名,在数据库拿取对应字段填充yjj_drug_middle表
  59. [2026-01-30 15:53:08] [INFO ] [PID:28220] [main:1560] 📌 「999 感冒灵颗粒」第2个商品 - 已关闭详情页标签页
  60. [2026-01-30 15:53:11] [INFO ] [PID:28220] [main:1567] 「999 感冒灵颗粒」第2个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」- 已切回列表页
  61. [2026-01-30 15:53:11] [INFO ] [PID:28220] [main:886] 单条数据插入成功:...
  62. [2026-01-30 15:53:11] [INFO ] [PID:28220] [main:1606] 「999 感冒灵颗粒」第2个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」采集完成
  63. [2026-01-30 15:53:13] [INFO ] [PID:28220] [main:1197] 📌 「999 感冒灵颗粒」第1页 第3/60个商品 - 等待2.05秒后采集(反爬)
  64. [2026-01-30 15:53:13] [INFO ] [PID:28220] [main:1231] ==========「999 感冒灵颗粒」第3个商品 - 列表页标题:999 三九 华润三九 感冒灵颗粒 10g*9袋==========
  65. [2026-01-30 15:53:13] [INFO ] [PID:28220] [main:1253] ==========999 感冒灵颗粒」第3个商品 - 列表页采购价格:14.15==========
  66. [2026-01-30 15:53:13] [INFO ] [PID:28220] [main:1263] ==========「999 感冒灵颗粒」第3个商品 - 列表页公司名:华润三九(枣庄)药业有限公司==========
  67. [2026-01-30 15:53:13] [INFO ] [PID:28220] [main:1274] ==========「999 感冒灵颗粒」第3个商品 - 列表页店名:湖北药九九==========
  68. [2026-01-30 15:53:13] [WARNING ] [PID:28220] [main:1293] 「999 感冒灵颗粒」第3个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」- 折扣价元素未找到,使用采购价兜底:14.15
  69. [2026-01-30 15:53:13] [INFO ] [PID:28220] [main:1300] 📌 「999 感冒灵颗粒」第1页 第3个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」- 模拟鼠标移动并点击
  70. [2026-01-30 15:53:18] [INFO ] [PID:28220] [main:1331] 📌 「999 感冒灵颗粒」第1页 第3个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」- 详情页加载完成,等待2.02秒(反爬)
  71. [2026-01-30 15:53:18] [INFO ] [PID:28220] [main:1344] ==========「999 感冒灵颗粒」第3个商品 - 详情页链接:https://www.yyjzt.com/goodDetail?ladderNum&itemStoreId=90707147&sourceProdetail=%2Fsearch&is_store=0==========
  72. [2026-01-30 15:53:18] [INFO ] [PID:28220] [main:1385] ==========「999 感冒灵颗粒」第3个商品 - 详情页有效期:20270831==========
  73. [2026-01-30 15:53:18] [INFO ] [PID:28220] [main:1398] ==========「999 感冒灵颗粒」第3个商品 - 详情页生产日期:20250916==========
  74. [2026-01-30 15:53:18] [INFO ] [PID:28220] [main:1408] ==========「999 感冒灵颗粒」第3个商品 - 详情页批准文号:国药准字Z44021940==========
  75. [2026-01-30 15:53:18] [INFO ] [PID:28220] [main:1419] ==========「999 感冒灵颗粒」第3个商品 - 详情页规格:10g*9袋==========
  76. [2026-01-30 15:53:18] [INFO ] [PID:28220] [main:1432] ==========「999 感冒灵颗粒」第3个商品 - 详情页规格:库存 >100==========
  77. [2026-01-30 15:53:18] [WARNING ] [PID:28220] [main:1446] 「999 感冒灵颗粒」第3个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」- 没有销量元素,使用默认值:
  78. [2026-01-30 15:53:32] [INFO ] [PID:28220] [main:726] 【店铺存在校验】店铺已存在 | 店铺名:'湖北药九九' | 结果:存在(True)不要执行采集店铺
  79. [2026-01-30 15:53:32] [INFO ] [PID:28220] [main:1542] 数据库有该店名,在数据库拿取对应字段填充yjj_drug_middle表
  80. [2026-01-30 15:53:32] [INFO ] [PID:28220] [main:1560] 📌 「999 感冒灵颗粒」第3个商品 - 已关闭详情页标签页
  81. [2026-01-30 15:53:35] [INFO ] [PID:28220] [main:1567] 「999 感冒灵颗粒」第3个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」- 已切回列表页
  82. [2026-01-30 15:53:35] [INFO ] [PID:28220] [main:886] 单条数据插入成功:...
  83. [2026-01-30 15:53:35] [INFO ] [PID:28220] [main:1606] 「999 感冒灵颗粒」第3个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」采集完成
  84. [2026-01-30 15:53:37] [INFO ] [PID:28220] [main:1197] 📌 「999 感冒灵颗粒」第1页 第4/60个商品 - 等待1.62秒后采集(反爬)
  85. [2026-01-30 15:53:37] [INFO ] [PID:28220] [main:1231] ==========「999 感冒灵颗粒」第4个商品 - 列表页标题:999 三九 华润三九 感冒灵颗粒 10g*9袋==========
  86. [2026-01-30 15:53:37] [INFO ] [PID:28220] [main:1253] ==========999 感冒灵颗粒」第4个商品 - 列表页采购价格:13.9==========
  87. [2026-01-30 15:53:37] [INFO ] [PID:28220] [main:1263] ==========「999 感冒灵颗粒」第4个商品 - 列表页公司名:惠州市九惠制药股份有限公司==========
  88. [2026-01-30 15:53:37] [INFO ] [PID:28220] [main:1274] ==========「999 感冒灵颗粒」第4个商品 - 列表页店名:广东融泰药业==========
  89. [2026-01-30 15:53:37] [INFO ] [PID:28220] [main:1288] ==========「999 感冒灵颗粒」第4个商品 - 详情页折扣价:13.62==========
  90. [2026-01-30 15:53:37] [INFO ] [PID:28220] [main:1300] 📌 「999 感冒灵颗粒」第1页 第4个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」- 模拟鼠标移动并点击
  91. [2026-01-30 15:53:43] [INFO ] [PID:28220] [main:1331] 📌 「999 感冒灵颗粒」第1页 第4个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」- 详情页加载完成,等待2.92秒(反爬)
  92. [2026-01-30 15:53:43] [INFO ] [PID:28220] [main:1344] ==========「999 感冒灵颗粒」第4个商品 - 详情页链接:https://www.yyjzt.com/goodDetail?ladderNum&itemStoreId=124298620&sourceProdetail=%2Fsearch&is_store=0==========
  93. [2026-01-30 15:53:43] [INFO ] [PID:28220] [main:1385] ==========「999 感冒灵颗粒」第4个商品 - 详情页有效期:20270430==========
  94. [2026-01-30 15:53:43] [INFO ] [PID:28220] [main:1398] ==========「999 感冒灵颗粒」第4个商品 - 详情页生产日期:20250516==========
  95. [2026-01-30 15:53:43] [INFO ] [PID:28220] [main:1408] ==========「999 感冒灵颗粒」第4个商品 - 详情页批准文号:国药准字Z44021940==========
  96. [2026-01-30 15:53:43] [INFO ] [PID:28220] [main:1419] ==========「999 感冒灵颗粒」第4个商品 - 详情页规格:10g*9袋==========
  97. [2026-01-30 15:53:43] [INFO ] [PID:28220] [main:1432] ==========「999 感冒灵颗粒」第4个商品 - 详情页规格:库存 5盒==========
  98. [2026-01-30 15:53:43] [WARNING ] [PID:28220] [main:1446] 「999 感冒灵颗粒」第4个商品「999 三九 华润三九 感冒灵颗粒 10g*9袋」- 没有销量元素,使用默认值:
  99. [2026-01-30 15:53:51] [INFO ] [PID:28220] [main:726] 【店铺存在校验】店铺已存在 | 店铺名:'广东融泰药业' | 结果:存在(True)不要执行采集店铺
  100. [2026-01-30 15:53:51] [INFO ] [PID:28220] [main:1542] 数据库有该店名,在数据库拿取对应字段填充yjj_drug_middle表
  101. [2026-01-30 15:53:51] [INFO ] [PID:28220] [main:1560] 📌 「999 感冒灵颗粒」第4个商品 - 已关闭详情页标签页
  102. [2026-01-30 15:53:51] [ERROR ] [PID:28220] [main:1610] 「999 感冒灵颗粒」第4个商品采集核心异常:Page.bring_to_front: Target page, context or browser has been closed
  103. Traceback (most recent call last):
  104. File "C:\Users\datai\Desktop\药九九\main.py", line 1562, in collect_data
  105. page.bring_to_front() # 激活列表页
  106. ~~~~~~~~~~~~~~~~~~~^^
  107. File "C:\Users\datai\AppData\Roaming\Python\Python314\site-packages\playwright\sync_api\_generated.py", line 9451, in bring_to_front
  108. return mapping.from_maybe_impl(self._sync(self._impl_obj.bring_to_front()))
  109. ~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  110. File "C:\Users\datai\AppData\Roaming\Python\Python314\site-packages\playwright\_impl\_sync_base.py", line 115, in _sync
  111. return task.result()
  112. ~~~~~~~~~~~^^
  113. File "C:\Users\datai\AppData\Roaming\Python\Python314\site-packages\playwright\_impl\_page.py", line 660, in bring_to_front
  114. await self._channel.send("bringToFront", None)
  115. File "C:\Users\datai\AppData\Roaming\Python\Python314\site-packages\playwright\_impl\_connection.py", line 69, in send
  116. return await self._connection.wrap_api_call(
  117. ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  118. ...<3 lines>...
  119. )
  120. ^
  121. File "C:\Users\datai\AppData\Roaming\Python\Python314\site-packages\playwright\_impl\_connection.py", line 559, in wrap_api_call
  122. raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
  123. playwright._impl._errors.TargetClosedError: Page.bring_to_front: Target page, context or browser has been closed
  124. [2026-01-30 15:53:56] [INFO ] [PID:28220] [main:1197] 📌 「999 感冒灵颗粒」第1页 第5/60个商品 - 等待2.43秒后采集(反爬)
  125. [2026-01-30 15:53:56] [ERROR ] [PID:28220] [main:1610] 「999 感冒灵颗粒」第5个商品采集核心异常:Locator.count: Target page, context or browser has been closed
  126. Traceback (most recent call last):
  127. File "C:\Users\datai\Desktop\药九九\main.py", line 1218, in collect_data
  128. if sold_locator.count() > 0:
  129. ~~~~~~~~~~~~~~~~~~^^
  130. File "C:\Users\datai\AppData\Roaming\Python\Python314\site-packages\playwright\sync_api\_generated.py", line 16876, in count
  131. return mapping.from_maybe_impl(self._sync(self._impl_obj.count()))
  132. ~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^
  133. File "C:\Users\datai\AppData\Roaming\Python\Python314\site-packages\playwright\_impl\_sync_base.py", line 115, in _sync
  134. return task.result()
  135. ~~~~~~~~~~~^^
  136. File "C:\Users\datai\AppData\Roaming\Python\Python314\site-packages\playwright\_impl\_locator.py", line 423, in count
  137. return await self._frame._query_count(self._selector)
  138. ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  139. File "C:\Users\datai\AppData\Roaming\Python\Python314\site-packages\playwright\_impl\_frame.py", line 136, in _query_count
  140. return await self._channel.send("queryCount", None, {"selector": selector})
  141. ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  142. File "C:\Users\datai\AppData\Roaming\Python\Python314\site-packages\playwright\_impl\_connection.py", line 69, in send
  143. return await self._connection.wrap_api_call(
  144. ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  145. ...<3 lines>...
  146. )
  147. ^
  148. File "C:\Users\datai\AppData\Roaming\Python\Python314\site-packages\playwright\_impl\_connection.py", line 559, in wrap_api_call
  149. raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
  150. playwright._impl._errors.TargetClosedError: Locator.count: Target page, context or browser has been closed
  151. [2026-01-30 15:53:58] [INFO ] [PID:28220] [main:1626] 采满5个往下滑
  152. [2026-01-30 15:53:58] [INFO ] [PID:28220] [main:192] 📜 开始慢速滚动(目标距离:396px,总步数:7,总时长约0.35秒)
  153. [2026-01-30 15:53:58] [WARNING ] [PID:28220] [main:214] 慢速滚动失败:Page.evaluate: Target page, context or browser has been closed