【发布时间】:2022-01-02 14:38:04
【问题描述】:
当我在没有格式化正文的情况下发出一个scrapy请求时,我得到了正确的结果,但是,当我格式化它以进行循环时,我得到一个 400 错误。
这是未格式化的正文:
'{"fields":"id,angellist_url,job_roles","limit":25,"offset":0,"form_data":{"must":{"filters":{"founding_or_hq_slug_locations":{"values":["spain"],"execution":"or"}},"execution":"and"},"should":{"filters":{}},"must_not":{"growth_stages":["mature"],"company_type":["service provider","government nonprofit"],"tags":["outside tech"],"company_status":["closed"]}},"keyword":null,"sort":"-last_funding_date"}'
这是格式化的正文:
'{"fields":"id,angellist_url,job_roles","limit":25,"offset":{offset_items},"form_data":{"must":{"filters":{"founding_or_hq_slug_locations":{"values":["spain"],"execution":"or"}},"execution":"and"},"should":{"filters":{}},"must_not":{"growth_stages":["mature"],"company_type":["service provider","government nonprofit"],"tags":["outside tech"],"company_status":["closed"]}},"keyword":null,"sort":"-last_funding_date"}'
然后在提出请求时我使用:
yield scrapy.Request(url = url, headers = headers, body = body.format(offset_items = '0'))
【问题讨论】:
-
你能给我们举个例子,说明
{**offset_items**}里面有什么,因为其他一切看起来都一样吗?当您说“格式”时,您的意思是您使用 json 序列化数据吗?当您说“制作循环”时,您的意思是您正在尝试制作数据的 for 循环并将其放入嵌套对象内的offset items中? -
offset_items 内部的一个例子是 0。是的,我的意思是循环数据并将其放入 offset_items