如何在 python 中同时执行批量请求？

Question

我正在使用 Reddit api 来支持一些 subreddit。我想同时为多个 subreddit 投票，使用 praw 库与 reddit api 交互。

我想为 /r/bookclub 的 27 个“热门”和“上升”帖子点赞：

subreddit = reddit.subreddit("bookclub")

for submission in subreddit.hot(limit=27):
    submission.upvote()

for submission in subreddit.rising(limit=27):
    submission.upvote()

我想使用异步或多处理来更快地执行此操作。我使用grequests 库一次完成所有.upvote()，到目前为止它工作正常，但我不确定它是否真的更好：

subreddit = reddit.subreddit("bookclub")

hot_upvotes = (grequests.get(submission.upvote()) for submission in subreddit.hot(limit=27))
grequests.map(hot_upvotes)

rising_upvotes = (grequests.get(submission.upvote()) for submission in subreddit.rising(limit=27))
grequests.map(rising_upvotes)

两个版本都支持 subreddit。我想知道是否可以同时运行hot_upvotes 和rising_upvotes 部分？

Answer 1

from threading import Thread
import functools

subreddit = reddit.subreddit("bookclub")

def run_hot_upvotes(subreddit):
    hot_upvotes = (grequests.get(submission.upvote()) for submission in subreddit.hot(limit=27))
    grequests.map(hot_upvotes)

def run_rising_upvotes(subreddit):
    rising_upvotes = (grequests.get(submission.upvote()) for submission in subreddit.rising(limit=27))
    grequests.map(rising_upvotes)

Thread(target = functools.partial(run_rising_upvotes, subreddit)).start()
Thread(target = functools.partial(run_hot_upvotes, subreddit)).start()

尝试以下方法让两者同时运行，每个都在自己的线程中。