Python 多函数并行执行

Question

寻找一种并行执行多个功能的方法。我查看了多处理，但想看看是否有人有此用例的示例：

我有以下几点：

data = function1(arg1,arg2,arg3,arg4)
data1 = functiun2(arg1,arg2,arg3,arg4, arg5, arg6)
data2 = functiun1(arg1,arg2,arg3,arg4, arg5)

# and so on for around 30 functions (only executes the 3 functions with separate args).

如何将这些带入多处理线程？

Answer 1

我应该可以做这样的事情

from multiprocessing import Pool

# Define function 1

# Define function 2

if __name__ == '__main__':
    processes = 30

    pool1 = Pool(processes)
    result1 = pool1.starmap_async(function1, [[arg1,arg2,arg3,arg4] for i in range(processes)])

    pool2 = Pool(processes)
    result2 = pool2.starmap_async(function2, [[arg1,arg2,arg3,arg4, arg5, arg6] for i in range(processes)])

    pool3 = Pool(processes)
    result3 = pool3.starmap_async(function1, [[arg1,arg2,arg3,arg4, arg5] for i in range(processes)])

    data = result1.get()
    data2 = result2.get()
    data3 = result3.get()

    pool1.close()
    pool1.join()

    pool2.close()
    pool2.join()

    pool3.close()
    pool3.join()

它将执行 30 个函数中的每一个函数 30 次。请注意，我建议使用循环来压缩它，但为了便于阅读，我将其保留原样。