在 python 2.7 中并行运行函数以在其他函数的末尾使用函数的输出

Question

我是 python 的新手，从未使用过它的并行处理模块，如 threading 或 multiprocess。我正在研究一个实时代码问题，其中一个函数的输出用作一个函数的输入。有一个大功能需要将近 3 秒才能完成。这就像一个程序，其中一个人将一些文件提交给接待处，并且在验证他的文件时，他被引导到其他地方进行不同的检查。如果在这些检查结束时文件验证结果可用，则程序将失败。

def parallel_running_function(*args):
     """It is the function which will take 3 seconds to complete"""
     output = "various documents matching and verification"
     return output

def check_1(*args):
    """ check one for the task"""

def check_2(*args):
    """ check two for the task"""

def check_3(*args):
    """ check three for the task"""

def check_4(*args):
    """ check 4 for the task"""


def main_function():

    output = parallel_running_function() # need to run this function 
                                        #parallel with other functions
    output_1 = check_1()
    output_2 = check_2()
    output_3 = check_3()
    output_4 = check_4()
    if output:
       "program is successful"
    else:
        "program is failed"

    I need the output of parallel running function is here along with the other executed functions. If I don't get the output of that function here then program will be failed or ll give some wrong result.

我正在使用 python 2.7。我已经阅读了多篇关于这个问题的帖子using threading、subprocess 和multiprocessing python 模块，但我无法得到这个问题的具体解决方案。我从其他帖子中得到的似乎是我需要使用multiprocessing 模块。有人可以给我一个想法，我应该如何克服这个问题。

Answer 1

你可以这样做：

import multiprocessing

pool = None

def parallel_running_function(*args):
     """It is the function which will take 3 seconds to complete"""
     output = "various documents matching and verification"
     return output

def check_1(*args):
    """ check one for the task"""

def check_2(*args):
    """ check two for the task"""

def check_3(*args):
    """ check three for the task"""

def check_4(*args):
    """ check 4 for the task"""


def main_function():

    res = pool.apply_async(parallel_running_function)

    res_1 = pool.apply_async(check_1)
    res_2 = pool.apply_async(check_2)
    res_3 = pool.apply_async(check_3)
    res_4 = pool.apply_async(check_4)

    output = res.get()
    output_1 = res_1.get()
    output_2 = res_2.get()
    output_3 = res_3.get()
    output_4 = res_4.get()

    if output:
       print "program is successful"
    else:
        print "program is failed"


if __name__ == '__main__':
    pool = multiprocessing.Pool(processes=4)
    main_function()

调用get时主进程会阻塞，但其他进程仍在运行。