更改 AWS Athena 查询的输出 CSV 文件名

Question

我想通过 AWS Lambda 运行我的 Athena 查询，但还将输出 CSV 文件的名称从查询执行 ID 更改为 my-bucket/folder/my-preferred-string.csv

我尝试在网上搜索结果，但找不到 lambda 函数的确切代码。

我是一名数据科学家，也是 AWS 的初学者。这对我来说是一次性的，所以寻找一个快速的解决方案或修补程序。

Answer 1

这个问题已经发布here

client = boto3.client('athena')
s3 = boto3.resource("s3")

# Run query
queryStart = client.start_query_execution(
    # PUT_YOUR_QUERY_HERE
    QueryString = '''
        SELECT *
        FROM "db_name"."table_name"
        WHERE value > 50
    ''',
    QueryExecutionContext = {
        # YOUR_ATHENA_DATABASE_NAME
        'Database': "covid_data"
    },
    ResultConfiguration = {
        # query result output location you mentioned in AWS Athena
        "OutputLocation": "s3://bucket-name-X/folder-Y/"
    }
)

# Executes query and waits 3 seconds
queryId = queryStart['QueryExecutionId']
time.sleep(3)

# Copies newly generated csv file with appropriate name
# query result output location you mentioned in AWS Athena
queryLoc = "bucket-name-X/folder-Y/" + queryId + ".csv"

# Destination location and file name
s3.Object("bucket-name-A", "report-2018.csv").copy_from(CopySource = queryLoc)

# Deletes Athena generated csv and it's metadata file
response = s3.delete_object(
    Bucket='bucket-name-A',
    Key=queryId+".csv"
)
response = s3.delete_object(
    Bucket='bucket-name-A',
    Key=queryId+".csv.metadata"
)
print('{file-name} csv generated')