使用 IP 将端口范围划分为新系列

Question

您好，我需要一些帮助，所以我有一个包含以下信息的文件；

IP,Ports,count
"192.168.0.1","80 8980 6789 443 4778 3556 7778 4432 5674 7786 2234 6678 33245 7788 3332 6678 3322 5432 5567",19
"192.168.0.2","80 8980 6789 443 4778 3556 7778 4432 5674 7786 2234 6678 33245 7788 3332 6678 3322 5432 5567",19
"192.168.0.3","80 8980 6789 443 4778 3556 7778 4432 5674 7786 2234 6678 33245 7788 3332 6678 3322 5432 5567",19
"192.168.0.4","80 8980 6789 443 4778 3556 7778 4432 5674 7786 2234 6678 33245 7788 3332 6678 3322 5432 5567",19

我想将端口拆分为 5 个范围，每个文件都包含在一个带有其 IP 的新文件中。

预期结果。

IP,Ports
192.168.0.1 80,8980,6789,443,4778
192.168.0.1 3556,7778,4432,5674,7786
192.168.0.1 2234,6678,33245,7788,3332
192.168.0.1 6678,3322,5432,5067
192.168.0.2 80,8980,6789,443,4778
192.168.0.2 3556,7778,4432,5674,7786
192.168.0.2 2234,6678,33245,7788,3332
192.168.0.2 6678,3322,5432,5067
192.168.0.3 80,8980,6789,443,4778
192.168.0.3 3556,7778,4432,5674,7786
192.168.0.3 2234,6678,33245,7788,3332
192.168.0.3 6678,3322,5432,5067
192.168.0.4 80,8980,6789,443,4778
192.168.0.4 3556,7778,4432,5674,7786
192.168.0.4 2234,6678,33245,7788,3332
192.168.0.4 6678,3322,5432,5067

说实话，我不知道该怎么做或从哪里开始。请协助。

在 AWK 或 python 中任何一个都可以，只需向我解释一下脚本/单行代码的作用，以便我可以尝试使用它。

Answer 1

您能否尝试以下操作（已在所示示例中测试和编写）。

awk -F'"|","' -v lines=$(wc -l < Input_file) '
BEGIN{
  print "IP,ports"
}
FNR>1{
  num=split($3,array," ")
  for(i=1;i<=num;i++){
    if(i==1){ printf $2 OFS }
    printf("%s%s",array[i],i%5==0||i==num?ORS:FNR==lines && i==num?ORS:",")
    if(i%5==0){ printf $2 OFS }
  }
}' Input_file

说明：在此添加上面的详细说明。

awk -F'"|","' -v lines=$(wc -l < Input_file) '                                  ##Starting awk program from here.
BEGIN{                                                                          ##Starting BEGIN section of this program.
  print "IP,ports"                                                              ##Printing headers here.
}
FNR>1{                                                                          ##Checking condition if current line number is greater than 1st line.
  num=split($3,array," ")                                                       ##Splitting 3rd field into an array with delimiter space.
  for(i=1;i<=num;i++){                                                          ##Traversing through all elements of array here.
    if(i==1){ printf $2 OFS }                                                   ##if its first element of array then print 2nd field of line and OFS.
    printf("%s%s",array[i],i%5==0||i==num?ORS:FNR==lines && i==num?ORS:",")     ##Printing array value along with condition if its 5 element or number of total elements equals i then print new line OR current line number equal to lines OR i equals to num then print new line OR print comma.
    if(i%5==0){ printf $2 OFS }                                                 ##If its 5th element then print current line 2nd field with space
  }
}' Input_file                                                                   ##mentioning Input_file name here.

Answer 2

对于 Python，您可以执行以下操作：

• 使用csv.DictReader 读取CSV 文件并使用DictReader 打开要写入的文件。 DictReader 将每一行映射到一个dict，这样可以更轻松地访问 CSV 列。
• 使用DictWriter.writeheader 写入输出CSV 标头。
• 使用for 循环迭代文件的每一行。
• 使用str.split 在空白处拆分端口。
• 每 5 个端口分块。我们可以使用How do you split a list into evenly sized chunks? 中的方法。
• 遍历这些块中的每一个，然后使用csvwriter.writerow 写入一个新行。我们确保仅包含 IP 和 Ports 列。

演示：

from csv import DictReader, DictWriter

# Given attribute to https://stackoverflow.com/questions/312443/how-do-you-split-a-list-into-evenly-sized-chunks/312464#312464
def chunks(lst, n):
    """Yield successive n-sized chunks from lst."""
    for i in range(0, len(lst), n):
        yield lst[i:i + n]

# Open both input and output files
with open("data.csv") as f, open("output.csv", mode="w", newline='') as o:

    # Create reading and writing objects
    reader = DictReader(f)
    writer = DictWriter(o, fieldnames=["IP", "Ports"])

    # Write headers
    writer.writeheader()

    # Go through each line from reader object
    for line in reader:

        # Split ports by whitespace into a list of ports
        ports = line["Ports"].split()

        # Go through each chunk(n = 5) of ports
        for port_chunk in chunks(ports, 5):

            # Write row to output CSV file
            row_dict = {"IP": line["IP"], "Ports": ",".join(port_chunk)}
            writer.writerow(row_dict)

输出.csv

IP,Ports
192.168.0.1,"80,8980,6789,443,4778"
192.168.0.1,"3556,7778,4432,5674,7786"
192.168.0.1,"2234,6678,33245,7788,3332"
192.168.0.1,"6678,3322,5432,5567"
192.168.0.2,"80,8980,6789,443,4778"
192.168.0.2,"3556,7778,4432,5674,7786"
192.168.0.2,"2234,6678,33245,7788,3332"
192.168.0.2,"6678,3322,5432,5567"
192.168.0.3,"80,8980,6789,443,4778"
192.168.0.3,"3556,7778,4432,5674,7786"
192.168.0.3,"2234,6678,33245,7788,3332"
192.168.0.3,"6678,3322,5432,5567"
192.168.0.4,"80,8980,6789,443,4778"
192.168.0.4,"3556,7778,4432,5674,7786"
192.168.0.4,"2234,6678,33245,7788,3332"
192.168.0.4,"6678,3322,5432,5567"